A4 Vertaisarvioitu artikkeli konferenssijulkaisussa
Incorporating external information in Bayesian classifiers via linear feature transformations
Tekijät: Pahikkala T, Boberg J, Myllari A, Salakoski T
Toimittaja: Salakoski Tapio, Ginter Filip, Pyysalo Sampo, Pahikkala, Tapio
Konferenssin vakiintunut nimi: 5th International Conference on Natural Language Processing
Julkaisuvuosi: 2006
Journal: Lecture Notes in Computer Science
Kokoomateoksen nimi: Proceedings of the 5th International Conference on Natural Language Processing FinTAL 06
Tietokannassa oleva lehden nimi: ADVANCES IN NATURAL LANGUAGE PROCESSING, PROCEEDINGS
Lehden akronyymi: LECT NOTES ARTIF INT
Vuosikerta: 4139
Aloitussivu: 399
Lopetussivu: 410
Sivujen määrä: 12
ISBN: 3-540-37334-9
ISSN: 0302-9743
DOI: https://doi.org/10.1007/11816508_41
Naive Bayes classifier is a frequently used method in various natural language processing tasks. Inspired by a modified version of the method called the flexible Bayes classifier, we explore the use of linear feature transformations together with the Bayesian classifiers, because it provides us an elegant way to endow the classifier with an external information that is relevant to the task. While the flexible Bayes classifier is based on the idea of using kernel density estimation to obtain the class conditional probabilities of continuously valued attributes, we use the linear transformations to smooth the feature frequency counts of discrete valued attributes. We evaluate the method on the context sensitive spelling error correction problem using the Reuters corpus. For this particular task, we define a positional feature transformation and a word feature transformation that take advantage of the positional information of the context words and the part-of-speech information of words, respectively. Our experimental results show that the performance of the Bayesian classifiers in the natural language disambiguation tasks can be improved with the proposed transformations and that the incorporation of external information via the linear feature transformations is a promising research direction.
