A4 Refereed article in a conference publication
Data Refining for Text Mining Process in Aviation Safety Data
Authors: Sjöblom Olli
Editors: Claude Godart, Norbert Gronau, Sushil Sharma, Gérôme Canals
Conference name: Conference on e-Business, e-Services, and e-Society
Publication year: 2009
Journal: IFIP Advances in Information and Communication Technology
Book title : Sofware Services for e-Business and e-Society
Series title: IFIP Advances in Information and Communication Technology
Number in series: 305
Volume: September 2009
First page : 415
Last page: 426
ISBN: 978-3-642-04279-9
eISBN: 978-3-642-04280-5
ISSN: 1868-4238
DOI: https://doi.org/10.1007/978-3-642-04280-5_32
Successful data mining is an iterative process during which data will be refined and adjusted to achieve more accurate mining results. Most important tools in the text mining context are list of stop words and list of synonyms. The size and richness of the lists mentioned depend on the structure of the language used in the text to be mined. English, for example, is an “easy” language for search technologies, because with a couple of exceptions, the stem of the
word is not conjugated and terms are formed using several words instead of creating compounds. This requires special attention to definitions when processing morphologically rich languages like Finnish. This chapter introduces the need and realisation of refining the source data for a successful data mining process based onto the results achieved from first mining round.