A1 Vertaisarvioitu alkuperäisartikkeli tieteellisessä lehdessä

Register identification from the unrestricted open Web using the Corpus of Online Registers of English




TekijätLaippala Veronika, Rönnqvist Samuel, Oinonen Miika, Kyröläinen Aki-Juhani, Salmela Anna, Biber Douglas, Egbert Jesse, Pyysalo Sampo

KustantajaSpringer

Julkaisuvuosi2022

Lehti: Language Resources and Evaluation

Lehden akronyymiLREV

eISSN1574-0218

DOIhttps://doi.org/10.1007/s10579-022-09624-1

Julkaisun avoimuus kirjaamishetkelläAvoimesti saatavilla

Julkaisukanavan avoimuus Osittain avoin julkaisukanava

Verkko-osoitehttps://link.springer.com/article/10.1007/s10579-022-09624-1

Rinnakkaistallenteen osoitehttps://research.utu.fi/converis/portal/detail/Publication/177822802


Tiivistelmä

This article examines the automatic identification of Web registers, that is, text varieties such as news articles and reviews. Most studies have focused on corpora restricted to include only preselected classes with well-defined characteristics. These corpora feature only a subset of documents found on the unrestricted open Web, for which register identification has been particularly difficult because the range of linguistic variation on the Web is known to be substantial. As part of this study, we present the first open release of the Corpus of Online Registers of English (CORE), which is drawn from the unrestricted open Web and, currently, is the largest collection of manually annotated Web registers. Furthermore, we demonstrate that the CORE registers can be automatically identified with competitive results, with the best performance being an F1-score of 68% with the deep learning model BERT. The best performance was achieved using two modeling strategies. The first one involved modeling the registers using propagated register labels, that is, repeating the main register label along with its corresponding subregister label in a multilabel model. In the second one, we explored how the length of the document affects model performance, discovering that the beginning provided superior classification accuracy. Overall, the current study presents a systematic approach for the automatic identification of a large number of Web registers from the unrestricted Web, hence providing new pathways for future studies.


Ladattava julkaisu

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on