A4 Refereed article in a conference publication

Beyond the English web: Zero-shot cross-lingual and lightweight monolingual classification of registers




AuthorsRepo Liina, Skantsi Valtteri, Rönnqvist Samuel, Hellström Saara, Oinonen Miika, Salmela Anna, Biber Douglas, Egbert Jesse, Pyysalo Sampo, Laippala Veronika

EditorsIonut-Teodor Sorodoc, Madhumita Sushil, Ece Takmaz, Eneko Agirre

Conference nameEuropean Chapter of the Association for Computational Linguistics

PublisherAssociation for Computational Linguistics (ACL)

Publication year2021

Book title Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop

Journal name in sourceEACL 2021 - 16th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Student Research Workshop

First page 183

Last page191

ISBN978-1-954085-04-6

Web address https://aclanthology.org/2021.eacl-srw.24.pdf

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/66505697


Abstract

We explore cross-lingual transfer of register classification for web documents. Registers,
that is, text varieties such as blogs or news are one of the primary predictors of linguistic variation and thus affect the automatic processing of language.

We introduce two new registerannotated corpora, FreCORE and SweCORE, for French and Swedish. We demonstrate that deep pre-trained language models perform strongly in these languages and outperform previous state-of-the-art in English and Finnish.

Specifically, we show 1) that zeroshot cross-lingual transfer from the large English CORE corpus can match or surpass previously published monolingual models, and 2) that lightweight monolingual classification requiring very little training data can reach or surpass our zero-shot performance. We further analyse classification results finding that certain registers continue to pose challenges in particular for cross-lingual transfer.


Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2024-26-11 at 18:56