A4 Vertaisarvioitu artikkeli konferenssijulkaisussa
On variability in the identification and labelling of disfluencies — preliminary results from 23 annotations of the same data
Tekijät: Trouvain, Jürgen; Crible, Ludivine; Belz, Malte; Betz, Simon; Beňuš, Štefan; Baqué, Lorraine; Cantarutti, Marina; Di Napoli, Jessica; Didirková, Ivana; Machuca, Maria; Mareková, Lucia; Niculescu, Oana; Peltonen, Pauliina; Pistono, Aurelie; Schettino, Loredana; Silber-Varod, Vered; Williams, Simon
Toimittaja: Helena Moniz and Fernando Batista
Konferenssin vakiintunut nimi: Disfluency in Spontaneous Speech Workshop
Julkaisuvuosi: 2025
Lehti: Interspeech
Kokoomateoksen nimi: Proc. Disfluency in Spontaneous Speech (DiSS) Workshop 2025
Aloitussivu: 57
Lopetussivu: 61
DOI: https://doi.org/10.21437/DiSS.2025-12
Julkaisun avoimuus kirjaamishetkellä: Avoimesti saatavilla
Julkaisukanavan avoimuus : Kokonaan avoin julkaisukanava
Verkko-osoite: https://www.isca-archive.org/tmp/diss_2025/trouvain25_diss.html
Rinnakkaistallenteen osoite: https://research.utu.fi/converis/portal/detail/Publication/499212588
Rinnakkaistallennetun julkaisun versio: Kustantajan versio
This study provides a preliminary report on a large inter-annotator agreement experiment where 23 expert annotators from various research backgrounds identified and labelled disfluencies in the same speech sample. Each annotator was instructed to analyze the sample according to the framework (definitions, segmentation, labels, etc.) they typically use. The annotations were then processed and compared across three different dimensions: 1) the scope of the chosen typology and the definitions within, 2) the implementation of the typology in terms of annotation tiers and labels, and 3) the temporal alignment of the annotations. Preliminary findings reveal that there are substantial variations between annotators on various levels of annotation. The lack of a common standard becomes particularly evident in more complex segments, such as repairs.
Ladattava julkaisu This is an electronic reprint of the original article. |  |
