A4 Refereed article in a conference publication
A System for Identifying and Exploring Text Repetition in Large Historical Document Corpora
Authors: Aleksi Vesanto, Asko Nivala, Tapio Salakoski, Hannu Salmi, Filip Ginter
Editors: Jörg Tiedemann
Conference name: Nordic Conference of Computational Linguistics
Publishing place: Gothenburg
Publication year: 2017
Book title : Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017, Gothenburg, Sweden
Series title: NEALT Proceedings Series
Number in series: 29
First page : 330
Last page: 333
ISBN: 978-91-7685-601-7
ISSN: 1650-3686
Web address : http://www.ep.liu.se/ecp/131/049/ecp17131049.pdf
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/20563854
We present a software for retrieving and
exploring duplicated text passages in low
quality OCR historical text corpora. The
system combines NCBI BLAST, a software created for comparing and aligning
biological sequences, with the Solr search
and indexing engine, providing a web interface to easily query and browse the
clusters of duplicated texts. We demonstrate the system on a corpus of scanned
and OCR-recognized Finnish newspapers
and journals from years 1771 to 1910.
Downloadable publication This is an electronic reprint of the original article. |