Refereed article in conference proceedings (A4)
A System for Identifying and Exploring Text Repetition in Large Historical Document Corpora
List of Authors: Aleksi Vesanto, Asko Nivala, Tapio Salakoski, Hannu Salmi, Filip Ginter
Editors: Jörg Tiedemann
Conference name: Nordic Conference of Computational Linguistics
Place: Gothenburg
Publication year: 2017
Book title *: Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017, Gothenburg, Sweden
Title of series: NEALT Proceedings Series
Number in series: 29
Start page: 330
End page: 333
ISBN: 978-91-7685-601-7
ISSN: 1650-3686
URL: http://www.ep.liu.se/ecp/131/049/ecp17131049.pdf
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/20563854
We present a software for retrieving and
exploring duplicated text passages in low
quality OCR historical text corpora. The
system combines NCBI BLAST, a software created for comparing and aligning
biological sequences, with the Solr search
and indexing engine, providing a web interface to easily query and browse the
clusters of duplicated texts. We demonstrate the system on a corpus of scanned
and OCR-recognized Finnish newspapers
and journals from years 1771 to 1910.
Downloadable publication This is an electronic reprint of the original article. |  |
