Refereed article in conference proceedings (A4)

A System for Identifying and Exploring Text Repetition in Large Historical Document Corpora




List of Authors: Aleksi Vesanto, Asko Nivala, Tapio Salakoski, Hannu Salmi, Filip Ginter

Conference name: Nordic Conference of Computational Linguistics

Place: Gothenburg

Publication year: 2017

Book title *: Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017, Gothenburg, Sweden

Title of series: NEALT Proceedings Series

Number in series: 29

ISBN: 978-91-7685-601-7

ISSN: 1650-3686

URL: http://www.ep.liu.se/ecp/131/049/ecp17131049.pdf

Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/20563854


Abstract







We present a software for retrieving and
exploring duplicated text passages in low
quality OCR historical text corpora. The
system combines NCBI BLAST, a software created for comparing and aligning
biological sequences, with the Solr search
and indexing engine, providing a web interface to easily query and browse the
clusters of duplicated texts. We demonstrate the system on a corpus of scanned
and OCR-recognized Finnish newspapers
and journals from years 1771 to 1910.





Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.




Last updated on 2022-07-04 at 16:26