A4 Refereed article in a conference publication

A System for Identifying and Exploring Text Repetition in Large Historical Document Corpora




AuthorsAleksi Vesanto, Asko Nivala, Tapio Salakoski, Hannu Salmi, Filip Ginter

EditorsJörg Tiedemann

Conference nameNordic Conference of Computational Linguistics

Publishing placeGothenburg

Publication year2017

Book title Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017, Gothenburg, Sweden

Series titleNEALT Proceedings Series

Number in series29

First page 330

Last page333

ISBN978-91-7685-601-7

ISSN1650-3686

Web address http://www.ep.liu.se/ecp/131/049/ecp17131049.pdf

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/20563854


Abstract







We present a software for retrieving and
exploring duplicated text passages in low
quality OCR historical text corpora. The
system combines NCBI BLAST, a software created for comparing and aligning
biological sequences, with the Solr search
and indexing engine, providing a web interface to easily query and browse the
clusters of duplicated texts. We demonstrate the system on a corpus of scanned
and OCR-recognized Finnish newspapers
and journals from years 1771 to 1910. 





Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2024-26-11 at 18:51