Refereed article in conference proceedings (A4)
CLEF 2017 eHealth evaluation lab overview
List of Authors: Goeuriot L., Suominen H., Kelly L., Robert A., Névéol A., Spijker R., Kanoulas E., Zuccon G., Palotti J.
Editors: Jones, G.J.F.; Lawless, S.; Gonzalo, J.; Kelly, L.; Goeuriot, L.; Mandl, Th.; Cappellato, L.; Ferro, N.
Conference name: International Conference of the Cross-Language Evaluation Forum for European Languages
Publisher: Springer Verlag
Publication year: 2017
Journal: Lecture Notes in Computer Science
Book title *: Experimental IR Meets Multilinguality, Multimodality, and Interaction
Journal name in source: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume number: 10456
Start page: 291
End page: 303
ISBN: 978-3-319-65812-4
eISBN: 978-3-319-65813-1
DOI: http://dx.doi.org/10.1007/978-3-319-65813-1_26
URL: https://link.springer.com/chapter/10.1007/978-3-319-65813-1_26
In this paper we provide an overview of the fifth edition of the CLEF
eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation
resource building efforts around the easing and support of patients,
their next-of-kins, clinical staff, and health scientists in
understanding, accessing, and authoring eHealth information in a
multilingual setting. This year’s lab offered three tasks: Task 1 on
multilingual information extraction to extend from last year’s task on
French corpora, Task 2 on technologically assisted reviews in empirical
medicine as a new pilot task, and Task 3 on patient-centered information
retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took
part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We
also continued the replication track from 2016. Herein, we describe the
resources created for these tasks, evaluation methodology adopted and
provide a brief summary of participants of this year’s challenges and
results obtained. As in previous years, the organizers have made data
and tools associated with the lab tasks available for future research
and development.