A4 Refereed article in a conference publication
Overview of the CLEF eHealth Evaluation Lab 2015
Authors: Goeuriot L, Kelly L, Suominen H, Hanlen L, Neveol A, Grouin C, Palotti J, Zuccon G
Editors: Mothe, J; Savoy, J; Kamps, J; PinelSauvagnat, K; Jones, GJF; SanJuan, E; Cappellato, L; Ferro, N
Conference name: International Conference of the Cross-Language Evaluation Forum for European Languages
Publisher: SPRINGER-VERLAG NEW YORK, MS INGRID CUNNINGHAM, 175 FIFTH AVE, NEW YORK, NY 10010 USA
Publication year: 2015
Journal: Lecture Notes in Computer Science
Book title : Experimental IR meets multilinquality, multimodality and interactionj
Journal name in source: EXPERIMENTAL IR MEETS MULTILINGUALITY, MULTIMODALITY, AND INTERACTION
Journal acronym: LECT NOTES COMPUT SC
Series title: Lecture notes in computer science
Volume: 9283
First page : 429
Last page: 443
Number of pages: 15
ISBN: 978-3-319-24026-8
eISBN: 978-3-319-24027-5
ISSN: 0302-9743
DOI: https://doi.org/10.1007/978-3-319-24027-5_44
The number of teams registering their interest was 47 in Tasks 1 (2 teams in Task 1a and 7 teams in Task 1b) and 53 in Task 2 (12 teams) for a total of 20 unique teams. The best system recognized 4, 984 out of 6, 818 test words correctly and generated 2, 626 incorrect words (i. e., 38.5% error) in Task 1a; had the F-measure of 0.756 for plain entity recognition, 0.711 for normalized entity recognition, and 0.872 for entity normalization in Task 1b; and resulted in P@10 of 0.5394 and nDCG@10 of 0.5086 in Task 2. These results demonstrate the substantial community interest and capabilities of these systems in addressing challenges faced by patients and nurses. As in previous years, the organizers have made data and tools available for future research and development.
