Overview of the CLEF eHealth Evaluation Lab 2015
: Goeuriot L, Kelly L, Suominen H, Hanlen L, Neveol A, Grouin C, Palotti J, Zuccon G
: Mothe, J; Savoy, J; Kamps, J; PinelSauvagnat, K; Jones, GJF; SanJuan, E; Cappellato, L; Ferro, N
: International Conference of the Cross-Language Evaluation Forum for European Languages
Publisher: SPRINGER-VERLAG NEW YORK, MS INGRID CUNNINGHAM, 175 FIFTH AVE, NEW YORK, NY 10010 USA
: 2015
: Lecture Notes in Computer Science
: Experimental IR meets multilinquality, multimodality and interactionj
: EXPERIMENTAL IR MEETS MULTILINGUALITY, MULTIMODALITY, AND INTERACTION
: LECT NOTES COMPUT SC
: Lecture notes in computer science
: 9283
: 429
: 443
: 15
: 978-3-319-24026-8
: 978-3-319-24027-5
: 0302-9743
DOI: https://doi.org/10.1007/978-3-319-24027-5_44
The number of teams registering their interest was 47 in Tasks 1 (2 teams in Task 1a and 7 teams in Task 1b) and 53 in Task 2 (12 teams) for a total of 20 unique teams. The best system recognized 4, 984 out of 6, 818 test words correctly and generated 2, 626 incorrect words (i. e., 38.5% error) in Task 1a; had the F-measure of 0.756 for plain entity recognition, 0.711 for normalized entity recognition, and 0.872 for entity normalization in Task 1b; and resulted in P@10 of 0.5394 and nDCG@10 of 0.5086 in Task 2. These results demonstrate the substantial community interest and capabilities of these systems in addressing challenges faced by patients and nurses. As in previous years, the organizers have made data and tools available for future research and development.
