A1 Vertaisarvioitu alkuperäisartikkeli tieteellisessä lehdessä
An experimental comparison of cross-validation techniques for estimating the area under the ROC curve
Tekijät: Airola A, Pahikkala T, Waegeman W, De Baets B, Salakoski T
Kustantaja: ELSEVIER SCIENCE BV
Julkaisuvuosi: 2011
Journal: Computational Statistics and Data Analysis
Tietokannassa oleva lehden nimi: COMPUTATIONAL STATISTICS & DATA ANALYSIS
Lehden akronyymi: COMPUT STAT DATA AN
Numero sarjassa: 4
Vuosikerta: 55
Numero: 4
Aloitussivu: 1828
Lopetussivu: 1844
Sivujen määrä: 17
ISSN: 0167-9473
DOI: https://doi.org/10.1016/j.csda.2010.11.018
Rinnakkaistallenteen osoite: https://research.utu.fi/converis/portal/detail/Publication/2930618
Reliable estimation of the classification performance of inferred predictive models is difficult when working with small data sets. Cross-validation is in this case a typical strategy for estimating the performance. However, many standard approaches to cross-validation suffer from extensive bias or variance when the area under the ROC curve (AUC) is used as the performance measure. This issue is explored through an extensive simulation study. Leave-pair-out cross-validation is proposed for conditional AUC-estimation, as it is almost unbiased, and its deviation variance is as low as that of the best alternative approaches. When using regularized least-squares based learners, efficient algorithms exist for calculating the leave-pair-out cross-validation estimate.
Ladattava julkaisu This is an electronic reprint of the original article. |  |
