A1 Vertaisarvioitu alkuperäisartikkeli tieteellisessä lehdessä
Estimating the prediction performance of spatial models via spatial k-fold cross validation
Tekijät: Pohjankukka J, Pahikkala T, Nevalainen P, Heikkonen J
Kustantaja: TAYLOR & FRANCIS LTD
Julkaisuvuosi: 2017
Journal: International Journal of Geographical Information Science
Tietokannassa oleva lehden nimi: INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE
Lehden akronyymi: INT J GEOGR INF SCI
Vuosikerta: 31
Numero: 10
Aloitussivu: 2001
Lopetussivu: 2019
Sivujen määrä: 19
ISSN: 1365-8816
DOI: https://doi.org/10.1080/13658816.2017.1346255
Rinnakkaistallenteen osoite: https://research.utu.fi/converis/portal/detail/Publication/26330595
In machine learning, one often assumes the data are independent when evaluating model performance. However, this rarely holds in practice. Geographic information datasets are an example where the data points have stronger dependencies among each other the closer they are geographically. This phenomenon known as spatial autocorrelation (SAC) causes the standard cross validation (CV) methods to produce optimistically biased prediction performance estimates for spatial models, which can result in increased costs and accidents in practical applications. To overcome this problem, we propose a modified version of the CV method called spatial k-fold cross validation (SKCV), which provides a useful estimate for model prediction performance without optimistic bias due to SAC. We test SKCV with three real-world cases involving open natural data showing that the estimates produced by the ordinary CV are up to 40% more optimistic than those of SKCV. Both regression and classification cases are considered in our experiments. In addition, we will show how the SKCV method can be applied as a criterion for selecting data sampling density for new research area.
Ladattava julkaisu This is an electronic reprint of the original article. |  |
