A1 Vertaisarvioitu alkuperäisartikkeli tieteellisessä lehdessä

Efficient hyperparameter tuning for kernel ridge regression with Bayesian optimization




TekijätStuke Annika, Rinke Patrick, Todorovic Milica

KustantajaIOP PUBLISHING LTD

Julkaisuvuosi2021

JournalMachine Learning: Science and Technology

Tietokannassa oleva lehden nimiMACHINE LEARNING-SCIENCE AND TECHNOLOGY

Lehden akronyymiMACH LEARN-SCI TECHN

Artikkelin numeroARTN 035022

Vuosikerta2

Numero3

Sivujen määrä14

DOIhttps://doi.org/10.1088/2632-2153/abee59

Verkko-osoitehttps://iopscience.iop.org/article/10.1088/2632-2153/abee59

Rinnakkaistallenteen osoitehttps://research.utu.fi/converis/portal/detail/Publication/66398682


Tiivistelmä
Machine learning methods usually depend on internal parameters-so called hyperparameters-that need to be optimized for best performance. Such optimization poses a burden on machine learning practitioners, requiring expert knowledge, intuition or computationally demanding brute-force parameter searches. We here assess three different hyperparameter selection methods: grid search, random search and an efficient automated optimization technique based on Bayesian optimization (BO). We apply these methods to a machine learning problem based on kernel ridge regression in computational chemistry. Two different descriptors are employed to represent the atomic structure of organic molecules, one of which introduces its own set of hyperparameters to the method. We identify optimal hyperparameter configurations and infer entire prediction error landscapes in hyperparameter space that serve as visual guides for the hyperparameter performance. We further demonstrate that for an increasing number of hyperparameters, BO and random search become significantly more efficient in computational time than an exhaustive grid search, while delivering an equivalent or even better accuracy.

Ladattava julkaisu

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2024-26-11 at 19:59