Speedy Local Search for Semi-Supervised Regularized Least-Squares
: Gieseke F, Kramer O, Airola A, Pahikkala T
: Joscha Bach, Stefan Edelkamp
: 34th Annual German Conference on AI
: 2011
: Lecture Notes in Computer Science
: KI 2011: Advances in Artificial Intelligence: 34th Annual German Conference on AI, Berlin, Germany, October 4-7,2011. Proceedings
: KI 2011: ADVANCES IN ARTIFICIAL INTELLIGENCE
: LECT NOTES ARTIF INT
: Lecture Notes in Computer Science
: 7006
: 87
: 98
: 2
: 978-3-642-24454-4
: 978-3-642-24455-1
: 0302-9743
DOI: https://doi.org/10.1007/978-3-642-24455-1_8
: http://research.utu.fi/converis/portal/Publication/3023302
In real-world machine learning scenarios, labeled data is often rare while unlabeled data can be obtained easily. Semi-supervised approaches aim at improving the prediction performance by taking both the labeled as well as the unlabeled part of the data into account. In particular, semi-supervised support vector machines favor decision hyperplanes which lie in a "low-density area" induced by the unlabeled patterns (while still considering the labeled part of the data). The associated optimization problem, however, is of combinatorial nature and, hence, difficult to solve. In this work, we present an efficient implementation of a simple local search strategy that is based on matrix updates of the intermediate candidate solutions. Our experiments on both artificial and real-world data sets indicate that the approach can successfully incorporate unlabeled data in an efficient manner.