Nonsmooth DC optimization support vector machines method for piecewise linear regression
: Bagirov, A.M.; Taheri, S.; Karmitsa, N.; Joki, K.; Mäkelä, M.M.
Publisher: Institute of Applied Mathematics of Baku State University
: 2024
: Applied and Computational Mathematics
: Applied and Computational Mathematics
: 23
: 3
: 282
: 306
: 1683-3511
: 1683-6154
DOI: https://doi.org/10.30546/1683-6154.23.3.2024.282
: https://doi.org/10.30546/1683-6154.23.3.2024.282
: https://research.utu.fi/converis/portal/detail/Publication/457906850
A new regression method called the adaptive piecewise linear support vector regression (A-PWLSVR) is introduced. We use the L1-risk function to define regression errors and apply the support vector machine approach in combination with the piecewise linear regression to develop a model for regression problems. We formulate the model as an unconstrained nonconvex nonsmooth optimization problem, where the objective function is represented as a difference of two convex (DC) functions. To address the nonconvexity of the problem a novel incremental approach is proposed. This approach builds the piecewise linear estimates by applying an adaptive selection procedure for the model parameters. The approach enables us to select starting points being rough approximations of the solution. The double bundle method for nonsmooth DC optimization is applied to solve the optimization problems. The proposed A-PWLSVR method is evaluated on several synthetic and real-world data sets for regression and compared with some mainstream regression methods.
:
The research was supported by the Australian Government through the Australian Research Council\u2019s Discovery Projects funding scheme (Project No. DP190100580) and by the Research Council of Finland (Project No. 289500, 319274, 345804, and 345805).
