|
A Dual Active-Set Algorithm for Regularized
Slope-Constrained Monotonic Regression
|
Oleg Burdakov *   , Oleg Sysoev |
| Linkӧping University , oleg.burdakov@liu.se |
|
|
Abstract: (10005 Views) |
| In many problems, it is necessary to take into account monotonic relations. Monotonic (isotonic) Regression (MR) is often involved in solving such problems. The MR solutions are of a step-shaped form with a typical sharp change of values between adjacent steps. This, in some applications, is regarded as a disadvantage. We recently introduced a Smoothed MR (SMR) problem which is obtained from the MR by adding a regularization penalty term. The SMR is aimed at smoothing the aforementioned sharp change. Moreover, its solution has a far less pronounced step-structure, if at all available. The purpose of this paper is to further improve the SMR solution by getting rid of such a structure. This is achieved by introducing a lowed bound on the slope in the SMR. We call it Smoothed Slope-Constrained MR (SSCMR) problem. It is shown here how to reduce it to the SMR which is a convex quadratic optimization problem. The Smoothed Pool Adjacent Violators (SPAV) algorithm developed in our recent publications for solving the SMR problem is adapted here to solving the SSCMR problem. This algorithm belongs to the class of dual active-set algorithms. Although the complexity of the SPAV algorithm is $𝑂(𝑛^2)$, its running time is growing in our computational experiments almost linearly with $𝑛$. We present numerical results which illustrate the predictive performance quality of our approach. They also show that the SSCMR solution is free of the undesirable features of the MR and SMR solutions. |
|
| Keywords: Monotonic regression, Regularization, Quadratic penalty, Convex quadratic optimization, Dual active-set method, Large-scale optimization. |
|
|
Full-Text [PDF 545 kb]
(16842 Downloads)
|
Type of Study: Original |
Subject:
Other
Received: 2018/05/28 | Accepted: 2018/05/28 | Published: 2018/05/28
|
|
|
|
|
|
|
| Send email to the article author |
|
|
|
| Add your comments about this article |
|
|
|
