arXiv Analytics

Sign in

arXiv:2502.07915 [math.OC]AbstractReferencesReviewsResources

Regularization for the Approximation of 2D Set of Points via the Length of the Curve

Majid E. Abbasov, Anna I. Belenok

Published 2025-02-11Version 1

We study the problem of approximation of 2D set of points. Such type of problems always occur in physical experiments, econometrics, data analysis and other areas. The often problems of outliers or spikes usually make researchers to apply regularization techniques, such as Lasso, Ridge or Elastic Net. These approaches always employ penalty coefficient. So the important question of evaluation of the upper bound for the coefficient arises. In the current study we propose a novel way of regularization and derive the upper bound for the used penalty coefficient. First the problem in a general form is stated. The solution is sought in the class of piecewise continuously differentiable functions. It is shown that the optimal solution belongs to the class of piecewise linear functions. So the problem of obtaining the piecewise linear approximation that fits 2D set of point the best is stated. We show that the optimal solution is trivial and tends to a line as penalty coefficient tends to infinity. Then the main result is stated and proved. It provides the upper bound for the penalty coefficient prior to which the optimal solution differs from the line more than some pregiven positive number. We also demonstrate the proposed ideas on numerical examples which include comparison with other regularization approaches.

Related articles: Most relevant | Search more
arXiv:2410.19805 [math.OC] (Published 2024-10-16)
The Distance Between the Perturbation of a Convex Function and its $Γ$-regularization
arXiv:1404.1972 [math.OC] (Published 2014-04-08, updated 2015-01-18)
Regularization for Design
arXiv:1508.06496 [math.OC] (Published 2015-08-26)
Approximations of Stochastic Hybrid Systems: A Compositional Approach