arXiv Analytics

Sign in

arXiv:2008.06148 [math.OC]AbstractReferencesReviewsResources

Complexity aspects of local minima and related notions

Amir Ali Ahmadi, Jeffrey Zhang

Published 2020-08-14Version 1

We consider the notions of (i) critical points, (ii) second-order points, (iii) local minima, and (iv) strict local minima for multivariate polynomials. For each type of point, and as a function of the degree of the polynomial, we study the complexity of deciding (1) if a given point is of that type, and (2) if a polynomial has a point of that type. Our results characterize the complexity of these two questions for all degrees left open by prior literature. Our main contributions reveal that many of these questions turn out to be tractable for cubic polynomials. In particular, we present an efficiently-checkable necessary and sufficient condition for local minimality of a point for a cubic polynomial. We also show that a local minimum of a cubic polynomial can be efficiently found by solving semidefinite programs of size linear in the number of variables. By contrast, we show that it is strongly NP-hard to decide if a cubic polynomial has a critical point. We also prove that the set of second-order points of any cubic polynomial is a spectrahedron, and conversely that any spectrahedron is the projection of the set of second-order points of a cubic polynomial. In our final section, we briefly present a potential application of finding local minima of cubic polynomials to the design of a third-order Newton method.

Comments: 41 pages, 10 figures
Categories: math.OC, cs.CC, cs.LG
Subjects: 90C60, 90C22, 90C30, 90C46
Related articles: Most relevant | Search more
arXiv:1712.06585 [math.OC] (Published 2017-12-18)
Third-order Smoothness Helps: Even Faster Stochastic Optimization Algorithms for Finding Local Minima
arXiv:2008.12170 [math.OC] (Published 2020-08-27)
Complexity Aspects of Fundamental Questions in Polynomial Optimization
arXiv:2303.03536 [math.OC] (Published 2023-03-06, updated 2023-07-13)
Certifying the absence of spurious local minima at infinity