Fejér* monotonicity in optimization algorithms

Roger Behling, Yunier Bello-Cruz, Alfredo Noel Iusem, Ademir Alves Ribeiro, Luiz-Rafael Santos

Published 2024-10-10Version 1

Fej\'er monotonicity is a well-established property commonly observed in sequences generated by optimization algorithms. In this paper, we introduce an extension of this property, called Fej\'er* monotonicity, which was initially proposed in [SIAM J. Optim., 34(3), 2535-2556 (2024)]. We discuss and build upon the concept by exploring its behavior within Hilbert spaces, presenting an illustrative example and insightful results regarding weak and strong convergence. We also compare Fej\'er* monotonicity with other weak notions of Fej\'er-like monotonicity, to better establish the role of Fej\'er* monotonicity in optimization algorithms.