arXiv:2312.05885 [cs.LG]AbstractReferencesReviewsResources
Adaptive Parameter Selection for Kernel Ridge Regression
Published 2023-12-10Version 1
This paper focuses on parameter selection issues of kernel ridge regression (KRR). Due to special spectral properties of KRR, we find that delicate subdivision of the parameter interval shrinks the difference between two successive KRR estimates. Based on this observation, we develop an early-stopping type parameter selection strategy for KRR according to the so-called Lepskii-type principle. Theoretical verifications are presented in the framework of learning theory to show that KRR equipped with the proposed parameter selection strategy succeeds in achieving optimal learning rates and adapts to different norms, providing a new record of parameter selection for kernel methods.
Comments: 19 pages
Related articles: Most relevant | Search more
arXiv:2309.13337 [cs.LG] (Published 2023-09-23)
On the Asymptotic Learning Curves of Kernel Ridge Regression under Power-law Decay
arXiv:2009.09136 [cs.LG] (Published 2020-09-19)
Kernel Ridge Regression Using Importance Sampling with Application to Seismic Response Prediction
arXiv:1406.2622 [cs.LG] (Published 2014-06-10)
Equivalence of Learning Algorithms