arXiv Analytics

Sign in

arXiv:2007.05554 [stat.ML]AbstractReferencesReviewsResources

Bayesian Optimization of Risk Measures

Sait Cakmak, Raul Astudillo, Peter Frazier, Enlu Zhou

Published 2020-07-10Version 1

We consider Bayesian optimization of objective functions of the form $\rho[ F(x, W) ]$, where $F$ is a black-box expensive-to-evaluate function and $\rho$ denotes either the VaR or CVaR risk measure, computed with respect to the randomness induced by the environmental random variable $W$. Such problems arise in decision making under uncertainty, such as in portfolio optimization and robust systems design. We propose a family of novel Bayesian optimization algorithms that exploit the structure of the objective function to substantially improve sampling efficiency. Instead of modeling the objective function directly as is typical in Bayesian optimization, these algorithms model $F$ as a Gaussian process, and use the implied posterior on the objective function to decide which points to evaluate. We demonstrate the effectiveness of our approach in a variety of numerical experiments.

Comments: The paper is 12 pages and includes 3 figures. The supplement is an additional 11 pages with 2 figures. The paper is currently under review for Neurips 2020
Categories: stat.ML, cs.LG, math.OC
Related articles: Most relevant | Search more
arXiv:1602.03220 [stat.ML] (Published 2016-02-09)
Discriminative Regularization for Generative Models
arXiv:1706.10031 [stat.ML] (Published 2017-06-30)
Neural Sequence Model Training via $α$-divergence Minimization
arXiv:2010.08007 [stat.ML] (Published 2020-10-15)
Continuum-Armed Bandits: A Function Space Perspective