arXiv Analytics

Sign in

arXiv:1807.00906 [cs.LG]AbstractReferencesReviewsResources

Uncertainty in the Variational Information Bottleneck

Alexander A. Alemi, Ian Fischer, Joshua V. Dillon

Published 2018-07-02Version 1

We present a simple case study, demonstrating that Variational Information Bottleneck (VIB) can improve a network's classification calibration as well as its ability to detect out-of-distribution data. Without explicitly being designed to do so, VIB gives two natural metrics for handling and quantifying uncertainty.

Comments: 10 pages, 7 figures. Accepted to UAI 2018 - Uncertainty in Deep Learning Workshop
Categories: cs.LG, stat.ML
Related articles: Most relevant | Search more
arXiv:1810.06530 [cs.LG] (Published 2018-10-15)
Successor Uncertainties: exploration and uncertainty in temporal difference learning
arXiv:2010.03753 [cs.LG] (Published 2020-10-08)
Uncertainty in Neural Processes
arXiv:2006.10562 [cs.LG] (Published 2020-06-18)
Uncertainty in Gradient Boosting via Ensembles