arXiv Analytics

Sign in

arXiv:2309.17006 [cond-mat.dis-nn]AbstractReferencesReviewsResources

Statistical physics, Bayesian inference and neural information processing

Erin Grant, Sandra Nestler, Berfin Şimşek, Sara Solla

Published 2023-09-29Version 1

Lecture notes from the course given by Professor Sara A. Solla at the Les Houches summer school on "Statistical physics of Machine Learning". The notes discuss neural information processing through the lens of Statistical Physics. Contents include Bayesian inference and its connection to a Gibbs description of learning and generalization, Generalized Linear Models as a controlled alternative to backpropagation through time, and linear and non-linear techniques for dimensionality reduction.

Comments: These are notes from the lecture of Sara Solla given at the summer school "Statistical Physics & Machine Learning", that took place in Les Houches School of Physics in France from 4th to 29th July 2022. The school was organized by Florent Krzakala and Lenka Zdeborov\'a from EPFL
Categories: cond-mat.dis-nn, stat.ML
Related articles: Most relevant | Search more
arXiv:2302.14112 [cond-mat.dis-nn] (Published 2023-02-27)
Injectivity of ReLU networks: perspectives from statistical physics
arXiv:0901.1144 [cond-mat.dis-nn] (Published 2009-01-08, updated 2009-10-26)
Bayesian Inference Based on Stationary Fokker-Planck Sampling
arXiv:2306.01477 [cond-mat.dis-nn] (Published 2023-06-02)
Statistical physics of learning in high-dimensional chaotic systems