Seminari del Dipartimento di Matematica

Seminario del 2025

Statistical physics of learning with two-layer neural networks

nell'ambito della serie: SEMINARS IN MATHEMATICAL PHYSICS AND BEYOND

fisica matematica

Feature learning - or the capacity of neural networks to adapt to the data during training - is often quoted as one of the fundamental reasons behind their unreasonable effectiveness. Yet, making mathematical sense of this seemingly clear intuition is still a largely open question. In this talk, I will discuss a simple setting where we can precisely characterise how features are learned by a two-layer neural network during the very first few steps of training, and how these features are essential for the network to efficiently generalise under limited availability of data.