Questo sito utilizza solo cookie tecnici per il corretto funzionamento delle pagine web e per il miglioramento dei servizi.
Se vuoi saperne di più o negare il consenso consulta l'informativa sulla privacy.
Proseguendo la navigazione del sito acconsenti all'uso dei cookie.

Elenco seminari del ciclo di seminari
“DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS”

A series of seminars given by Dott. Pierfrancesco Urbani and valid as a PhD course.

Pierfrancesco Urbani

Lecture 8: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 09:00

presso Aula Seminario VIII piano

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives

Pierfrancesco Urbani

Lecture 7: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 11:00

presso Seminario II

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives

Pierfrancesco Urbani

Lecture 6: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 11:00

presso Aula Enriques

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives

Pierfrancesco Urbani

Lecture 5: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 09:00

presso Aula Enriques

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives

Pierfrancesco Urbani

Lecture 4: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 09:00

presso Aula Seminario VIII piano

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives

Pierfrancesco Urbani

Lecture 3: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 11:00

presso Seminario II

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives

Pierfrancesco Urbani

Lecture 2: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 11:00

presso Aula Enriques

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: \\ 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. \\ 2. Equilibrium dynamics and Fluctuation-Dissipation relations. \\ 3. Dynamical mean field theory: Dynamical cavity method \\ 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. \\ 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. \\ 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. \\ 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. \\ 8. Learning algorithms and optimal control of high-d chaotic dynamics. \\ 9. From Neural ODEs to LLMs and generative models \\ 10. Open problems and perspectives\\

Pierfrancesco Urbani

Lecture 1: Dynamics and landscapes in high dimension

nel ciclo di seminari: DYNAMICS AND LANDSCAPES IN HIGH DIMENSION: FROM CONSTRAINT SATISFACTION PROBLEMS TO OVERPARAMETRIZED AND RECURRENT NEURAL NETWORKS

ore 09:00

presso Aula Enriques

analisi numerica

fisica matematica

interdisciplinare

probabilità

This series of lectures aims to review the research landscape on high-dimensional dynamical systems, a topic that arises in multiple disciplines. In physics, understanding the many-body dynamics of complex systems is crucial for characterizing their equilibration properties—or the lack thereof. Beyond physics, the study of dynamics is equally vital in optimization and computer science, particularly when dealing with high-dimensional, non-convex problems—such as those encountered in the training dynamics of artificial neural networks. In neuroscience, these systems also model recurrent neural networks, where fixed points, chaos, and control mechanisms shape their behavior. The course has a twofold purpose: first, to survey current knowledge of high-dimensional dynamical systems across various contexts; and second, to explore dynamical mean field theory, the primary toolkit for tackling these challenges. Outline: 1. Stochastic differential equations, Langevin dynamics, Fokker-Planck equation and stationary measures. 2. Equilibrium dynamics and Fluctuation-Dissipation relations. 3. Dynamical mean field theory: Dynamical cavity method 4. Dynamics of mean field spin glasses. High temperature phase and relaxation to equilibrium; Low temperature phase, aging. Landscape interpretation. 5. High-dimensional inference: Langevin/Gradient Descent algorithms and their suboptimality with respect to Approximate Message Passing. 6. Training dynamics of artificial neural networks. Neural tangent kernel and feature learning theory. Separation of timescales between feature learning and overfitting. 7. Recurrent neural networks. Transition to and chaos in high dimension. Maximal Lypaunov exponent. 8. Learning algorithms and optimal control of high-d chaotic dynamics. 9. From Neural ODEs to LLMs and generative models 10. Open problems and perspectives