Author's posts
Conservation laws for neural network training: two papers at @NeurIPS23 & @ICML24
We study conservation laws during the (euclidean or not) gradient or momentum flow of neural networks. Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows, accepted at ICML24 1/ We define the concept of conservation laws for momentum flows and show how to extend the framework from our previous paper (Abide by the Law and …
Invited talk @IEM @EPFL, May 24th 2024
Frugality in machine learning: Sparsity, a value for the future? Sparse vectors and sparse matrices play a transerve role in signal and image processing: they have led to succesful approaches efficiently addressing tasks as diverse as data compression, fast transforms, signal denoising and source separation, or more generally inverse problems. To what extent can the …
Invited talk, MAP5, Paris, May 17th 2024
Frugality in machine learning: Sparsity, a value for the future? Sparse vectors and sparse matrices play a transerve role in signal and image processing: they have led to succesful approaches efficiently addressing tasks as diverse as data compression, fast transforms, signal denoising and source separation, or more generally inverse problems. To what extent can the …
Invited talk, Math Machine Learning seminar MPI MIS + UCLA, online, May 16, 2024
‘Conservation Laws for Gradient Flows’ Understanding the geometric properties of gradient descent dynamics isa key ingredient in deciphering the recent success of very largemachine learning models. A striking observation is that trainedover-parameterized models retain some properties of the optimizationinitialization. This “implicit bias” is believed to be responsible forsome favorable properties of the trained models and …
Invited talk @RWTH Sparsity and Singular Structures, Aachen, 26-29 February 2024
https://sfb1481.rwth-aachen.de/symposium24/programme
Journées SMAI-MODE 2024, Lyon, 25-29 mars 2024
Details and registration https://indico.math.cnrs.fr/event/9418/
Journée SIGMA – MODE 2024, 30 janvier 2024, Inria Paris.
More information and (free but mandatory) registration at: http://angkor.univ-mlv.fr/~vialard/conferences/sigmamode/
Invited talk at JRAF, Grenoble, 13-14 December 2023
https://jraf-2023.sciencesconf.org/
Invited Talk @DIPOpt workshop, Nov 29th 2023
http://perso.ens-lyon.fr/nelly.pustelnik/DIPOpt/
Exposé à la journée d’étude “Quelle IA pour 2030?” du projet AILyS
https://www.ens-lyon.fr/evenement/recherche/quelle-ia-pour-2030-le-projet-ailys