SHARP+Foundry workshop @COLT 2025 in Lyon, June 30th 2025

On June 30th 2025, at ENS de Lyon, in the framework of the COLT2025 conference on learning theory, the SHARP and Foundry projects of the PEPR IA are co-organizing a one-day workshop on “Frugal and Robust Foundations for Machine Learning – Occam’s razor at the age of LLM’s”. The workshop will be dedicated to recent advances in frugal and robust learning. Details here

2 papers @ICML2025, with an oral

Two papers I contributed to have been accepted at ICML 2025

  • Selected for an oral presentation: Sibylle Marcotte, Rémi Gribonval, Gabriel Peyré. Transformative or Conservative? Conservation laws for ResNets and Transformers
  • Antoine Gonon, Nicolas Brisebarre, Elisa Riccietti, Rémi Gribonval. A rescaling-invariant Lipschitz bound based on path-metrics for modern ReLU network parameterizations
  • Congratulations also to my colleagues for the following paper also accepted:

  • Antoine Gonon, Léon Zheng, Pascal Carrivain, Quoc-Tung Le. Fast inference with Kronecker-sparse matrices
  • SSFAM Phd Prize – honorable mention for Antoine Gonon

    Antoine Gonon, former Ph.D. student in the Ockham and ARIC teams, is among the laureates of the Ph.D. award of the SSFAM (French-speaking Machine Learning Society) for his thesis on “Harnessing symmetries for modern deep learning challenges: a path-lifting perspective“. Congratulations to Antoine!

    Talk @ PEPR IA Days, Saclay, Mar 18th 2025

    PEPR IA Days, Talk on Highs and lows of sparsity in a world of depths

    Journée AILYS at ENS Lyon, Feb 14th 2025

    Optimization for Artificial Intelligence
    Robustness, Overfitting, Transfer, Frugality

    Talk on Conservation laws during neural network training (joint work with S. Marcotte and G. Peyré)


    Séminaire “mathématiques de l’IA”, IMB, Bordeaux, Jan 30 2025

    Rescaling Symmetries in Neural Networks: a Path-lifting Perspective

    joint work with A. Gonon, N. Brisebarre, E. Riccietti (https://hal.science/hal-04225201v5, https://hal.science/hal-04584311v3) 
    and with A. Gagneux, M. Massias, E. Soubies (https://hal.science/hal-04877619v1) 

    Séminaire MMCS de l’ICJ, Lyon 1, 7/01/2024 – Conservation Laws for Gradient Flows

    https://math.univ-lyon1.fr/wikis/seminaire-mmcs/doku.php

    Prix Loréal-UNESCO 2024 for Sibylle Marcotte

    Sibylle Marcotte, doctorante à l’ENS Ulm que je co-supervise avec Gabriel Peyré, parmi les lauréates du 18e Prix Jeunes Talents France L’Oréal-UNESCO Pour Les Femmes et la Science

    Invited talk @Workshop Frugalité en IA et en statistiques, Sorbonne Université, Paris, Oct 4th 2024

    https://frugalias.sciencesconf.org/

    PolSys Seminar, LIP6, Paris, Sep 27th 2024

    https://www-polsys.lip6.fr/Seminar/seminar.html Conservation Laws for Gradient Flows