{"id":598,"date":"2020-09-04T16:01:22","date_gmt":"2020-09-04T16:01:22","guid":{"rendered":"http:\/\/people.irisa.fr\/Remi.Gribonval\/?page_id=598"},"modified":"2024-09-12T14:05:23","modified_gmt":"2024-09-12T14:05:23","slug":"m2a-concentration","status":"publish","type":"page","link":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/talks-and-tutorials\/m2a-concentration\/","title":{"rendered":"M2 course, ENS Lyon: Concentration of measure in probability and high-dimensional statistical learning"},"content":{"rendered":"<h2>\u00a0<\/h2>\n<p>Course of the <a href=\"http:\/\/mathematiques.ens-lyon.fr\/master-2-234092.kjsp?RH=1403617207802&amp;RF=1403617207802\">Master of Advanced Mathematics<\/a>, Probability &amp; Statistics Track.<\/p>\n<h2>Links<\/h2>\n<ul>\n<li>Student registration and more : <a href=\"https:\/\/etudes.ens-lyon.fr\/course\/view.php?id=4882\" target=\"_blank\" rel=\"noopener\">on official course page<\/a><\/li>\n<li><a href=\"https:\/\/perso.ens-lyon.fr\/aurelien.garivier\/www.math.univ-toulouse.fr\/_agarivie\/concentration.html\">Course page maintained by Aur\u00e9lien Garivier (soon to be updated from last year )<\/a><\/li>\n<\/ul>\n<h2>Lecturers<\/h2>\n<p><a href=\"https:\/\/perso.ens-lyon.fr\/jean-christophe.mourrat\/\">Jean-Christophe Mourrat<\/a>, <a href=\"https:\/\/perso.ens-lyon.fr\/aurelien.garivier\/www.math.univ-toulouse.fr\/_agarivie\/index.html\">Aur\u00e9lien Garivier<\/a>, <a href=\"https:\/\/people.irisa.fr\/Remi.Gribonval\/\">R\u00e9mi Gribonval<\/a><\/p>\n<h2>Course description<\/h2>\n<p>This course will introduce the notion of concentration of measure and highlight its applications, notably in high dimensional data processing and machine learning. The course will start from deviations inequalities for averages of independent variables, and illustrate their interest for the analysis of random graphs and random projections for dimension reduction. It will then be shown how other high-dimensional random functions concentrate, and what guarantees this concentration yields for randomized algorithms and machine learning procedures to learn from large training collections.<\/p>\n<h2>Prerequisite<\/h2>\n<p>Basic knowledge of probability theory, linear algebra and analysis over the reals.<\/p>\n<h2>Evaluation<\/h2>\n<p>Homework, in-class exercices and final exam: 50%. Presentation of a research article: 50% (details to come, see official page)<\/p>\n<h2>Bibliography<\/h2>\n<ol>\n<li>Concentration Inequalities, <em>by St\u00e9phane Boucheron, Pascal Massart and Gabor Lugosi<\/em><\/li>\n<li><a href=\"https:\/\/www.math.uci.edu\/~rvershyn\/papers\/HDP-book\/HDP-book.html\">High-Dimensional Probability &#8211; An Introduction with Applications in Data Science<\/a>, <em>by Roman Vershynin<\/em><\/li>\n<li><a href=\"http:\/\/www.cs.huji.ac.il\/~shais\/UnderstandingMachineLearning\/copy.html\">Understanding Machine Learning, From Theory to Algorithms<\/a>, <em> by Shai Shalev-Shwartz and Shai Ben-David<\/em><\/li>\n<li><a href=\"https:\/\/cs.nyu.edu\/~mohri\/mlbook\/\">Foundations of Machine Learning<\/a> <em>by Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar<\/em><\/li>\n<\/ol>\n<hr \/>\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u00a0 Course of the Master of Advanced Mathematics, Probability &amp; Statistics Track. Links Student registration and more : on official course page Course page maintained by Aur\u00e9lien Garivier (soon to be updated from last year ) Lecturers Jean-Christophe Mourrat, Aur\u00e9lien Garivier, R\u00e9mi Gribonval Course description This course will introduce the notion of concentration of measure &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/talks-and-tutorials\/m2a-concentration\/\">Continue reading<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":44,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-598","page","type-page","status-publish","hentry","nodate","item-wrap"],"_links":{"self":[{"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/pages\/598","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/comments?post=598"}],"version-history":[{"count":16,"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/pages\/598\/revisions"}],"predecessor-version":[{"id":785,"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/pages\/598\/revisions\/785"}],"up":[{"embeddable":true,"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/pages\/44"}],"wp:attachment":[{"href":"https:\/\/perso.ens-lyon.fr\/remi.gribonval\/wp-json\/wp\/v2\/media?parent=598"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}