Information theory

Fall 2020 at ENS Lyon

General information

Lectures
- Omar Fawzi
- Default time: Tuesdays 10:15 to 12:15 (see pad for additional information)
- Online via BBB link on the portail des etudes
Tutorials
- Paul Ferme and Dewi Sintiari
- Default time: Mondays 10:15 to 12:15
- See the pad and webpage of Paul Ferme for more information

This course is an introduction to information theory and error correcting codes from the computer science point of view.

Definition and properties of entropy functions
Data compression
Shannon's noisy coding theorem
Applications of information theory to combinatorics, cryptography, complexity theory
Error correcting codes: Definitions, properties and examples
Applications of error correcting codes

Resources

[CT] Elements of Information Theory
[Mac] Information Theory, Inference and Learning Algorithms
[PW] Lecture notes on Information Theory
[GRS] Essential Coding Theory
[Sen] Introduction a la theorie de l'information

For some online resources on probability (for computer science), you can look at these notes or these notes (starting at Lecture 10).

Grading

The grading scheme will take into account

A final exam and a midterm exam (the form will depend on the evolution of the health situation)
Weekly online assignments
Two or three homeworks
Bonus: Small project, such as writing a wikipedia article related to information theory

Schedule

Please check portail des etudes for details on the lectures