Duration
30h Th, 15h Pr, 30h Proj.
Number of credits
Lecturer
Language(s) of instruction
English language
Organisation and examination
Teaching in the second semester
Schedule
Units courses prerequisite and corequisite
Prerequisite or corequisite units are presented within each program
Learning unit contents
NB: This course is given in English, since the 2013-2014 academic year.
Information theory provides a quantitative measure of the information provided by a message or an observation. This notion was introduced by Claude Shannon in 1948 in order to establish the limits of what is possible in terms of data compression and transmission over noisy channels. Since these times, this theory has found many applications in telecommunications, computer science ans statistics. The courss is composed of three parts.
- The foundations of information theory.
- An introduction to coding theory for data compression, error-free communication, and cryptography.
- An overview of other applications of information theory.
Learning outcomes of the learning unit
Successful completion of this course means that the student has acquired a good understanding of the principles of information theory and will be able to exploit these principles in order to analyze and design source and channel coding algorithms.
Prerequisite knowledge and skills
Probability calculus and elements of statistics.
Planned learning activities and teaching methods
Exercise sessions and homework.
Mode of delivery (face-to-face ; distance-learning)
2nd semester
Recommended or required readings
Available at AEES
Assessment methods and criteria
Practical work for each student. Written exam (June).
Work placement(s)
Organizational remarks
Contacts
Adaptation of teaching commitments following the COVID-19 pandemic for the May-June 2020 session
Teaching methods implemented : distance-learning
The course is given at distance, and video lectures, of D. Mackay are indicated to students to prepare themselves. The subjects covered are reduced given the difficulties.
Assessment subjects
The 3 main parts of the course: information measures and their algebra, source coding, channel coding, are maintained.
Assessment methods
The usual written exam is replaced by an 'e-campus' driven multiple choice questionnaire type of exam. It was discussed with the students, and a 'dummy' blank test will be organized in early May to minimize the risk of logistics problems and allow the students toi have a first practice of the new exam setting.
Contacts
Adaptation of teaching commitments following the COVID-19 pandemic for the Aug-Sept 2020 session
Assessment subjects
The 3 main parts of the course: information measures and their algebra, source coding, channel coding, are maintained.
Assessment methods
The usual written exam is replaced by an 'e-campus' driven multiple choice questionnaire type of exam. It was discussed with the students, and a 'dummy' blank test will be organized in early May to minimize the risk of logistics problems and allow the students toi have a first practice of the new exam setting.