2017-2018 / ELEN0062-1

Introduction to machine learning

Duration

30h Th, 5h Pr, 40h Proj.

Number of credits

 Master in biomedical engineering (120 ECTS)5 crédits 
 Master in data science (120 ECTS)5 crédits 
 Master in electrical engineering (120 ECTS)5 crédits 
 Master of science in computer science and engineering (120 ECTS)5 crédits 
 Master in data science and engineering (120 ECTS)5 crédits 
 Master in computer science (120 ECTS)5 crédits 
 Master in bio-informatics and modelling (120 ECTS)6 crédits 
 Master in mathematics (120 ECTS)8 crédits 

Lecturer

Pierre Geurts, Louis Wehenkel

Coordinator

N...

Language(s) of instruction

English language

Organisation and examination

Teaching in the first semester, review in January

Units courses prerequisite and corequisite

Prerequisite or corequisite units are presented within each program

Learning unit contents

Machine learning studies methods that automatically build a general solution to a problem from a set of solutions of specific instances of this problem. Its applications are multitudinous: extraction of medical diagnostic decision rules from clinical databases; bioinformatics; construction of credit allocation procedures from bank customer databases; computer vision; modeling, optimisation and control of complex systems; automatic syntesis of algorithms; extraction of knowledge from human experts...
The theoretical part of the course introduces the different types of machine learning problems (supervised learning: classification and regression, unsupervised learning: clustering and dimensionality reduction), the main underlying principles (bias/variance tradeoff, cross-validation, model selection) as well as the main families of methods (linear regression, k nearest neighbors, decision trees, ensemble methods, support vector machines, artificial neural networks, k-means...). Theoretical lectures are complemented with practical projects that allow the students to get acquainted with the theoretical concepts and the main method families by carrying out experiments on artificial and real datasets.

Learning outcomes of the learning unit

At the end of the course, the student will be able to analyze the theoretical (computational and statistical) properties of the most important machine learning algorithms, to apply them in practice, and to assess in a sound way their performances.

Prerequisite knowledge and skills

Elements of probability calculus, statistics, algorithmics, and optimization (as taught for example in the bachelor in engineering or in computer science).

Planned learning activities and teaching methods

Theoretical ex cathedra lectures combined with projects using the computer. Three projects are organized during the semester. The first two are intended to put into practice the course material by answering theoretical questions and carrying out experiments on artificial data sets. The third project is organized in the form of a student competition aimed at obtaining the best performances on a real supervised learning problem. The three projects are to be carried out by groups of typically two students.

Mode of delivery (face-to-face ; distance-learning)

Theoretical lectures are face-to-face. Projects are carried out remotely. 

Recommended or required readings

Slides of the theoretical lectures are available on the course website. Links to additional material (books or papers) are provided on the same web page and at the end of each set of slides.

Assessment methods and criteria

The evaluation is based on the three projects (30%) and an oral exam (70%).
Each project will require to submit a written report and the source code of the solutions in due time. In addition, each group will be given the opportunity to present his solution to the third project (competition) in front of the class. The projects are inseparable from the teaching unit and considered as compulsory. Students who have not realised the projects and / or who have not submitted the expected reports within the prescribed time or in the prescribed form will not be allowed to take the exam.
The goal of the oral exam will be to assess the understanding of theoretical lectures. Students will have to present one or several parts of the course and answer questions covering the whole course material.
 

Work placement(s)

Organizational remarks

The lectures are given during the first semester, every wednesday from 9am to at most 12:30am.
Web page: http://www.montefiore.ulg.ac.be/~lwh/AIA

Contacts

Teachers:Louis Wehenkel (L.Wehenkel@ulg.ac.be), Pierre Geurts (p.geurts@ulg.ac.be)
Teaching assistants: Antonio Sutera (a.sutera@ulg.ac.be), Jean-Michel Begon (jm.begon@student.ulg.ac.be)