Education
Knowledge transfer is an integral part of Idiap's activities. Along research and technology transfer, education is one of the three main missions of the institute. We achieve this commitment thanks to teachings in various higher education institutions, as well by offering continuing training to businesses and outreach activities for youngsters.
Student Projects
All projects listed here are suitable as master's or graduate project unless otherwise indicated.
Social media and crowdsourcing for social good
Project Summary: The student will contribute to a multidisciplinary initiative for the use of social media and mobile crowdsourcing for social good. Several projects are available. Specific topics include:
* Social media analytics
* Visualization of social and crowdsourced data
* Smartphone apps for mobile crowdsourcing
Students will be working with social computing researchers studying European and developing cities.
Contact: Prof. Daniel Gatica-Perez
A human-centered approach to understand local news consumption
Project Summary: The goal of the project is the design and implementation a framework to study the consumption of local news in the Swiss multicultural context. The project will include a combination of research methods for experimental design and data analysis, and will be done in the context of the AI4Media European project (A European Excellence Center for Media, Society, and Democracy). The main tasks of the project include: literature review; identification of local news sources; mixed-method experimental design; experiments and data analysis; and writing.
Contact: Prof. Daniel Gatica-Perez
Swiss Alpine Lakes & Citizen Science
Project Summary: In the context of the CLIMACT UNIL-EPFL initiative, we aim at cataloging all Swiss Alpine Lakes located above 2000 meters, including collection of water samples and in-depth analysis of their microbial diversity, with a citizen science approach to engage citizens and increase awareness regarding environmental conservation. The project will build upon existing data sources (including Wikipedia and government data), and computational tools including natural language processing, computer vision, and visualization to build online interactive functionalities that can be used as part of citizen science activities.
Contact: Prof. Daniel Gatica-Perez
Privacy-preserving machine learning methods for diversity-aware mobile computing
Project Summary: The goal of the project is to study privacy-preserving machine methods in the context of mobile, diversity-aware computing systems that support the local needs of communities. The project will include work in machine learning, mobile data analysis, and will be done in the context of the multidisciplinary WeNet European project. The main tasks of the project include: literature review; algorithm design and implementation; experiments and data analysis; and writing.
Contact: Prof. Daniel Gatica-Perez
A FATE framework for diversity-aware mobile computing
Project Summary: This project will study and propose a methodology to characterize and validate machine learning methods in the context of diversity-aware mobile computing from the FATE perspective (fairness, accountability, transparency, ethics.) Recent approaches include Google’s model cards for model reporting or Microsoft’s Guidelines for Human-AI interaction. The project will provide a set of best practices for this domain. The main tasks of the project include: literature review; method design and implementation; experiments and data analysis; and writing.
Contact: Prof. Daniel Gatica-Perez
The European AI Act and its impact on European cities
Project Summary: The April 2021 proposal by the European Commission on AI regulation (The AI Act) will impact many sectors of the economy and have important societal implications. This project will study this proposal, analyze its possible effects on how European cities use AI as part of their mission, and make recommendations for the future. The project will be done in the context of the multidisciplinary ICARUS European project, which involve a number of actors in cities and non-governmental organizations. The main tasks of the project include: literature review; conceptual analysis; data collection; data analysis, and writing.
Contact: Prof. Daniel Gatica-Perez
Robot Learning and Interaction
Project Summary: The Robot Learning and Interaction Group proposes various Master and Semester projects with topics related to robotics, machine learning, adaptive control and human-robot interaction.
The list of projects is available here.
Supervisor: Dr. Sylvain Calinon
Keywords: robotics, machine learning, adaptive control, human-robot interaction
Human-Robot Interfaces for Interactive Robot Programming
Project Summary: For robots to be widely adopted across industries and beyond structured manufacturing environments,it is critical for them to be programmable by a wide range of users. Growing research on End UserProgramming (EUP) for robotics aims to address this problem with novel user interfaces, programminglanguages, and techniques to aid or fully automate robot programming.
In this project, you will design a Human-Robot Interface for Robot Programming, integrating anexisting programming framework based on iterative Linear Quadratic Regulator (iLQR) [1] on a roboticmanipulator, the FRANKA EMIKA Panda. The interface will allow users to compose robot programsdefined as sequences of components like goal poses or constraints (e.g., maintaining a gripper orientation)which, in turn, inform the generation of executable robot trajectories.
For more details, see the following document
Supervisors: Dr. Jean-Marc Odobez, Dr. Sylvain Calinon
Advisors and point of contact: Dr. Mattia Racca
6D Pose Estimation for Robotic Manipulation Tasks
Project Summary: For robots to interact with their environment in a safe and efficient manner, they need robust ways of estimating the pose (location, orientation) of the objects to be manipulated. This is usually done with RGB-D cameras as input sensors, i.e. cameras that provide not only the color of each pixel (the RGB part) but also how far it is from the camera (the D for “depth”).
Most recent methods leverage deep learning architecture to achieve such estimation, leveraging convolutional neural networks and fully-connected layers.
In this semester project, you will use referenced methods (Wang et al 2019, He et al 2020 & 2021), testing their performance and usability on the available datasets. In particular, you will take advantage of the YCB Object Dataset, a popular robotics dataset used to evaluate 6D pose estimation techniques (Calli et al, 2015). This dataset, avaialble in the lab, consists of real-life items and their corresponding 3D model (in the form of point clouds or textured meshes). You will then integrate the methods in a lab setup, where the input images come, in real time, from a RBG-D camera (Intel Realsense d415, Kinect Azure). Finally, you will showcase the robustness of the methods, by having the estimated 6D pose of YCB items used as input for a robot grasping task.For more details about the tasks and goals, see the following link:
Supervisor: Dr. Jean-Marc Odobez
Advisors and point of contact: Anshul Gupta (research assistant), Dr. Mattia Racca
Interaction Manager for Human-Robot Interactions
Project Summary: This project aims to provide an easy way to create dialogues for human-robot interactions. For example, a robot introducing itself when someone looks at it, telling a joke if the person asks for one, and then using the person’s laughter to learn whether the joke was a good one. In this project (semester or master), you will use RASA, a commercial dialogue management system used in many chatbots on the web to handle turn-taking discussions. You will interface this system with a simulated robot as well as a real Pepper robot to create scenarios allowing people to interact with Pepper in different ways and ensuring that Pepper’s responses are appropriate both verbally and non-verbally. For this, you will need to use Pepper’s sensors to make sense of the world and understand people’s speech, relay this information to the dialogue manager in RASA, and treat the outputs of the dialogue manager to create real robot behaviors (speech and gestures).
For more details, see the following link to pdf
Supervisors: Dr. Jean-Marc Odobez, Dr. Emmanuel Senft
Point of contact: Dr. Emmanuel Senft
Courses
Idiap researchers are involved in several courses listed below.
Automatic Speech Processing (EE-554) Lecturer(s): Mathew Magimai Doss
The goal of this course is to provide the students with the main formalisms, models and algorithms required for the implementation of advanced speech processing applications (involving, among others, speech coding, speech analysis/synthesis, and speech recognition).
Master course at EPFL in the Electrical and Electronics Engineering program
Computational Social Media (DH-500) Lecturer(s): Gatica-Perez Daniel
The course integrates concepts from media studies, machine learning, multimedia and network science to characterize social practices and analyze content in sites like Facebook, Twitter and YouTube. Students will learn computational methods to infer individual and networked phenomena in social media.
Master course at EPFL in the Digital Humanities, Life Science Engineering program
Genomics and bioinformatics (BIO-463) Lecturer(s) Luisier Raphaëlle & Jacques Rougemont
This course covers various data analysis approaches associated with applications of DNA sequencing technologies, from genome sequencing to quantifying gene expression, transcription factor binding and chromosome conformation.
Master course at EPFL in the Life Science Engineering program
Biometrics (School of Criminal Justice (ESC)) Lecturer(s): Sébastien Marcel
This course introduces to the analysis, modelling and interpretation of biometric data for biometric person recognition, forensic biometrics, cybersecurity and behavioural biometrics in man-machine communication.
Master course at University of Lausanne in the School of Criminal Justice
Perception and learning from multimodal sensors (EE-623) Lecturer(s): Odobez Jean-Marc
The course will cover different aspects of multimodal processing (complementarity vs redundancy; alignment and synchrony; fusion), with an emphasis on the analysis of people, behaviors and interactions from multimodal sensor, using statistical models and deep learning as main modeling tools.
Doctoral course at EPFL in the Electrical and Electronics Engineering program
Digital Speech and Audio Coding (EE-719) Lecturer(s): Magimai Doss Mathew, Motlicek Petr
The goal of this course is to introduce the engineering students state-of-the-art speech and audio coding techniques with an emphasis on the integration of knowledge about sound production and auditory perception through signal processing techniques.
Doctoral course at EPFL in the Electrical and Electronics Engineering program
Machine Learning for Engineers (EE-613) Lecturer(s): Calinon Sylvain, Odobez Jean-Marc
The objective of this course is to give an overview of machine learning techniques used for real-world applications, and to teach how to implement and use them in practice. Laboratories will be done in python using jupyter notebooks.
Doctoral course at EPFL in the Electrical and Electronics Engineering program
Deep Learning For Natural Language Processing (EE-608) Lecturer(s): James Henderson
The Deep Learning for NLP course provides an overview of neural network based methods applied to text. The focus is on models particularly suited to the properties of human language, such as categorical, unbounded, and structured representations, and very large input and output vocabularies.
Doctoral course at EPFL in the Electrical and Electronics Engineering program
Thanks to an agreement with EPFL’s EDEE and EDIC Doctoral Programs, we fund and supervise a large number of PhD students. The Institute also hosts international master and intern students. You can find open positions currently available at Idiap on our career page.
Outreach
As part of its educational mission, Idiap also carries out science promotion activities. More info here