Perception & Activity Understanding

The research group on the understanding of perception and activity conducts research analyses of human activities from multimodal data.

The analysis of human activities from multimodal data is useful for surveillance, behavior analysis, human–robot interfaces, and multimedia content analysis. This includes investigating the fundamental tasks of scene analysis such as detection, segmentation and tracking of people, their representation, and the characterization of their condition, as well as the modeling of sequential data and their interpretation in the form of gestures, activities, behavior, or social relationships, through the design of sound algorithms which exploit and extend models and methods of computer vision, machine learning, and multimodal data-fusion. Surveillance, traffic analysis, analysis of behavior, human-robot interfaces, and multimedia content analysis are the main application domains.

Group News

Swiss algorithms to help customers in a Finnish shopping mall
research — Sep 08, 2020

Human-robot interactions are often lacking fluidity, especially outside of the lab. Today, researchers from Idiap are publishing in open access the algorithms which allowed a robot to be used in real conditions in a shopping mall in Finland in the framework of the European project Mummer.

Group Job Openings

Several Openings for Cross-Disciplinary Senior Researcher positions by admin — last modified Mar 01, 2021
With the growth of the institute, in addition to increased Federal funding to further support its activities, Idiap is opening several additional permanent senior research scientist positions.

Current Group Members

ODOBEZ, Jean-Marc
(Senior Researcher, EPFL Maître d'enseignement et de recherche)
- website

VILLAMIZAR, Michael (Alejandro)
(Research Associate)
- website

SOUSA EWERTON, Marco (Antonio)
(Postdoctoral Researcher)
- website

RACCA, Mattia
(Postdoctoral Researcher)
- website

(Research Assistant)
- website

(Research Assistant)
- website

(Research Assistant)

GUPTA, Anshul
(Research Assistant)
- website


  • AMINIAN, Bozorgmehr (Nima)
  • BA, Silèye
  • CAN, Gulcan
  • CAO, Yuanzhouhan
  • CHEN, Cheng
  • CHEN, Yiqiang
  • DESPRÈS, Nicolas
  • DUVAL, Matthieu
  • EMONET, Rémi
  • FUNES MORA, Kenneth Alberto
  • GAY, Paul
  • HE, Weipeng
  • HEILI, Alexandre
  • HU, Rui
  • KHALIDOV, Vasil
  • LE, Nam
  • LEFÈVRE, Stéphanie
  • LIU, Gang
  • LOPEZ-MENDEZ, Adolfo
  • MOSTAANI, Zohreh
  • RICCI, Elisa
  • ROMAN RANGEL, Edgar Francisco
  • SHEIKHI, Samira
  • TAVENARD, Romain
  • VARADARAJAN, Jagannadan
  • WU, Di
  • YAO, Jian
  • YU, Yu

Active Research Grants

Past Research Grants