Speech & Audio Processing

Speech processing has been one of the mainstays of Idiap’s research portfolio for many years. Today it is still the largest group within the institute, and Idiap continues to be recognised as a leading proponent in the field.

The expertise of the group encompasses statistical automatic speech recognitionbased on hidden Markov models, or hybrid systems exploiting connectionist approaches, text-to-speech, and generic audio processing, covering sound source localization, microphone arrays, speaker diarization, audio indexing, very low bit-rate speech coding, and perceptual background noise analysis for telecommunication systems.

Group News

Challenges in Cross-Lingual Information Retrieval
research — last modified Dec 02, 2020

Prof. Esaú Villatoto Tello, visitor professor at Idiap since September 2019, joins the SARAL project to work on the design of Cross-lingual Information Retrieval tools.

Lei Wang finishes her internship at Idiap
research — last modified Dec 02, 2020

Lei joined Idiap in October 2019 for an internship in the framework of the China Scholarship Council visiting scholar program. During her internship, she worked on neural network-based mappings for single-channel dereverberation and noise reduction.

The first Roxanne field test took place
research — last modified Nov 02, 2020

Roxanne is a EU-funded project that leverages text, speech and video in real-time in order to build tools for combating organized crime.

Idiap at Interspeech 2020
research — last modified Nov 02, 2020

This week Idiap's speech group will be presenting five papers at Interspeech 2020, the largest conference for automatic speech processing. Our papers address a variety of research problems: Pathological speech processing, Multilingual automatic speech recognition, Automatic Speech Recognition for Air Traffic Control management and Speaker recognition.

Group Job Openings

Speech recognition and natural language processing for digital interviews by admin — last modified Oct 16, 2020
In the context of a new Swiss NSF grant, we seek a PhD student to work on speech recognition and natural language processing for digital interviews. The project is a collaboration between the universities of Neuchâtel and Lausanne, and Idiap Research Institute.
Internship position in domain of automatic speech recognition by admin — last modified Jul 10, 2020
The position will be aligned with an European project on automatic speech recognition of air-traffic communication through SESAR Joint Undertaking exploratory research
Postdoc positions in automatic speech recognition by admin — last modified Jul 10, 2020
The Idiap Research Institute seeks qualified candidates for several postdoctoral positions in the field of Deep Learning applied for acoustic, and/or language modeling in Automatic Speech Recognition (ASR).

Current Group Members

BOURLARD, Hervé
(Director, EPFL Full Professor)
- website


GARNER, Philip
(Senior Researcher)
- website


MAGIMAI DOSS, Mathew
(Senior Researcher)
- website


MOTLICEK, Petr
(Senior Researcher)
- website


IMSENG, David
(Research Associate)
- website


KODRASI, Ina
(Research Associate)
- website


MADIKERI, Srikanth
(Research Associate)
- website


PARIDA, Shantipriya
(Postdoctoral Researcher)
- website


PRASAD, Ravi (Shankar)
(Postdoctoral Researcher)
- website


SARFJOO, Saeed (Seyyed)
(Postdoctoral Researcher)
- website


KHOSRAVANI, Abbas
(Postdoctoral Researcher)
- website


ANTONELLO, Niccolò
(Postdoctoral Researcher)
- website


HE, Weipeng
(Postdoctoral Researcher)
- website


KABIL, Selen
(Research Assistant)
- website


VYAS, Apoorv
(Research Assistant)
- website


MARELLI, François
(Research Assistant)
- website


HERMANN, Enno
(Research Assistant)
- website


FRITSCH, Julian (David)
(Research Assistant)
- website


FABIEN, Maël
(Research Assistant)
- website


SCHNELL, Bastian
(Research Assistant)
- website


BITTAR, Alexandre
(Research Assistant)
- website


TORNAY, Sandrine
(Research Assistant)
- website


PRASAD, Amrutha
(Research Assistant)
- website


JANBAKHSHI, Parvaneh
(Research Assistant)
- website


MOSTAANI, Zohreh
(Research Assistant)
- website


ZULUAGA GOMEZ, Juan Pablo
(Research Assistant)
- website


COPPIETERS DE GIBSON, Louise
(Research Assistant)
- website


BRAUN, Rudolf (Arseni)
(Junior Developper)
- website


VILLATORO TELLO, Esaú
(Sabbatical Academic Visitor)
- website


Alumni

  • ABROL, Vinayak
  • AICHINGER, Ida
  • AJMERA, Jitendra
  • ARADILLA ZAPATA, Guillermo
  • ATHINEOS, Marios
  • BABY, Deepak
  • BAHAADINI, Sara
  • BARBER, David
  • BENZEGHIBA, Mohamed (Faouzi)
  • CANDY, Romain
  • CEREKOVIC, Aleksandra
  • CEVHER, Volkan
  • CHAVARRIAGA, Ricardo
  • COLLADO, Thierry
  • CRITTIN, Frank
  • DEY, Subhadeep
  • DIGHE, Pranay
  • DINES, John
  • DRYGAJLO, Andrzej
  • DUFFNER, Stefan
  • GALAN MOLES, Ferran
  • GOMEZ ALANIS, Alejandro
  • GRANDVALET, Yves
  • GRANGIER, David
  • HAGEN, Astrid
  • HAJIBABAEI, Mahdi
  • HALPERN, Bence
  • HERMANSKY, Hynek
  • HONNET, Pierre-Edouard
  • IKBAL, Shajith
  • IVANOVA, Maria
  • JEANNINGROS, Loïc
  • KETABDAR, Hamed
  • KHONGLAH, Banriskhem (Kayang)
  • KRSTULOVIC, Sacha
  • LATHOUD, Guillaume
  • LAZARIDIS, Alexandros
  • LI, Weifeng
  • LOUPI, Dimitra
  • MARIÉTHOZ, Johnny
  • MARTINS, Renato
  • MASSON, Olivier
  • MBANGA NDJOCK, Pierre (Armel)
  • MCCOWAN, Iain
  • MENDOZA, Viviana
  • MILLÁN, José del R.
  • MILLIUS, Loris
  • MOORE, Darren
  • MORRIS, Andrew
  • MOULIN, François
  • MUCKENHIRN, Hannah
  • NALLANTHIGHAL, Venkata Srikanth
  • NATUREL, Xavier
  • PARTHASARATHI, Sree Hari Krishnan
  • PINTO, Francisco
  • POTARD, Blaise
  • RAZAVI, Marzieh
  • SAMUI, Suman
  • SEBASTIAN, Jilt
  • SHAHNAWAZUDDIN, Syed
  • SHAKAS, Alexis
  • SHANKAR, Ravi
  • SHARMA, Shivam
  • SRINIVASAMURTHY, Ajay
  • STEPHENSON, Todd
  • STERPU, George
  • SZASZAK, György
  • TONG, Sibo
  • TYAGI, Vivek
  • ULLMANN, Raphael
  • VALENTE, Fabio
  • VITEK, Radovan
  • VLASENKO, Bogdan
  • WANG, Lei
  • WELLNER, Pierre
  • ZHAN, Qingran

Active Research Grants

Past Research Grants