Idiap Research Institute
Social Computing Group
Perception and Activity Understanding  Group
Martigny, CH-1920


Google Scholar

Active Project:


MAAYA: Multimedia Analysis and Access for Documentation and Decipherment of Maya Epigraphy


I am awarded the Women in Data Science (WiDS) travel grant for attending the WiDS 2018 conference

We presented 'Eating Routine in Context' (collaborate with Nestle) at the Applied Machine Learning Days workshop, Jan. 2018

Our work is reported in Horizons -Le magazine suisse de la recherche scientifique, pp 48, mars 2017

We presented our MAAYA project at EPFL Open Day 2016

We presented our MAAYA project at Idiap Innovation Day 2016

I am awarded the Alliance of Digital Humanities Organisations (ADHO) bursary award

Our work is reported by Le Temps,

Our work is reported at EPFL front page research news

Our paper is accepted to be published in the Signal Processing Magazine


Short Bio

I am currently a Postdoctoral Researcher at the Idiap Research Institute, supervised by Prof. Daniel Gatica-Perez and Dr. Jean-Marc Odobez. I am also a Scientific Collaborator in the Digital Humantities Institute (DHI) at École Polytechnique Féderale de Lausanne (EPFL). Before joining Idiap, I pursued my PhD degree in the Centre for Vision Speech and Signal Processing (CVSSP) at the University of Surrey, supervised by Dr John Collomosse and Dr Krystian Mikolajczyk.

Research Interest

Computer Vision  & Pattern Recognition
Multimedia Information Retrieval
Digital Humanities


R. Hu, H. Pham, P. Buluschek, and Daniel Gatica-Perez, Elderly Living Alone: Detecting Home Visits with Ambient and Wearable .Sensing. accepted to be published in Multimedia & Health workshop@ ACM Multimedia 2017.
R. Hu, Jean-Marc Odobez, and Daniel Gatica-Perez, Analyzing and Visualizing Ancient Maya HIeroglyphics Using Shape: from Computer Vision to Digital Humanities, accepted to be published in special issue of Digital Scholarship in the Humanities Journal, dedicated to DH2016 at Krakow, 2017. (my Demo)
R. Hu, Jean-Marc Odobez, and Daniel Gatica-Perez, Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation, accepted to be published by ACM Journal on Computing and Cultural Heritage, 2017.
Edgar Roman-Rangel, Gulcan Can, Stephane Marchand-Maillet, Rui Hu, Carlos Pallan Gayol, Guido Krem- pel, Jakub Spotak, Jean-Marc Odobez, and Daniel Gatica-Perez, Transferring Neural Representations for Low-dimensional Indexing of Maya Hieroglyphic Art,3rd Workshop on Computer Vision for Art Analysis, at ECCV 2016.
Darshan Santani, Rui Hu, Daniel Gatica-Perez, InnerView: Learning Place Ambiance from Social Media Images, ACM MM 2016.
R. Hu, Jean-Marc Odobez, and Daniel Gatica-Perez, Assessing a Shape Descriptor for Analysis of Mesoamerican Hieroglyphics: A View Towards Practice in Digital Humanities, accepted as a full paper to be presented at: Digital Humanities, 2016. (project page)
R. Hu, G. Can, C. Pallan Gayol, G. Krempel, J. Spotak, G. Vail, S. Marchand-Maillet, J.-M. Odobez, and D. Gatica-Perez, Multimedia Analysis and Access of Ancient Maya Epigraphy, IEEE Signal Processing Magazine, Special Issue on Signal Processing for Art Investigation, Vol. 32, No. 4, pp. 75-84, Jul. 2015
R. Hu, C. Pallan Gayol, G. Krempel, J.-M. Odobez, and D. Gatica-Perez, Automatic Maya Hieroglyph Retrieval Using Shape and Context Information, in Proc. ACM Int. Conf. on Multimedia (ACM MM), Orlando, Nov. 2014
D. Larlus-Larrondo, R. Hu, C. Saunders, G. Csurka, Image Segmentation Using Hierarchical Unsupervised Segmentation and Hierarchical Classifiers. US Patent, patent number: US 8873812 B2, publication date: Oct. 28 2014.

, J. Collomosse,  Markov Random Fields for Sketch Based Video Retrieval, accepted by ICMR 2013. (PDF)


R. Hu, J. Collomosse, A Performance Evaluation of Gradient Field HOG Descriptor for Sketch Based Image Retrieval, accepted for publication in Computer Vision and Image Understanding. (PDF, project page)

R. Hu, D. Larlus, G. Csurka, On the use of Regions for Semantic Image Segmentation, accepted by the 8th Indian Conference on Vision, Graphics and Image Processing (ICVGIP 2012) as oral (9%). (PDF)
R. Hu
, S. James, J. P. Collomosse, Annotated Free-hand Sketches for Video Retrieval using Object Semantics and Motion, accepted by International Conference on MultiMedia Modeling (MMM 2012). (PDF)
R. Hu, T. Wang and J. Collomosse. A Bag-of-Regions Approach to Sketch Based Image Retrieval. 18th International Conference on Image Processing (ICIP). 2011.  (PDF)
route T. Wang, J. Collomosse, R. Hu, D. Slatter, P. Cheatle and D. Greig. Stylized Ambient Displays of Digital Media Collections.  Computers & Graphics. Elsevier. 54-66, Volume 35, Issue 1, February 2011. (DOI)
sketchimg R. Hu, M. Barnard and J. Collomosse, "Gradient Field Descriptor for Sketch based Retrieval and Localization", accepted by the International Conference on Image Processing (ICIP) 2010. (PDF, DEMO)
R. Hu
and J. Collomosse Motion-sketch based Video Retrieval using a Trellis Levenshtein Levenshtrin Distance, accepted by the International Conference on Pattern Recognition (ICPR) 2010. (PDF)
cvmpT. Wang, A. Mansfield, R. Hu, and J. P. Collomosse, An Evolutionary Approach to Automatic Video Editing, In Proceedings of the 6th European Conference on Visual Media Production (CVMP 2009), Nov. 2009. (PDF, BIB)

R. Hu
, "Free-hand Sketch based image and video retrieval", in Proceedings of ACM International Conference of Multimedia (ACM MM) 2010, Doctoral Symposium.

R.Hu, J.Collomosse, Sketch Based Video Retrieval Using Spatial-Temporal Features, In Proceedings 20th British Machine Vision Conference (BMVC 2009), UK Student Vision Workshop, Sep, 2009.

Previous Publication:

R. Hu, S. Rueger, D. Song, H. Liu, and Z. Huang, Dissimilarity Measures for Content-based Image Retrieval", IEEE International Conference on Multimedia and Expo (ICME), pp. 1365-1368, 2008.

H. Liu, D. Song, S. Rueger, R. Hu, and V. Uren, Comparing Dissimilarity Measures for Content-based Image Retrieval", Asia Information Retrieval Symposium (AIRS), LNCS 4352, pp.44-50, 2008.

S. Overell, A. Llorente, H. Liu, R. Hu, A. Rae, J. Zhu and, S. Rueger, Experiments Combining Different Evidence Sources", to be published in ImageCLEF 2008 workshop.

L. Jiao, R. Hu, W. Zhou, and Y. Gao,  Face Recognition Using Kernel Uncorrelated Discriminant Analysis", 13th International Multimedia Modeling Conference (MMM), LNCS 4352, Part II, pp.415-422, 2007.

Y. Gao, R. Hu, L. Jiao, W. Zhou, and X. Zhang, SAR Occluded Targets Recognition Using SVM", 13th International Multimedia Modeling Conference (MMM), LNCS 4352, Part II, pp.423-432, 2007.

R. Hu, L. Jiao, W. Zhou, and Y. Gao, Remote Sensing Target Recognition Based on Contourlet and Kernel Fisher Discriminant", International Conference on Computational Intelligence and Security (CIS), Part II, pp.1716-1721, 2006.