1. head pose tracking data set

The head pose video database contains videos of people in real situations with their head poses continuously annotataed using a device called the "Flock of Birds", a magnetic 3D location and orientation tracker.  The device was well camouflaged behind the user's ear.  Using this setup, two data sets were recorded:  one in an office environment and one in a meeting environment. http://www.idiap.ch/HeadPoseDatabase

2. multiple person tracking data set

This data set consists of video taken from several hours of people walking across a scene.  Between 1 and 4 people appear at at time. The data is annotated with user identity and location as a bounding box. http://mmm.idiap.ch/protected/im2sa/main.html