Quality of Life Grand Challenge

Pilot Dataset

The pilot dataset contains 4 subjects cooking five different recipes (brownies, pizza, sandwich, salad, and scrambled eggs). Few signals are not available. The following modalities were recorded:

Video:
(1) Three high spatial resolution (1024 x 768) color video cameras at low temporal resolution (30 Hertz).
(2) Two low spatial resolution (640 x 480) color video cameras at high temporal resolution (60 Hertz).
(3) One wearable high spatial resolution (800 x 600) camera at low temporal resolution (30 Hertz).

Audio:
(1) Five balanced microphones.
(2) Wearable watch.

Motion Capture:
(1) A Vicon motion capture system with 12 infrared MX-40 cameras. Each camera records images at 4 megapixel resolution at 120 Hertz.

Internal Measurement Units (IMUs):
(1) Wired IMUs (3DMGX).

Wearable devices:
(1) eWatch.

Pilot Dataset Technical Report

Download

This data is free for use in research projects.
You may include this data in commercially-sold products, but you may not resell this data directly, even in converted form.

If you wish to obtain the uncompressed images email jkh+mocap@cs.cmu.edu to coordinate shipping us a disk.

This data is free to use for any purpose. If you write a paper using the data, please send an email to jkh+mocap@cs.cmu.edu giving the citation. Please also include the following text in your acknowledgments section:

The data used in this paper was obtained from kitchen.cs.cmu.edu and the data collection was funded in part by the National Science Foundation under Grant No. EEEC-0540865.

Subject Recipe	Five Static Cameras	Wearable Camera	Wearable Microphone	Five Microphones	Five Accelerometers/ Gyroscopes	Motion Capture	Multi-View Video
Subject1 Brownies	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject1 Eggs	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject1 Pizza	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject1 Salad	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject1Sandwich	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject2 Brownies	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject2 Eggs	video.zip	onboard.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject2 Pizza	video.zip	onboard.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject2 Salad	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject2 Sandwich	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject3 Brownies	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject3 Eggs	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject3 Pizza	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject3 Salad	video.zip	onboard.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject3 Sandwich	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject4 Brownies	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject4 Eggs	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject4 Pizza	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelereometers.zip	mocap.zip	6view.zip
Subject4 Salad	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip
Subject4 Sandwich	video.zip	onboard video.zip	onboardMic.zip	audio.zip	accelerometers.zip	mocap.zip	6view.zip