Pilot Dataset

The pilot dataset contains 4 subjects cooking five different recipes (brownies, pizza, sandwich, salad, and scrambled eggs). Few signals are not available. The following modalities were recorded:

  • Video:
    (1) Three high spatial resolution (1024 x 768) color video cameras at low temporal resolution (30 Hertz).
    (2) Two low spatial resolution (640 x 480) color video cameras at high temporal resolution (60 Hertz).
    (3) One wearable high spatial resolution (800 x 600) camera at low temporal resolution (30 Hertz).
  • Audio:
    (1) Five balanced microphones.
    (2) Wearable watch.
  • Motion Capture:
    (1) A Vicon motion capture system with 12 infrared MX-40 cameras. Each camera records images at 4 megapixel resolution at 120 Hertz.
  • Internal Measurement Units (IMUs):
    (1) Wired IMUs (3DMGX).
  • Wearable devices:
    (1) eWatch.

Pilot Dataset Technical Report

Download


This data is free for use in research projects.
You may include this data in commercially-sold products, but you may not resell this data directly, even in converted form.

Subject Recipe

Five Static Cameras

Wearable Camera

Wearable Microphone

Five Microphones

Five Accelerometers/ Gyroscopes

Motion Capture

Multi-View Video

Subject1 Brownies

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject1 Eggs

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject1 Pizza

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject1 Salad

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject1Sandwich

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject2 Brownies

video.zip

onboard

video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject2 Eggs

video.zip

onboard.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject2 Pizza

video.zip

onboard.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject2 Salad

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject2 Sandwich

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject3 Brownies

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject3 Eggs

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject3 Pizza

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject3 Salad

video.zip

onboard.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject3 Sandwich

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject4 Brownies

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject4 Eggs

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject4 Pizza

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelereometers.zip

mocap.zip

6view.zip

Subject4 Salad

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

Subject4 Sandwich

video.zip

onboard video.zip

onboardMic.zip

audio.zip

accelerometers.zip

mocap.zip

6view.zip

If you wish to obtain the uncompressed images email jkh+mocap@cs.cmu.edu to coordinate shipping us a disk.

Related Dataset: mocap.cs.cmu.edu