Main Dataset

This is the main dataset that contains 18 subjects cooking five different recipes (brownies, pizza, sandwich, salad, and scrambled eggs).

The following modalities were recorded:

    • Video:
      (1) Three high spatial resolution (1024 x 768) color video cameras at low temporal resolution (30 Hertz).
      (2) Two low spatial resolution (640 x 480) color video cameras at high temporal resolution (60 Hertz).
      (3) One wearable high spatial resolution (800 x 600 / 1024 x 768) camera at low temporal resolution (30 Hertz).
    • Audio:
      (1) Five balanced microphones.
    • Motion Capture:
      (1) A Vicon motion capture system with 12 infrared MX-40 cameras. Each camera records images at 4 megapixel resolution at 120 Hertz.
    • Internal Measurement Units (IMUs):
      (1) Wired IMUs (3DMGX).
      (2) Bluetooth IMUs (6DOF).
    • Wearable devices:
      (1) BodyMedia.
      (2) eWatch.

    Main Dataset Technical Report

    Download


    This data is free for use in research projects.
    You may include this data in commercially-sold products, but you may not resell this data directly, even in converted form.

Subjects
ALL S07 S08 S09 S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 S21 S22 S23 S24 S25 S28 S29 S30 S31 S32 S33 S34 S35 S36 S37 S40 S41 S47 S48 S49 S50 S51 S52 S53 S54 S55

Recipes
Brownie Eggs Pizza Salad Sandwich


Subject Recipe

Six Cameras
(1 Onboard 5 Static)
Five
Environmental Microphones
Four Wireless IMU's Five Wired IMU's Motion Capture RFID (iBracelet) eWatch BodyMedia
Subject 07
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 08
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 09
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 11
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 12
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 13
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip mocap.zip RFID.zip eWatch.zip Bodymedia.zip
Subject 14
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 15
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 16
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 17
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 18
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 19
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 20
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 21
Brownie
- Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 22
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 23
Brownie
- - - - - RFID.zip - Bodymedia.zip
Subject 24
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - - eWatch.zip -
Subject 25
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip Bodymedia.zip
Subject 28
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 29
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 30
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 31
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 32
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 33
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 34
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 35
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 36
Brownie
Video.zip Mic.zip 6DOFv4.zip - - RFID.zip eWatch.zip -
Subject 37
Brownie
Video.zip Mic.zip 6DOFv4.zip - - RFID.zip eWatch.zip -
Subject 40
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 41
Brownie
Video.zip Mic.zip 6DOFv4.zip - - RFID.zip eWatch.zip -
Subject 47
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 48
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 49
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 50
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip - -
Subject 51
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 53
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 54
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -
Subject 55
Brownie
Video.zip Mic.zip 6DOFv4.zip 3DMGX1.zip - RFID.zip eWatch.zip -

If you wish to obtain the uncompressed images email jkh+mocap@cs.cmu.edu to coordinate shipping us a disk.

Related Dataset: mocap.cs.cmu.edu