Home


The CMU Multi-Modal Activity Database (CMU-MMAC) database contains multimodal measures of the human activity of subjects performing the tasks involved in cooking and food preparation. The CMU-MMAC database was collected in Carnegie Mellon's Motion Capture Lab. A kitchen was built and to date twenty-five subjects have been recorded cooking five different recipes: brownies, pizza, sandwich, salad, and scrambled eggs.

The following modalities were recorded:

    • VIDEO:
      (1) Three high spatial resolution (1024 x 768) color video cameras at low temporal resolution (30 Hertz).
      (2) Two low spatial resolution (640 x 480) color video cameras at high temporal resolution (60 Hertz).
      (3) One wearable high spatial resolution (800 x 600 / 1024 x 768) camera at low temporal resolution (30 Hertz).

    • AUDIO:
      (1) Five balanced microphones.

    • MOTION CAPTURE:
      (1) A Vicon motion capture system with 12 infrared MX-40 cameras. Each camera records images at 4 megapixel resolution at 120 Hertz.

    • Five wired IMUS (3DMGX - Sampling rate = 125Hz).

    • Four bluetooth IMUS (6DOF - Sampling rate = 62Hz).

    • RFID bracelet (iBracelet)

    There are 3 datasets:

    • Main Dataset: 43 subjects cooking 5 recipes.

    • Anomalous Dataset: Three subjects cooking five recipes. Some anomalous situations occur (fire and smoke, falling dishes, distractions...).

    • Pilot Dataset: First recorded system.


Technical Report


Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database
Download

F. De la Torre, J. Hodgins, J. Montano, S. Valcarcel, A. Bargteil, X. Martin and J. Macey.

Tech. report CMU-RI-TR-08-22, Robotics Institute, Carnegie Mellon University, July, 2009.


Device information

POINT GREY Flea2 Cameras Download | Website
eWatch Download | Website
Behringer Studio condenser microphone Download
SparkFun IMU 6 Degrees of Freedom v4 Download
MicroStrain IMU 3DM-GX1 Download
Intel iBracelet (RFID)Download
Bodymedia BMSDownload

Videos


This video shows different signals while the subject is cooking a salad:


You can download the visual application used to show all the signals and also the video in AVI format here.

This video video has been made with the information provided by the Motion Capture, the subject is cooking scramble eggs:

Download AVI