Data Description
The data has been collected using two smartphones (right arm and left hip), two smartwatches (both wrists) and one motion capture system with 29 markers. There were 4 subjects who prepared 3 recipes (sandwich, fruit salad, cereal) 5 times each. The subjects followed a script for each recipe but acted as naturally as possible.
Important Notice We have updated the dataset, so the file names may have changed. The updated dataset contains timestamps (in milliseconds) for the data. The timestamp indicates the number of milliseconds since the segment started. You can now work with the missing data.
The following is a video example of one recording session during the sandwich recipe.
The following is an example of the motion capture recording.
Data structure
The data has been separated into training data and test data. Training data contains data from 3 subjects and test data contains the fourth subject’s data.
Each recording has been segmented into 30-second segments. Each segment was assigned a random identifier, so the order of the segments is unknown. Each sensor data is stored in a separate file with the segment-id used to identify related files. Each body part is represented by one folder. The following figure illustrates this process.
The training data folder contains five folders: left hip, right arm, right wrist, left wrist and mocap. Each folder contains the same number of files, one per segment. The name of the file identifies the subject and the segment id. The next figure shows the example of segment 9 represented in all five folders.
Remember that the number is random, so the order of the files is not the order of the segments.
The training data contains a labels.txt file. This file contains one row per file, and each row contains the file name, the macro activity and the micro activities all separated by commas. An example of a labels file is shown below showing three rows of the file.
subject1_file_939,fruitsalad,Take,Peel,
subject1_file_264,fruitsalad,Put,Cut,Peel,
subject1_file_975,fruitsalad,Take,Add,Mix,
Test data will become available in March 1st 2020.