# EEG Moments Dataset (EMD)

This is the data repository for the [EEG Moments Dataset (EMD)][paper_emd]. EMD contains EEG responses to 1,102 3-second videos across 6 human subjects. During the EMD experiment, the video stimuli were presented with the corresponding audio track, so as to enable analyses of visual and/or auditory processing of naturalistic dynamic events. Each subject saw the 1,000 video training set 6 times, and the 102 video testing set 24 times. Each video is additionally human-annotated with 15 object labels, 5 scene labels, 5 action labels, 5 sentence text descriptions, 1 spoken transcription, 1 memorability score, and 1 memorability decay rate.

EMD is the EEG companion dataset of the [BOLD Moments Dataset (BMD)][paper_bmd], which consists of fMRI responses for the same 1,102 3-second videos.

EMD additionally contains eye tracking data (gaze and pupil size) collected during the EEG experiment. Note that subjects were instructed to maintain central fixation during the stimulus video presentation.



## 🔍 Overview of contents

The home folder (everything except the `./stimuli` and the `./derivatives/` folders) contains the raw EEG and eye-tracking data in BIDS format before any preprocessing. The eye-tracking data is denoted as `physio` in the corresponding file names. Download this folder if you want to run your own preprocessing pipeline.

The `./stimuli/` folder contains a `.txt` file with instructions to access the video stimuli which, due to copyright permission considerations, must be downloaded separately.

The `./derivatives/` folder contains all data derivatives, including the stimulus metadata (`./derivatives/stimuli_metadata/`), preprocessed EEG data (`./derivatives/eeg/`), and preprocessed eye-tracking data (`./derivatives/eyetracking/`).



## 📝 Data collection notes

### 🧠 Missing EEG data

#### Subject 1

- **Session 3:**
    - **Run 10:** The first EEG video trial is missing, as the EEG recording only starts ~400ms after the onset of the first video trial.

#### Subject 5

- **Session 7:**
    - **Run 16:** The EEG recording only contains the first 64 (out of 66) video trials.

### 👁️ Missing/Bad eye tracking data 

#### Subject 3

- Subject 3 exhibited more substantial eye movements, which are likely the result of calibration difficulties associated with wearing glasses, rather than actual eye movements per se.

#### Subject 4

- **Session 5:**
    - **Run 5:** The eye tracking recording only contains the first 39 (out of 66) video trials.
- **Session 6:**
    - **Run 10:** The eye tracking recording only contains the first 23 (out of 66) video trials.
    - **Run 12:** The eye tracking recording only contains the first 33 (out of 66) video trials.

#### Subject 5

- **Session 6:**
    - **Run 11:** The eye tracking recording only contains the first 50 (out of 66) video trials.



## 💻 Code

The code we used for collecting, preprocessing and analyzing the EEG Moments Dataset (EMD) is available on [GitHub][github].

If you wish to familiarize with EMD's preprocessed EEG and eye tracking data, check out this [interactive Colab tutorial][colab].



## 📧 Contact

For any question regarding the EEG Moments Dataset, you can get in touch with Ale Gifford (alessandro.gifford@gmail.com).



## 📜 Citation

If you use EMD's data, please cite the paper:

> * Gifford AT, Oyarzo P, Zonneveld AW, Sartzetaki C, Groen IIA, Cichy RM. 2026. A large dataset of human EEG responses to short naturalistic videos for studying dynamic visual event processing. _arXiv_. DOI: [https://doi.org/10.48550/arXiv.2608.28768][paper_emd]

If you use EMD's stimuli or stimulus metadata, please also cite the paper:

> * Lahner B, Dwivedi K, Iamshchinina P, Graumann M, Lascelles A, Roig G, Gifford AT, Pan B, Jin S, Murty AR, Kay K, Oliva A, Cichy RM. 2024. Modeling short visual events through the BOLD moments video fMRI dataset and metadata. _Nature Communications_. DOI: [https://doi.org/10.1038/s41467-024-50310-3][paper_bmd]



[paper_emd]: https://doi.org/10.48550/arXiv.2608.28768
[paper_bmd]: https://doi.org/10.1038/s41467-024-50310-3
[github]: https://github.com/gifale95/EMD
[colab]: https://colab.research.google.com/drive/1Z5MDo8yy3sucggLQ4SMETtud2E1igRE9?usp=drive_link