The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data
- We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and task-specific reading. The data for the benchmark is based on the Zurich Cognitive Language Processing Corpus (ZuCo 2.0), which provides simultaneous eye-tracking and EEG signals from natural reading of English sentences. The training dataset is publicly available, and we present a newly recorded hidden testset. We provide multiple solid baseline methods for this task and discuss future improvements. We release our code and provide an easy-to-use interface to evaluate new approaches with an accompanying public leaderboard: .
Author details: | Nora Hollenstein, Marius Trondle, Martyna Plomecka, Samuel Kiegeland, Yilmazcan Ozyurt, Lena Ann JägerORCiDGND, Nicolas LangerORCiD |
---|---|
DOI: | https://doi.org/10.3389/fpsyg.2022.1028824 |
ISSN: | 1664-1078 |
Pubmed ID: | https://pubmed.ncbi.nlm.nih.gov/36710838 |
Title of parent work (English): | Frontiers in psychology |
Publisher: | Frontiers Media |
Place of publishing: | Lausanne |
Publication type: | Article |
Language: | English |
Date of first publication: | 2023/01/12 |
Publication year: | 2023 |
Release date: | 2024/06/18 |
Tag: | EEG; cross-subject evaluation; eye-tracking; machine learning; reading research; reading task classification |
Volume: | 13 |
Article number: | 1028824 |
Number of pages: | 20 |
Funding institution: | Swiss National Science Foundation [100014_175875]; German Federal; Ministry of Education and Research [01|S20043]; Swiss National Science; Foundation (SNF) [100014_175875] Funding Source: Swiss National Science; Foundation (SNF) |
Organizational units: | Humanwissenschaftliche Fakultät / Strukturbereich Kognitionswissenschaften / Department Linguistik |
DDC classification: | 1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie |
4 Sprache / 41 Linguistik / 410 Linguistik | |
Peer review: | Referiert |
Publishing method: | Open Access / Gold Open-Access |
DOAJ gelistet | |
License (German): | CC-BY - Namensnennung 4.0 International |