TY - JOUR A1 - Stober, Sebastian A1 - Sternin, Avital T1 - Decoding music perception and imagination using deep-learning techniques JF - Signal processing and machine learning for brain-machine interfaces N2 - Deep learning is a sub-field of machine learning that has recently gained substantial popularity in various domains such as computer vision, automatic speech recognition, natural language processing, and bioinformatics. Deep-learning techniques are able to learn complex feature representations from raw signals and thus also have potential to improve signal processing in the context of brain-computer interfaces (BCIs). However, they typically require large amounts of data for training - much more than what can often be provided with reasonable effort when working with brain activity recordings of any kind. In order to still leverage the power of deep-learning techniques with limited available data, special care needs to be taken when designing the BCI task, defining the structure of the deep model, and choosing the training method. This chapter presents example approaches for the specific scenario of music-based brain-computer interaction through electroencephalography - in the hope that these will prove to be valuable in different settings as well. We explain important decisions for the design of the BCI task and their impact on the models and training techniques that can be used. Furthermore, we present and compare various pre-training techniques that aim to improve the signal-to-noise ratio. Finally, we discuss approaches to interpret the trained models. Y1 - 2018 SN - 978-1-78561-399-9 SN - 978-1-78561-398-2 U6 - https://doi.org/10.1049/PBCE114E VL - 114 SP - 271 EP - 299 PB - Institution of Engineering and Technology CY - London ER - TY - JOUR A1 - Bridwell, David A. A1 - Cavanagh, James F. A1 - Collins, Anne G. E. A1 - Nunez, Michael D. A1 - Srinivasan, Ramesh A1 - Stober, Sebastian A1 - Calhoun, Vince D. T1 - Moving Beyond ERP Components BT - a selective review of approaches to integrate EEG and behavior JF - Frontiers in human neuroscienc N2 - Relationships between neuroimaging measures and behavior provide important clues about brain function and cognition in healthy and clinical populations. While electroencephalography (EEG) provides a portable, low cost measure of brain dynamics, it has been somewhat underrepresented in the emerging field of model-based inference. We seek to address this gap in this article by highlighting the utility of linking EEG and behavior, with an emphasis on approaches for EEG analysis that move beyond focusing on peaks or "components" derived from averaging EEG responses across trials and subjects (generating the event-related potential, ERP). First, we review methods for deriving features from EEG in order to enhance the signal within single-trials. These methods include filtering based on user-defined features (i.e., frequency decomposition, time-frequency decomposition), filtering based on data-driven properties (i.e., blind source separation, BSS), and generating more abstract representations of data (e.g., using deep learning). We then review cognitive models which extract latent variables from experimental tasks, including the drift diffusion model (DDM) and reinforcement learning (RL) approaches. Next, we discuss ways to access associations among these measures, including statistical models, data-driven joint models and cognitive joint modeling using hierarchical Bayesian models (HBMs). We think that these methodological tools are likely to contribute to theoretical advancements, and will help inform our understandings of brain dynamics that contribute to moment-to-moment cognitive function. KW - EEG KW - ERP KW - blind source separation KW - partial least squares KW - canonical correlations analysis KW - representational similarity analysis KW - deep learning KW - hierarchical Bayesian model Y1 - 2018 U6 - https://doi.org/10.3389/fnhum.2018.00106 SN - 1662-5161 VL - 12 PB - Frontiers Research Foundation CY - Lausanne ER - TY - GEN A1 - Bridwell, David A. A1 - Cavanagh, James F. A1 - Collins, Anne G. E. A1 - Nunez, Michael D. A1 - Srinivasan, Ramesh A1 - Stober, Sebastian A1 - Calhoun, Vince D. T1 - Moving beyond ERP components BT - a selective review of approaches to integrate EEG and behavior T2 - Postprints der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Relationships between neuroimaging measures and behavior provide important clues about brain function and cognition in healthy and clinical populations. While electroencephalography (EEG) provides a portable, low cost measure of brain dynamics, it has been somewhat underrepresented in the emerging field of model-based inference. We seek to address this gap in this article by highlighting the utility of linking EEG and behavior, with an emphasis on approaches for EEG analysis that move beyond focusing on peaks or "components" derived from averaging EEG responses across trials and subjects (generating the event-related potential, ERP). First, we review methods for deriving features from EEG in order to enhance the signal within single-trials. These methods include filtering based on user-defined features (i.e., frequency decomposition, time-frequency decomposition), filtering based on data-driven properties (i.e., blind source separation, BSS), and generating more abstract representations of data (e.g., using deep learning). We then review cognitive models which extract latent variables from experimental tasks, including the drift diffusion model (DDM) and reinforcement learning (RL) approaches. Next, we discuss ways to access associations among these measures, including statistical models, data-driven joint models and cognitive joint modeling using hierarchical Bayesian models (HBMs). We think that these methodological tools are likely to contribute to theoretical advancements, and will help inform our understandings of brain dynamics that contribute to moment-to-moment cognitive function. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 656 KW - EEG KW - ERP KW - blind source separation KW - partial least squares KW - canonical correlations analysis KW - representational similarity analysis KW - deep learning KW - hierarchical Bayesian model Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-459667 SN - 1866-8364 IS - 656 ER -