TY - THES A1 - Ziehe, Andreas T1 - Blind source separation based on joint diagonalization of matrices with applications in biomedical signal processing T1 - Blinde Signalquellentrennung beruhend auf simultaner Diagonalisierung von Matrizen mit Anwendungen in der biomedizinischen Signalverarbeitung T1 - Blinde Signalquellentrennung beruhend auf simultaner Diagonalisierung von Matrizen mit Anwendungen in der biomedizinischen Signalverarbeitung N2 - This thesis is concerned with the solution of the blind source separation problem (BSS). The BSS problem occurs frequently in various scientific and technical applications. In essence, it consists in separating meaningful underlying components out of a mixture of a multitude of superimposed signals. In the recent research literature there are two related approaches to the BSS problem: The first is known as Independent Component Analysis (ICA), where the goal is to transform the data such that the components become as independent as possible. The second is based on the notion of diagonality of certain characteristic matrices derived from the data. Here the goal is to transform the matrices such that they become as diagonal as possible. In this thesis we study the latter method of approximate joint diagonalization (AJD) to achieve a solution of the BSS problem. After an introduction to the general setting, the thesis provides an overview on particular choices for the set of target matrices that can be used for BSS by joint diagonalization. As the main contribution of the thesis, new algorithms for approximate joint diagonalization of several matrices with non-orthogonal transformations are developed. These newly developed algorithms will be tested on synthetic benchmark datasets and compared to other previous diagonalization algorithms. Applications of the BSS methods to biomedical signal processing are discussed and exemplified with real-life data sets of multi-channel biomagnetic recordings. N2 - Diese Arbeit befasst sich mit der Lösung des Problems der blinden Signalquellentrennung (BSS). Das BSS Problem tritt häufig in vielen wissenschaftlichen und technischen Anwendungen auf. Im Kern besteht das Problem darin, aus einem Gemisch von überlagerten Signalen die zugrundeliegenden Quellsignale zu extrahieren. In wissenschaftlichen Publikationen zu diesem Thema werden hauptsächlich zwei Lösungsansätze verfolgt: Ein Ansatz ist die sogenannte "Analyse der unabhängigen Komponenten", die zum Ziel hat, eine lineare Transformation V der Daten X zu finden, sodass die Komponenten Un der transformierten Daten U = V X (die sogenannten "independent components") so unabhängig wie möglich sind. Ein anderer Ansatz beruht auf einer simultanen Diagonalisierung mehrerer spezieller Matrizen, die aus den Daten gebildet werden. Diese Möglichkeit der Lösung des Problems der blinden Signalquellentrennung bildet den Schwerpunkt dieser Arbeit. Als Hauptbeitrag der vorliegenden Arbeit präsentieren wir neue Algorithmen zur simultanen Diagonalisierung mehrerer Matrizen mit Hilfe einer nicht-orthogonalen Transformation. Die neu entwickelten Algorithmen werden anhand von numerischen Simulationen getestet und mit bereits bestehenden Diagonalisierungsalgorithmen verglichen. Es zeigt sich, dass unser neues Verfahren sehr effizient und leistungsfähig ist. Schließlich werden Anwendungen der BSS Methoden auf Probleme der biomedizinischen Signalverarbeitung erläutert und anhand von realistischen biomagnetischen Messdaten wird die Nützlichkeit in der explorativen Datenanalyse unter Beweis gestellt. KW - Signaltrennung KW - Mischung KW - Diagonalisierung KW - Bioelektrisches Signal KW - Magnetoencephalographie KW - Elektroencephalographie KW - Signalquellentrennung KW - Matrizen-Eigenwertaufgabe KW - Simultane Diagonalisierung KW - Optimierungsproblem KW - blind source separation KW - BSS KW - ICA KW - independent component analysis KW - approximate joint diagonalization KW - EEG KW - MEG Y1 - 2005 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-5694 ER - TY - JOUR A1 - Wieser, Matthias J. A1 - Hambach, Anna A1 - Weymar, Mathias T1 - Neurophysiological correlates of attentional bias for emotional faces in socially anxious individuals BT - Evidence from a visual search task and N2pc JF - Biological psychology N2 - Visual search paradigms have provided evidence for the enhanced capture of attention by threatening faces. Especially in social anxiety, hypervigilance for threatening faces has been found repeatedly across behavioral paradigms, whose reliability however have been questioned recently. In this EEG study, we sought to determine whether the detection of threat (angry faces) is specifically enhanced in individuals with high (HSA) compared to low social anxiety (LSA). In a visual search paradigm, the N2pc component of the event-related brain potential was measured as an electrophysiological indicator of attentional selection. Twenty-one HSA and twenty-one LSA participants were investigated while searching for threatening or friendly targets within an array of neutral faces, or neutral targets within threatening or friendly distractors. Whereas no differences were found in reaction times, HSA showed significant higher detection rates for angry faces, whereas LSA showed a clear ‘happiness bias’. HSA also showed enhanced N2pc amplitudes in response to emotional facial expressions (angry and happy), indicating a general attentional bias for emotional faces. Overall, the results show that social anxiety may be characterized not only by a spatial attentional bias for threatening faces, but for emotional faces in general. In addition, the results further demonstrate the utility of the N2pc component in capturing subtle attentional biases. KW - N2pc KW - EEG KW - Social anxiety KW - Facial expression KW - Threat Y1 - 2018 U6 - https://doi.org/10.1016/j.biopsycho.2018.01.004 SN - 0301-0511 SN - 1873-6246 VL - 132 SP - 192 EP - 201 PB - Elsevier CY - Amsterdam ER - TY - GEN A1 - Ventura-Bort, Carlos A1 - Wirkner, Janine A1 - Genheimer, Hannah A1 - Wendt, Julia A1 - Hamm, Alfons O. A1 - Weymar, Mathias T1 - Effects of Transcutaneous Vagus Nerve Stimulation (tVNS) on the P300 and Alpha-Amylase Level BT - A Pilot Study T2 - Postprints der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Recent research suggests that the P3b may be closely related to the activation of the locus coeruleus-norepinephrine (LC-NE) system. To further study the potential association, we applied a novel technique, the non-invasive transcutaneous vagus nerve stimulation (tVNS), which is speculated to increase noradrenaline levels. Using a within-subject cross-over design, 20 healthy participants received continuous tVNS and sham stimulation on two consecutive days (stimulation counterbalanced across participants) while performing a visual oddball task. During stimulation, oval non-targets (standard), normal-head (easy) and rotated-head (difficult) targets, as well as novel stimuli (scenes) were presented. As an indirect marker of noradrenergic activation we also collected salivary alpha-amylase (sAA) before and after stimulation. Results showed larger P3b amplitudes for target, relative to standard stimuli, irrespective of stimulation condition. Exploratory post hoc analyses, however, revealed that, in comparison to standard stimuli, easy (but not difficult) targets produced larger P3b (but not P3a) amplitudes during active tVNS, compared to sham stimulation. For sAA levels, although main analyses did not show differential effects of stimulation, direct testing revealed that tVNS (but not sham stimulation) increased sAA levels after stimulation. Additionally, larger differences between tVNS and sham stimulation in P3b magnitudes for easy targets were associated with larger increase in sAA levels after tVNS, but not after sham stimulation. Despite preliminary evidence for a modulatory influence of tVNS on the P3b, which may be partly mediated by activation of the noradrenergic system, additional research in this field is clearly warranted. Future studies need to clarify whether tVNS also facilitates other processes, such as learning and memory, and whether tVNS can be used as therapeutic tool. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 473 KW - EEG KW - P300 KW - tVNS KW - norepinephrine KW - locus coeruleus KW - salivary alpha-amylase Y1 - 2018 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-419259 IS - 473 ER - TY - JOUR A1 - Ventura-Bort, Carlos A1 - Wirkner, Janine A1 - Genheimer, Hannah A1 - Wendt, Julia A1 - Hamm, Alfons O. A1 - Weymar, Mathias T1 - Effects of Transcutaneous Vagus Nerve Stimulation (tVNS) on the P300 and Alpha-Amylase Level BT - A Pilot Study JF - Frontiers in Human Neuroscience N2 - Recent research suggests that the P3b may be closely related to the activation of the locus coeruleus-norepinephrine (LC-NE) system. To further study the potential association, we applied a novel technique, the non-invasive transcutaneous vagus nerve stimulation (tVNS), which is speculated to increase noradrenaline levels. Using a within-subject cross-over design, 20 healthy participants received continuous tVNS and sham stimulation on two consecutive days (stimulation counterbalanced across participants) while performing a visual oddball task. During stimulation, oval non-targets (standard), normal-head (easy) and rotated-head (difficult) targets, as well as novel stimuli (scenes) were presented. As an indirect marker of noradrenergic activation we also collected salivary alpha-amylase (sAA) before and after stimulation. Results showed larger P3b amplitudes for target, relative to standard stimuli, irrespective of stimulation condition. Exploratory post hoc analyses, however, revealed that, in comparison to standard stimuli, easy (but not difficult) targets produced larger P3b (but not P3a) amplitudes during active tVNS, compared to sham stimulation. For sAA levels, although main analyses did not show differential effects of stimulation, direct testing revealed that tVNS (but not sham stimulation) increased sAA levels after stimulation. Additionally, larger differences between tVNS and sham stimulation in P3b magnitudes for easy targets were associated with larger increase in sAA levels after tVNS, but not after sham stimulation. Despite preliminary evidence for a modulatory influence of tVNS on the P3b, which may be partly mediated by activation of the noradrenergic system, additional research in this field is clearly warranted. Future studies need to clarify whether tVNS also facilitates other processes, such as learning and memory, and whether tVNS can be used as therapeutic tool. KW - EEG KW - P300 KW - tVNS KW - norepinephrine KW - locus coeruleus KW - salivary alpha-amylase Y1 - 2018 U6 - https://doi.org/10.3389/fnhum.2018.00202 SN - 1662-5161 VL - 12 SP - 1 EP - 12 PB - Frontiers Research Foundation CY - Lausanne ER - TY - THES A1 - Ventura-Bort, Carlos T1 - Temporo-spatial dynamics of the impact of emotional contexts on visual processing and memory T1 - Zeitlich-räumliche Dynamik der Auswirkungen emotionaler Kontexte auf die visuelle Verarbeitung und das Gedächtnis N2 - It has frequently been observed that single emotional events are not only more efficiently processed, but also better remembered, and form longer-lasting memory traces than neutral material. However, when emotional information is perceived as a part of a complex event, such as in the context of or in relation to other events and/or source details, the modulatory effects of emotion are less clear. The present work aims to investigate how emotional, contextual source information modulates the initial encoding and subsequent long-term retrieval of associated neutral material (item memory) and contextual source details (contextual source memory). To do so, a two-task experiment was used, consisting of an incidental encoding task in which neutral objects were displayed over different contextual background scenes which varied in emotional content (unpleasant, pleasant, and neutral), and a delayed retrieval task (1 week), in which previously-encoded objects and new ones were presented. In a series of studies, behavioral indices (Studies 2, 3, and 5), event-related potentials (ERPs; Studies 1-4), and functional magnetic resonance imaging (Study 5) were used to investigate whether emotional contexts can rapidly tune the visual processing of associated neutral information (Study 1) and modulate long-term item memory (Study 2), how different recognition memory processes (familiarity vs. recollection) contribute to these emotion effects on item and contextual source memory (Study 3), whether the emotional effects of item memory can also be observed during spontaneous retrieval (Sstudy 4), and which brain regions underpin the modulatory effects of emotional contexts on item and contextual source memory (Study 5). In Study 1, it was observed that emotional contexts by means of emotional associative learning, can rapidly alter the processing of associated neutral information. Neutral items associated with emotional contexts (i.e. emotional associates) compared to neutral ones, showed enhanced perceptual and more elaborate processing after one single pairing, as indexed by larger amplitudes in the P100 and LPP components, respectively. Study 2 showed that emotional contexts produce longer-lasting memory effects, as evidenced by better item memory performance and larger ERP Old/New differences for emotional associates. In Study 3, a mnemonic differentiation was observed between item and contextual source memory which was modulated by emotion. Item memory was driven by familiarity, independently of emotional contexts during encoding, whereas contextual source memory was driven by recollection, and better for emotional material. As in Study 2, enhancing effects of emotional contexts for item memory were observed in ERPs associated with recollection processes. Likewise, for contextual source memory, a pronounced recollection-related ERP enhancement was observed for exclusively emotional contexts. Study 4 showed that the long-term recollection enhancement of emotional contexts on item memory can be observed even when retrieval is not explicitly attempted, as measured with ERPs, suggesting that the emotion enhancing effects on memory are not related to the task embedded during recognition, but to the motivational relevance of the triggering event. In Study 5, it was observed that enhancing effects of emotional contexts on item and contextual source memory involve stronger engagement of the brain's regions which are associated with memory recollection, including areas of the medial temporal lobe, posterior parietal cortex, and prefrontal cortex. Taken together, these findings suggest that emotional contexts rapidly modulate the initial processing of associated neutral information and the subsequent, long-term item and contextual source memories. The enhanced memory effects of emotional contexts are strongly supported by recollection rather than familiarity processes, and are shown to be triggered when retrieval is both explicitly and spontaneously attempted. These results provide new insights into the modulatory role of emotional information on the visual processing and the long-term recognition memory of complex events. The present findings are integrated into the current theoretical models and future ventures are discussed. N2 - Es wurde häufig beobachtet, dass einzelne emotionale Ereignisse effizienter verarbeitet und besser erinnert werden und länger anhaltende Gedächtnisspuren bilden als neutrales Material. Wenn jedoch emotionale Informationen als Teil eines komplexen Ereignisses wahrgenommen werden, wie beispielsweise im Kontext oder in Bezug auf andere Ereignisse und/oder Quellendetails, sind die modulierenden Einflüsse von Emotionen weniger klar. Die vorliegende Arbeit zielt darauf ab zu untersuchen, wie emotionale, kontextuelle Quelleninformationen die anfängliche Kodierung und den anschließenden langfristigen Abruf von zugehörigem neutralen Material (Itemgedächtnis) und kontextuellen Quellendetails (Quellengedächtnis) modulieren. Dazu wurde ein Zwei-Aufgaben-Experiment verwendet, bestehend aus einer nicht instruierten Enkodierungsaufgabe, bei der neutrale Objekte eingebettet in verschiedene kontextuelle Hintergrundszenen dargeboten wurden, die in ihrem emotionalen Inhalt variierten (unangenehm, angenehm und neutral), und einer verzögerten Abrufaufgabe (1 Woche), bei der zuvor enkodierte und neue Objekte präsentiert wurden. In einer Reihe von Studien wurden Verhaltensindizes (Studien 2-5), ereigniskorrelierte Potenziale (EKPs; Studien 1-4) und funktionelle Magnetresonanztomographie (Studie 5) verwendet, um zu untersuchen, ob emotionale Kontexte die visuelle Verarbeitung der zugehörigen neutralen Informationen kurzfristig verändern können (Studie 1) und das Langzeitgedächtnis modulieren (Studie 2), wie verschiedene Prozesse des Wiedererkennens (Vertrautheit vs. Rekollektion) zu diesen Emotionseffekten auf das Item- und das kontextuelle Quellengedächtnis beitragen (Studie 3), ob die emotionalen Effekte auf das Itemgedächtnis auch bei der spontanen Abfrage beobachtet werden können (Studie 4) und über welche Hirnregionen die modulierenden Effekte emotionaler Kontexte auf das Item- und kontextuelle Quellengedächtnis vermittelt werden (Studie 5). In Studie 1 wurde beobachtet, dass emotionale Kontexte durch emotionales assoziatives Lernen die Verarbeitung der zugehörigen neutralen Informationen kurzfristig verändern können. Neutrale Elemente, die mit emotionalen Kontexten verbunden sind (im Folgenden „emotional Assoziierte“ genannt), zeigten nach einer einzigen Paarung im Vergleich zu neutralen Elementen eine verbesserte perzeptuelle und elaboriertere Verarbeitung, wie durch höhere Amplituden in den P100- bzw. LPP-Komponenten nachgewiesen wurde. Studie 2 zeigte, dass emotionale Kontexte länger anhaltende Gedächtniseffekte erzeugen, was sich in einer besseren Itemgedächtnisleistung und größeren EKP-alt/neu Unterschieden für emotional Assoziierte zeigte. In Studie 3 wurde eine mnemonische Differenzierung zwischen Item- und kontextuellem Quellengedächtnis beobachtet, die durch Emotionen moduliert wurde. Das Itemgedächtnis wurde durch den Prozess der Vertrautheit getrieben unabhängig von den emotionalen Kontexten während der Enkodierung. Das kontextuelle Quellengedächtnis wurde dagegen durch Rekollektion getrieben und war besser für emotionales Material. Wie in Studie 2 wurden in EKPs, die mit Rekollektionsprozessen in Verbindung stehen, verstärkende Effekte von emotionalen Kontexten für das Itemgedächtnis beobachtet. Ebenso wurde für das kontextuelle Quellengedächtnis eine ausgeprägte Rekollektionsbezogene Potenzierung der EKPs ausschließlich für emotionale Kontexte beobachtet. Studie 4 zeigte, dass die langfristige Verstärkung der Rekollektion, die emotionale Kontexten im Itemgedächtnis verursachen, auch dann beobachtet werden kann, wenn der Abruf nicht explizit instruiert wird. Dieser Befund zum spontanen Erinnern deutet darauf hin, dass die gedächtnissteigernden Effekte von Emotionen nicht mit der Aufgabe zusammenhängen, die während des Abrufs gestellt wurde, sondern mit der motivationalen Relevanz des auslösenden Ereignisses. In Studie 5 wurde beobachtet, dass an der verstärkenden Wirkung von emotionalen Kontexten auf das Item- und kontextuelle Quellengedächtnis solche Hirnregionen beteiligt sind, die mit der Rekollektionsprozessen assoziiert werden, einschließlich der Bereiche des medialen Temporallappens, des posterioren parietalen Kortex und des präfrontalen Kortex. Zusammengenommen deuten diese Ergebnisse darauf hin, dass emotionale Kontexte die anfängliche Verarbeitung der zugehörigen neutralen Informationen und der nachfolgenden, langfristigen Erinnerungen an Items und kontextuelle Quellen schnell modulieren. Die durch emotionaler Kontexte ausgelösten Gedächtniseffekte werden eher durch Rekollektions- und weniger durch Vertrautheitsprozesse vermittelt und zeigen sich sowohl bei expliziten als auch bei spontanen Abruf. Diese Ergebnisse liefern neue Erkenntnisse über die modulierende Rolle emotionaler Informationen bei der visuellen Verarbeitung und der Langzeiterinnerung an komplexe Ereignisse. Die vorliegenden Erkenntnisse werden in aktuelle theoretische Modelle integriert und zukünftige Forschungsperspektiven werden diskutiert. KW - memory KW - fMRI KW - Emotion KW - emotion KW - EEG KW - Gedächtnis KW - EEG KW - fMRT Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-550236 ER - TY - JOUR A1 - Patzwald, Christiane A1 - Matthes, Daniel A1 - Elsner, Birgit T1 - Eighteen-month-olds integrate verbal cues into their action processing BT - evidence from ERPs and mu power JF - Infant behavior & development : an international and interdisciplinary journal N2 - Behavioral research has shown that infants use both behavioral cues and verbal cues when processing the goals of others' actions. For instance, 18-month-olds selectively imitate an observed goal-directed action depending on its (in)congruence with a model's previous verbal announcement of a desired action goal. This EEG-study analyzed the electrophysiological underpinnings of these behavioral findings on the two functional levels of conceptual action processing and motor activation. Mid-latency mean negative ERP amplitude and mu-frequency band power were analyzed while 18-month-olds (N = 38) watched videos of an adult who performed one out of two potential actions on a novel object. In a within-subjects design, the action demonstration was preceded by either a congruent or an incongruent verbally announced action goal (e.g., "up" or "down" and upward movement). Overall, ERP negativity did not differ between conditions, but a closer inspection revealed that in two subgroups, about half of the infants showed a broadly distributed increased mid-latency ERP negativity (indicating enhanced conceptual action processing) for either the congruent or the incongruent stimuli, respectively. As expected, mu power at sensorimotor sites was reduced (indicating enhanced motor activation) for congruent relative to incongruent stimuli in the entire sample. Both EEG correlates were related to infants' language skills. Hence, 18-month-olds integrate action-goal-related verbal cues into their processing of others' actions, at the functional levels of both conceptual processing and motor activation. Further, cue integration when inferring others' action goals is related to infants' language proficiency. KW - EEG KW - infancy KW - social cues KW - verbs KW - action processing KW - social learning KW - event-related potentials (ERPs) KW - Mu power KW - motor activation Y1 - 2020 U6 - https://doi.org/10.1016/j.infbeh.2019.101414 SN - 0163-6383 SN - 1879-0453 VL - 58 PB - Elsevier CY - New York ER - TY - THES A1 - Patzwald, Christiane T1 - Actions through the lens of communicative cues BT - the influence of verbal cues and emotional cues on action processing and action selection in the second year of life N2 - The PhD thesis entitled “Actions through the lens of communicative cues. The influence of verbal cues and emotional cues on action processing and action selection in the second year of life” is based on four studies, which examined the cognitive integration of another person’s communicative cues (i.e., verbal cues, emotional cues) with behavioral cues in 18- and 24-month-olds. In the context of social learning of instrumental actions, it was investigated how the intention-related coherence of either a verbally announced action intention or an emotionally signaled action evaluation with an action demonstration influenced infants’ neuro-cognitive processing (Study I) and selection (Studies II, III, IV) of a novel object-directed action. Developmental research has shown that infants benefit from another’s behavioral cues (e.g., action effect, persistency, selectivity) to infer the underlying goal or intention, respectively, of an observed action (e.g., Cannon & Woodward, 2012; Woodward, 1998). Particularly action effects support infants in distinguishing perceptual action features (e.g., target object identity, movement trajectory, final target object state) from conceptual action features such as goals and intentions. However, less is known about infants’ ability to cognitively integrate another’s behavioral cues with additional action-related communicative cues. There is some evidence showing that in the second year of life, infants selectively imitate a novel action that is verbally (“There!”) or emotionally (positive expression) marked as aligning with the model’s action intention over an action that is verbally (“Whoops!”) or emotionally (negative expression) marked as unintentional (Carpenter, Akhtar, & Tomasello, 1998; Olineck & Poulin-Dubois, 2005, 2009; Repacholi, 2009; Repacholi, Meltzoff, Toub, & Ruba, 2016). Yet, it is currently unclear which role the specific intention-related coherence of a communicative cue with a behavioral cue plays in infants’ action processing and action selection that is, whether the communicative cue confirms, contrasts, clarifies, or is unrelated to the behavioral cue. Notably, by using both verbal cues and emotional cues, we examined not only two domains of communicative cues but also two qualitatively distinct relations between behavioral cues on the one hand and communicative cues on the other hand. More specifically, a verbal cue has the potential to communicate an action intention in the absence of an action demonstration and thus a prior-intention (Searle, 1983), whereas an emotional cue evaluates an ongoing or past action demonstration and thus signals an intention-in-action (Searle, 1983). In a first research focus, this thesis examined infants’ capacity to cognitively integrate another’s intention-related communicative cues and behavioral cues, and also focused on the role of the social cues’ coherence in infants’ action processing and action selection. In a second research focus, and to gain more elaborate insights into how the sub-processes of social learning (attention, encoding, response; cf. Bandura, 1977) are involved in this coherence-sensitive integrative processing, we employed a multi-measures approach. More specifically, we used Electroencephalography (EEG) and looking times to examine how the cues’ coherence influenced the compound of attention and encoding, and imitation (including latencies to first-touch and first-action) to address the compound of encoding and response. Based on the action-reconstruction account (Csibra, 2007), we predicted that infants use extra-motor information (i.e., communicative cues) together with behavioral cues to reconstruct another’s action intention. Accordingly, we expected infants to possess a flexibly organized internal action hierarchy, which they adapt according to the cues’ coherence that is, according to what they inferred to be the overarching action goal. More specifically, in a social-learning situation that comprised an adult model, who demonstrated an action on a novel object that offered two actions, we expected the demonstrated action to lead infants’ action hierarchy when the communicative (i.e., verbal, emotional) cue conveyed similar (confirming coherence) or no additional (un-related coherence) intention-related information relative to the behavioral cue. In terms of action selection, this action hierarchy should become evident in a selective imitation of the demonstrated action. However, when the communicative cue questioned (contrasting coherence) the behaviorally implied action goal or was the only cue conveying meaningful intention-related information (clarifying coherence), the verbally/emotionally intended action should ascend infants’ action hierarchy. Consequently, infants’ action selection should align with the verbally/emotionally intended action (goal emulation). Notably, these predictions oppose the direct-matching perspective (Rizzolatti & Craighero, 2004), according to which the observation of another’s action directly resonates with the observer’s motor repertoire, with this motor resonance enabling the identification of the underlying action goal. Importantly, the direct-matching perspective predicts a rather inflexible action hierarchy inasmuch as the process of goal identification should solely rely on the behavioral cue, irrespective of the behavioral cue’s coherence with extra-motor intention-related information, as it may be conveyed via communicative cues. As to the role of verbal cues, Study I used EEG to examine the influence of a confirming (Congruent) versus contrasting (Incongruent) coherence of a verbal action intention with the same action demonstration on 18-month-olds’ conceptual action processing (as measured via mid-latency mean negative ERP amplitude) and motor activation (as measured via central mu-frequency band power). The action was demonstrated on a novel object that offered two action alternatives from a neutral position. We expected mid-latency ERP negativity to be enhanced in Incongruent compared to Congruent, because past EEG research has demonstrated enhanced conceptual processing for stimuli that mismatched rather than matched the semantic context (Friedrich & Friederici, 2010; Kaduk et al., 2016). Regarding motor activation, Csibra (2007) posited that the identification of a clear action goal constitutes a crucial basis for motor activation to occur. We therefore predicted reduced mu power (indicating enhanced motor activation) for Congruent than Incongruent, because in Congruent, the cues’ match provides unequivocal information about the model’s action goal, whereas in Incongruent, the conflict may render the model’s action goal more unclear. Unexpectedly, in the entire sample, 18-month-olds’ mid-latency ERP negativity during the observation of the same action demonstration did not differ significantly depending on whether this action was congruent or incongruent with the model’s verbal action intention. Yet, post hoc analyses revealed the presence of two subgroups of infants, each of which exhibited significantly different mid-latency ERP negativity for Congruent versus Incongruent, but in opposing directions. The subgroups differed in their productive action-related language skills, with the linguistically more advanced infants exhibiting the expected response pattern of enhanced ERP mean negativity in Incongruent than Congruent, indicating enhanced conceptual processing of an action demonstration that was contrasted rather than confirmed by the verbal action context. As expected, central mu power in the entire sample was reduced in Congruent relative to Incongruent, indicating enhanced motor activation when the action demonstration was preceded by a confirming relative to a contrasting verbal action intention. This finding may indicate the covert preparation for a preferential imitation of the congruent relative to the incongruent action (Filippi et al., 2016; Frey & Gerry, 2006). Overall, these findings are in line with the action-reconstruction account (Csibra, 2007), because they suggest a coherence-sensitive attention to and encoding of the same perceptual features of another’s behavior and thus a cognitive integration of intention-related verbal cues and behavioral cues. Yet, because the subgroup constellation in infants’ ERPs was only discovered post hoc, future research is clearly required to substantiate this finding. Also, future research should validate our interpretation that enhanced motor activation may reflect an electrophysiological marker of subsequent imitation by employing EEG and imitation in a within-subjects design. Study II built on Study I by investigating the impact of coherence of a verbal cue and a behavioral cue on 18- and 24-month-olds’ action selection in an imitation study. When infants of both age groups observed a confirming (Congruent) or unrelated (Pseudo-word: action demonstration was associated with novel verb-like cue) coherence, they selectively imitated the demonstrated action over the not demonstrated, alternative action, with no difference between these two conditions. These findings suggest that, as expected, infants’ action hierarchy was led by the demonstrated action when the verbal cue provided similar (Congruent) or no additional (Pseudo-word) intention-related information relative to a meaningful behavioral cue. These findings support the above-mentioned interpretation that enhanced motor activation during action observation may reflect a covert preparation for imitation (Study I). Interestingly, infants did not seem to benefit from the intention-highlighting effect of the verbal cue in Congruent, suggesting that the verbal cue had an unspecific (e.g., attention-guiding) effect on infants’ action selection. Contrary, when infants observed a contrasting (Incongruent) or clarifying (Failed-attempt: model failed to manipulate the object but verbally announced a certain action intention) coherence, their action selection varied with age and also varied across the course of the experiment (block 1 vs. block 2). More specifically, the 24-month-olds made stronger use of the verbal cue for their action selection in block 1 than did the 18-month-olds. However, while the 18-month-olds’ use of the verbal cue increased across blocks, particularly in Incongruent, the 24-month-olds’ use of the verbal cue decreased across blocks. Overall, these results suggest that, as expected, infants’ action hierarchy in Incongruent (both age groups) and Failed-attempt (only 24-month-olds) drew on the verbal action intention, because in both age groups, infants emulated the verbal intention about as often as they imitated the demonstrated action or even emulated the verbal action intention preferentially. Yet, these findings were confined to certain blocks. It may be argued that the younger age group had a harder time inferring and emulating the intended, yet never observed action, because this requirement is more demanding in cognitive and motor terms. These demands may explain why the 18-month-olds needed some time to take account of the verbal action intention. Contrary, it seems that the 24-month-olds, although demonstrating their principle capacity to take account of the verbal cue in block 1, lost trust in the model’s verbal cue, maybe because the verbal cue did not have predictive value for the model’s actual behavior. Supporting this interpretation, research on selective trust has demonstrated that already infants evaluate another’s reliability or competence, respectively, based on how that model handles familiar objects (behavioral reliability) or labels familiar objects (verbal reliability; for reviews, see Mills, 2013; Poulin-Dubois & Brosseau-Liard, 2016). Relatedly, imitation research has demonstrated that the interpersonal aspects of a social-learning situation gain increasing relevance for infants during the second year of life (Gellén & Buttelmann, 2019; Matheson, Moore, & Akhtar, 2013; Uzgiris, 1981). It may thus be argued that when the 24-month-olds were repeatedly faced with a verbally unreliable model, they de-evaluated the verbal cue as signaling the model’s action intention and instead relied more heavily on alternative cues such as the behavioral cue (Incongruent) or the action context (e.g., object affordances, salience; Failed-attempt). Infants’ first-action latencies were higher in Incongruent and Failed-attempt than in both Congruent and Pseudo-word, and were also higher in Failed-attempt than in Incongruent. These latency-findings thus indicate that situations involving a meaningful verbal cue that deviated from the behavioral cue are cognitively more demanding, resulting in a delayed initiation of a behavioral response. In sum, the findings of Study II suggest that both age groups were highly flexible in their integration of a verbal cue and behavioral cue. Moreover, our results do not indicate a general superiority of either cue. Instead, it seems to depend on the informational gain conveyed by the verbal cue whether it exerts a specific, intention-highlighting effect (Incongruent, Failed-attempt) or an unspecific (e.g., attention-guiding) effect (Congruent, Pseudo-word). Studies III and IV investigated the impact of another’s action-related emotional cues on 18-month-olds’ action selection. In Study III, infants observed a model, who demonstrated two actions on a novel object in direct succession, and who combined one of the two actions with a positive (happy) emotional expression and the other action with a negative (sad) emotional expression. As expected, infants imitated the positively emoted (PE) action more often than the negatively emoted (NE) action. This preference arose from an increase in infants’ readiness to perform the PE action from the baseline period (prior to the action demonstrations) to the test period (following the action demonstrations), rather than from a decrease in readiness to the perform the NE action. The positive cue thus had a stronger behavior-regulating effect than the negative cue. Notably, infants’ more general object-directed behavior in terms of first-touch latencies remained unaffected by the emotional cues’ valence, indicating that infants had linked the emotional cues specifically to the corresponding action and not the object as a whole (Repacholi, 2009). Also, infants’ looking times during the action demonstration did not differ significantly as a function of emotional valence and were characterized by a predominant attentional focus to the action/object rather than to the model’s face. Together with the findings on infants’ first-touch latencies, these results indicate a sensitivity for the notion that emotions can have very specific referents (referential specificity; Martin, Maza, McGrath, & Phelps, 2014). Together, Study III provided evidence for selective imitation based on another’s intention-related (particularly positive) emotional cues in an action-selection task, and thus indicates that infants’ action hierarchy flexibly responds to another’s emotional evaluation of observed actions. According to Repacholi (2009), we suggest that infants used the model’s emotional evaluation to re-appraise the corresponding action (effect), for instance in terms of desirability. Study IV followed up on Study III by investigating the role of the negative emotional cue for infants’ action selection in more detail. Specifically, we investigated whether a contrasting (negative) emotional cue alone would be sufficient to differentially rank the two actions along infants’ action hierarchy or whether instead infants require direct information about the model’s action intention (in the form of a confirming action-emotion pair) to align their action selection with the emotional cues. Also, we examined whether the absence of a direct behavior-regulating effect of the negative cue in Study III was due to the negative cue itself or to the concurrently available positive cue masking the negative cue’s potential effect. To this end, we split the demonstration of the two action-emotion pairs across two trials. In each trial, one action was thus demonstrated and emoted (PE, NE action), and one action was not demonstrated and un-emoted (UE action). For trial 1, we predicted that infants, who observed a PE action demonstration, would selectively imitate the PE action, whereas infants, who observed a NE action demonstration would selectively emulate the UE action. As to trial 2, we expected the complementary action-emotion pair to provide additional clarifying information as the model’s emotional evaluation of both actions, which should either lead to adaptive perseveration (if infants’ action selection in trial 1 had already drawn on the emotional cue) or adaptive change (if infants’ action selection in trial 1 signaled a disregard of the emotional cue). As to trial 1, our findings revealed that, as expected, infants imitated the PE action more often than they emulated the UE action. Like in Study III, this selectivity arose from an increase in infants’ propensity to perform the PE action from baseline to trial 1. Also like in Study III, infants performed the NE action about equally often in baseline and trial 1, which speaks against a direct behavior-regulating effect of the negative cue also when presented in isolation. However, after a NE action demonstration, infants emulated the UE action more often in trial 1 than in baseline, suggesting an indirect behavior-regulating effect of the negative cue. Yet, this indirect effect did not yield a selective emulation of the UE action, because infants performed both action alternatives about equally often in trial 1. Unexpectedly, infants’ action selection in trial 2 was unaffected by the emotional cue. Instead, infants perseverated their action selection of trial 1 in trial 2, irrespective of whether it was adaptive or non-adaptive with respect to the model’s emotional evaluation of the action. It seems that infants changed their strategy across trials, from an initial adherence to the emotional (particularly positive) cue, towards bringing about a salient action effect (Marcovich & Zelazo, 2009). In sum, Studies III and IV indicate a dynamic interplay of different action-selection strategies, depending on valence and presentation order. Apparently, at least in infancy, action reconstruction as one basis for selective action performance reaches its limits when infants can only draw on indirect intention-related information (i.e., which action should be avoided). Overall, our findings favor the action-reconstruction account (Csibra, 2007), according to which actions are flexibly organized along a hierarchy, depending on inferential processes based on extra-motor intention-related information. At the same time, the findings question the direct-matching hypothesis (Rizzolatti & Craighero, 2004), according to which the identification (and pursuit) of action goals hinges on a direct simulation of another’s behavioral cues. Based on the studies’ findings, a preliminary working model is introduced, which seeks to integrate the two theoretical accounts by conceptualizing the routes that activation induced by social cues may take to eventually influence an infant’s action selection. Our findings indicate that it is useful to strive a differentiated conceptualization of communicative cues, because they seem to operate at different places within the process of cue integration, depending on their potential to convey direct intention-related information. Moreover, we suggest that there is bidirectional exchange within each compound of adjacent sub-processes (i.e., between attention and encoding, and encoding and response), and between the compounds. Hence, our findings highlight the benefits of a multi-measures approach when studying the development of infants’ social-cognitive abilities, because it provides a more comprehensive picture how the concerted use of social cues from different domains influences infants’ processing and selection of instrumental actions. Finally, this thesis points to potential future directions to substantiate our current interpretation of the findings.. Moreover, an extension to additional kinds of coherence is suggested to get closer to infants’ everyday-world of experience. KW - infancy KW - social cognition KW - action processing KW - emotions KW - language KW - imitation KW - EEG Y1 - 2020 ER - TY - THES A1 - Metzner, Paul-Philipp T1 - Eye movements and brain responses in natural reading T1 - Blickbewegungen und Hirnströme im natürlichen Lesen N2 - Intuitively, it is clear that neural processes and eye movements in reading are closely connected, but only few studies have investigated both signals simultaneously. Instead, the usual approach is to record them in separate experiments and to subsequently consolidate the results. However, studies using this approach have shown that it is feasible to coregister eye movements and EEG in natural reading and contributed greatly to the understanding of oculomotor processes in reading. The present thesis builds upon that work, assessing to what extent coregistration can be helpful for sentence processing research. In the first study, we explore how well coregistration is suited to study subtle effects common to psycholinguistic experiments by investigating the effect of distance on dependency resolution. The results demonstrate that researchers must improve the signal-to-noise ratio to uncover more subdued effects in coregistration. In the second study, we compare oscillatory responses in different presentation modes. Using robust effects from world knowledge violations, we show that the generation and retrieval of memory traces may differ between natural reading and word-by-word presentation. In the third study, we bridge the gap between our knowledge of behavioral and neural responses to integration difficulties in reading by analyzing the EEG in the context of regressive saccades. We find the P600, a neural indicator of recovery processes, when readers make a regressive saccade in response to integration difficulties. The results in the present thesis demonstrate that coregistration can be a useful tool for the study of sentence processing. However, they also show that it may not be suitable for some questions, especially if they involve subtle effects. N2 - Es erscheint offensichtlich, dass neuronale Prozesse und Blickbewegungen im Lesen eng miteinander verwoben sind, aber nur wenige Studien haben beide Signale simultan betrachtet. Der übliche Ansatz ist, sie stattdessen in separaten Esxperimenten aufzuzeichnen und die Ergebnisse anschließend miteinander zu vereinbaren. Es wurde jedoch bereits gezeigt, dass Blickbewegungen und EEG im natürlichen Lesen koregistriert werden können; Studien, die diesen Ansatzes verfolgen, haben entscheidend zum Verständnis okulomotorischer Prozesse beim Lesen beigetragen. Von diesen Studien ausgehend erörtert die vorliegende Dissertation, inwieweit Koregistrierung auch für Satzverarbeitungsforschung nützlich sein kann. In der ersten Studie wird erörtert, wie gut Koregistrierung für die Erfassung schwacher Effekte geeignet ist, wie sie für psycholinguistische Experimente typisch sind. Die linguistische Fragestellung in dieser Studie ist, wie sich Distanz auf die Auflösung linguistischer Abhängigkeiten auswirkt. Die Ergebnisse verdeutlichen, dass Forscher den Signal-Rausch-Abstand erhöhen müssen, um kleinere Effekte mittels Koregistrierung zu erfassen. In der zweiten Studie werden neuronale Oszillationen in unterschiedlichen Präsentationsformen untersucht. Mithilfe robuster Effekte in Reaktion auf Weltwissensverletzungen wird gezeigt, dass Enkodierung und Abruf von Gedächtnisspuren sich zwischen natürlichem und wortweisem Lesen unterscheidet. In der dritten Studie wird eine Verbindung zwischen behavioralen und elektrophysiologischen Reaktionen auf Integrationsschwierigkeiten im Lesen hergestellt. Hierzu wird das EEG in An- und Abwesenheit regressiver Sakkaden analysiert. Die P600, eine neuronale Reflektion von Reparaturprozessen, ist nur im Kontext von regressiven Sakkaden in Reaktion auf Integrationsschwierigkeiten zu beobachen. Die Ergebnisse der vorliegenden Arbeit demonstrieren, dass Koregistrierung eine vielversprechende Methode für die Satzverarbeitungsforschung ist. Sie zeigen jedoch auch, dass Koregistrierung sich nicht für jede Fragestellung eignet, insbesondere, wenn schwache Effekte zu erwarten sind. KW - natural reading KW - sentence processing KW - eye tracking KW - EEG KW - coregistration KW - dependency resolution KW - neural oscillations KW - regressive saccades KW - natürliches Lesen KW - Satzverarbeitung KW - Blickbewegungen KW - EEG KW - Koregistrierung KW - Abhängigkeitsauflösung KW - neuronale Oszillationen KW - regressive Sakkaden Y1 - 2015 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-82806 ER - TY - JOUR A1 - McLoughlin, Grainne A1 - Palmer, Jason A1 - Makeig, Scott A1 - Bigdely-Shamlo, Nima A1 - Banaschewski, Tobias A1 - Laucht, Manfred A1 - Brandeis, D. T1 - EEG Source Imaging Indices of Cognitive Control Show Associations with Dopamine System Genes JF - Brain Topography N2 - Cognitive or executive control is a critical mental ability, an important marker of mental illness, and among the most heritable of neurocognitive traits. Two candidate genes, catechol-O-methyltransferase (COMT) and DRD4, which both have a roles in the regulation of cortical dopamine, have been consistently associated with cognitive control. Here, we predicted that individuals with the COMT Met/Met allele would show improved response execution and inhibition as indexed by event-related potentials in a Go/NoGo task, while individuals with the DRD4 7-repeat allele would show impaired brain activity. We used independent component analysis (ICA) to separate brain source processes contributing to high-density EEG scalp signals recorded during the task. As expected, individuals with the DRD4 7-repeat polymorphism had reduced parietal P3 source and scalp responses to response (Go) compared to those without the 7-repeat. Contrary to our expectation, the COMT homozygous Met allele was associated with a smaller frontal P3 source and scalp response to response-inhibition (NoGo) stimuli, suggesting that while more dopamine in frontal cortical areas has advantages in some tasks, it may also compromise response inhibition function. An interaction effect emerged for P3 source responses to Go stimuli. These were reduced in those with both the 7-repeat DRD4 allele and either the COMT Val/Val or the Met/Met homozygous polymorphisms but not in those with the heterozygous Val/Met polymorphism. This epistatic interaction between DRD4 and COMT replicates findings that too little or too much dopamine impairs cognitive control. The anatomic and functional separated maximally independent cortical EEG sources proved more informative than scalp channel measures for genetic studies of brain function and thus better elucidate the complex mechanisms in psychiatric illness. KW - EEG KW - Genetics KW - DRD4 KW - COMT KW - ICA KW - Measure projection Y1 - 2017 U6 - https://doi.org/10.1007/s10548-017-0601-z SN - 0896-0267 SN - 1573-6792 VL - 31 IS - 3 SP - 392 EP - 406 PB - Springer CY - Dordrecht ER - TY - JOUR A1 - Kühnpast, Nicole A1 - Gramann, Klaus A1 - Pollatos, Olga T1 - Electrophysiologic evidence for multilevel deficits in emotional face processing in patients with Bulimia Nervosa JF - Psychosomatic medicine N2 - Background: Empirical evidence suggests substantial deficits regarding emotion recognition in bulimia nervosa (BN). The aim of the current study was to investigate electrophysiologic evidence for deficits in emotional face processing in patients with BN. Methods: Event-related potentials were recorded from 13 women with BN and 13 matched healthy controls while viewing neutral, happy, fearful, and angry facial expressions. Participants' recognition performance for emotional faces was tested in a subsequent categorization task. In addition, the degree of alexithymia, depression, and anxiety were assessed via questionnaires. Results: Categorization of emotional faces was hampered in BN (p = .01). Amplitudes of event-related potentials differed during emotional face processing: face-specific N170 amplitudes were less pronounced for angry faces in patients with BN (mean [M] [standard deviation {SD}] = 1.46 [0.56] mu V versus M [SD] = -1.23 [0.61] mu V, p = .02). In contrast, P3 amplitudes were more pronounced in patients with BN as compared with controls (M [SD] = 2.64 [0.46] mu V versus M [SD] = 1.25 [0.39] mu V, p = .04), independent of emotional expression. Conclusions: The study provides novel electrophysiologic data showing that emotional faces are processed differently in patients with BN as compared with healthy controls. We suggest that deficits in early automatic emotion classification in BN are followed by an increased allocation of attentional resources to compensate for those deficits. These findings might contribute to a better understanding of the impaired social functioning in BN. KW - eating disorders KW - bulimia nervosa KW - EEG KW - emotions KW - face recognition KW - N170 KW - N2 KW - P3 Y1 - 2012 U6 - https://doi.org/10.1097/PSY.0b013e31825ca15a SN - 0033-3174 VL - 74 IS - 7 SP - 736 EP - 744 PB - Lippincott Williams & Wilkins CY - Philadelphia ER - TY - GEN A1 - Jeglinski-Mende, Melinda A. A1 - Schmidt, Hendrikje T1 - Psychotherapy in the Framework of Embodied Cognition BT - Does Interpersonal Synchrony Influence Therapy Success? T2 - Postprints der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Mental health problems remain among the main generators of costs within and beyond the health care system. Psychotherapy, the tool of choice in their treatment, is qualified by social interaction, and cooperation within the therapist-patient-dyad. Research into the factors influencing therapy success to date is neither exhaustive nor conclusive. Among many others, the quality of the relationship between therapist and patient stands out regardless of the followed psychotherapy school. Emerging research points to a connection between interpersonal synchronization within the sessions and therapy outcome. Consequently, it can be considered significant for the shaping of this relationship. The framework of Embodied Cognition assumes bodily and neuronal correlates of thinking. Therefore, the present paper reviews investigations on interpersonal, non-verbal synchrony in two domains: firstly, studies on interpersonal synchrony in psychotherapy are reviewed (synchronization of movement). Secondly, findings on neurological correlates of interpersonal synchrony (assessed with EEG, fMRI, fNIRS) are summarized in a narrative manner. In addition, the question is asked whether interpersonal synchrony can be achieved voluntarily on an individual level. It is concluded that there might be mechanisms which could give more insights into therapy success, but as of yet remain uninvestigated. Further, the framework of embodied cognition applies more to the current body of evidence than classical cognitivist views. Nevertheless, deeper research into interpersonal physical and neurological processes utilizing the framework of Embodied Cognition emerges as a possible route of investigation on the road to lower drop-out rates, improved and quality-controlled therapeutic interventions, thereby significantly reducing healthcare costs. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 708 KW - psychotherapy KW - embodied cognition KW - hyperscanning KW - motion energy analysis KW - neurofeedback KW - EEG KW - fMRI KW - fNIRS Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-503162 SN - 1866-8364 IS - 708 ER - TY - JOUR A1 - Jeglinski-Mende, Melinda A. A1 - Schmidt, Hendrikje T1 - Psychotherapy in the Framework of Embodied Cognition BT - Does Interpersonal Synchrony Influence Therapy Success? JF - Frontiers in Psychiatry N2 - Mental health problems remain among the main generators of costs within and beyond the health care system. Psychotherapy, the tool of choice in their treatment, is qualified by social interaction, and cooperation within the therapist-patient-dyad. Research into the factors influencing therapy success to date is neither exhaustive nor conclusive. Among many others, the quality of the relationship between therapist and patient stands out regardless of the followed psychotherapy school. Emerging research points to a connection between interpersonal synchronization within the sessions and therapy outcome. Consequently, it can be considered significant for the shaping of this relationship. The framework of Embodied Cognition assumes bodily and neuronal correlates of thinking. Therefore, the present paper reviews investigations on interpersonal, non-verbal synchrony in two domains: firstly, studies on interpersonal synchrony in psychotherapy are reviewed (synchronization of movement). Secondly, findings on neurological correlates of interpersonal synchrony (assessed with EEG, fMRI, fNIRS) are summarized in a narrative manner. In addition, the question is asked whether interpersonal synchrony can be achieved voluntarily on an individual level. It is concluded that there might be mechanisms which could give more insights into therapy success, but as of yet remain uninvestigated. Further, the framework of embodied cognition applies more to the current body of evidence than classical cognitivist views. Nevertheless, deeper research into interpersonal physical and neurological processes utilizing the framework of Embodied Cognition emerges as a possible route of investigation on the road to lower drop-out rates, improved and quality-controlled therapeutic interventions, thereby significantly reducing healthcare costs. KW - psychotherapy KW - embodied cognition KW - hyperscanning KW - motion energy analysis KW - neurofeedback KW - EEG KW - fMRI KW - fNIRS Y1 - 2021 U6 - https://doi.org/10.3389/fpsyt.2021.562490 SN - 1664-0640 VL - 12 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Hodapp, Alice A1 - Rabovsky, Milena T1 - The N400 ERP component reflects an error-based implicit learning signal during language comprehension JF - European journal of neuroscience N2 - The functional significance of the N400 evoked-response component is still actively debated. An increasing amount of theoretical and computational modelling work is built on the interpretation of the N400 as a prediction error. In neural network modelling work, it was proposed that the N400 component can be interpreted as the change in a probabilistic representation of meaning that drives the continuous adaptation of an internal model of the statistics of the environment. These results imply that increased N400 amplitudes should correspond to greater adaptation, which can be measured via implicit memory. To investigate this model derived hypothesis, the current study manipulated expectancy in a sentence reading task to influence N400 amplitudes and subsequently presented the previously expected vs. unexpected words in a perceptual identification task to measure implicit memory. As predicted, reaction times in the perceptual identification task were significantly faster for previously unexpected words that induced larger N400 amplitudes in the previous sentence reading task. Additionally, it could be demonstrated that this adaptation seems to specifically depend on the process underlying N400 amplitudes, as participants with larger N400 differences during sentence reading also exhibited a larger implicit memory benefit in the perceptual identification task. These findings support the interpretation of the N400 as an implicit learning signal driving adaptation in language processing. KW - adaptation KW - EEG KW - expectancy KW - implicit learning KW - prediction error Y1 - 2021 U6 - https://doi.org/10.1111/ejn.15462 SN - 0953-816X SN - 1460-9568 VL - 54 IS - 9 SP - 7125 EP - 7140 PB - Wiley CY - Oxford ER - TY - JOUR A1 - Gebel, Arnd A1 - Lehmann, Tim A1 - Granacher, Urs T1 - Balance task difficulty affects postural sway and cortical activity in healthy adolescents JF - Experimental brain research N2 - Electroencephalographic (EEG) research indicates changes in adults' low frequency bands of frontoparietal brain areas executing different balance tasks with increasing postural demands. However, this issue is unsolved for adolescents when performing the same balance task with increasing difficulty. Therefore, we examined the effects of a progressively increasing balance task difficulty on balance performance and brain activity in adolescents. Thirteen healthy adolescents aged 16-17 year performed tests in bipedal upright stance on a balance board with six progressively increasing levels of task difficulty. Postural sway and cortical activity were recorded simultaneously using a pressure sensitive measuring system and EEG. The power spectrum was analyzed for theta (4-7 Hz) and alpha-2 (10-12 Hz) frequency bands in pre-defined frontal, central, and parietal clusters of electrocortical sources. Repeated measures analysis of variance (rmANOVA) showed a significant main effect of task difficulty for postural sway (p < 0.001; d = 6.36). Concomitantly, the power spectrum changed in frontal, bilateral central, and bilateral parietal clusters. RmANOVAs revealed significant main effects of task difficulty for theta band power in the frontal (p < 0.001, d = 1.80) and both central clusters (left: p < 0.001, d = 1.49; right: p < 0.001, d = 1.42) as well as for alpha-2 band power in both parietal clusters (left: p < 0.001, d = 1.39; right: p < 0.001, d = 1.05) and in the central right cluster (p = 0.005, d = 0.92). Increases in theta band power (frontal, central) and decreases in alpha-2 power (central, parietal) with increasing balance task difficulty may reflect increased attentional processes and/or error monitoring as well as increased sensory information processing due to increasing postural demands. In general, our findings are mostly in agreement with studies conducted in adults. Similar to adult studies, our data with adolescents indicated the involvement of frontoparietal brain areas in the regulation of postural control. In addition, we detected that activity of selected brain areas (e.g., bilateral central) changed with increasing postural demands. KW - balance KW - postural control KW - EEG KW - Theta KW - Alpha-2 KW - ICA KW - youth Y1 - 2020 U6 - https://doi.org/10.1007/s00221-020-05810-1 SN - 0014-4819 SN - 1432-1106 VL - 238 IS - 5 SP - 1323 EP - 1333 PB - Springer CY - New York ER - TY - GEN A1 - Gebel, Arnd A1 - Busch, Aglaja A1 - Stelzel, Christine A1 - Hortobágyi, Tibor A1 - Granacher, Urs T1 - Effects of Physical and Mental Fatigue on Postural Sway and Cortical Activity in Healthy Young Adults T2 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Physical fatigue (PF) negatively affects postural control, resulting in impaired balance performance in young and older adults. Similar effects on postural control can be observed for mental fatigue (MF) mainly in older adults. Controversial results exist for young adults. There is a void in the literature on the effects of fatigue on balance and cortical activity. Therefore, this study aimed to examine the acute effects of PF and MF on postural sway and cortical activity. Fifteen healthy young adults aged 28 ± 3 years participated in this study. MF and PF protocols comprising of an all-out repeated sit-to-stand task and a computer-based attention network test, respectively, were applied in random order. Pre and post fatigue, cortical activity and postural sway (i.e., center of pressure displacements [CoPd], velocity [CoPv], and CoP variability [CV CoPd, CV CoPv]) were tested during a challenging bipedal balance board task. Absolute spectral power was calculated for theta (4–7.5 Hz), alpha-2 (10.5–12.5 Hz), beta-1 (13–18 Hz), and beta-2 (18.5–25 Hz) in frontal, central, and parietal regions of interest (ROI) and baseline-normalized. Inference statistics revealed a significant time-by-fatigue interaction for CoPd (p = 0.009, d = 0.39, Δ 9.2%) and CoPv (p = 0.009, d = 0.36, Δ 9.2%), and a significant main effect of time for CoP variability (CV CoPd: p = 0.001, d = 0.84; CV CoPv: p = 0.05, d = 0.62). Post hoc analyses showed a significant increase in CoPd (p = 0.002, d = 1.03) and CoPv (p = 0.003, d = 1.03) following PF but not MF. For cortical activity, a significant time-by-fatigue interaction was found for relative alpha-2 power in parietal (p < 0.001, d = 0.06) areas. Post hoc tests indicated larger alpha-2 power increases after PF (p < 0.001, d = 1.69, Δ 3.9%) compared to MF (p = 0.001, d = 1.03, Δ 2.5%). In addition, changes in parietal alpha-2 power and measures of postural sway did not correlate significantly, irrespective of the applied fatigue protocol. No significant changes were found for the other frequency bands, irrespective of the fatigue protocol and ROI under investigation. Thus, the applied PF protocol resulted in increased postural sway (CoPd and CoPv) and CoP variability accompanied by enhanced alpha-2 power in the parietal ROI while MF led to increased CoP variability and alpha-2 power in our sample of young adults. Potential underlying cortical mechanisms responsible for the greater increase in parietal alpha-2 power after PF were discussed but could not be clearly identified as cause. Therefore, further future research is needed to decipher alternative interpretations. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 793 KW - balance KW - cognitive/muscular fatigue KW - EEG KW - theta KW - alpha-2 Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-564419 SN - 1866-8364 SP - 1 EP - 14 PB - Universitätsverlag Potsdam CY - Potsdam ER - TY - JOUR A1 - Gebel, Arnd A1 - Busch, Aglaja A1 - Stelzel, Christine A1 - Hortobágyi, Tibor A1 - Granacher, Urs T1 - Effects of Physical and Mental Fatigue on Postural Sway and Cortical Activity in Healthy Young Adults JF - Frontiers in Human Neuroscience N2 - Physical fatigue (PF) negatively affects postural control, resulting in impaired balance performance in young and older adults. Similar effects on postural control can be observed for mental fatigue (MF) mainly in older adults. Controversial results exist for young adults. There is a void in the literature on the effects of fatigue on balance and cortical activity. Therefore, this study aimed to examine the acute effects of PF and MF on postural sway and cortical activity. Fifteen healthy young adults aged 28 ± 3 years participated in this study. MF and PF protocols comprising of an all-out repeated sit-to-stand task and a computer-based attention network test, respectively, were applied in random order. Pre and post fatigue, cortical activity and postural sway (i.e., center of pressure displacements [CoPd], velocity [CoPv], and CoP variability [CV CoPd, CV CoPv]) were tested during a challenging bipedal balance board task. Absolute spectral power was calculated for theta (4–7.5 Hz), alpha-2 (10.5–12.5 Hz), beta-1 (13–18 Hz), and beta-2 (18.5–25 Hz) in frontal, central, and parietal regions of interest (ROI) and baseline-normalized. Inference statistics revealed a significant time-by-fatigue interaction for CoPd (p = 0.009, d = 0.39, Δ 9.2%) and CoPv (p = 0.009, d = 0.36, Δ 9.2%), and a significant main effect of time for CoP variability (CV CoPd: p = 0.001, d = 0.84; CV CoPv: p = 0.05, d = 0.62). Post hoc analyses showed a significant increase in CoPd (p = 0.002, d = 1.03) and CoPv (p = 0.003, d = 1.03) following PF but not MF. For cortical activity, a significant time-by-fatigue interaction was found for relative alpha-2 power in parietal (p < 0.001, d = 0.06) areas. Post hoc tests indicated larger alpha-2 power increases after PF (p < 0.001, d = 1.69, Δ 3.9%) compared to MF (p = 0.001, d = 1.03, Δ 2.5%). In addition, changes in parietal alpha-2 power and measures of postural sway did not correlate significantly, irrespective of the applied fatigue protocol. No significant changes were found for the other frequency bands, irrespective of the fatigue protocol and ROI under investigation. Thus, the applied PF protocol resulted in increased postural sway (CoPd and CoPv) and CoP variability accompanied by enhanced alpha-2 power in the parietal ROI while MF led to increased CoP variability and alpha-2 power in our sample of young adults. Potential underlying cortical mechanisms responsible for the greater increase in parietal alpha-2 power after PF were discussed but could not be clearly identified as cause. Therefore, further future research is needed to decipher alternative interpretations. KW - balance KW - cognitive/muscular fatigue KW - EEG KW - theta KW - alpha-2 Y1 - 2022 U6 - https://doi.org/10.3389/fnhum.2022.871930 SN - 1662-5161 VL - 16 SP - 1 EP - 14 PB - Frontiers Media S.A. CY - Lausanne, Schweiz ER - TY - JOUR A1 - Fargier, Raphael A1 - Bürki-Foschini, Audrey Damaris A1 - Pinet, Svetlana A1 - Alario, F. -Xavier A1 - Laganaro, Marina T1 - Word onset phonetic properties and motor artifacts in speech production EEG recordings JF - Psychophysiology : journal of the Society for Psychophysiological Research N2 - Electrophysiological research using verbal response paradigms faces the problem of muscle artifacts that occur during speech production or in the period preceding articulation. In this context, this paper has two related aims. The first is to show how the nature of the first phoneme influences the alignment of the ERPs. The second is to further characterize the EEG signal around the onset of articulation, both in temporal and frequency domains. Participants were asked to name aloud pictures of common objects. We applied microstate analyses and time-frequency transformations of ERPs locked to vocal onset to compare the EEG signal between voiced and unvoiced labial plosive word onset consonants. We found a delay of about 40 ms in the set of stable topographic patterns for /b/ relative to /p/ onset words. A similar shift was observed in the power increase of gamma oscillations (30-50 Hz), which had an earlier onset for /p/ trials (similar to 150 ms before vocal onset). This 40-ms shift is consistent with the length of the voiced proportion of the acoustic signal prior to the release of the closure in the vocal responses. These results demonstrate that phonetic features are an important parameter affecting response-locked ERPs, and hence that the onset of the acoustic energy may not be an optimal trigger for synchronizing the EEG activity to the response in vocal paradigms. The indexes explored in this study provide a step forward in the characterization of muscle-related artifacts in electrophysiological studies of speech and language production. KW - EEG KW - motor artifact KW - phonetics KW - picture naming KW - speech production Y1 - 2017 U6 - https://doi.org/10.1111/psyp.12982 SN - 0048-5772 SN - 1469-8986 VL - 55 IS - 2 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Dornhege, Guido A1 - Blankertz, Benjamin A1 - Krauledat, Matthias A1 - Losch, Florian A1 - Curio, Gabriel A1 - Müller, Klaus-Robert T1 - Combined optimization of spatial and temporal filters for improving brain-computer interfacing JF - IEEE transactions on bio-medical electronics N2 - Brain-computer interface (BCI) systems create a novel communication channel from the brain to an output de ice by bypassing conventional motor output pathways of nerves and muscles. Therefore they could provide a new communication and control option for paralyzed patients. Modern BCI technology is essentially based on techniques for the classification of single-trial brain signals. Here we present a novel technique that allows the simultaneous optimization of a spatial and a spectral filter enhancing discriminability rates of multichannel EEG single-trials. The evaluation of 60 experiments involving 22 different subjects demonstrates the significant superiority of the proposed algorithm over to its classical counterpart: the median classification error rate was decreased by 11%. Apart from the enhanced classification, the spatial and/or the spectral filter that are determined by the algorithm can also be used for further analysis of the data, e.g., for source localization of the respective brain rhythms. KW - brain-computer interface KW - common spatial patterns KW - EEG KW - event-related desynchronization KW - single-trial-analysis Y1 - 2006 U6 - https://doi.org/10.1109/TBME.2006.883649 SN - 0018-9294 VL - 53 IS - 11 SP - 2274 EP - 2281 PB - IEEE CY - New York ER - TY - THES A1 - Dornhege, Guido T1 - Increasing information transfer rates for brain-computer interfacing T1 - Erhöhung der Informationstransferrate einer Gehirn-Computer-Schnittstelle N2 - The goal of a Brain-Computer Interface (BCI) consists of the development of a unidirectional interface between a human and a computer to allow control of a device only via brain signals. While the BCI systems of almost all other groups require the user to be trained over several weeks or even months, the group of Prof. Dr. Klaus-Robert Müller in Berlin and Potsdam, which I belong to, was one of the first research groups in this field which used machine learning techniques on a large scale. The adaptivity of the processing system to the individual brain patterns of the subject confers huge advantages for the user. Thus BCI research is considered a hot topic in machine learning and computer science. It requires interdisciplinary cooperation between disparate fields such as neuroscience, since only by combining machine learning and signal processing techniques based on neurophysiological knowledge will the largest progress be made. In this work I particularly deal with my part of this project, which lies mainly in the area of computer science. I have considered the following three main points: Establishing a performance measure based on information theory: I have critically illuminated the assumptions of Shannon's information transfer rate for application in a BCI context. By establishing suitable coding strategies I was able to show that this theoretical measure approximates quite well to what is practically achieveable. Transfer and development of suitable signal processing and machine learning techniques: One substantial component of my work was to develop several machine learning and signal processing algorithms to improve the efficiency of a BCI. Based on the neurophysiological knowledge that several independent EEG features can be observed for some mental states, I have developed a method for combining different and maybe independent features which improved performance. In some cases the performance of the combination algorithm outperforms the best single performance by more than 50 %. Furthermore, I have theoretically and practically addressed via the development of suitable algorithms the question of the optimal number of classes which should be used for a BCI. It transpired that with BCI performances reported so far, three or four different mental states are optimal. For another extension I have combined ideas from signal processing with those of machine learning since a high gain can be achieved if the temporal filtering, i.e., the choice of frequency bands, is automatically adapted to each subject individually. Implementation of the Berlin brain computer interface and realization of suitable experiments: Finally a further substantial component of my work was to realize an online BCI system which includes the developed methods, but is also flexible enough to allow the simple realization of new algorithms and ideas. So far, bitrates of up to 40 bits per minute have been achieved with this system by absolutely untrained users which, compared to results of other groups, is highly successful. N2 - Ein Brain-Computer Interface (BCI) ist eine unidirektionale Schnittstelle zwischen Mensch und Computer, bei der ein Mensch in der Lage ist, ein Gerät einzig und allein Kraft seiner Gehirnsignale zu steuern. In den BCI Systemen fast aller Forschergruppen wird der Mensch in Experimenten über Wochen oder sogar Monaten trainiert, geeignete Signale zu produzieren, die vordefinierten allgemeinen Gehirnmustern entsprechen. Die BCI Gruppe in Berlin und Potsdam, der ich angehöre, war in diesem Feld eine der ersten, die erkannt hat, dass eine Anpassung des Verarbeitungssystems an den Menschen mit Hilfe der Techniken des Maschinellen Lernens große Vorteile mit sich bringt. In unserer Gruppe und mittlerweile auch in vielen anderen Gruppen wird BCI somit als aktuelles Forschungsthema im Maschinellen Lernen und folglich in der Informatik mit interdisziplinärer Natur in Neurowissenschaften und anderen Feldern verstanden, da durch die geeignete Kombination von Techniken des Maschinellen Lernens und der Signalverarbeitung basierend auf neurophysiologischem Wissen der größte Erfolg erzielt werden konnte. In dieser Arbeit gehe ich auf meinem Anteil an diesem Projekt ein, der vor allem im Informatikbereich der BCI Forschung liegt. Im Detail beschäftige ich mich mit den folgenden drei Punkten: Diskussion eines informationstheoretischen Maßes für die Güte eines BCI's: Ich habe kritisch die Annahmen von Shannon's Informationsübertragungsrate für die Anwendung im BCI Kontext beleuchtet. Durch Ermittlung von geeigneten Kodierungsstrategien konnte ich zeigen, dass dieses theoretische Maß den praktisch erreichbaren Wert ziemlich gut annähert. Transfer und Entwicklung von geeigneten Techniken aus dem Bereich der Signalverarbeitung und des Maschinellen Lernens: Eine substantielle Komponente meiner Arbeit war die Entwicklung von Techniken des Machinellen Lernens und der Signalverarbeitung, um die Effizienz eines BCI's zu erhöhen. Basierend auf dem neurophysiologischem Wissen, dass verschiedene unabhängige Merkmale in Gehirnsignalen für verschiedene mentale Zustände beobachtbar sind, habe ich eine Methode zur Kombination von verschiedenen und unter Umständen unabhängigen Merkmalen entwickelt, die sehr erfolgreich die Fähigkeiten eines BCI's verbessert. Besonders in einigen Fällen übertraf die Leistung des entwickelten Kombinationsalgorithmus die beste Leistung auf den einzelnen Merkmalen mit mehr als 50 %. Weiterhin habe ich theoretisch und praktisch durch Einführung geeigneter Algorithmen die Frage untersucht, wie viele Klassen man für ein BCI nutzen kann und sollte. Auch hier wurde ein relevantes Resultat erzielt, nämlich dass für BCI Güten, die bis heute berichtet sind, die Benutzung von 3 oder 4 verschiedenen mentalen Zuständen in der Regel optimal im Sinne von erreichbarer Leistung sind. Für eine andere Erweiterung wurden Ideen aus der Signalverarbeitung mit denen des Maschinellen Lernens kombiniert, da ein hoher Erfolg erzielt werden kann, wenn der temporale Filter, d.h. die Wahl des benutzten Frequenzbandes, automatisch und individuell für jeden Menschen angepasst wird. Implementation des Berlin Brain-Computer Interfaces und Realisierung von geeigneten Experimenten: Eine weitere wichtige Komponente meiner Arbeit war eine Realisierung eines online BCI Systems, welches die entwickelten Methoden umfasst, aber auch so flexibel ist, dass neue Algorithmen und Ideen einfach zu verwirklichen sind. Bis jetzt wurden mit diesem System Bitraten von bis zu 40 Bits pro Minute von absolut untrainierten Personen in ihren ersten BCI Experimenten erzielt. Dieses Resultat übertrifft die bisher berichteten Ergebnisse aller anderer BCI Gruppen deutlich.
Bemerkung: Der Autor wurde mit dem Michelson-Preis 2005/2006 für die beste Promotion des Jahrgangs der Mathematisch-Naturwissenschaftlichen Fakultät der Universität Potsdam ausgezeichnet. KW - Kybernetik KW - Maschinelles Lernen KW - Gehirn-Computer-Schnittstelle KW - BCI KW - EEG KW - Spatio-Spectral Filter KW - Feedback KW - Multi-Class KW - Classification KW - Signal Processing KW - Brain Computer Interface KW - Information Transfer Rate KW - Machine Learning KW - Single Trial Analysis KW - Feature Combination KW - Common Spatial Pattern Y1 - 2006 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-7690 ER - TY - JOUR A1 - Dimigen, Olaf A1 - Sommer, Werner A1 - Hohlfeld, Annette A1 - Jacobs, Arthur M. A1 - Kliegl, Reinhold T1 - Coregistration of eye movements and EEG in natural reading analyses and review JF - Journal of experimental psychology : General N2 - Brain-electric correlates of reading have traditionally been studied with word-by-word presentation, a condition that eliminates important aspects of the normal reading process and precludes direct comparisons between neural activity and oculomotor behavior. In the present study, we investigated effects of word predictability on eye movements (EM) and fixation-related brain potentials (FRPs) during natural sentence reading. Electroencephalogram (EEG) and EM (via video-based eye tracking) were recorded simultaneously while subjects read heterogeneous German sentences, moving their eyes freely over the text. FRPs were time-locked to first-pass reading fixations and analyzed according to the cloze probability of the currently fixated word. We replicated robust effects of word predictability on EMs and the N400 component in FRPs. The data were then used to model the relation among fixation duration, gaze duration, and N400 amplitude, and to trace the time course of EEG effects relative to effects in EM behavior. In an extended Methodological Discussion section, we review 4 technical and data-analytical problems that need to be addressed when FRPs are recorded in free-viewing situations (such as reading, visual search, or scene perception) and propose solutions. Results suggest that EEG recordings during normal vision are feasible and useful to consolidate findings from EEG and eye-tracking studies. KW - EEG KW - eye tracking KW - fixation-related potentials KW - artifact correction KW - natural viewing Y1 - 2011 U6 - https://doi.org/10.1037/a0023885 SN - 0096-3445 VL - 140 IS - 4 SP - 552 EP - 572 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Dimigen, Olaf A1 - Kliegl, Reinhold A1 - Sommer, Werner T1 - Trans-saccadic parafoveal preview benefits in fluent reading: A study with fixation-related brain potentials JF - NeuroImage : a journal of brain function N2 - During natural reading, a parafoveal preview of the upcoming word facilitates its subsequent recognition (e.g., shorter fixation durations compared to masked preview) but nothing is known about the neural correlates of this so-called preview benefit. Furthermore, while the evidence is strong that readers preprocess orthographic features of upcoming words, it is controversial whether word meaning can also be accessed parafoveally. We investigated the timing, scope, and electrophysiological correlates of parafoveal information use in reading by simultaneously recording eye movements and fixation-related brain potentials (FRPs) while participants read word lists fluently from left to right. For one word the target (e.g., "blade") parafoveal information was manipulated by showing an identical ("blade"), semantically related ("knife"), or unrelated ("sugar") word as preview. In boundary trials, the preview was shown parafoveally but changed to the correct target word during the incoming saccade. Replicating classic findings, target words were fixated shorter after identical previews. In the EEG, this benefit was reflected in an occipitotemporal preview positivity between 200 and 280 ms. In contrast, there was no facilitation from related previews. In parafoveal-on-foveal trials, preview and target were embedded at neighboring list positions without a display change. Consecutive fixation of two related words produced N400 priming effects, but only shortly (160 ms) after the second word was directly fixated. Results demonstrate that neural responses to words are substantially altered by parafoveal preprocessing under normal reading conditions. We found no evidence that word meaning contributes to these effects. Saccade-contingent display manipulations can be combined with EEG recordings to study extrafoveal perception in vision. KW - EEG KW - Eye tracking KW - Active vision KW - Eye-fixation-related potentials (EFRP) KW - Parafoveal vision KW - Boundary technique Y1 - 2012 U6 - https://doi.org/10.1016/j.neuroimage.2012.04.006 SN - 1053-8119 SN - 1095-9572 VL - 62 IS - 1 SP - 381 EP - 393 PB - Elsevier CY - San Diego ER - TY - BOOK A1 - Dambacher, Michael T1 - Bottom-up and top-down processes in reading : influences of frequency and predictability on event-related potentials and eye movements N2 - In reading, word frequency is commonly regarded as the major bottom-up determinant for the speed of lexical access. Moreover, language processing depends on top-down information, such as the predictability of a word from a previous context. Yet, however, the exact role of top-down predictions in visual word recognition is poorly understood: They may rapidly affect lexical processes, or alternatively, influence only late post-lexical stages. To add evidence about the nature of top-down processes and their relation to bottom-up information in the timeline of word recognition, we examined influences of frequency and predictability on event-related potentials (ERPs) in several sentence reading studies. The results were related to eye movements from natural reading as well as to models of word recognition. As a first and major finding, interactions of frequency and predictability on ERP amplitudes consistently revealed top-down influences on lexical levels of word processing (Chapters 2 and 4). Second, frequency and predictability mediated relations between N400 amplitudes and fixation durations, pointing to their sensitivity to a common stage of word recognition; further, larger N400 amplitudes entailed longer fixation durations on the next word, a result providing evidence for ongoing processing beyond a fixation (Chapter 3). Third, influences of presentation rate on ERP frequency and predictability effects demonstrated that the time available for word processing critically co-determines the course of bottom-up and top-down influences (Chapter 4). Fourth, at a near-normal reading speed, an early predictability effect suggested the rapid comparison of top-down hypotheses with the actual visual input (Chapter 5). The present results are compatible with interactive models of word recognition assuming that early lexical processes depend on the concerted impact of bottom-up and top-down information. We offered a framework that reconciles the findings on a timeline of word recognition taking into account influences of frequency, predictability, and presentation rate (Chapter 4). N2 - Wortfrequenz wird in der Leseforschung als wesentliche Bottom-up Determinante für die Geschwindigkeit des lexikalischen Zugriffs betrachtet. Darüber hinaus spielen Top-down Informationen, wie die kontextbasierte Wortvorhersagbarkeit, in der Sprachverarbeitung eine wichtige Rolle. Bislang ist die exakte Bedeutung von Top-down Vorhersagen in der visuellen Worterkennung jedoch unzureichend verstanden: Es herrscht Uneinigkeit darüber, ob ausschließlich späte post-lexikalische, oder auch frühe lexikalische Verarbeitungsstufen durch Vorhersagbarkeit beeinflusst werden. Um ein besseres Verständnis von Top-down Prozessen und deren Zusammenhänge mit Bottom-up Informationen in der Worterkennung zu gewährleisten, wurden in der vorliegenden Arbeit Einflüsse von Frequenz und Vorhersagbarkeit auf ereigniskorrelierte Potentiale (EKPs) untersucht. Die Ergebnisse aus mehreren Satzlesestudien wurden mit Blickbewegungen beim natürlichen Lesen sowie mit Modellen der Worterkennung in Beziehung gesetzt. Als primärer Befund zeigten sich in EKP Amplituden konsistent Interaktionen zwischen Frequenz und Vorhersagbarkeit. Die Ergebnisse deuten auf Top-down Einflüsse während lexikalischer Wortverarbeitungsstufen hin (Kapitel 2 und 4). Zweitens mediierten Frequenz und Vorhersagbarkeit Zusammenhänge zwischen N400 Amplituden und Fixationsdauern; die Modulation beider abhängigen Maße lässt auf eine gemeinsame Wortverarbeitungsstufe schließen. Desweiteren signalisierten längere Fixationsdauern nach erhöhten N400 Amplituden das Andauern der Wortverarbeitung über die Dauer einer Fixation hinaus (Kapitel 3). Drittens zeigten sich Einflüsse der Präsentationsrate auf Frequenz- und Vorhersagbarkeitseffekte in EKPs. Der Verlauf von Bottom-up und Top-down Prozessen wird demnach entscheidend durch die zur Wortverarbeitung verfügbaren Zeit mitbestimmt (Kapitel 4). Viertens deutete ein früher Vorhersagbarkeitseffekt bei einer leseähnlichen Präsentationsgeschwindigkeit auf den schnellen Abgleich von Top-down Vorhersagen mit dem tatsächlichen visuellen Input hin (Kapitel 5). Die Ergebnisse sind mit interaktiven Modellen der Worterkennung vereinbar, nach welchen Bottom-up und Top-down Informationen gemeinsam frühe lexikalische Verarbeitungsstufen beeinflussen. Unter Berücksichtigung der Effekte von Frequenz, Vorhersagbarkeit und Präsentationsgeschwindigkeit wird ein Modell vorgeschlagen, das die vorliegenden Befunde zusammenführt (Kapitel 4). T3 - Potsdam Cognitive Science Series - 1 KW - Lesen KW - visuelle Worterkennung KW - Bottom-up KW - Top-down KW - Frequenz KW - Vorhersagbarkeit KW - Stimulus-Onset Asynchrony KW - EEG KW - ereigniskorrelierte Potentiale KW - reading KW - visual word recognition KW - bottom-up KW - top-down KW - frequency KW - predictability KW - stimulus-onset asynchrony KW - EEG KW - event-related potentials Y1 - 2010 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-42024 SN - 978-3-86956-059-5 PB - Universitätsverlag Potsdam CY - Potsdam ER - TY - JOUR A1 - Bürki-Foschini, Audrey Damaris A1 - Viebahn, Malte Clemens A1 - Gafos, Adamantios I. T1 - Plasticity and transfer in the sound system BT - exposure to syllables in production or perception changes their subsequent production JF - Language, cognition and neuroscience N2 - This study focuses on the ability of the adult sound system to reorganise as a result of experience. Participants were exposed to existing and novel syllables in either a listening task or a production task over the course of two days. On the third day, they named disyllabic pseudowords while their electroencephalogram was recorded. The first syllable of these pseudowords had either been trained in the auditory modality, trained in production or had not been trained. The EEG response differed between existing and novel syllables for untrained but not for trained syllables, indicating that training novel sound sequences modifies the processes involved in the production of these sequences to make them more similar to those underlying the production of existing sound sequences. Effects of training on the EEG response were observed both after production training and mere auditory exposure. KW - Language production KW - EEG KW - syllables KW - phonetic encoding KW - transfer Y1 - 2020 U6 - https://doi.org/10.1080/23273798.2020.1782445 SN - 2327-3798 SN - 2327-3801 VL - 35 IS - 10 SP - 1371 EP - 1393 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Bridwell, David A. A1 - Cavanagh, James F. A1 - Collins, Anne G. E. A1 - Nunez, Michael D. A1 - Srinivasan, Ramesh A1 - Stober, Sebastian A1 - Calhoun, Vince D. T1 - Moving Beyond ERP Components BT - a selective review of approaches to integrate EEG and behavior JF - Frontiers in human neuroscienc N2 - Relationships between neuroimaging measures and behavior provide important clues about brain function and cognition in healthy and clinical populations. While electroencephalography (EEG) provides a portable, low cost measure of brain dynamics, it has been somewhat underrepresented in the emerging field of model-based inference. We seek to address this gap in this article by highlighting the utility of linking EEG and behavior, with an emphasis on approaches for EEG analysis that move beyond focusing on peaks or "components" derived from averaging EEG responses across trials and subjects (generating the event-related potential, ERP). First, we review methods for deriving features from EEG in order to enhance the signal within single-trials. These methods include filtering based on user-defined features (i.e., frequency decomposition, time-frequency decomposition), filtering based on data-driven properties (i.e., blind source separation, BSS), and generating more abstract representations of data (e.g., using deep learning). We then review cognitive models which extract latent variables from experimental tasks, including the drift diffusion model (DDM) and reinforcement learning (RL) approaches. Next, we discuss ways to access associations among these measures, including statistical models, data-driven joint models and cognitive joint modeling using hierarchical Bayesian models (HBMs). We think that these methodological tools are likely to contribute to theoretical advancements, and will help inform our understandings of brain dynamics that contribute to moment-to-moment cognitive function. KW - EEG KW - ERP KW - blind source separation KW - partial least squares KW - canonical correlations analysis KW - representational similarity analysis KW - deep learning KW - hierarchical Bayesian model Y1 - 2018 U6 - https://doi.org/10.3389/fnhum.2018.00106 SN - 1662-5161 VL - 12 PB - Frontiers Research Foundation CY - Lausanne ER - TY - GEN A1 - Bridwell, David A. A1 - Cavanagh, James F. A1 - Collins, Anne G. E. A1 - Nunez, Michael D. A1 - Srinivasan, Ramesh A1 - Stober, Sebastian A1 - Calhoun, Vince D. T1 - Moving beyond ERP components BT - a selective review of approaches to integrate EEG and behavior T2 - Postprints der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Relationships between neuroimaging measures and behavior provide important clues about brain function and cognition in healthy and clinical populations. While electroencephalography (EEG) provides a portable, low cost measure of brain dynamics, it has been somewhat underrepresented in the emerging field of model-based inference. We seek to address this gap in this article by highlighting the utility of linking EEG and behavior, with an emphasis on approaches for EEG analysis that move beyond focusing on peaks or "components" derived from averaging EEG responses across trials and subjects (generating the event-related potential, ERP). First, we review methods for deriving features from EEG in order to enhance the signal within single-trials. These methods include filtering based on user-defined features (i.e., frequency decomposition, time-frequency decomposition), filtering based on data-driven properties (i.e., blind source separation, BSS), and generating more abstract representations of data (e.g., using deep learning). We then review cognitive models which extract latent variables from experimental tasks, including the drift diffusion model (DDM) and reinforcement learning (RL) approaches. Next, we discuss ways to access associations among these measures, including statistical models, data-driven joint models and cognitive joint modeling using hierarchical Bayesian models (HBMs). We think that these methodological tools are likely to contribute to theoretical advancements, and will help inform our understandings of brain dynamics that contribute to moment-to-moment cognitive function. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 656 KW - EEG KW - ERP KW - blind source separation KW - partial least squares KW - canonical correlations analysis KW - representational similarity analysis KW - deep learning KW - hierarchical Bayesian model Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-459667 SN - 1866-8364 IS - 656 ER - TY - THES A1 - Breakell Fernandez, Leigh T1 - Investigating word order processing using pupillometry and event-related potentials T1 - Untersuchung von Wortfolge-Verarbeitungen unter Verwendung von Pupillometrie und EEG N2 - In this thesis sentence processing was investigated using a psychophysiological measure known as pupillometry as well as Event-Related Potentials (ERP). The scope of the the- sis was broad, investigating the processing of several different movement constructions with native speakers of English and second language learners of English, as well as word order and case marking in German speaking adults and children. Pupillometry and ERP allowed us to test competing linguistic theories and use novel methodologies to investigate the processing of word order. In doing so we also aimed to establish pupillometry as an effective way to investigate the processing of word order thus broadening the methodological spectrum. N2 - Die Doktorarbeit befasste sich mit der Untersuchung von Satzverarbeitung mittels der psychophysiologischen Methode Pupillometrie sowie EEG .Sie umfasst die Untersuchung verschiedener syntaktischer Konstruktionen und Kasusmarkierungen, deren Verarbeitung bei Muttersprachlern und Zweitsprachenlernern des Englischen sowie deutschsprachigen Erwachsenen und Kindern getestet wurden. Pupillometrie und EEG machten es möglich, konkurrierende linguistische Theorien zu testen und neuartige Methodiken zur Untersuchung der Verarbeitung von Wortfolgen zu nutzen. Ein besonderer Schwerpunkt bestand darin, Pupillometrie als effektive Art der Untersuchung von Wortfolge-Verarbeitungen zu etablieren und damit das methodologische Spektrum zu erweitern. KW - pupillometry KW - ERP KW - movement structures KW - L2 KW - word order processing KW - child language processing KW - auditory sentence processing KW - Verarbeitung von Zweitsprachen KW - EEG KW - Verarbeitung von Wortfolgen KW - Pupillometrie KW - Eye-Tracking Satzverarbeitung KW - Sprachverarbeitung bei Kindern Y1 - 2016 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-91438 ER - TY - JOUR A1 - Bosch, Sina A1 - Krause, Helena A1 - Leminen, Alina T1 - The time-course of morphosyntactic and semantic priming in late bilinguals: A study of German adjectives JF - Bilingualism : language and cognition. N2 - How do late proficient bilinguals process morphosyntactic and lexical-semantic information in their non-native language (L2)? How is this information represented in the L2 mental lexicon? And what are the neural signatures of L2 morphosyntactic and lexical-semantic processing? We addressed these questions in one behavioral and two ERP priming experiments on inflected German adjectives testing a group of advanced late Russian learners of German in comparison to native speaker (L1) controls. While in the behavioral experiment, the L2 learners performed native-like, the ERP data revealed clear L1/L2 differences with respect to the temporal dynamics of grammatical processing. Specifically, our results show that L2 morphosyntactic processing yielded temporally and spatially extended brain responses relative to L1 processing, indicating that grammatical processing of inflected words in an L2 is more demanding and less automatic than in the L1. However, this group of advanced L2 learners showed native-like lexical-semantic processing. KW - Inflection KW - EEG KW - Grammatical Processing KW - Mental Lexicon Y1 - 2017 U6 - https://doi.org/10.1017/S1366728916000055 SN - 1366-7289 SN - 1469-1841 VL - 20 SP - 435 EP - 456 PB - Cambridge Univ. Press CY - New York ER - TY - THES A1 - Allefeld, Carsten T1 - Phase synchronization analysis of event-related brain potentials in language processing N2 - Das Forschungsthema Synchronisation bildet einen Schnittpunkt von Nichtlinearer Dynamik und Neurowissenschaft. So hat zum einen neurobiologische Forschung gezeigt, daß die Synchronisation neuronaler Aktivität einen wesentlichen Aspekt der Funktionsweise des Gehirns darstellt. Zum anderen haben Fortschritte in der physikalischen Theorie zur Entdeckung des Phänomens der Phasensynchronisation geführt. Eine dadurch motivierte Datenanalysemethode, die Phasensynchronisations-Analyse, ist bereits mit Erfolg auf empirische Daten angewandt worden. Die vorliegende Dissertation knüpft an diese konvergierenden Forschungslinien an. Ihren Gegenstand bilden methodische Beiträge zur Fortentwicklung der Phasensynchronisations-Analyse, sowie deren Anwendung auf ereigniskorrelierte Potentiale, eine besonders in den Kognitionswissenschaften wichtige Form von EEG-Daten. Die methodischen Beiträge dieser Arbeit bestehen zum ersten in einer Reihe spezialisierter statistischer Tests auf einen Unterschied der Synchronisationsstärke in zwei verschiedenen Zuständen eines Systems zweier Oszillatoren. Zweitens wird im Hinblick auf den viel-kanaligen Charakter von EEG-Daten ein Ansatz zur multivariaten Phasensynchronisations-Analyse vorgestellt. Zur empirischen Untersuchung neuronaler Synchronisation wurde ein klassisches Experiment zur Sprachverarbeitung repliziert, in dem der Effekt einer semantischen Verletzung im Satzkontext mit demjenigen der Manipulation physischer Reizeigenschaften (Schriftfarbe) verglichen wird. Hier zeigt die Phasensynchronisations-Analyse eine Verringerung der globalen Synchronisationsstärke für die semantische Verletzung sowie eine Verstärkung für die physische Manipulation. Im zweiten Fall läßt sich der global beobachtete Synchronisationseffekt mittels der multivariaten Analyse auf die Interaktion zweier symmetrisch gelegener Gehirnareale zurückführen. Die vorgelegten Befunde zeigen, daß die physikalisch motivierte Methode der Phasensynchronisations-Analyse einen wesentlichen Beitrag zur Untersuchung ereigniskorrelierter Potentiale in den Kognitionswissenschaften zu leisten vermag. N2 - The topic of synchronization forms a link between nonlinear dynamics and neuroscience. On the one hand, neurobiological research has shown that the synchronization of neuronal activity is an essential aspect of the working principle of the brain. On the other hand, recent advances in the physical theory have led to the discovery of the phenomenon of phase synchronization. A method of data analysis that is motivated by this finding - phase synchronization analysis - has already been successfully applied to empirical data. The present doctoral thesis ties up to these converging lines of research. Its subject are methodical contributions to the further development of phase synchronization analysis, as well as its application to event-related potentials, a form of EEG data that is especially important in the cognitive sciences. The methodical contributions of this work consist firstly in a number of specialized statistical tests for a difference in the synchronization strength in two different states of a system of two oscillators. Secondly, in regard of the many-channel character of EEG data an approach to multivariate phase synchronization analysis is presented. For the empirical investigation of neuronal synchronization a classic experiment on language processing was replicated, comparing the effect of a semantic violation in a sentence context with that of the manipulation of physical stimulus properties (font color). Here phase synchronization analysis detects a decrease of global synchronization for the semantic violation as well as an increase for the physical manipulation. In the latter case, by means of the multivariate analysis the global synchronization effect can be traced back to an interaction of symmetrically located brain areas.
The findings presented show that the method of phase synchronization analysis motivated by physics is able to provide a relevant contribution to the investigation of event-related potentials in the cognitive sciences. T2 - Phase synchronization analysis of event-related brain potentials in language processing KW - Synchronisation KW - EEG KW - Sprachverarbeitung KW - Multivariate Analyse KW - synchronization KW - EEG KW - language processing KW - multivariate analysis Y1 - 2004 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-0001873 ER - TY - GEN A1 - Agarwal, Ankit A1 - Marwan, Norbert A1 - Maheswaran, Rathinasamy A1 - Merz, Bruno A1 - Kurths, Jürgen T1 - Multi-scale event synchronization analysis for unravelling climate processes BT - a wavelet-based approach T2 - Postprints der Universität Potsdam : Mathematisch-Naturwissenschaftliche Reihe N2 - The temporal dynamics of climate processes are spread across different timescales and, as such, the study of these processes at only one selected timescale might not reveal the complete mechanisms and interactions within and between the (sub-) processes. To capture the non-linear interactions between climatic events, the method of event synchronization has found increasing attention recently. The main drawback with the present estimation of event synchronization is its restriction to analysing the time series at one reference timescale only. The study of event synchronization at multiple scales would be of great interest to comprehend the dynamics of the investigated climate processes. In this paper, the wavelet-based multi-scale event synchronization (MSES) method is proposed by combining the wavelet transform and event synchronization. Wavelets are used extensively to comprehend multi-scale processes and the dynamics of processes across various timescales. The proposed method allows the study of spatio-temporal patterns across different timescales. The method is tested on synthetic and real-world time series in order to check its replicability and applicability. The results indicate that MSES is able to capture relationships that exist between processes at different timescales. T3 - Zweitveröffentlichungen der Universität Potsdam : Mathematisch-Naturwissenschaftliche Reihe - 661 KW - precipitation KW - phase KW - EEG KW - desynchronization KW - interdependences KW - coherence KW - networks KW - monsoon KW - models KW - time Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-418274 SN - 1866-8372 IS - 661 ER -