TY - THES A1 - Kuhnke, Philipp T1 - The neural basis of conceptual knowledge retrieval T1 - Die neuronale Basis der Konzeptverarbeitung BT - insights from fMRI & TMS in the healthy human brain BT - Einblicke durch fMRT & TMS im gesunden menschlichen Gehirn N2 - Conceptual knowledge about objects, people and events in the world is central to human cognition, underlying core cognitive abilities such as object recognition and use, and word comprehension. Previous research indicates that concepts consist of perceptual and motor features represented in modality-specific perceptual-motor brain regions. In addition, cross-modal convergence zones integrate modality-specific features into more abstract conceptual representations. However, several questions remain open: First, to what extent does the retrieval of perceptual-motor features depend on the concurrent task? Second, how do modality-specific and cross-modal regions interact during conceptual knowledge retrieval? Third, which brain regions are causally relevant for conceptually-guided behavior? This thesis addresses these three key issues using functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) in the healthy human brain. Study 1 - an fMRI activation study - tested to what extent the retrieval of sound and action features of concepts, and the resulting engagement of auditory and somatomotor brain regions depend on the concurrent task. 40 healthy human participants performed three different tasks - lexical decision, sound judgment, and action judgment - on words with a high or low association to sounds and actions. We found that modality-specific regions selectively respond to task-relevant features: Auditory regions selectively responded to sound features during sound judgments, and somatomotor regions selectively responded to action features during action judgments. Unexpectedly, several regions (e.g. the left posterior parietal cortex; PPC) exhibited a task-dependent response to both sound and action features. We propose these regions to be "multimodal", and not "amodal", convergence zones which retain modality-specific information. Study 2 - an fMRI connectivity study - investigated the functional interaction between modality-specific and multimodal areas during conceptual knowledge retrieval. Using the above fMRI data, we asked (1) whether modality-specific and multimodal regions are functionally coupled during sound and action feature retrieval, (2) whether their coupling depends on the task, (3) whether information flows bottom-up, top-down, or bidirectionally, and (4) whether their coupling is behaviorally relevant. We found that functional coupling between multimodal and modality-specific areas is task-dependent, bidirectional, and relevant for conceptually-guided behavior. Left PPC acted as a connectivity "switchboard" that flexibly adapted its coupling to task-relevant modality-specific nodes. Hence, neuroimaging studies 1 and 2 suggested a key role of left PPC as a multimodal convergence zone for conceptual knowledge. However, as neuroimaging is correlational, it remained unknown whether left PPC plays a causal role as a multimodal conceptual hub. Therefore, study 3 - a TMS study - tested the causal relevance of left PPC for sound and action feature retrieval. We found that TMS over left PPC selectively impaired action judgments on low sound-low action words, as compared to sham stimulation. Computational simulations of the TMS-induced electrical field revealed that stronger stimulation of left PPC was associated with worse performance on action, but not sound, judgments. These results indicate that left PPC causally supports conceptual processing when action knowledge is task-relevant and cannot be compensated by sound knowledge. Our findings suggest that left PPC is specialized for action knowledge, challenging the view of left PPC as a multimodal conceptual hub. Overall, our studies support "hybrid theories" which posit that conceptual processing involves both modality-specific perceptual-motor regions and cross-modal convergence zones. In our new model of the conceptual system, we propose conceptual processing to rely on a representational hierarchy from modality-specific to multimodal up to amodal brain regions. Crucially, this hierarchical system is flexible, with different regions and connections being engaged in a task-dependent fashion. Our model not only reconciles the seemingly opposing grounded cognition and amodal theories, it also incorporates task dependency of conceptually-related brain activity and connectivity, thereby resolving several current issues on the neural basis of conceptual knowledge retrieval. N2 - Konzeptuelles Wissen über Objekte, Menschen und Ereignisse in der Welt ist zentral für die menschliche Kognition. So unterliegt es kognitiven Fähigkeiten wie der Objekterkennung und -benutzung und dem Wortverständnis. Die bisherige Forschung legt nahe, dass Konzepte aus perzeptuellen und motorischen Merkmalen bestehen, die in modalitätsspezifischen perzeptuell-motorischen Hirnregionen repräsentiert sind. Darüber hinaus integrieren crossmodale Konvergenzzonen modalitätsspezifische Merkmale in abstraktere konzeptuelle Repräsentationen. Mehrere Fragen bleiben jedoch offen. Erstens: Inwiefern hängt die Aktivierung perzeptuell-motorischer Areale von der Aufgabe ab? Zweitens: Wie interagieren modalitätsspezifische und crossmodale Areale miteinander? Drittens: Welche Hirnregionen sind kausal relevant für konzeptgeleitetes Verhalten? Diese Dissertation adressiert diese Kernfragen mittels funktioneller Magnetresonanztomografie (fMRT) und transkranieller Magnetstimulation (TMS) im gesunden menschlichen Gehirn. Studie 1—eine fMRT Aktivierungsstudie—prüfte, inwiefern die Aktivierung von Geräusch– und Handlungsmerkmalen von der Aufgabe abhängt. Vierzig gesunde Probanden führten drei verschiedene Aufgaben—lexikalische Entscheidungen, Geräuschentscheidungen, Handlungsentscheidungen—bei Wörtern mit einer hohen oder niedrigen Assoziation zu Geräuschen und Handlungen aus. Die Ergebnisse zeigten, dass modalitätsspezifische Regionen selektiv für aufgabenrelevante Merkmale aktiv wurden: Auditorische Regionen aktivierten selektiv für Geräuschmerkmale während Geräuschentscheidungen. Somatomotorische Areale hingehen aktivierten selektiv für Handlungsmerkmale während Handlungsentscheidungen. Überraschenderweise zeigten mehrere Regionen (z.B. der linke posteriore Parietalkortex; PPC) aufgabenabhängige Aktivität für Geräusch- und Handlungsmerkmale. Wir schlagen vor, dass die Regionen „multimodale“ (und nicht „amodale“) Konvergenzzonen sind, die modalitätsspezifische Informationen behalten. Studie 2—eine fMRT Konnektivitätsstudie—untersuchte die funktionale Interaktion zwischen modalitätsspezifischen und multimodalen Arealen während der Konzeptverarbeitung. Mit denselben fMRT-Daten fragten wir, (1) ob modalitätsspezifische und multimodale Areale während der Verarbeitung von Geräusch- und Handlungsmerkmalen zusammenarbeiten, (2) ob deren Interaktion von der Aufgabe abhängt, (3) in welche Richtung die Information fließt und (4) ob die Interaktion das Verhalten der Probanden bestimmt. Wir fanden heraus, dass die funktionale Interaktion zwischen modalitätsspezifischen und multimodalen Arealen aufgabenabhängig, bidirektional und relevant für das Verhalten ist. Der linke PPC agierte als „Schaltstelle“, die flexibel ihre Konnektivität zu aufgabenrelevanten modalitätsspezifischen Knoten adaptierte. Studien 1 und 2 legen also eine zentrale Rolle des linken PPC als multimodale Konvergenzzone für konzeptuelles Wissen nahe. Da bildgebende Verfahren jedoch korrelativ sind, bleibt unklar, ob der linke LPP tatsächlich eine kausale Rolle als multimodales konzeptuelles Areal spielt. Studie 3—eine TMS Studie—testete daher die kausale Relevanz des linken PPC für Geräusch- und Handlungswissen. Die Ergebnisse zeigten, dass TMS über dem linken PPC (im Vergleich zu Placebo-Stimulation) selektiv Handlungsentscheidungen störte. Computersimulationen des TMS-induzierten elektrischen Feldes zeigten zudem, dass stärkere Stimulation des linken PPC mit schlechterer Verhaltensleistung bei Handlungsentscheidungen, aber nicht bei Geräuschentscheidungen, assoziiert war. Diese Ergebnisse deuten darauf hin, dass der linke PPC auf Handlungswissen spezialisiert ist, was die Sicht des PPC als multimodales konzeptuelles Areal herausfordert. Insgesamt unterstützen unsere Studien sogenannte Hybridtheorien, die vorschlagen, dass konzeptuelle Verarbeitung sowohl modalitätsspezifische als auch crossmodale Hirnregionen involviert. Unser neues Modell des konzeptuellen Systems postuliert, dass konzeptuelle Verarbeitung auf einer repräsentationalen Hierarchie von modalitätsspezifischen zu multimodalen bis hin zu amodalen Regionen basiert. Dieses hierarchische System ist flexibel, sodass verschiedene Regionen und Verbindungen in aufgabenabhängiger Weise aktiviert werden. Unser Modell bringt somit nicht nur die scheinbar widersprüchlichen grounded cognition und amodalen Theorien in Einklang, sondern es berücksichtigt auch die Aufgabenabhängigkeit von konzeptueller Hirnaktivität und -konnektivität und klärt so einige aktuelle Kernfragen zur neuronalen Basis der Konzeptverarbeitung. KW - neuroscience KW - cognitive science KW - cognition KW - semantics KW - concepts KW - fMRI KW - TMS KW - neuroimaging KW - brain stimulation KW - language KW - Kognition KW - Kognitionswissenschaft KW - Konzept KW - Gedächtnis KW - Semantik KW - Sprache KW - Bildgebung KW - Hirnstimulation KW - Neurostimulation KW - funktionelle Magnetresonanztomografie KW - fMRT KW - transkranielle Magnetstimulation KW - TMS Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-514414 ER - TY - THES A1 - Patzwald, Christiane T1 - Actions through the lens of communicative cues BT - the influence of verbal cues and emotional cues on action processing and action selection in the second year of life N2 - The PhD thesis entitled “Actions through the lens of communicative cues. The influence of verbal cues and emotional cues on action processing and action selection in the second year of life” is based on four studies, which examined the cognitive integration of another person’s communicative cues (i.e., verbal cues, emotional cues) with behavioral cues in 18- and 24-month-olds. In the context of social learning of instrumental actions, it was investigated how the intention-related coherence of either a verbally announced action intention or an emotionally signaled action evaluation with an action demonstration influenced infants’ neuro-cognitive processing (Study I) and selection (Studies II, III, IV) of a novel object-directed action. Developmental research has shown that infants benefit from another’s behavioral cues (e.g., action effect, persistency, selectivity) to infer the underlying goal or intention, respectively, of an observed action (e.g., Cannon & Woodward, 2012; Woodward, 1998). Particularly action effects support infants in distinguishing perceptual action features (e.g., target object identity, movement trajectory, final target object state) from conceptual action features such as goals and intentions. However, less is known about infants’ ability to cognitively integrate another’s behavioral cues with additional action-related communicative cues. There is some evidence showing that in the second year of life, infants selectively imitate a novel action that is verbally (“There!”) or emotionally (positive expression) marked as aligning with the model’s action intention over an action that is verbally (“Whoops!”) or emotionally (negative expression) marked as unintentional (Carpenter, Akhtar, & Tomasello, 1998; Olineck & Poulin-Dubois, 2005, 2009; Repacholi, 2009; Repacholi, Meltzoff, Toub, & Ruba, 2016). Yet, it is currently unclear which role the specific intention-related coherence of a communicative cue with a behavioral cue plays in infants’ action processing and action selection that is, whether the communicative cue confirms, contrasts, clarifies, or is unrelated to the behavioral cue. Notably, by using both verbal cues and emotional cues, we examined not only two domains of communicative cues but also two qualitatively distinct relations between behavioral cues on the one hand and communicative cues on the other hand. More specifically, a verbal cue has the potential to communicate an action intention in the absence of an action demonstration and thus a prior-intention (Searle, 1983), whereas an emotional cue evaluates an ongoing or past action demonstration and thus signals an intention-in-action (Searle, 1983). In a first research focus, this thesis examined infants’ capacity to cognitively integrate another’s intention-related communicative cues and behavioral cues, and also focused on the role of the social cues’ coherence in infants’ action processing and action selection. In a second research focus, and to gain more elaborate insights into how the sub-processes of social learning (attention, encoding, response; cf. Bandura, 1977) are involved in this coherence-sensitive integrative processing, we employed a multi-measures approach. More specifically, we used Electroencephalography (EEG) and looking times to examine how the cues’ coherence influenced the compound of attention and encoding, and imitation (including latencies to first-touch and first-action) to address the compound of encoding and response. Based on the action-reconstruction account (Csibra, 2007), we predicted that infants use extra-motor information (i.e., communicative cues) together with behavioral cues to reconstruct another’s action intention. Accordingly, we expected infants to possess a flexibly organized internal action hierarchy, which they adapt according to the cues’ coherence that is, according to what they inferred to be the overarching action goal. More specifically, in a social-learning situation that comprised an adult model, who demonstrated an action on a novel object that offered two actions, we expected the demonstrated action to lead infants’ action hierarchy when the communicative (i.e., verbal, emotional) cue conveyed similar (confirming coherence) or no additional (un-related coherence) intention-related information relative to the behavioral cue. In terms of action selection, this action hierarchy should become evident in a selective imitation of the demonstrated action. However, when the communicative cue questioned (contrasting coherence) the behaviorally implied action goal or was the only cue conveying meaningful intention-related information (clarifying coherence), the verbally/emotionally intended action should ascend infants’ action hierarchy. Consequently, infants’ action selection should align with the verbally/emotionally intended action (goal emulation). Notably, these predictions oppose the direct-matching perspective (Rizzolatti & Craighero, 2004), according to which the observation of another’s action directly resonates with the observer’s motor repertoire, with this motor resonance enabling the identification of the underlying action goal. Importantly, the direct-matching perspective predicts a rather inflexible action hierarchy inasmuch as the process of goal identification should solely rely on the behavioral cue, irrespective of the behavioral cue’s coherence with extra-motor intention-related information, as it may be conveyed via communicative cues. As to the role of verbal cues, Study I used EEG to examine the influence of a confirming (Congruent) versus contrasting (Incongruent) coherence of a verbal action intention with the same action demonstration on 18-month-olds’ conceptual action processing (as measured via mid-latency mean negative ERP amplitude) and motor activation (as measured via central mu-frequency band power). The action was demonstrated on a novel object that offered two action alternatives from a neutral position. We expected mid-latency ERP negativity to be enhanced in Incongruent compared to Congruent, because past EEG research has demonstrated enhanced conceptual processing for stimuli that mismatched rather than matched the semantic context (Friedrich & Friederici, 2010; Kaduk et al., 2016). Regarding motor activation, Csibra (2007) posited that the identification of a clear action goal constitutes a crucial basis for motor activation to occur. We therefore predicted reduced mu power (indicating enhanced motor activation) for Congruent than Incongruent, because in Congruent, the cues’ match provides unequivocal information about the model’s action goal, whereas in Incongruent, the conflict may render the model’s action goal more unclear. Unexpectedly, in the entire sample, 18-month-olds’ mid-latency ERP negativity during the observation of the same action demonstration did not differ significantly depending on whether this action was congruent or incongruent with the model’s verbal action intention. Yet, post hoc analyses revealed the presence of two subgroups of infants, each of which exhibited significantly different mid-latency ERP negativity for Congruent versus Incongruent, but in opposing directions. The subgroups differed in their productive action-related language skills, with the linguistically more advanced infants exhibiting the expected response pattern of enhanced ERP mean negativity in Incongruent than Congruent, indicating enhanced conceptual processing of an action demonstration that was contrasted rather than confirmed by the verbal action context. As expected, central mu power in the entire sample was reduced in Congruent relative to Incongruent, indicating enhanced motor activation when the action demonstration was preceded by a confirming relative to a contrasting verbal action intention. This finding may indicate the covert preparation for a preferential imitation of the congruent relative to the incongruent action (Filippi et al., 2016; Frey & Gerry, 2006). Overall, these findings are in line with the action-reconstruction account (Csibra, 2007), because they suggest a coherence-sensitive attention to and encoding of the same perceptual features of another’s behavior and thus a cognitive integration of intention-related verbal cues and behavioral cues. Yet, because the subgroup constellation in infants’ ERPs was only discovered post hoc, future research is clearly required to substantiate this finding. Also, future research should validate our interpretation that enhanced motor activation may reflect an electrophysiological marker of subsequent imitation by employing EEG and imitation in a within-subjects design. Study II built on Study I by investigating the impact of coherence of a verbal cue and a behavioral cue on 18- and 24-month-olds’ action selection in an imitation study. When infants of both age groups observed a confirming (Congruent) or unrelated (Pseudo-word: action demonstration was associated with novel verb-like cue) coherence, they selectively imitated the demonstrated action over the not demonstrated, alternative action, with no difference between these two conditions. These findings suggest that, as expected, infants’ action hierarchy was led by the demonstrated action when the verbal cue provided similar (Congruent) or no additional (Pseudo-word) intention-related information relative to a meaningful behavioral cue. These findings support the above-mentioned interpretation that enhanced motor activation during action observation may reflect a covert preparation for imitation (Study I). Interestingly, infants did not seem to benefit from the intention-highlighting effect of the verbal cue in Congruent, suggesting that the verbal cue had an unspecific (e.g., attention-guiding) effect on infants’ action selection. Contrary, when infants observed a contrasting (Incongruent) or clarifying (Failed-attempt: model failed to manipulate the object but verbally announced a certain action intention) coherence, their action selection varied with age and also varied across the course of the experiment (block 1 vs. block 2). More specifically, the 24-month-olds made stronger use of the verbal cue for their action selection in block 1 than did the 18-month-olds. However, while the 18-month-olds’ use of the verbal cue increased across blocks, particularly in Incongruent, the 24-month-olds’ use of the verbal cue decreased across blocks. Overall, these results suggest that, as expected, infants’ action hierarchy in Incongruent (both age groups) and Failed-attempt (only 24-month-olds) drew on the verbal action intention, because in both age groups, infants emulated the verbal intention about as often as they imitated the demonstrated action or even emulated the verbal action intention preferentially. Yet, these findings were confined to certain blocks. It may be argued that the younger age group had a harder time inferring and emulating the intended, yet never observed action, because this requirement is more demanding in cognitive and motor terms. These demands may explain why the 18-month-olds needed some time to take account of the verbal action intention. Contrary, it seems that the 24-month-olds, although demonstrating their principle capacity to take account of the verbal cue in block 1, lost trust in the model’s verbal cue, maybe because the verbal cue did not have predictive value for the model’s actual behavior. Supporting this interpretation, research on selective trust has demonstrated that already infants evaluate another’s reliability or competence, respectively, based on how that model handles familiar objects (behavioral reliability) or labels familiar objects (verbal reliability; for reviews, see Mills, 2013; Poulin-Dubois & Brosseau-Liard, 2016). Relatedly, imitation research has demonstrated that the interpersonal aspects of a social-learning situation gain increasing relevance for infants during the second year of life (Gellén & Buttelmann, 2019; Matheson, Moore, & Akhtar, 2013; Uzgiris, 1981). It may thus be argued that when the 24-month-olds were repeatedly faced with a verbally unreliable model, they de-evaluated the verbal cue as signaling the model’s action intention and instead relied more heavily on alternative cues such as the behavioral cue (Incongruent) or the action context (e.g., object affordances, salience; Failed-attempt). Infants’ first-action latencies were higher in Incongruent and Failed-attempt than in both Congruent and Pseudo-word, and were also higher in Failed-attempt than in Incongruent. These latency-findings thus indicate that situations involving a meaningful verbal cue that deviated from the behavioral cue are cognitively more demanding, resulting in a delayed initiation of a behavioral response. In sum, the findings of Study II suggest that both age groups were highly flexible in their integration of a verbal cue and behavioral cue. Moreover, our results do not indicate a general superiority of either cue. Instead, it seems to depend on the informational gain conveyed by the verbal cue whether it exerts a specific, intention-highlighting effect (Incongruent, Failed-attempt) or an unspecific (e.g., attention-guiding) effect (Congruent, Pseudo-word). Studies III and IV investigated the impact of another’s action-related emotional cues on 18-month-olds’ action selection. In Study III, infants observed a model, who demonstrated two actions on a novel object in direct succession, and who combined one of the two actions with a positive (happy) emotional expression and the other action with a negative (sad) emotional expression. As expected, infants imitated the positively emoted (PE) action more often than the negatively emoted (NE) action. This preference arose from an increase in infants’ readiness to perform the PE action from the baseline period (prior to the action demonstrations) to the test period (following the action demonstrations), rather than from a decrease in readiness to the perform the NE action. The positive cue thus had a stronger behavior-regulating effect than the negative cue. Notably, infants’ more general object-directed behavior in terms of first-touch latencies remained unaffected by the emotional cues’ valence, indicating that infants had linked the emotional cues specifically to the corresponding action and not the object as a whole (Repacholi, 2009). Also, infants’ looking times during the action demonstration did not differ significantly as a function of emotional valence and were characterized by a predominant attentional focus to the action/object rather than to the model’s face. Together with the findings on infants’ first-touch latencies, these results indicate a sensitivity for the notion that emotions can have very specific referents (referential specificity; Martin, Maza, McGrath, & Phelps, 2014). Together, Study III provided evidence for selective imitation based on another’s intention-related (particularly positive) emotional cues in an action-selection task, and thus indicates that infants’ action hierarchy flexibly responds to another’s emotional evaluation of observed actions. According to Repacholi (2009), we suggest that infants used the model’s emotional evaluation to re-appraise the corresponding action (effect), for instance in terms of desirability. Study IV followed up on Study III by investigating the role of the negative emotional cue for infants’ action selection in more detail. Specifically, we investigated whether a contrasting (negative) emotional cue alone would be sufficient to differentially rank the two actions along infants’ action hierarchy or whether instead infants require direct information about the model’s action intention (in the form of a confirming action-emotion pair) to align their action selection with the emotional cues. Also, we examined whether the absence of a direct behavior-regulating effect of the negative cue in Study III was due to the negative cue itself or to the concurrently available positive cue masking the negative cue’s potential effect. To this end, we split the demonstration of the two action-emotion pairs across two trials. In each trial, one action was thus demonstrated and emoted (PE, NE action), and one action was not demonstrated and un-emoted (UE action). For trial 1, we predicted that infants, who observed a PE action demonstration, would selectively imitate the PE action, whereas infants, who observed a NE action demonstration would selectively emulate the UE action. As to trial 2, we expected the complementary action-emotion pair to provide additional clarifying information as the model’s emotional evaluation of both actions, which should either lead to adaptive perseveration (if infants’ action selection in trial 1 had already drawn on the emotional cue) or adaptive change (if infants’ action selection in trial 1 signaled a disregard of the emotional cue). As to trial 1, our findings revealed that, as expected, infants imitated the PE action more often than they emulated the UE action. Like in Study III, this selectivity arose from an increase in infants’ propensity to perform the PE action from baseline to trial 1. Also like in Study III, infants performed the NE action about equally often in baseline and trial 1, which speaks against a direct behavior-regulating effect of the negative cue also when presented in isolation. However, after a NE action demonstration, infants emulated the UE action more often in trial 1 than in baseline, suggesting an indirect behavior-regulating effect of the negative cue. Yet, this indirect effect did not yield a selective emulation of the UE action, because infants performed both action alternatives about equally often in trial 1. Unexpectedly, infants’ action selection in trial 2 was unaffected by the emotional cue. Instead, infants perseverated their action selection of trial 1 in trial 2, irrespective of whether it was adaptive or non-adaptive with respect to the model’s emotional evaluation of the action. It seems that infants changed their strategy across trials, from an initial adherence to the emotional (particularly positive) cue, towards bringing about a salient action effect (Marcovich & Zelazo, 2009). In sum, Studies III and IV indicate a dynamic interplay of different action-selection strategies, depending on valence and presentation order. Apparently, at least in infancy, action reconstruction as one basis for selective action performance reaches its limits when infants can only draw on indirect intention-related information (i.e., which action should be avoided). Overall, our findings favor the action-reconstruction account (Csibra, 2007), according to which actions are flexibly organized along a hierarchy, depending on inferential processes based on extra-motor intention-related information. At the same time, the findings question the direct-matching hypothesis (Rizzolatti & Craighero, 2004), according to which the identification (and pursuit) of action goals hinges on a direct simulation of another’s behavioral cues. Based on the studies’ findings, a preliminary working model is introduced, which seeks to integrate the two theoretical accounts by conceptualizing the routes that activation induced by social cues may take to eventually influence an infant’s action selection. Our findings indicate that it is useful to strive a differentiated conceptualization of communicative cues, because they seem to operate at different places within the process of cue integration, depending on their potential to convey direct intention-related information. Moreover, we suggest that there is bidirectional exchange within each compound of adjacent sub-processes (i.e., between attention and encoding, and encoding and response), and between the compounds. Hence, our findings highlight the benefits of a multi-measures approach when studying the development of infants’ social-cognitive abilities, because it provides a more comprehensive picture how the concerted use of social cues from different domains influences infants’ processing and selection of instrumental actions. Finally, this thesis points to potential future directions to substantiate our current interpretation of the findings.. Moreover, an extension to additional kinds of coherence is suggested to get closer to infants’ everyday-world of experience. KW - infancy KW - social cognition KW - action processing KW - emotions KW - language KW - imitation KW - EEG Y1 - 2020 ER - TY - THES A1 - Harding, Eleanor Elizabeth T1 - Neurocognitive entrainment to meter influences syntactic comprehension in music and language T1 - Neurokognitives Entrainment durch Metrum beeinflusst Syntaxverständnis in Musik und Sprache BT - an individual-differences approach BT - ein Zugang über individuelle Unterschiede N2 - Meter and syntax have overlapping elements in music and speech domains, and individual differences have been documented in both meter perception and syntactic comprehension paradigms. Previous evidence insinuated but never fully explored the relationship that metrical structure has to syntactic comprehension, the comparability of these processes across music and language domains, and the respective role of individual differences. This dissertation aimed to investigate neurocognitive entrainment to meter in music and language, the impact that neurocognitive entrainment had on syntactic comprehension, and whether individual differences in musical expertise, temporal perception and working memory played a role during these processes. A theoretical framework was developed, which linked neural entrainment, cognitive entrainment, and syntactic comprehension while detailing previously documented effects of individual differences on meter perception and syntactic comprehension. The framework was developed in both music and language domains and was tested using behavioral and EEG methods across three studies (seven experiments). In order to satisfy empirical evaluation of neurocognitive entrainment and syntactic aspects of the framework, original melodies and sentences were composed. Each item had four permutations: regular and irregular metricality, based on the hierarchical organization of strong and weak notes and syllables, and preferred and non-preferred syntax, based on structurally alternate endings. The framework predicted — for both music and language domains — greater neurocognitive entrainment in regular compared to irregular metricality conditions, and accordingly, better syntactic integration in regular compared to irregular metricality conditions. Individual differences among participants were expected for both entrainment and syntactic processes. Altogether, the dissertation was able to support a holistic account of neurocognitive entrainment to musical meter and its subsequent influence on syntactic integration of melodies, with musician participants. The theoretical predictions were not upheld in the language domain with musician participants, but initial behavioral evidence in combination with previous EEG evidence suggest that perhaps non-musician language EEG data would support the framework’s predictions. Musicians’ deviation from hypothesized results in the language domain were suspected to reflect heightened perception of acoustic features stemming from musical training, which caused current ‘overly’ regular stimuli to distract the cognitive system. The individual-differences approach was vindicated by the surfacing of two factors scores, Verbal Working Memory and Time and Pitch Discrimination, which in turn correlated with multiple experimental data across the three studies. N2 - Metrum und Syntax weisen sowohl in Musik als auch Sprache ähnliche Strukturelemente auf und in beiden Domänen sind interindividuelle Unterschiede in der Wahrnehmung von Metrum und Syntax berichtet worden. Bisherige Befunde deuten eine Wechselwirkung von metrischer Struktur auf syntaktische Verarbeitung an. Bislang gibt es jedoch keine konkreten Untersuchungen, die diese Beziehung systematisch beleuchtet haben, die Vergleichbarkeit dieser Prozesse in Musik und Sprache eruiert oder den Einfluss interindividueller Unterschiede erforscht haben. Die vorliegende Dissertation zielte daher darauf ab, ein neurokognitives Phänomen — Entrainment — in Musik und Sprache zu untersuchen, dessen Einfluss auf syntaktisches Verstehen zu definieren und herauszufinden, ob individuelle Unterschiede in musikalischer Vorerfahrung, Zeitwahrnehmung oder Arbeitsgedächtnis eine entscheidende Rolle bei diesen Prozessen spielt. Es wurde ein theoretischer Rahmen entwickelt, der neuronales Entrainment, kognitives Entrainment und syntaktisches Verstehen verknüpft und bereits dokumentierte individuelle Unterschiede in der Wahrnehmung vom Metrum und in syntaktischem Verstehen berücksichtigt. Dieser Rahmen wurde sowohl für Musik als auch Sprache formuliert und mit Hilfe von Verhaltens- und EEG-Untersuchungen in drei Studien (zusammengesetzt aus sieben Experimenten) getestet. Um eine empirische Untersuchung von neurokognitivem Entrainment und syntaktischem Verstehen zu ermöglichen, wurde geeignetes Melodie- und Satzmaterial entwickelt. Jede Melodie und jeder Satz wurde in vier Variationen dargeboten: regelmäßiges/unregelmäßiges Metrum, basierend auf der hierarchischen Organisation von betonten/unbetonten Noten und Silben, und bevorzugte/nicht bevorzugte Syntax, basierend auf strukturell verschiedenen Satzenden. Es wurde erwartet, dass in beiden Domänen regelmäßiges Metrum zu größerem neurokognitiven Entrainment führt als unregelmäßiges Metrum. Individuelle Unterschiede zwischen den Teilnehmern wurden sowohl für Entrainment als auch für die syntaktische Verarbeitung erwartet. Insgesamt kann die Dissertation den Einfluss von musikalischem Metrum auf neurokognitives Entrainment sowie dessen Einfluss wiederum auf die syntaktische Integration von Melodien bestätigen. Für die Sprachverarbeitung konnten diese Zusammenhänge in der hier getesteten Stichprobe von Musikern nicht nachgewiesen werden. Frühere Befunde aus Verhaltens- und EEG-Studien legen jedoch nahe, dass Untersuchungen mit Nichtmusikern ein solches Ergebnis erbringen könnten. Dass Musiker von unseren Hypothesen abweichende Ergebnisse in der Sprachverarbeitung zeigen, kann damit zu tun haben, dass sie durch ihr musikalisches Training akustische Merkmale besser wahrnehmen, wodurch "übermäßig" reguläre Stimuli kognitive Interferenzeffekte induzieren können. Des Weiteren konnte in allen drei Studien gezeigt werden, dass individuelle Wahrnehmungsunterschiede durch zwei Faktoren definiert werden: verbales Arbeitsgedächtnis sowie Zeit- und Tonhöhenunterscheidung. KW - entrainment KW - Entrainment KW - syntax KW - Syntax KW - meter KW - Metrum KW - language KW - Sprache KW - music KW - Musik Y1 - 2016 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-102258 ER -