TY - JOUR A1 - Arantzeta, Miren A1 - Bastiaanse, Roelien A1 - Burchert, Frank A1 - Wieling, Martijn Benjamin A1 - Martinez-Zabaleta, Maite A1 - Laka, Itziar T1 - Eye-tracking the effect of word order in sentence comprehension in aphasia BT - evidence from Basque, a free word order ergative language JF - Language, cognition and neuroscience N2 - Agrammatic speakers of languages with overt grammatical case show impaired use of the morphological cues to establish theta-role relations in sentences presented in non-canonical word orders. We analysed the effect of word order on the sentence comprehension of aphasic speakers of Basque, an ergative, free word order and head-final (SOV) language. Ergative languages such as Basque establish a one-to-one mapping of the thematic role and the case marker. We collected behavioural and gaze-fixation data while agrammatic speakers performed a picture-matching task with auditorily presented sentences with different word orders. We found that people with aphasia (PWA) had difficulties in assigning theta-roles in Theme-Agent order. This result is in line with processing accounts. Contrary to previous findings, our data do not suggest a systematic delay in the integration of morphological information in the PWA group, but strong reliance on the ergative case morphology and difficulties assigning thematic roles into the determiner phrases. KW - Aphasia KW - comprehension KW - Basque KW - sentence processing KW - eye-tracking Y1 - 2017 U6 - https://doi.org/10.1080/23273798.2017.1344715 SN - 2327-3798 SN - 2327-3801 VL - 32 IS - 10 SP - 1320 EP - 1343 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Arantzeta, Miren A1 - Webster, Janet A1 - Laka, Itziar A1 - Martinez-Zabaleta, Maite A1 - Howard, David T1 - What happens when they think they are right? BT - Error awareness analysis of sentence comprehension deficits in aphasia JF - Aphasiology : an international, interdisciplinary journal N2 - Background: Comprehension of non-canonical sentences is frequently characterised by chance level performance in people with aphasia (PWA). Chance level performance has been interpreted as guessing, but online data does not support this rendering. It is still not clear whether the incorrect sentence processing is guided by the compensatory strategies that PWA might employ to overcome linguistic difficulties.Aims: We aim to study to what extent people with non-fluent aphasia are aware of their sentence comprehension deficits.Methods & Procedures: This study combined offline and online data to investigate the effect of word order and error-awareness on sentence comprehension in a group of PWA and non-brain damaged (NBD) participants. The offline tasks involved auditory sentence picture-matching immediately followed by a confidence rating (CR). Participants were asked to judge the perceived correctness of their previous answer. Online data consisted of eye-tracking.Outcomes & Results: Replicating previous findings, PWA had significantly worse comprehension of Theme-Agent order compared to Agent-Theme order sentences. Controls showed ceiling level sentence comprehension. CR was a poor predictor of response accuracy in PWA, but moderate-good in NBD. A total of 6.8% of judgements were classified as guessing by PWA. Post hoc gaze data analysis indicated that CR was a predictor of the fixation pattern during the presentation of the linguistic stimuli.Conclusions: Results suggest that PWA were mostly unaware of their sentence comprehension errors and did not consciously employ strategies to compensate for their difficulties. KW - Aphasia KW - sentence comprehension KW - error awareness KW - eye-tracking KW - anosognosia Y1 - 2018 U6 - https://doi.org/10.1080/02687038.2017.1423270 SN - 0268-7038 SN - 1464-5041 VL - 32 IS - 12 SP - 1418 EP - 1444 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Clackson, Kaili A1 - Heyer, Vera T1 - Reflexive anaphor resolution in spoken language comprehension: structural constraints and beyond JF - Frontiers in psychology N2 - We report results from an eye-tracking during listening study examining English-speaking adults' online processing of reflexive pronouns, and specifically whether the search for an antecedent is restricted to syntactically appropriate positions. Participants listened to a short story where the recipient of an object was introduced with a reflexive, and were asked to identify the object recipient as quickly as possible. This allowed for the recording of participants' offline interpretation of the reflexive, response times, and eye movements on hearing the reflexive. Whilst our offline results show that the ultimate interpretation for reflexives was constrained by binding principles, the response time, and eye-movement data revealed that during processing participants were temporarily distracted by a structurally inappropriate competitor antecedent when this was prominent in the discourse. These results indicate that in addition to binding principles, online referential decisions are also affected by discourse-level information. KW - binding principle A KW - reflexive resolution KW - discourse prominence KW - sentence processing KW - eye-tracking Y1 - 2014 U6 - https://doi.org/10.3389/fpsyg.2014.00904 SN - 1664-1078 VL - 5 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Hollenstein, Nora A1 - Trondle, Marius A1 - Plomecka, Martyna A1 - Kiegeland, Samuel A1 - Ozyurt, Yilmazcan A1 - Jäger, Lena Ann A1 - Langer, Nicolas T1 - The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data JF - Frontiers in psychology N2 - We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and task-specific reading. The data for the benchmark is based on the Zurich Cognitive Language Processing Corpus (ZuCo 2.0), which provides simultaneous eye-tracking and EEG signals from natural reading of English sentences. The training dataset is publicly available, and we present a newly recorded hidden testset. We provide multiple solid baseline methods for this task and discuss future improvements. We release our code and provide an easy-to-use interface to evaluate new approaches with an accompanying public leaderboard: . KW - reading task classification KW - eye-tracking KW - EEG KW - machine learning KW - reading research KW - cross-subject evaluation Y1 - 2023 U6 - https://doi.org/10.3389/fpsyg.2022.1028824 SN - 1664-1078 VL - 13 PB - Frontiers Media CY - Lausanne ER - TY - JOUR A1 - Husain, Samar A1 - Vasishth, Shravan A1 - Srinivasan, Narayanan T1 - Integration and prediction difficulty in Hindi sentence comprehension: Evidence from an eye-tracking corpus JF - Journal of Eye Movement Research N2 - This is the first attempt at characterizing reading difficulty in Hindi using naturally occurring sentences. We created the Potsdam-Allahabad Hindi Eyetracking Corpus by recording eye-movement data from 30 participants at the University of Allahabad, India. The target stimuli were 153 sentences selected from the beta version of the Hindi-Urdu treebank. We find that word- or low-level predictors (syllable length, unigram and bigram frequency) affect first-pass reading times, regression path duration, total reading time, and outgoing saccade length. An increase in syllable length results in longer fixations, and an increase in word unigram and bigram frequency leads to shorter fixations. Longer syllable length and higher frequency lead to longer outgoing saccades. We also find that two predictors of sentence comprehension difficulty, integration and storage cost, have an effect on reading difficulty. Integration cost (Gibson, 2000) was approximated by calculating the distance (in words) between a dependent and head; and storage cost (Gibson, 2000), which measures difficulty of maintaining predictions, was estimated by counting the number of predicted heads at each point in the sentence. We find that integration cost mainly affects outgoing saccade length, and storage cost affects total reading times and outgoing saccade length. Thus, word-level predictors have an effect in both early and late measures of reading time, while predictors of sentence comprehension difficulty tend to affect later measures. This is, to our knowledge, the first demonstration using eye-tracking that both integration and storage cost influence reading difficulty. KW - reading KW - Hindi KW - eye-tracking KW - sentence comprehension KW - integration cost KW - storage cost Y1 - 2015 SN - 1995-8692 VL - 8 IS - 2 PB - International Group for Eye Movement Research CY - Bern ER - TY - JOUR A1 - Jäger, Lena Ann A1 - Benz, Lena A1 - Roeser, Jens A1 - Dillon, Brian W. A1 - Vasishth, Shravan T1 - Teasing apart retrieval and encoding interference in the processing of anaphors JF - Frontiers in psychology N2 - Two classes of account have been proposed to explain the memory processes subserving the processing of reflexive-antecedent dependencies. Structure-based accounts assume that the retrieval of the antecedent is guided by syntactic tree-configurational information without considering other kinds of information such as gender marking in the case of English reflexives. By contrast, unconstrained cue-based retrieval assumes that all available information is used for retrieving the antecedent. Similarity-based interference effects from structurally illicit distractors which match a non-structural retrieval cue have been interpreted as evidence favoring the unconstrained cue-based retrieval account since cue-based retrieval interference from structurally illicit distractors is incompatible with the structure-based account. However, it has been argued that the observed effects do not necessarily reflect interference occurring at the moment of retrieval but might equally well be accounted for by interference occurring already at the stage of encoding or maintaining the antecedent in memory, in which case they cannot be taken as evidence against the structure-based account. We present three experiments (self-paced reading and eye-tracking) on German reflexives and Swedish reflexive and pronominal possessives in which we pit the predictions of encoding interference and cue-based retrieval interference against each other. We could not find any indication that encoding interference affects the processing ease of the reflexive-antecedent dependency formation. Thus, there is no evidence that encoding interference might be the explanation for the interference effects observed in previous work. We therefore conclude that invoking encoding interference may not be a plausible way to reconcile interference effects with a structure-based account of reflexive processing. KW - anaphors KW - reflexives KW - possessives KW - eye-tracking KW - German KW - Swedish KW - working-memory KW - interference Y1 - 2015 U6 - https://doi.org/10.3389/fpsyg.2015.00506 SN - 1664-1078 VL - 6 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Jäger, Lena Ann A1 - Benz, Lena A1 - Roeser, Jens A1 - Dillon, Brian W. A1 - Vasishth, Shravan T1 - Teasing apart retrieval and encoding interference in the processing of anaphors JF - Frontiers in psychology N2 - Two classes of account have been proposed to explain the memory processes subserving the processing of reflexive-antecedent dependencies. Structure-based accounts assume that the retrieval of the antecedent is guided by syntactic tree-configurational information without considering other kinds of information such as gender marking in the case of English reflexives. By contrast, unconstrained cue-based retrieval assumes that all available information is used for retrieving the antecedent. Similarity-based interference effects from structurally illicit distractors which match a non-structural retrieval cue have been interpreted as evidence favoring the unconstrained cue-based retrieval account since cue-based retrieval interference from structurally illicit distractors is incompatible with the structure-based account. However, it has been argued that the observed effects do not necessarily reflect interference occurring at the moment of retrieval but might equally well be accounted for by interference occurring already at the stage of encoding or maintaining the antecedent in memory, in which case they cannot be taken as evidence against the structure-based account. We present three experiments (self-paced reading and eye-tracking) on German reflexives and Swedish reflexive and pronominal possessives in which we pit the predictions of encoding interference and cue-based retrieval interference against each other. We could not find any indication that encoding interference affects the processing ease of the reflexive-antecedent dependency formation. Thus, there is no evidence that encoding interference might be the explanation for the interference effects observed in previous work. We therefore conclude that invoking encoding interference may not be a plausible way to reconcile interference effects with a structure-based account of reflexive processing. KW - anaphors KW - reflexives KW - possessives KW - eye-tracking KW - German KW - Swedish KW - working-memory KW - interference Y1 - 2015 U6 - https://doi.org/10.3389/fpsyg.2015.00506 SN - 1664-1078 VL - 6 IS - 506 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Jäger, Lena Ann A1 - Engelmann, Felix A1 - Vasishth, Shravan T1 - Retrieval interference in reflexive processing: experimental evidence from Mandarin, and computational modeling JF - Frontiers in psychology N2 - We conducted two eye-tracking experiments investigating the processing of the Mandarin reflexive ziji in order to tease apart structurally constrained accounts from standard cue-based accounts of memory retrieval. In both experiments, we tested whether structurally inaccessible distractors that fulfill the animacy requirement of ziji influence processing times at the reflexive. In Experiment 1, we manipulated animacy of the antecedent and a structurally inaccessible distractor intervening between the antecedent and the reflexive. In conditions where the accessible antecedent mismatched the animacy cue, we found inhibitory interference whereas in antecedent-match conditions, no effect of the distractor was observed. In Experiment 2, we tested only antecedent-match configurations and manipulated locality of the reflexive-antecedent binding (Mandarin allows non-local binding). Participants were asked to hold three distractors (animate vs. inanimate nouns) in memory while reading the target sentence. We found slower reading times when animate distractors were held in memory (inhibitory interference). Moreover, we replicated the locality effect reported in previous studies. These results are incompatible with structure-based accounts. However, the cue-based ACT-R model of Lewis and Vasishth (2005) cannot explain the observed pattern either. We therefore extend the original ACT-R model and show how this model not only explains the data presented in this article, but is also able to account for previously unexplained patterns in the literature on reflexive processing. KW - Chinese reflexives KW - ACT-R KW - eye-tracking KW - interference KW - cue-based retrieval KW - computational modeling KW - ziji KW - content-addressable memory Y1 - 2015 U6 - https://doi.org/10.3389/fpsyg.2015.00617 SN - 1664-1078 VL - 6 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Jäger, Lena Ann A1 - Engelmann, Felix A1 - Vasishth, Shravan T1 - Retrieval interference in reflexive processing BT - Experimental evidence from Mandarin, and computational modeling JF - Frontiers in psychology N2 - We conducted two eye-tracking experiments investigating the processing of the Mandarin reflexive ziji in order to tease apart structurally constrained accounts from standard cue-based accounts of memory retrieval. In both experiments, we tested whether structurally inaccessible distractors that fulfill the animacy requirement of ziji influence processing times at the reflexive. In Experiment 1, we manipulated animacy of the antecedent and a structurally inaccessible distractor intervening between the antecedent and the reflexive. In conditions where the accessible antecedent mismatched the animacy cue, we found inhibitory interference whereas in antecedent-match conditions, no effect of the distractor was observed. In Experiment 2, we tested only antecedent-match configurations and manipulated locality of the reflexive-antecedent binding (Mandarin allows non-local binding). Participants were asked to hold three distractors (animate vs. inanimate nouns) in memory while reading the target sentence. We found slower reading times when animate distractors were held in memory (inhibitory interference). Moreover, we replicated the locality effect reported in previous studies. These results are incompatible with structure-based accounts. However, the cue-based ACT-R model of Lewis and Vasishth (2005) cannot explain the observed pattern either. We therefore extend the original ACT-R model and show how this model not only explains the data presented in this article, but is also able to account for previously unexplained patterns in the literature on reflexive processing. KW - Chinese reflexives KW - ACT-R KW - eye-tracking KW - interference KW - cue-based retrieval KW - computational modeling KW - ziji KW - content-addressable memory Y1 - 2015 U6 - https://doi.org/10.3389/fpsyg.2015.00617 SN - 1664-1078 VL - 6 IS - 617 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Krasotkina, Anna A1 - Götz, Antonia A1 - Höhle, Barbara A1 - Schwarzer, Gudrun T1 - Infants’ gaze patterns for same-race and other-race faces, and the other-race effect JF - Brain Sciences N2 - The other-race effect (ORE) can be described as difficulties in discriminating between faces of ethnicities other than one's own, and can already be observed at approximately 9 months of age. Recent studies also showed that infants visually explore same-and other-race faces differently. However, it is still unclear whether infants' looking behavior for same- and other-race faces is related to their face discrimination abilities. To investigate this question we conducted a habituation-dishabituation experiment to examine Caucasian 9-month-old infants' gaze behavior, and their discrimination of same- and other-race faces, using eye-tracking measurements. We found that infants looked longer at the eyes of same-race faces over the course of habituation, as compared to other-race faces. After habituation, infants demonstrated a clear other-race effect by successfully discriminating between same-race faces, but not other-race faces. Importantly, the infants' ability to discriminate between same-race faces significantly correlated with their fixation time towards the eyes of same-race faces during habituation. Thus, our findings suggest that for infants old enough to begin exhibiting the ORE, gaze behavior during habituation is related to their ability to differentiate among same-race faces, compared to other-race faces. KW - eye-tracking KW - infancy KW - habituation KW - other-race effect KW - face KW - discrimination Y1 - 2020 U6 - https://doi.org/10.3390/brainsci10060331 SN - 2076-3425 VL - 10 IS - 6 PB - Brain Sciences CY - Basel ER -