TY - JOUR A1 - Metzner, Paul A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan A1 - Roesler, Frank T1 - The Importance of Reading Naturally: Evidence From Combined Recordings of Eye Movements and Electric Brain Potentials JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society KW - Reading KW - Sentence comprehension KW - ERP KW - Eye movements KW - Regressions Y1 - 2017 U6 - https://doi.org/10.1111/cogs.12384 SN - 0364-0213 SN - 1551-6709 VL - 41 SP - 1232 EP - 1263 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Engelmann, Felix A1 - Vasishth, Shravan A1 - Engbert, Ralf A1 - Kliegl, Reinhold T1 - A framework for modeling the interaction of syntactic processing and eye movement control JF - Topics in cognitive science N2 - We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. KW - Sentence comprehension KW - Eye movements KW - Reading KW - Parsing difficulty KW - Working memory KW - Surprisal KW - Computational modeling Y1 - 2013 U6 - https://doi.org/10.1111/tops.12026 SN - 1756-8757 VL - 5 IS - 3 SP - 452 EP - 474 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan T1 - Scanpaths reveal syntactic underspecification and reanalysis strategies JF - Language and cognitive processes N2 - What theories best characterise the parsing processes triggered upon encountering ambiguity, and what effects do these processes have on eye movement patterns in reading? The present eye-tracking study, which investigated processing of attachment ambiguities of an adjunct in Spanish, suggests that readers sometimes underspecify attachment to save memory resources, consistent with the good-enough account of parsing. Our results confirm a surprising prediction of the good-enough account: high-capacity readers commit to an attachment decision more often than low-capacity participants, leading to more errors and a greater need to reanalyse in garden-path sentences. These results emerged only when we separated functionally different types of regressive eye movements using a scanpath analysis; conventional eye-tracking measures alone would have led to different conclusions. The scanpath analysis also showed that rereading was the dominant strategy for recovering from garden-pathing. Our results may also have broader implications for models of reading processes: reanalysis effects in eye movements occurred late, which suggests that the coupling of oculo-motor control and the parser may not be as tight as assumed in current computational models of eye movement control in reading. KW - Reading KW - Eye movements KW - Scanpaths KW - Parsing KW - Reanalysis KW - Individual differences KW - Working memory KW - Underspecification Y1 - 2013 U6 - https://doi.org/10.1080/01690965.2012.728232 SN - 0169-0965 SN - 1464-0732 VL - 28 IS - 10 SP - 1545 EP - 1578 PB - Wiley CY - Hove ER - TY - JOUR A1 - Hanne, Sandra A1 - Sekerina, Irina A. A1 - Vasishth, Shravan A1 - Burchert, Frank A1 - De Bleser, Ria T1 - Chance in agrammatic sentence comprehension what does it really mean? Evidence from eye movements of German agrammatic aphasic patients JF - Aphasiology : an international, interdisciplinary journal N2 - Background: In addition to the canonical subject-verb-object (SVO) word order, German also allows for non-canonical order (OVS), and the case-marking system supports thematic role interpretation. Previous eye-tracking studies (Kamide et al., 2003; Knoeferle, 2007) have shown that unambiguous case information in non-canonical sentences is processed incrementally. For individuals with agrammatic aphasia, comprehension of non-canonical sentences is at chance level (Burchert et al., 2003). The trace deletion hypothesis (Grodzinsky 1995, 2000) claims that this is due to structural impairments in syntactic representations, which force the individual with aphasia (IWA) to apply a guessing strategy. However, recent studies investigating online sentence processing in aphasia (Caplan et al., 2007; Dickey et al., 2007) found that divergences exist in IWAs' sentence-processing routines depending on whether they comprehended non-canonical sentences correctly or not, pointing rather to a processing deficit explanation. Aims: The aim of the current study was to investigate agrammatic IWAs' online and offline sentence comprehension simultaneously in order to reveal what online sentence-processing strategies they rely on and how these differ from controls' processing routines. We further asked whether IWAs' offline chance performance for non-canonical sentences does indeed result from guessing. Methods Procedures: We used the visual-world paradigm and measured eye movements (as an index of online sentence processing) of controls (N = 8) and individuals with aphasia (N = 7) during a sentence-picture matching task. Additional offline measures were accuracy and reaction times. Outcomes Results: While the offline accuracy results corresponded to the pattern predicted by the TDH, IWAs' eye movements revealed systematic differences depending on the response accuracy. Conclusions: These findings constitute evidence against attributing IWAs' chance performance for non-canonical structures to mere guessing. Instead, our results support processing deficit explanations and characterise the agrammatic parser as deterministic and inefficient: it is slowed down, affected by intermittent deficiencies in performing syntactic operations, and fails to compute reanalysis even when one is detected. KW - Eye movements KW - Non-canonical sentences KW - Agrammatic aphasia KW - Broca's aphasia KW - Chance performance KW - Online and offline processing KW - Sentence comprehension disorders KW - German syntax Y1 - 2011 U6 - https://doi.org/10.1080/02687038.2010.489256 SN - 0268-7038 VL - 25 IS - 2 SP - 221 EP - 244 PB - Wiley CY - Hove ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan T1 - What is the scanpath signature of syntactic reanalysis? JF - Journal of memory and language N2 - Which repair strategy does the language system deploy when it gets garden-pathed, and what can regressive eye movements in reading tell us about reanalysis strategies? Several influential eye-tracking studies on syntactic reanalysis (Frazier & Rayner, 1982; Meseguer, Carreiras, & Clifton, 2002; Mitchell, Shen, Green, & Hodgson, 2008) have addressed this question by examining scanpaths, i.e., sequential patterns of eye fixations. However, in the absence of a suitable method for analyzing scanpaths, these studies relied on simplified dependent measures that are arguably ambiguous and hard to interpret. We address the theoretical question of repair strategy by developing a new method that quantifies scanpath similarity. Our method reveals several distinct fixation strategies associated with reanalysis that went undetected in a previously published data set (Meseguer et al., 2002). One prevalent pattern suggests re-parsing of the sentence, a strategy that has been discussed in the literature (Frazier & Rayner, 1982); however, readers differed tremendously in how they orchestrated the various fixation strategies. Our results suggest that the human parsing system non-deterministically adopts different strategies when confronted with the disambiguating material in garden-path sentences. KW - Reading KW - Syntactic reanalysis KW - Eye movements KW - Parsing KW - Individual differences KW - Scanpaths Y1 - 2011 U6 - https://doi.org/10.1016/j.jml.2011.02.004 SN - 0749-596X VL - 65 IS - 2 SP - 109 EP - 127 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Kliegl, Reinhold A1 - Vasishth, Shravan T1 - Determinants of Scanpath Regularity in Reading JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society N2 - Scanpaths have played an important role in classic research on reading behavior. Nevertheless, they have largely been neglected in later research perhaps due to a lack of suitable analytical tools. Recently, von der Malsburg and Vasishth (2011) proposed a new measure for quantifying differences between scanpaths and demonstrated that this measure can recover effects that were missed with the traditional eyetracking measures. However, the sentences used in that study were difficult to process and scanpath effects accordingly strong. The purpose of the present study was to test the validity, sensitivity, and scope of applicability of the scanpath measure, using simple sentences that are typically read from left to right. We derived predictions for the regularity of scanpaths from the literature on oculomotor control, sentence processing, and cognitive aging and tested these predictions using the scanpath measure and a large database of eye movements. All predictions were confirmed: Sentences with short words and syntactically more difficult sentences elicited more irregular scanpaths. Also, older readers produced more irregular scanpaths than younger readers. In addition, we found an effect that was not reported earlier: Syntax had a smaller influence on the eye movements of older readers than on those of young readers. We discuss this interaction of syntactic parsing cost with age in terms of shifts in processing strategies and a decline of executive control as readers age. Overall, our results demonstrate the validity and sensitivity of the scanpath measure and thus establish it as a productive and versatile tool for reading research. KW - Eye movements KW - Reading KW - Scanpaths KW - Language understanding KW - Oculo-motor control KW - Individual differences KW - Aging KW - Development Y1 - 2015 U6 - https://doi.org/10.1111/cogs.12208 SN - 0364-0213 SN - 1551-6709 VL - 39 IS - 7 SP - 1675 EP - 1703 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Patil, Umesh A1 - Hanne, Sandra A1 - Burchert, Frank A1 - De Bleser, Ria A1 - Vasishth, Shravan T1 - A Computational Evaluation of Sentence Processing Deficits in Aphasia JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society N2 - Individuals with agrammatic Broca's aphasia experience difficulty when processing reversible non-canonical sentences. Different accounts have been proposed to explain this phenomenon. The Trace Deletion account (Grodzinsky, 1995, 2000, 2006) attributes this deficit to an impairment in syntactic representations, whereas others (e.g., Caplan, Waters, Dede, Michaud, & Reddy, 2007; Haarmann, Just, & Carpenter, 1997) propose that the underlying structural representations are unimpaired, but sentence comprehension is affected by processing deficits, such as slow lexical activation, reduction in memory resources, slowed processing and/or intermittent deficiency, among others. We test the claims of two processing accounts, slowed processing and intermittent deficiency, and two versions of the Trace Deletion Hypothesis (TDH), in a computational framework for sentence processing (Lewis & Vasishth, 2005) implemented in ACT-R (Anderson, Byrne, Douglass, Lebiere, & Qin, 2004). The assumption of slowed processing is operationalized as slow procedural memory, so that each processing action is performed slower than normal, and intermittent deficiency as extra noise in the procedural memory, so that the parsing steps are more noisy than normal. We operationalize the TDH as an absence of trace information in the parse tree. To test the predictions of the models implementing these theories, we use the data from a German sentence—picture matching study reported in Hanne, Sekerina, Vasishth, Burchert, and De Bleser (2011). The data consist of offline (sentence-picture matching accuracies and response times) and online (eye fixation proportions) measures. From among the models considered, the model assuming that both slowed processing and intermittent deficiency are present emerges as the best model of sentence processing difficulty in aphasia. The modeling of individual differences suggests that, if we assume that patients have both slowed processing and intermittent deficiency, they have them in differing degrees. KW - Aphasia KW - Non-canonical sentences KW - Sentence-picture matching KW - Eye movements KW - Computational modeling KW - Cognitive architecture KW - Individual differences Y1 - 2016 U6 - https://doi.org/10.1111/cogs.12250 SN - 0364-0213 SN - 1551-6709 VL - 40 SP - 5 EP - 50 PB - Wiley-Blackwell CY - Hoboken ER -