TY - JOUR A1 - Metzner, Paul A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan A1 - Roesler, Frank T1 - The Importance of Reading Naturally: Evidence From Combined Recordings of Eye Movements and Electric Brain Potentials JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society KW - Reading KW - Sentence comprehension KW - ERP KW - Eye movements KW - Regressions Y1 - 2017 U6 - https://doi.org/10.1111/cogs.12384 SN - 0364-0213 SN - 1551-6709 VL - 41 SP - 1232 EP - 1263 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Kliegl, Reinhold A1 - Vasishth, Shravan T1 - Determinants of Scanpath Regularity in Reading JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society N2 - Scanpaths have played an important role in classic research on reading behavior. Nevertheless, they have largely been neglected in later research perhaps due to a lack of suitable analytical tools. Recently, von der Malsburg and Vasishth (2011) proposed a new measure for quantifying differences between scanpaths and demonstrated that this measure can recover effects that were missed with the traditional eyetracking measures. However, the sentences used in that study were difficult to process and scanpath effects accordingly strong. The purpose of the present study was to test the validity, sensitivity, and scope of applicability of the scanpath measure, using simple sentences that are typically read from left to right. We derived predictions for the regularity of scanpaths from the literature on oculomotor control, sentence processing, and cognitive aging and tested these predictions using the scanpath measure and a large database of eye movements. All predictions were confirmed: Sentences with short words and syntactically more difficult sentences elicited more irregular scanpaths. Also, older readers produced more irregular scanpaths than younger readers. In addition, we found an effect that was not reported earlier: Syntax had a smaller influence on the eye movements of older readers than on those of young readers. We discuss this interaction of syntactic parsing cost with age in terms of shifts in processing strategies and a decline of executive control as readers age. Overall, our results demonstrate the validity and sensitivity of the scanpath measure and thus establish it as a productive and versatile tool for reading research. KW - Eye movements KW - Reading KW - Scanpaths KW - Language understanding KW - Oculo-motor control KW - Individual differences KW - Aging KW - Development Y1 - 2015 U6 - https://doi.org/10.1111/cogs.12208 SN - 0364-0213 SN - 1551-6709 VL - 39 IS - 7 SP - 1675 EP - 1703 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Boston, Marisa Ferrara A1 - Hale, John T. A1 - Vasishth, Shravan A1 - Kliegl, Reinhold T1 - Parallel processing and sentence comprehension difficulty JF - Language and cognitive processes N2 - Eye fixation durations during normal reading correlate with processing difficulty, but the specific cognitive mechanisms reflected in these measures are not well understood. This study finds support in German readers' eye fixations for two distinct difficulty metrics: surprisal, which reflects the change in probabilities across syntactic analyses as new words are integrated; and retrieval, which quantifies comprehension difficulty in terms of working memory constraints. We examine the predictions of both metrics using a family of dependency parsers indexed by an upper limit on the number of candidate syntactic analyses they retain at successive words. Surprisal models all fixation measures and regression probability. By contrast, retrieval does not model any measure in serial processing. As more candidate analyses are considered in parallel at each word, retrieval can account for the same measures as surprisal. This pattern suggests an important role for ranked parallelism in theories of sentence comprehension. KW - Reading KW - Parsing KW - Computer model KW - Corpus Y1 - 2011 U6 - https://doi.org/10.1080/01690965.2010.492228 SN - 0169-0965 VL - 26 IS - 3 SP - 301 EP - 349 PB - Wiley CY - Hove ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan T1 - What is the scanpath signature of syntactic reanalysis? JF - Journal of memory and language N2 - Which repair strategy does the language system deploy when it gets garden-pathed, and what can regressive eye movements in reading tell us about reanalysis strategies? Several influential eye-tracking studies on syntactic reanalysis (Frazier & Rayner, 1982; Meseguer, Carreiras, & Clifton, 2002; Mitchell, Shen, Green, & Hodgson, 2008) have addressed this question by examining scanpaths, i.e., sequential patterns of eye fixations. However, in the absence of a suitable method for analyzing scanpaths, these studies relied on simplified dependent measures that are arguably ambiguous and hard to interpret. We address the theoretical question of repair strategy by developing a new method that quantifies scanpath similarity. Our method reveals several distinct fixation strategies associated with reanalysis that went undetected in a previously published data set (Meseguer et al., 2002). One prevalent pattern suggests re-parsing of the sentence, a strategy that has been discussed in the literature (Frazier & Rayner, 1982); however, readers differed tremendously in how they orchestrated the various fixation strategies. Our results suggest that the human parsing system non-deterministically adopts different strategies when confronted with the disambiguating material in garden-path sentences. KW - Reading KW - Syntactic reanalysis KW - Eye movements KW - Parsing KW - Individual differences KW - Scanpaths Y1 - 2011 U6 - https://doi.org/10.1016/j.jml.2011.02.004 SN - 0749-596X VL - 65 IS - 2 SP - 109 EP - 127 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Engelmann, Felix A1 - Vasishth, Shravan A1 - Engbert, Ralf A1 - Kliegl, Reinhold T1 - A framework for modeling the interaction of syntactic processing and eye movement control JF - Topics in cognitive science N2 - We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. KW - Sentence comprehension KW - Eye movements KW - Reading KW - Parsing difficulty KW - Working memory KW - Surprisal KW - Computational modeling Y1 - 2013 U6 - https://doi.org/10.1111/tops.12026 SN - 1756-8757 VL - 5 IS - 3 SP - 452 EP - 474 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan T1 - Scanpaths reveal syntactic underspecification and reanalysis strategies JF - Language and cognitive processes N2 - What theories best characterise the parsing processes triggered upon encountering ambiguity, and what effects do these processes have on eye movement patterns in reading? The present eye-tracking study, which investigated processing of attachment ambiguities of an adjunct in Spanish, suggests that readers sometimes underspecify attachment to save memory resources, consistent with the good-enough account of parsing. Our results confirm a surprising prediction of the good-enough account: high-capacity readers commit to an attachment decision more often than low-capacity participants, leading to more errors and a greater need to reanalyse in garden-path sentences. These results emerged only when we separated functionally different types of regressive eye movements using a scanpath analysis; conventional eye-tracking measures alone would have led to different conclusions. The scanpath analysis also showed that rereading was the dominant strategy for recovering from garden-pathing. Our results may also have broader implications for models of reading processes: reanalysis effects in eye movements occurred late, which suggests that the coupling of oculo-motor control and the parser may not be as tight as assumed in current computational models of eye movement control in reading. KW - Reading KW - Eye movements KW - Scanpaths KW - Parsing KW - Reanalysis KW - Individual differences KW - Working memory KW - Underspecification Y1 - 2013 U6 - https://doi.org/10.1080/01690965.2012.728232 SN - 0169-0965 SN - 1464-0732 VL - 28 IS - 10 SP - 1545 EP - 1578 PB - Wiley CY - Hove ER -