TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan T1 - What is the scanpath signature of syntactic reanalysis? JF - Journal of memory and language N2 - Which repair strategy does the language system deploy when it gets garden-pathed, and what can regressive eye movements in reading tell us about reanalysis strategies? Several influential eye-tracking studies on syntactic reanalysis (Frazier & Rayner, 1982; Meseguer, Carreiras, & Clifton, 2002; Mitchell, Shen, Green, & Hodgson, 2008) have addressed this question by examining scanpaths, i.e., sequential patterns of eye fixations. However, in the absence of a suitable method for analyzing scanpaths, these studies relied on simplified dependent measures that are arguably ambiguous and hard to interpret. We address the theoretical question of repair strategy by developing a new method that quantifies scanpath similarity. Our method reveals several distinct fixation strategies associated with reanalysis that went undetected in a previously published data set (Meseguer et al., 2002). One prevalent pattern suggests re-parsing of the sentence, a strategy that has been discussed in the literature (Frazier & Rayner, 1982); however, readers differed tremendously in how they orchestrated the various fixation strategies. Our results suggest that the human parsing system non-deterministically adopts different strategies when confronted with the disambiguating material in garden-path sentences. KW - Reading KW - Syntactic reanalysis KW - Eye movements KW - Parsing KW - Individual differences KW - Scanpaths Y1 - 2011 U6 - https://doi.org/10.1016/j.jml.2011.02.004 SN - 0749-596X VL - 65 IS - 2 SP - 109 EP - 127 PB - Elsevier CY - San Diego ER - TY - THES A1 - von der Malsburg, Titus Raban T1 - Scanpath phenomena in reading : an investigation of scanpath effects in syntactic ambiguity resolution and in general reading Y1 - 2012 CY - Potsdam ER - TY - JOUR A1 - Vasishth, Shravan A1 - von der Malsburg, Titus Raban A1 - Engelmann, Felix T1 - What eye movements can tell us about sentence comprehension JF - Wiley interdisciplinary reviews : Cognitive Science N2 - Eye movement data have proven to be very useful for investigating human sentence processing. Eyetracking research has addressed a wide range of questions, such as recovery mechanisms following garden-pathing, the timing of processes driving comprehension, the role of anticipation and expectation in parsing, the role of semantic, pragmatic, and prosodic information, and so on. However, there are some limitations regarding the inferences that can be made on the basis of eye movements. One relates to the nontrivial interaction between parsing and the eye movement control system which complicates the interpretation of eye movement data. Detailed computational models that integrate parsing with eye movement control theories have the potential to unpack the complexity of eye movement data and can therefore aid in the interpretation of eye movements. Another limitation is the difficulty of capturing spatiotemporal patterns in eye movements using the traditional word-based eyetracking measures. Recent research has demonstrated the relevance of these patterns and has shown how they can be analyzed. In this review, we focus on reading, and present examples demonstrating how eye movement data reveal what events unfold when the parser runs into difficulty, and how the parsing system interacts with eye movement control. WIREs Cogn Sci 2013, 4:125134. doi: 10.1002/wcs.1209 For further resources related to this article, please visit the WIREs website. Y1 - 2013 U6 - https://doi.org/10.1002/wcs.1209 SN - 1939-5078 VL - 4 IS - 2 SP - 125 EP - 134 PB - Wiley CY - San Fransisco ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan T1 - Scanpaths reveal syntactic underspecification and reanalysis strategies JF - Language and cognitive processes N2 - What theories best characterise the parsing processes triggered upon encountering ambiguity, and what effects do these processes have on eye movement patterns in reading? The present eye-tracking study, which investigated processing of attachment ambiguities of an adjunct in Spanish, suggests that readers sometimes underspecify attachment to save memory resources, consistent with the good-enough account of parsing. Our results confirm a surprising prediction of the good-enough account: high-capacity readers commit to an attachment decision more often than low-capacity participants, leading to more errors and a greater need to reanalyse in garden-path sentences. These results emerged only when we separated functionally different types of regressive eye movements using a scanpath analysis; conventional eye-tracking measures alone would have led to different conclusions. The scanpath analysis also showed that rereading was the dominant strategy for recovering from garden-pathing. Our results may also have broader implications for models of reading processes: reanalysis effects in eye movements occurred late, which suggests that the coupling of oculo-motor control and the parser may not be as tight as assumed in current computational models of eye movement control in reading. KW - Reading KW - Eye movements KW - Scanpaths KW - Parsing KW - Reanalysis KW - Individual differences KW - Working memory KW - Underspecification Y1 - 2013 U6 - https://doi.org/10.1080/01690965.2012.728232 SN - 0169-0965 SN - 1464-0732 VL - 28 IS - 10 SP - 1545 EP - 1578 PB - Wiley CY - Hove ER - TY - JOUR A1 - Metzner, Paul-Philipp A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan A1 - Rösler, Frank T1 - Brain Responses to World Knowledge Violations: A Comparison of Stimulus- and Fixation-triggered Event-related Potentials and Neural Oscillations JF - Journal of cognitive neuroscience N2 - Recent research has shown that brain potentials time-locked to fixations in natural reading can be similar to brain potentials recorded during rapid serial visual presentation (RSVP). We attempted two replications of Hagoort, Hald, Bastiaansen, and Petersson [Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. Integration of word meaning and world knowledge in language comprehension. Science, 304, 438-441, 2004] to determine whether this correspondence also holds for oscillatory brain responses. Hagoort et al. reported an N400 effect and synchronization in the theta and gamma range following world knowledge violations. Our first experiment (n = 32) used RSVP and replicated both the N400 effect in the ERPs and the power increase in the theta range in the time-frequency domain. In the second experiment (n = 49), participants read the same materials freely while their eye movements and their EEG were monitored. First fixation durations, gaze durations, and regression rates were increased, and the ERP showed an N400 effect. An analysis of time-frequency representations showed synchronization in the delta range (1-3 Hz) and desynchronization in the upper alpha range (11-13 Hz) but no theta or gamma effects. The results suggest that oscillatory EEG changes elicited by world knowledge violations are different in natural reading and RSVP. This may reflect differences in how representations are constructed and retrieved from memory in the two presentation modes. Y1 - 2015 U6 - https://doi.org/10.1162/jocn_a_00731 SN - 0898-929X SN - 1530-8898 VL - 27 IS - 5 SP - 1017 EP - 1028 PB - MIT Press CY - Cambridge ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Kliegl, Reinhold A1 - Vasishth, Shravan T1 - Determinants of Scanpath Regularity in Reading JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society N2 - Scanpaths have played an important role in classic research on reading behavior. Nevertheless, they have largely been neglected in later research perhaps due to a lack of suitable analytical tools. Recently, von der Malsburg and Vasishth (2011) proposed a new measure for quantifying differences between scanpaths and demonstrated that this measure can recover effects that were missed with the traditional eyetracking measures. However, the sentences used in that study were difficult to process and scanpath effects accordingly strong. The purpose of the present study was to test the validity, sensitivity, and scope of applicability of the scanpath measure, using simple sentences that are typically read from left to right. We derived predictions for the regularity of scanpaths from the literature on oculomotor control, sentence processing, and cognitive aging and tested these predictions using the scanpath measure and a large database of eye movements. All predictions were confirmed: Sentences with short words and syntactically more difficult sentences elicited more irregular scanpaths. Also, older readers produced more irregular scanpaths than younger readers. In addition, we found an effect that was not reported earlier: Syntax had a smaller influence on the eye movements of older readers than on those of young readers. We discuss this interaction of syntactic parsing cost with age in terms of shifts in processing strategies and a decline of executive control as readers age. Overall, our results demonstrate the validity and sensitivity of the scanpath measure and thus establish it as a productive and versatile tool for reading research. KW - Eye movements KW - Reading KW - Scanpaths KW - Language understanding KW - Oculo-motor control KW - Individual differences KW - Aging KW - Development Y1 - 2015 U6 - https://doi.org/10.1111/cogs.12208 SN - 0364-0213 SN - 1551-6709 VL - 39 IS - 7 SP - 1675 EP - 1703 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Schotter, Elizabeth Roye A1 - Leinenger, Mallorie A1 - von der Malsburg, Titus Raban T1 - When your mind skips what your eyes fixate BT - how forced fixations lead to comprehension illusions in reading JF - Psychonomic bulletin & review : a journal of the Psychonomic Society N2 - The phenomenon of forced fixations suggests that readers sometimes fixate a word (due to oculomotor constraints) even though they intended to skip it (due to parafoveal cognitive-linguistic processing). We investigate whether this leads readers to look directly at a word but not pay attention to it. We used a gaze-contingent boundary paradigm to dissociate parafoveal and foveal information (e.g., the word phone changed to scarf once the reader's eyes moved to it) and asked questions about the sentence to determine which one the reader encoded. When the word was skipped or fixated only briefly (i.e., up to 100 ms) readers were more likely to report reading the parafoveal than the fixated word, suggesting that there are cases in which readers look directly at a word but their minds ignore it, leading to the illusion of reading something they did not fixate. KW - Word recognition KW - Text comprehension KW - Eye movements and reading Y1 - 2017 U6 - https://doi.org/10.3758/s13423-017-1356-y SN - 1069-9384 SN - 1531-5320 VL - 25 IS - 5 SP - 1884 EP - 1890 PB - Springer CY - New York ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Angele, Bernhard T1 - False positives and other statistical errors in standard analyses of eye movements in reading JF - Journal of memory and language N2 - In research on eye movements in reading, it is common to analyze a number of canonical dependent measures to study how the effects of a manipulation unfold over time. Although this gives rise to the well-known multiple comparisons problem, i.e. an inflated probability that the null hypothesis is incorrectly rejected (Type I error), it is accepted standard practice not to apply any correction procedures. Instead, there appears to be a widespread belief that corrections are not necessary because the increase in false positives is too small to matter. To our knowledge, no formal argument has ever been presented to justify this assumption. Here, we report a computational investigation of this issue using Monte Carlo simulations. Our results show that, contrary to conventional wisdom, false positives are increased to unacceptable levels when no corrections are applied. Our simulations also show that counter-measures like the Bonferroni correction keep false positives in check while reducing statistical power only moderately. Hence, there is little reason why such corrections should not be made a standard requirement. Further, we discuss three statistical illusions that can arise when statistical power is low, and we show how power can be improved to prevent these illusions. In sum, our work renders a detailed picture of the various types of statistical errors than can occur in studies of reading behavior and we provide concrete guidance about how these errors can be avoided. (C) 2016 Elsevier Inc. All rights reserved. KW - Statistics KW - False positives KW - Null-hypothesis testing KW - Eye-tracking KW - Reading KW - Sentence processing Y1 - 2017 U6 - https://doi.org/10.1016/j.jml.2016.10.003 SN - 0749-596X SN - 1096-0821 VL - 94 SP - 119 EP - 133 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Metzner, Paul A1 - von der Malsburg, Titus Raban A1 - Vasishth, Shravan A1 - Roesler, Frank T1 - The Importance of Reading Naturally: Evidence From Combined Recordings of Eye Movements and Electric Brain Potentials JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society KW - Reading KW - Sentence comprehension KW - ERP KW - Eye movements KW - Regressions Y1 - 2017 U6 - https://doi.org/10.1111/cogs.12384 SN - 0364-0213 SN - 1551-6709 VL - 41 SP - 1232 EP - 1263 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Schotter, Elizabeth Roye A1 - von der Malsburg, Titus Raban A1 - Leinenger, Mallorie T1 - Forced Fixations, Trans-Saccadic Integration, and Word Recognition BT - Evidence for a Hybrid Mechanism of Saccade Triggering in Reading JF - Journal of experimental psychology : Learning, memory, and cognition N2 - Recent studies using the gaze-contingent boundary paradigm reported a reversed preview benefit- shorter fixations on a target word when an unrelated preview was easier to process than the fixated target (Schotter & Leinenger, 2016). This is explained viaforeedfixatiotzs-short fixations on words that would ideally be skipped (because lexical processing has progressed enough) but could not be because saccade planning reached a point of no return. This contrasts with accounts of preview effects via trans-saccadic integration-shorter fixations on a target word when the preview is more similar to it (see Cutter. Drieghe, & Liversedge, 2015). In addition, if the previewed word-not the fixated target-determines subsequent eye movements, is it also this word that enters the linguistic processing stream? We tested these accounts by having 24 subjects read 150 sentences in the boundary paradigm in which both the preview and target were initially plausible but later one, both, or neither became implausible, providing an opportunity to probe which one was linguistically encoded. In an intervening buffer region, both words were plausible, providing an opportunity to investigate trans-saccadic integration. The frequency of the previewed word affected progressive saccades (i.e.. forced fixations) as well as when transsaccadic integration failure increased regressions, but, only the implausibility of the target word affected semantic encoding. These data support a hybrid account of saccadic control (Reingold, Reichle. Glaholt, & Sheridan, 2012) driven by incomplete (often parafoveal) word recognition, which occurs prior to complete (often foveal) word recognition. KW - parafoveal processing KW - word recognition KW - regressive saccades KW - eye movements KW - reading Y1 - 2019 U6 - https://doi.org/10.1037/xlm0000617 SN - 0278-7393 SN - 1939-1285 VL - 45 IS - 4 SP - 677 EP - 688 PB - American Psychological Association CY - Washington ER -