TY - JOUR A1 - Rabe, Maximilian Michael A1 - Chandra, Johan A1 - Krügel, André A1 - Seelig, Stefan A. A1 - Vasishth, Shravan A1 - Engbert, Ralf T1 - A bayesian approach to dynamical modeling of eye-movement control in reading of normal, mirrored, and scrambled texts JF - Psychological Review N2 - In eye-movement control during reading, advanced process-oriented models have been developed to reproduce behavioral data. So far, model complexity and large numbers of model parameters prevented rigorous statistical inference and modeling of interindividual differences. Here we propose a Bayesian approach to both problems for one representative computational model of sentence reading (SWIFT; Engbert et al., Psychological Review, 112, 2005, pp. 777-813). We used experimental data from 36 subjects who read the text in a normal and one of four manipulated text layouts (e.g., mirrored and scrambled letters). The SWIFT model was fitted to subjects and experimental conditions individually to investigate between- subject variability. Based on posterior distributions of model parameters, fixation probabilities and durations are reliably recovered from simulated data and reproduced for withheld empirical data, at both the experimental condition and subject levels. A subsequent statistical analysis of model parameters across reading conditions generates model-driven explanations for observable effects between conditions. KW - reading eye movements KW - dynamical models KW - Bayesian inference KW - oculomotor KW - control KW - individual differences Y1 - 2021 U6 - https://doi.org/10.1037/rev0000268 SN - 0033-295X SN - 1939-1471 VL - 128 IS - 5 SP - 803 EP - 823 PB - American Psychological Association CY - Washington ER - TY - CHAP A1 - Engbert, Ralf T1 - A computational model of microsaccadic responses to shifts of covert attention T2 - Perception Y1 - 2012 SN - 0301-0066 SN - 1468-4233 VL - 41 SP - 55 EP - 55 PB - Sage Publ. CY - London ER - TY - JOUR A1 - Engbert, Ralf A1 - Longtin, Andre A1 - Kliegl, Reinhold T1 - A dynamical model of saccade generation in reading based on spatially distributed lexical processing Y1 - 2002 ER - TY - JOUR A1 - Engelmann, Felix A1 - Vasishth, Shravan A1 - Engbert, Ralf A1 - Kliegl, Reinhold T1 - A framework for modeling the interaction of syntactic processing and eye movement control JF - Topics in cognitive science N2 - We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. KW - Sentence comprehension KW - Eye movements KW - Reading KW - Parsing difficulty KW - Working memory KW - Surprisal KW - Computational modeling Y1 - 2013 U6 - https://doi.org/10.1111/tops.12026 SN - 1756-8757 VL - 5 IS - 3 SP - 452 EP - 474 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Malem-Shinitski, Noa A1 - Opper, Manfred A1 - Reich, Sebastian A1 - Schwetlick, Lisa A1 - Seelig, Stefan A. A1 - Engbert, Ralf T1 - A mathematical model of local and global attention in natural scene viewing JF - PLoS Computational Biology : a new community journal N2 - Author summary
Switching between local and global attention is a general strategy in human information processing. We investigate whether this strategy is a viable approach to model sequences of fixations generated by a human observer in a free viewing task with natural scenes. Variants of the basic model are used to predict the experimental data based on Bayesian inference. Results indicate a high predictive power for both aggregated data and individual differences across observers. The combination of a novel model with state-of-the-art Bayesian methods lends support to our two-state model using local and global internal attention states for controlling eye movements.
Understanding the decision process underlying gaze control is an important question in cognitive neuroscience with applications in diverse fields ranging from psychology to computer vision. The decision for choosing an upcoming saccade target can be framed as a selection process between two states: Should the observer further inspect the information near the current gaze position (local attention) or continue with exploration of other patches of the given scene (global attention)? Here we propose and investigate a mathematical model motivated by switching between these two attentional states during scene viewing. The model is derived from a minimal set of assumptions that generates realistic eye movement behavior. We implemented a Bayesian approach for model parameter inference based on the model's likelihood function. In order to simplify the inference, we applied data augmentation methods that allowed the use of conjugate priors and the construction of an efficient Gibbs sampler. This approach turned out to be numerically efficient and permitted fitting interindividual differences in saccade statistics. Thus, the main contribution of our modeling approach is two-fold; first, we propose a new model for saccade generation in scene viewing. Second, we demonstrate the use of novel methods from Bayesian inference in the field of scan path modeling. Y1 - 2020 U6 - https://doi.org/10.1371/journal.pcbi.1007880 SN - 1553-734X SN - 1553-7358 VL - 16 IS - 12 PB - PLoS CY - San Fransisco ER - TY - JOUR A1 - Kruegel, Andre A1 - Engbert, Ralf T1 - A model of saccadic landing positions in reading under the influence of sensory noise JF - Visual cognition KW - Bayesian estimation KW - Word boundaries KW - Saccade planning KW - Mathematical model KW - Eye movements during reading Y1 - 2014 U6 - https://doi.org/10.1080/13506285.2014.894166 SN - 1350-6285 SN - 1464-0716 VL - 22 IS - 3-4 SP - 334 EP - 353 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Herrmann, Carl J. J. A1 - Metzler, Ralf A1 - Engbert, Ralf T1 - A self-avoiding walk with neural delays as a model of fixational eye movements JF - Scientific reports N2 - Fixational eye movements show scaling behaviour of the positional mean-squared displacement with a characteristic transition from persistence to antipersistence for increasing time-lag. These statistical patterns were found to be mainly shaped by microsaccades (fast, small-amplitude movements). However, our re-analysis of fixational eye-movement data provides evidence that the slow component (physiological drift) of the eyes exhibits scaling behaviour of the mean-squared displacement that varies across human participants. These results suggest that drift is a correlated movement that interacts with microsaccades. Moreover, on the long time scale, the mean-squared displacement of the drift shows oscillations, which is also present in the displacement auto-correlation function. This finding lends support to the presence of time-delayed feedback in the control of drift movements. Based on an earlier non-linear delayed feedback model of fixational eye movements, we propose and discuss different versions of a new model that combines a self-avoiding walk with time delay. As a result, we identify a model that reproduces oscillatory correlation functions, the transition from persistence to antipersistence, and microsaccades. Y1 - 2017 U6 - https://doi.org/10.1038/s41598-017-13489-8 SN - 2045-2322 VL - 7 PB - Nature Publ. Group CY - London ER - TY - JOUR A1 - Risse, Sarah A1 - Hohenstein, Sven A1 - Kliegl, Reinhold A1 - Engbert, Ralf T1 - A theoretical analysis of the perceptual span based on SWIFT simulations of the n+2 boundary paradigm JF - Visual cognition N2 - Eye-movement experiments suggest that the perceptual span during reading is larger than the fixated word, asymmetric around the fixation position, and shrinks in size contingent on the foveal processing load. We used the SWIFT model of eye-movement control during reading to test these hypotheses and their implications under the assumption of graded parallel processing of all words inside the perceptual span. Specifically, we simulated reading in the boundary paradigm and analysed the effects of denying the model to have valid preview of a parafoveal word n + 2 two words to the right of fixation. Optimizing the model parameters for the valid preview condition only, we obtained span parameters with remarkably realistic estimates conforming to the empirical findings on the size of the perceptual span. More importantly, the SWIFT model generated parafoveal processing up to word n + 2 without fitting the model to such preview effects. Our results suggest that asymmetry and dynamic modulation are plausible properties of the perceptual span in a parallel word-processing model such as SWIFT. Moreover, they seem to guide the flexible distribution of processing resources during reading between foveal and parafoveal words. KW - Eye movements KW - Reading KW - Computational modelling KW - Perceptual span KW - Preview Y1 - 2014 U6 - https://doi.org/10.1080/13506285.2014.881444 SN - 1350-6285 SN - 1464-0716 VL - 22 IS - 3-4 SP - 283 EP - 308 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Krampe, Ralf-Thomas A1 - Engbert, Ralf A1 - Kliegl, Reinhold T1 - Age-specific problems in rhythmic timing Y1 - 2001 ER - TY - JOUR A1 - Engbert, Ralf A1 - Mergenthaler, Konstantin A1 - Sinn, Petra A1 - Pikovskij, Arkadij T1 - An integrated model of fixational eye movements and microsaccades JF - Proceedings of the National Academy of Sciences of the United States of America N2 - When we fixate a stationary target, our eyes generate miniature (or fixational) eye movements involuntarily. These fixational eye movements are classified as slow components (physiological drift, tremor) and microsaccades, which represent rapid, small-amplitude movements. Here we propose an integrated mathematical model for the generation of slow fixational eye movements and microsaccades. The model is based on the concept of self-avoiding random walks in a potential, a process driven by a self-generated activation field. The self-avoiding walk generates persistent movements on a short timescale, whereas, on a longer timescale, the potential produces antipersistent motions that keep the eye close to an intended fixation position. We introduce microsaccades as fast movements triggered by critical activation values. As a consequence, both slow movements and microsaccades follow the same law of motion; i.e., movements are driven by the self-generated activation field. Thus, the model contributes a unified explanation of why it has been a long-standing problem to separate slow movements and microsaccades with respect to their motion-generating principles. We conclude that the concept of a self-avoiding random walk captures fundamental properties of fixational eye movements and provides a coherent theoretical framework for two physiologically distinct movement types. Y1 - 2011 U6 - https://doi.org/10.1073/pnas.1102730108 SN - 0027-8424 VL - 108 IS - 39 SP - E765 EP - E770 PB - National Acad. of Sciences CY - Washington ER -