TY - JOUR A1 - Schwetlick, Lisa A1 - Backhaus, Daniel A1 - Engbert, Ralf T1 - A dynamical scan-path model for task-dependence during scene viewing JF - Psychological review N2 - In real-world scene perception, human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional probabilities of gaze positions for a given image via saliency maps. Recently, progress has been made on models for the generation of scan paths under the constraints of saliency as well as attentional and oculomotor restrictions. Experimental research demonstrated that task constraints can have a strong impact on viewing behavior. Here, we propose a scan-path model for both fixation positions and fixation durations, which include influences of task instructions and interindividual differences. Based on an eye-movement experiment with four different task conditions, we estimated model parameters for each individual observer and task condition using a fully Bayesian dynamical modeling framework using a joint spatial-temporal likelihood approach with sequential estimation. Resulting parameter values demonstrate that model properties such as the attentional span are adjusted to task requirements. Posterior predictive checks indicate that our dynamical model can reproduce task differences in scan-path statistics across individual observers. KW - scene viewing KW - eye movements KW - task dependence KW - individual differences; KW - Bayesian inference Y1 - 2023 U6 - https://doi.org/10.1037/rev0000379 SN - 0033-295X SN - 1939-1471 VL - 130 IS - 3 SP - 807 EP - 840 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Parshina, Olga A1 - Laurinavichyute, Anna A1 - Sekerina, Irina A. T1 - Eye-movement benchmarks in heritage language reading JF - Bilingualism : language and cognition N2 - This eye-tracking study establishes basic benchmarks of eye movements during reading in heritage language (HL) by Russian-speaking adults and adolescents of high (n = 21) and low proficiency (n = 27). Heritage speakers (HSs) read sentences in Cyrillic, and their eye movements were compared to those of Russian monolingual skilled adult readers, 8-year-old children and L2 learners. Reading patterns of HSs revealed longer mean fixation durations, lower skipping probabilities, and higher regressive saccade rates than in monolingual adults. High-proficient HSs were more similar to monolingual children, while low-proficient HSs performed on par with L2 learners. Low-proficient HSs differed from high-proficient HSs in exhibiting lower skipping probabilities, higher fixation counts, and larger frequency effects. Taken together, our findings are consistent with the weaker links account of bilingual language processing as well as the divergent attainment theory of HL. KW - bilingualism KW - heritage language KW - reading KW - eye movements KW - Russian KW - children KW - L2 learners Y1 - 2021 U6 - https://doi.org/10.1017/S136672892000019X SN - 1366-7289 SN - 1469-1841 VL - 24 IS - 1 SP - 69 EP - 82 PB - Cambridge University Press CY - Cambridge ER - TY - THES A1 - Rabe, Maximilian Michael T1 - Modeling the interaction of sentence processing and eye-movement control in reading T1 - Modellierung der Interaktion von Satzverarbeitung und Blickbewegungskontrolle beim Lesen N2 - The evaluation of process-oriented cognitive theories through time-ordered observations is crucial for the advancement of cognitive science. The findings presented herein integrate insights from research on eye-movement control and sentence comprehension during reading, addressing challenges in modeling time-ordered data, statistical inference, and interindividual variability. Using kernel density estimation and a pseudo-marginal likelihood for fixation durations and locations, a likelihood implementation of the SWIFT model of eye-movement control during reading (Engbert et al., Psychological Review, 112, 2005, pp. 777–813) is proposed. Within the broader framework of data assimilation, Bayesian parameter inference with adaptive Markov Chain Monte Carlo techniques is facilitated for reliable model fitting. Across the different studies, this framework has shown to enable reliable parameter recovery from simulated data and prediction of experimental summary statistics. Despite its complexity, SWIFT can be fitted within a principled Bayesian workflow, capturing interindividual differences and modeling experimental effects on reading across different geometrical alterations of text. Based on these advancements, the integrated dynamical model SEAM is proposed, which combines eye-movement control, a traditionally psychological research area, and post-lexical language processing in the form of cue-based memory retrieval (Lewis & Vasishth, Cognitive Science, 29, 2005, pp. 375–419), typically the purview of psycholinguistics. This proof-of-concept integration marks a significant step forward in natural language comprehension during reading and suggests that the presented methodology can be useful to develop complex cognitive dynamical models that integrate processes at levels of perception, higher cognition, and (oculo-)motor control. These findings collectively advance process-oriented cognitive modeling and highlight the importance of Bayesian inference, individual differences, and interdisciplinary integration for a holistic understanding of reading processes. Implications for theory and methodology, including proposals for model comparison and hierarchical parameter inference, are briefly discussed. N2 - Die Evaluierung prozessorientierter kognitiver Theorien durch zeitlich geordnete Beobachtungen ist ein zentraler Baustein für die Weiterentwicklung der Kognitionswissenschaft. Die hier präsentierten Ergebnisse integrieren Erkenntnisse aus der Forschung zur Blickbewegungskontrolle und zur Satzverarbeitung beim Lesen und gehen dabei auf Herausforderungen bei der Modellierung von zeitlich geordneten Daten, statistischer Inferenz und interindividueller Variabilität ein. Unter Verwendung von Kerndichteschätzung und einer pseudo-marginalen Wahrscheinlichkeitverteilung für Fixationsdauern und -orte wird eine Implementation für die Likelihood des SWIFT-Modells zur Blickbewegungskontrolle beim Lesen (Engbert et al., Psychological Review, 112, 2005, S. 777–813) eingeführt. Im breiteren Kontext der Datenassimilation wird Bayes'sche Parameterinferenz mit adaptiven Markov-Chain-Monte-Carlo-Techniken verwendet, um eine zuverlässige Modellanpassung zu ermöglichen. In verschiedenen Studien hat sich dieser methodische Rahmen als geeignet erwiesen, um zuverlässige Parameterrückgewinnung aus simulierten Daten und Vorhersage experimenteller Zusammenfassungsstatistiken zu ermöglichen. Trotz dessen Komplexität kann SWIFT innerhalb eines fundierten Bayes'schen Workflows angepasst werden und macht daraufhin zuverlässige Vorhersagen für interindividuelle Unterschiede sowie die Modellierung experimenteller Effekte bei verschiedenen geometrischen Änderungen von Text. Basierend auf diesen Fortschritten wird das integrierte dynamische Modell SEAM eingeführt. Dieses kombiniert die Forschungsgebiete der traditionell psychologisch geprägten Blickbewegungskontrolle und der traditionell psycholinguistisch geprägten postlexikalischen Sprachverarbeitung in Form von cue-basiertem Gedächtnisabruf (Lewis & Vasishth, Cognitive Science, 29, 2005, S. 375–419). Der Nachweis der Durchführbarkeit solcher integrativer Modelle stellt einen bedeutenden Fortschritt bei der natürlichen Sprachverarbeitung beim Lesen dar und legt nahe, dass die vorgestellte Methodik nützlich sein kann, um komplexe kognitive dynamische Modelle zu entwickeln, die Prozesse auf den Ebenen der Wahrnehmung, höheren Kognition, und (okulo-)motorischen Kontrolle integrieren. Diese Erkenntnisse fördern insgesamt die prozessorientierte kognitive Modellierung und betonen die Bedeutung der Bayes'schen Inferenz, individueller Unterschiede und interdisziplinärer Integration für ein ganzheitliches Verständnis von Leseprozessen. Implikationen für Theorie und Methodologie, einschließlich Vorschlägen für Modellvergleich und hierarchische Parameterinferenz, werden kurz diskutiert. KW - eye movements KW - dynamical cognitive modeling KW - sequential likelihood KW - psycholinguistics KW - cognitive psychology KW - sentence processing KW - reading KW - Blickbewegungen KW - Dynamische kognitive Modellierung KW - Sequenzielle Likelihood KW - Psycholinguistik KW - Kognitionspsychologie KW - Satzverarbeitung KW - Lesen Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-622792 ER - TY - JOUR A1 - Cajar, Anke A1 - Engbert, Ralf A1 - Laubrock, Jochen T1 - How spatial frequencies and color drive object search in real-world scenes BT - a new eye-movement corpus JF - Journal of vision N2 - When studying how people search for objects in scenes, the inhomogeneity of the visual field is often ignored. Due to physiological limitations, peripheral vision is blurred and mainly uses coarse-grained information (i.e., low spatial frequencies) for selecting saccade targets, whereas high-acuity central vision uses fine-grained information (i.e., high spatial frequencies) for analysis of details. Here we investigated how spatial frequencies and color affect object search in real-world scenes. Using gaze-contingent filters, we attenuated high or low frequencies in central or peripheral vision while viewers searched color or grayscale scenes. Results showed that peripheral filters and central high-pass filters hardly affected search accuracy, whereas accuracy dropped drastically with central low-pass filters. Peripheral filtering increased the time to localize the target by decreasing saccade amplitudes and increasing number and duration of fixations. The use of coarse-grained information in the periphery was limited to color scenes. Central filtering increased the time to verify target identity instead, especially with low-pass filters. We conclude that peripheral vision is critical for object localization and central vision is critical for object identification. Visual guidance during peripheral object localization is dominated by low-frequency color information, whereas high-frequency information, relatively independent of color, is most important for object identification in central vision. KW - scene viewing KW - eye movements KW - object search KW - central and peripheral KW - vision KW - spatial frequencies KW - color KW - gaze-contingent displays Y1 - 2020 U6 - https://doi.org/10.1167/jov.20.7.8 SN - 1534-7362 VL - 20 IS - 7 PB - Association for Research in Vision and Opthalmology CY - Rockville ER - TY - JOUR A1 - Meixner, Johannes M. A1 - Nixon, Jessie S. A1 - Laubrock, Jochen T1 - The perceptual span is dynamically adjusted in response to foveal load by beginning readers JF - Journal of experimental psychology : general N2 - The perceptual span describes the size of the visual field from which information is obtained during a fixation in reading. Its size depends on characteristics of writing system and reader, but-according to the foveal load hypothesis-it is also adjusted dynamically as a function of lexical processing difficulty. Using the moving window paradigm to manipulate the amount of preview, here we directly test whether the perceptual span shrinks as foveal word difficulty increases. We computed the momentary size of the span from word-based eye-movement measures as a function of foveal word frequency, allowing us to separately describe the perceptual span for information affecting spatial saccade targeting and temporal saccade execution. First fixation duration and gaze duration on the upcoming (parafoveal) word N + 1 were significantly shorter when the current (foveal) word N was more frequent. We show that the word frequency effect is modulated by window size. Fixation durations on word N + 1 decreased with high-frequency words N, but only for large windows, that is, when sufficient parafoveal preview was available. This provides strong support for the foveal load hypothesis. To investigate the development of the foveal load effect, we analyzed data from three waves of a longitudinal study on the perceptual span with German children in Grades 1 to 6. Perceptual span adjustment emerged early in development at around second grade and remained stable in later grades. We conclude that the local modulation of the perceptual span indicates a general cognitive process, perhaps an attentional gradient with rapid readjustment. KW - eye movements KW - attention KW - perceptual span KW - foveal load KW - reading KW - development Y1 - 2022 U6 - https://doi.org/10.1037/xge0001140 SN - 0096-3445 SN - 1939-2222 VL - 151 IS - 6 SP - 1219 EP - 1232 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Seelig, Stefan A. A1 - Rabe, Maximilian Michael A1 - Malem-Shinitski, Noa A1 - Risse, Sarah A1 - Reich, Sebastian A1 - Engbert, Ralf T1 - Bayesian parameter estimation for the SWIFT model of eye-movement control during reading JF - Journal of mathematical psychology N2 - Process-oriented theories of cognition must be evaluated against time-ordered observations. Here we present a representative example for data assimilation of the SWIFT model, a dynamical model of the control of fixation positions and fixation durations during natural reading of single sentences. First, we develop and test an approximate likelihood function of the model, which is a combination of a spatial, pseudo-marginal likelihood and a temporal likelihood obtained by probability density approximation Second, we implement a Bayesian approach to parameter inference using an adaptive Markov chain Monte Carlo procedure. Our results indicate that model parameters can be estimated reliably for individual subjects. We conclude that approximative Bayesian inference represents a considerable step forward for computational models of eye-movement control, where modeling of individual data on the basis of process-based dynamic models has not been possible so far. KW - dynamical models KW - reading KW - eye movements KW - saccades KW - likelihood function KW - Bayesian inference KW - MCMC KW - interindividual differences Y1 - 2020 U6 - https://doi.org/10.1016/j.jmp.2019.102313 SN - 0022-2496 SN - 1096-0880 VL - 95 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Adam, Maurits A1 - Elsner, Birgit T1 - The impact of salient action effects on 6-, 7-, and 11-month-olds’ goal-predictive gaze shifts for a human grasping action JF - PLOS ONE N2 - When infants observe a human grasping action, experience-based accounts predict that all infants familiar with grasping actions should be able to predict the goal regardless of additional agency cues such as an action effect. Cue-based accounts, however, suggest that infants use agency cues to identify and predict action goals when the action or the agent is not familiar. From these accounts, we hypothesized that younger infants would need additional agency cues such as a salient action effect to predict the goal of a human grasping action, whereas older infants should be able to predict the goal regardless of agency cues. In three experiments, we presented 6-, 7-, and 11-month-olds with videos of a manual grasping action presented either with or without an additional salient action effect (Exp. 1 and 2), or we presented 7-month-olds with videos of a mechanical claw performing a grasping action presented with a salient action effect (Exp. 3). The 6-month-olds showed tracking gaze behavior, and the 11-month-olds showed predictive gaze behavior, regardless of the action effect. However, the 7-month-olds showed predictive gaze behavior in the action-effect condition, but tracking gaze behavior in the no-action-effect condition and in the action-effect condition with a mechanical claw. The results therefore support the idea that salient action effects are especially important for infants' goal predictions from 7 months on, and that this facilitating influence of action effects is selective for the observation of human hands. KW - attention KW - eye movements KW - infants perception KW - mechanisms KW - origins Y1 - 2020 U6 - https://doi.org/10.1371/journal.pone.0240165 SN - 1932-6203 VL - 15 IS - 10 PB - Public Library of Science CY - San Fransisco ER - TY - GEN A1 - Cajar, Anke A1 - Engbert, Ralf A1 - Laubrock, Jochen T1 - Potsdam Eye-Movement Corpus for Scene Memorization and Search With Color and Spatial-Frequency Filtering T2 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 788 KW - eye movements KW - corpus dataset KW - scene viewing KW - object search KW - scene memorization KW - spatial frequencies KW - color KW - central and peripheral vision Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-563184 SN - 1866-8364 SP - 1 EP - 7 PB - Universitätsverlag Potsdam CY - Potsdam ER - TY - JOUR A1 - Cajar, Anke A1 - Engbert, Ralf A1 - Laubrock, Jochen T1 - Potsdam Eye-Movement Corpus for Scene Memorization and Search With Color and Spatial-Frequency Filtering JF - Frontiers in psychology / Frontiers Research Foundation KW - eye movements KW - corpus dataset KW - scene viewing KW - object search KW - scene memorization KW - spatial frequencies KW - color KW - central and peripheral vision Y1 - 2022 U6 - https://doi.org/10.3389/fpsyg.2022.850482 SN - 1664-1078 VL - 13 SP - 1 EP - 7 PB - Frontiers Research Foundation CY - Lausanne, Schweiz ER - TY - JOUR A1 - Schütt, Heiko Herbert A1 - Rothkegel, Lars Oliver Martin A1 - Trukenbrod, Hans Arne A1 - Reich, Sebastian A1 - Wichmann, Felix A. A1 - Engbert, Ralf T1 - Likelihood-based parameter estimation and comparison of dynamical cognitive models JF - Psychological Review N2 - Dynamical models of cognition play an increasingly important role in driving theoretical and experimental research in psychology. Therefore, parameter estimation, model analysis and comparison of dynamical models are of essential importance. In this article, we propose a maximum likelihood approach for model analysis in a fully dynamical framework that includes time-ordered experimental data. Our methods can be applied to dynamical models for the prediction of discrete behavior (e.g., movement onsets); in particular, we use a dynamical model of saccade generation in scene viewing as a case study for our approach. For this model, the likelihood function can be computed directly by numerical simulation, which enables more efficient parameter estimation including Bayesian inference to obtain reliable estimates and corresponding credible intervals. Using hierarchical models inference is even possible for individual observers. Furthermore, our likelihood approach can be used to compare different models. In our example, the dynamical framework is shown to outperform nondynamical statistical models. Additionally, the likelihood based evaluation differentiates model variants, which produced indistinguishable predictions on hitherto used statistics. Our results indicate that the likelihood approach is a promising framework for dynamical cognitive models. KW - likelihood KW - model fitting KW - dynamical model KW - eye movements KW - model comparison Y1 - 2017 U6 - https://doi.org/10.1037/rev0000068 SN - 0033-295X SN - 1939-1471 VL - 124 IS - 4 SP - 505 EP - 524 PB - American Psychological Association CY - Washington ER -