TY - JOUR A1 - Schwetlick, Lisa A1 - Backhaus, Daniel A1 - Engbert, Ralf T1 - A dynamical scan-path model for task-dependence during scene viewing JF - Psychological review N2 - In real-world scene perception, human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional probabilities of gaze positions for a given image via saliency maps. Recently, progress has been made on models for the generation of scan paths under the constraints of saliency as well as attentional and oculomotor restrictions. Experimental research demonstrated that task constraints can have a strong impact on viewing behavior. Here, we propose a scan-path model for both fixation positions and fixation durations, which include influences of task instructions and interindividual differences. Based on an eye-movement experiment with four different task conditions, we estimated model parameters for each individual observer and task condition using a fully Bayesian dynamical modeling framework using a joint spatial-temporal likelihood approach with sequential estimation. Resulting parameter values demonstrate that model properties such as the attentional span are adjusted to task requirements. Posterior predictive checks indicate that our dynamical model can reproduce task differences in scan-path statistics across individual observers. KW - scene viewing KW - eye movements KW - task dependence KW - individual differences; KW - Bayesian inference Y1 - 2023 U6 - https://doi.org/10.1037/rev0000379 SN - 0033-295X SN - 1939-1471 VL - 130 IS - 3 SP - 807 EP - 840 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Seelig, Stefan A. A1 - Rabe, Maximilian Michael A1 - Malem-Shinitski, Noa A1 - Risse, Sarah A1 - Reich, Sebastian A1 - Engbert, Ralf T1 - Bayesian parameter estimation for the SWIFT model of eye-movement control during reading JF - Journal of mathematical psychology N2 - Process-oriented theories of cognition must be evaluated against time-ordered observations. Here we present a representative example for data assimilation of the SWIFT model, a dynamical model of the control of fixation positions and fixation durations during natural reading of single sentences. First, we develop and test an approximate likelihood function of the model, which is a combination of a spatial, pseudo-marginal likelihood and a temporal likelihood obtained by probability density approximation Second, we implement a Bayesian approach to parameter inference using an adaptive Markov chain Monte Carlo procedure. Our results indicate that model parameters can be estimated reliably for individual subjects. We conclude that approximative Bayesian inference represents a considerable step forward for computational models of eye-movement control, where modeling of individual data on the basis of process-based dynamic models has not been possible so far. KW - dynamical models KW - reading KW - eye movements KW - saccades KW - likelihood function KW - Bayesian inference KW - MCMC KW - interindividual differences Y1 - 2020 U6 - https://doi.org/10.1016/j.jmp.2019.102313 SN - 0022-2496 SN - 1096-0880 VL - 95 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Schütt, Heiko Herbert A1 - Rothkegel, Lars Oliver Martin A1 - Trukenbrod, Hans Arne A1 - Engbert, Ralf A1 - Wichmann, Felix A. T1 - Disentangling bottom-up versus top-down and low-level versus high-level influences on eye movements over time JF - Journal of vision N2 - Bottom-up and top-down as well as low-level and high-level factors influence where we fixate when viewing natural scenes. However, the importance of each of these factors and how they interact remains a matter of debate. Here, we disentangle these factors by analyzing their influence over time. For this purpose, we develop a saliency model that is based on the internal representation of a recent early spatial vision model to measure the low-level, bottom-up factor. To measure the influence of high-level, bottom-up features, we use a recent deep neural network-based saliency model. To account for top-down influences, we evaluate the models on two large data sets with different tasks: first, a memorization task and, second, a search task. Our results lend support to a separation of visual scene exploration into three phases: the first saccade, an initial guided exploration characterized by a gradual broadening of the fixation density, and a steady state that is reached after roughly 10 fixations. Saccade-target selection during the initial exploration and in the steady state is related to similar areas of interest, which are better predicted when including high-level features. In the search data set, fixation locations are determined predominantly by top-down processes. In contrast, the first fixation follows a different fixation density and contains a strong central fixation bias. Nonetheless, first fixations are guided strongly by image properties, and as early as 200 ms after image onset, fixations are better predicted by high-level information. We conclude that any low-level, bottom-up factors are mainly limited to the generation of the first saccade. All saccades are better explained when high-level features are considered, and later, this high-level, bottom-up control can be overruled by top-down influences. KW - saliency KW - fixations KW - natural scenes KW - visual search KW - eye movements Y1 - 2019 U6 - https://doi.org/10.1167/19.3.1 SN - 1534-7362 VL - 19 IS - 3 PB - Association for Research in Vision and Opthalmology CY - Rockville ER - TY - JOUR A1 - Risse, Sarah A1 - Kliegl, Reinhold T1 - Dissociating preview validity and preview difficulty in parafoveal processing of word n+1 during reading JF - Journal of experimental psychology : Human perception and performance N2 - Many studies have shown that previewing the next word n + 1 during reading leads to substantial processing benefit (e.g., shorter word viewing times) when this word is eventually fixated. However, evidence of such preprocessing in fixations on the preceding word n when in fact the information about the preview is acquired is far less consistent. A recent study suggested that such effects may be delayed into fixations on the next word n + 1 (Risse & Kliegl, 2012). To investigate the time course of parafoveal information-acquisition on the control of eye movements during reading, we conducted 2 gaze-contingent display-change experiments and orthogonally manipulated the processing difficulty (i.e., word frequency) of an n + 1 preview word and its validity relative to the target word. Preview difficulty did not affect fixation durations on the pretarget word n but on the target word n + 1. In fact, the delayed preview-difficulty effect was almost of the same size as the preview benefit associated with the n + 1 preview validity. Based on additional results from quantile-regression analyses on the time course of the 2 preview effects, we discuss consequences as to the integration of foveal and parafoveal information and potential implications for computational models of eye guidance in reading. KW - display-change awareness KW - eye movements KW - parafoveal-on-foveal effect KW - parafoveal preview benefit KW - perceptual span Y1 - 2014 U6 - https://doi.org/10.1037/a0034997 SN - 0096-1523 SN - 1939-1277 VL - 40 IS - 2 SP - 653 EP - 668 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Ziubanova, Anastasia A. A1 - Laurinavichyute, Anna A1 - Parshina, Olga T1 - Does early exposure to spoken and sign language affect reading fluency in deaf and hard-of-hearing adult signers? JF - Frontiers in psychology N2 - Introduction Early linguistic background, and in particular, access to language, lays the foundation of future reading skills in deaf and hard-of-hearing signers. The current study aims to estimate the impact of two factors – early access to sign and/or spoken language – on reading fluency in deaf and hard-of-hearing adult Russian Sign Language speakers. Methods In the eye-tracking experiment, 26 deaf and 14 hard-of-hearing native Russian Sign Language speakers read 144 sentences from the Russian Sentence Corpus. Analysis of global eye-movement trajectories (scanpaths) was used to identify clusters of typical reading trajectories. The role of early access to sign and spoken language as well as vocabulary size as predictors of the more fluent reading pattern was tested. Results Hard-of-hearing signers with early access to sign language read more fluently than those who were exposed to sign language later in life or deaf signers without access to speech sounds. No association between early access to spoken language and reading fluency was found. Discussion Our results suggest a unique advantage for the hard-of-hearing individuals from having early access to both sign and spoken language and support the existing claims that early exposure to sign language is beneficial not only for deaf but also for hard-of-hearing children. KW - reading fluency KW - deaf KW - hard-of-hearing KW - sign language KW - multimodal bilingualism KW - scanpaths KW - eye movements Y1 - 2023 U6 - https://doi.org/10.3389/fpsyg.2023.1145638 SN - 1664-1078 VL - 14 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Risse, Sarah A1 - Kliegl, Reinhold T1 - Evidence for delayed Parafoveal-on-Foveal effects from word n+2 in reading JF - Journal of experimental psychology : Human perception and performance N2 - During reading information is acquired from word(s) beyond the word that is currently looked at. It is still an open question whether such parafoveal information can influence the current viewing of a word, and if so, whether such parafoveal-on-foveal effects are attributable to distributed processing or to mislocated fixations which occur when the eyes are directed at a parafoveal word but land on another word instead. In two display-change experiments, we orthogonally manipulated the preview and target difficulty of word n+2 to investigate the role of mislocated fixations on the previous word n+1. When the eyes left word n, an easy or difficult word n+2 preview was replaced by an easy or difficult n+2 target word. In Experiment 1, n+2 processing difficulty was manipulated by means of word frequency (i.e., easy high-frequency vs. difficult low-frequency word n+2). In Experiment 2, we varied the visual familiarity of word n+2 (i.e., easy lower-case vs. difficult alternating-case writing). Fixations on the short word n+1, which were likely to be mislocated, were nevertheless not influenced by the difficulty of the adjacent word n+2, the hypothesized target of the mislocated fixation. Instead word n+1 was influenced by the preview difficulty of word n+2, representing a delayed parafoveal-on-foveal effect. The results challenge the mislocated-fixation hypothesis as an explanation of parafoveal-on-foveal effects and provide new insight into the complex spatial and temporal effect structure of processing inside the perceptual span during reading. KW - perceptual span KW - n+2-boundary paradigm KW - preview benefit KW - parafoveal-on-foveal effect KW - mislocated fixations KW - eye movements Y1 - 2012 U6 - https://doi.org/10.1037/a0027735 SN - 0096-1523 VL - 38 IS - 4 SP - 1026 EP - 1042 PB - American Psychological Association CY - Washington ER - TY - THES A1 - Hohenstein, Sven T1 - Eye movements and processing of semantic information in the parafovea during reading T1 - Blickbewegungen und die Verarbeitung semantischer Informationen in der Parafovea beim Lesen N2 - When we read a text, we obtain information at different levels of representation from abstract symbols. A reader’s ultimate aim is the extraction of the meaning of the words and the text. The reserach of eye movements in reading covers a broad range of psychological systems, ranging from low-level perceptual and motor processes to high-level cognition. Reading of skilled readers proceeds highly automatic, but is a complex phenomenon of interacting subprocesses at the same time. The study of eye movements during reading offers the possibility to investigate cognition via behavioral measures during the excercise of an everyday task. The process of reading is not limited to the directly fixated (or foveal) word but also extends to surrounding (or parafoveal) words, particularly the word to the right of the gaze position. This process may be unconscious, but parafoveal information is necessary for efficient reading. There is an ongoing debate on whether processing of the upcoming word encompasses word meaning (or semantics) or only superficial features. To increase the knowledge about how the meaning of one word helps processing another word, seven experiments were conducted. In these studies, words were exachanged during reading. The degree of relatedness between the word to the right of the currently fixated one and the word subsequently fixated was experimentally manipulated. Furthermore, the time course of the parafoveal extraction of meaning was investigated with two different approaches, an experimental one and a statistical one. As a major finding, fixation times were consistently lower if a semantically related word was presented compared to the presence of an unrelated word. Introducing an experimental technique that allows controlling the duration for which words are available, the time course of processing and integrating meaning was evaluated. Results indicated both facilitation and inhibition due to relatedness between the meanings of words. In a more natural reading situation, the effectiveness of the processing of parafoveal words was sometimes time-dependent and substantially increased with shorter distances between the gaze position and the word. Findings are discussed with respect to theories of eye-movement control. In summary, the results are more compatible with models of distributed word processing. The discussions moreover extend to language differences and technical issues of reading research. N2 - Wenn wir einen Text lesen, erfassen wir Informationen auf verschiedenen Repräsentationsebenen anhand abstrakter Symbole. Das oberste Ziel des Lesers ist das Erfassen der Bedeutung der Worte und des Textes. Die Erforschung der Blickbewegungen beim Lesen umfasst verschiedene Verarbeitungsebenen, die von Warhnehmung über motorische Prozesse bis hin zu Kognition auf übergeordneter Ebene reichen. Das Lesen geübter Leser verläuft zum großen Teil automatisch, ist aber gleichzeitig ein komplexes Phänomen interagierender Teilprozesse. Die Untersuchung von Blickbewegungen beim Lesen eröffnet die Möglichkeit, kognitive Prozesse bei der Ausübung einer alltäglichen Aufgabe anhand von Verhaltensmaßen zu untersuchen. Der Leseprozess ist nicht beschränkt auf das direkt fixierte (oder foveale) Wort, sondern umfasst auch umgebende (oder parafoveale) Wörter, insbesondere das Wort rechts der Blickposition. Obgleich dies nicht notwendigerweise bewusst geschieht, ist die parafoveale Information dennoch wichtig für effizientes Lesen. Es wird darüber diskutiert, ob die Verarbeitung des nächsten Wortes die Wortbedeutung (Semantik) oder nur oberflächliche Eigenschaften umfasst. Um ein besseres Verständnis zu erhalten, ob die Bedeutung eines Wortes bei der Verarbeitung eines anderen Wortes hilft, wurden sieben Experimente durchgeführt. In diesen Studien wurde ein Wort im Satz während des Lesens ausgetauscht. Der inhaltliche Zusammenhang zwischen einer parafoveal präsentierten Vorschau und dem anschließend fixierten Zielwort wurde experimentell manipuliert. Außerdem wurde der zeitliche Verlauf der Bedeutungserfassung aus parafovealen Wörtern mit zwei Ansätzen untersucht, einem experimentellen und einem statistischen. Als primärer Befund zeigte sich, dass die Fixationszeiten durchweg kürzer waren, wenn ein semantisch verwandtes Wort als Vorschau präsentiert wurde, verglichen mit einem Wort ohne Verwandtschaft. Mit der in dieser Arbeit verwendeten experimentellen Vorgehensweise konnte zudem der zeitliche Verlauf des Verarbeitens und Integrierens von Bedeutung ermittelt wurde. Dabei ergaben sich kürzere Fixationszeiten auf dem Zielwort bei ähnlichen Wortbedeutungen und längere Fixationszeiten bei unterschiedlichen Wortbedeutungen. Die Ergebnisse zeigten sowohl leichtere als auch schwerere Verarbeitung in Folge der Ähnlichkeit von Wortbedeutungen. In einer natürlicheren Lesesituation war die Wirksamkeit der Verarbeitung nachfolgender Wörter teilweise abhängig von der Dauer der Vorschau, und sie war deutlich größer bei kürzerer räumlicher Distanz zwischen der Blickposition und der Vorschau. Die Befunde werden mit Blick auf Theorien der Blickbewegunskontrolle diskutiert. Die Ergebnisse sind stärker mit Modellen verteilter Wortverarbeitung vereinbar. Die Diskussion erstreckt sich außerdem auf Sprachunterschiede und technische Aspekte der Leseforschung. KW - Blickbewegungen KW - Lesen KW - parafoveale Verarbeitung KW - Semantik KW - eye movements KW - reading KW - parafoveal processing KW - semantics Y1 - 2013 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-70363 ER - TY - JOUR A1 - Fernandez, Gerardo A1 - Shalom, Diego E. A1 - Kliegl, Reinhold A1 - Sigman, Mariano T1 - Eye movements during reading proverbs and regular sentences: the incoming word predictability effect JF - Language, cognition and neuroscience KW - eye movements KW - reading KW - proverbs KW - incoming word predictability effect Y1 - 2014 U6 - https://doi.org/10.1080/01690965.2012.760745 SN - 2327-3798 SN - 2327-3801 VL - 29 IS - 3 SP - 260 EP - 273 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Trukenbrod, Hans Arne A1 - Engbert, Ralf T1 - Eye movements in a sequential scanning task - evidence for distributed processing JF - Journal of vision N2 - Current models of eye movement control are derived from theories assuming serial processing of single items or from theories based on parallel processing of multiple items at a time. This issue has persisted because most investigated paradigms generated data compatible with both serial and parallel models. Here, we study eye movements in a sequential scanning task, where stimulus n indicates the position of the next stimulus n + 1. We investigate whether eye movements are controlled by sequential attention shifts when the task requires serial order of processing. Our measures of distributed processing in the form of parafoveal-on-foveal effects, long-range modulations of target selection, and skipping saccades provide evidence against models strictly based on serial attention shifts. We conclude that our results lend support to parallel processing as a strategy for eye movement control. KW - eye movements KW - distributed processing KW - sequential attention shifts KW - parafoveal-on-foveal effects KW - skipping costs/benefits Y1 - 2012 U6 - https://doi.org/10.1167/12.1.5 SN - 1534-7362 VL - 12 IS - 1 PB - Association for Research in Vision and Opthalmology CY - Rockville ER - TY - THES A1 - Wotschack, Christiane T1 - Eye movements in reading strategies : how reading strategies modulate effects of distributed processing and oculomotor control T1 - Lesestrategien und Blickbewegungen : wie Lesestrategien Effekte der verteilten Verarbeitung und der okulomotorischen Kontrolle modulieren N2 - Throughout its empirical research history eye movement research has always been aware of the differences in reading behavior induced by individual differences and task demands. This work introduces a novel comprehensive concept of reading strategy, comprising individual differences in reading style and reading skill as well as reader goals. In a series of sentence reading experiments recording eye movements, the influence of reading strategies on reader- and word-level effects assuming distributed processing has been investigated. Results provide evidence for strategic, top-down influences on eye movement control that extend our understanding of eye guidance in reading. N2 - Seit Beginn der Blickbewegungsforschung beim Lesen ist man sich über Unterschiede im Blickverhalten bewusst, die im Zusammenhang mit individuellen Unterschieden oder Aufgabenanforderungen stehen. Unter dem Begriff ‚Lesestrategie’ wurden diese Unterschiede hauptsächlich für diagnostische Zwecke verwendet. Diese Studie verwendet eine neue, umfassende Definition von Lesestrategie und berücksichtigt sowohl individuelle Unterschiede in Lesestil und Lesevermögen als auch Ziel und Intention des Lesers. In einer Reihe von Satzleseexperimenten, bei denen die Blickbewegungen aufgezeichnet wurden, wurde der Einfluss von Lesestrategien auf Effekte der Leser-und Wortebene untersucht, wobei eine verteilte Verarbeitung beim Lesen angenommen wird. Die Ergebnisse liefern Evidenzen für strategische, top-down Einflüsse auf die Blickbewegungen und leisten einen wichtigen Beitrag für das bessere Verständnis der Blickbewegungskontrolle beim Lesen. T3 - Spektrum Patholinguistik - Schriften - 1 KW - Blickbewegungen KW - Satzlesen KW - Lesestrategie KW - verteilte Verarbeitung KW - individuelle Unterschiede KW - eye movements KW - sentence reading KW - reading strategy KW - distributed processing KW - individual differences Y1 - 2009 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-36846 SN - 978-3-86956-021-2 PB - Universitätsverlag Potsdam CY - Potsdam ER -