TY - JOUR A1 - Engelmann, Felix A1 - Vasishth, Shravan A1 - Engbert, Ralf A1 - Kliegl, Reinhold T1 - A framework for modeling the interaction of syntactic processing and eye movement control JF - Topics in cognitive science N2 - We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. KW - Sentence comprehension KW - Eye movements KW - Reading KW - Parsing difficulty KW - Working memory KW - Surprisal KW - Computational modeling Y1 - 2013 U6 - https://doi.org/10.1111/tops.12026 SN - 1756-8757 VL - 5 IS - 3 SP - 452 EP - 474 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Hyönä, Jukka A1 - Heikkilä, Timo T. A1 - Vainio, Seppo A1 - Kliegl, Reinhold T1 - Parafoveal access to word stem during reading BT - an eye movement study JF - Cognition : international journal of cognitive science N2 - Previous studies (Hyona, Yan, & Vainio, 2018; Yan et al., 2014) have demonstrated that in morphologically rich languages a word's morphological status is processed parafoveally to be used in modulating saccadic programming in reading. In the present parafoveal preview study conducted in Finnish, we examined the exact nature of this effect by comparing reading of morphologically complex words (a stem + two suffixes) to that of monomorphemic words. In the preview-change condition, the final 3-4 letters were replaced with other letters making the target word a pseudoword; for suffixed words, the word stem remained intact but the suffix information was unavailable; for monomorphemic words, only part of the stem was parafoveally available. Three alternative predictions were put forth. According to the first alternative, the morphological effect in initial fixation location is due to parafoveally perceiving the suffix as a highly frequent letter cluster and then adjusting the saccade program to land closer to the word beginning for suffixed than monomorphemic words. The second alternative, the processing difficulty hypothesis, assumes a morphological complexity effect: suffixed words are more complex than monomorphemic words. Therefore, the attentional window is narrower and the saccade is shorter. The third alternative posits that the effect reflects parafoveal access to the word's stem. The results for the initial fixation location and fixation durations were consistent with the parafoveal stem-access view. KW - Eye movements KW - Reading KW - Morphological complexity KW - Parafoveal processing KW - Display change KW - Initial fixation location Y1 - 2021 U6 - https://doi.org/10.1016/j.cognition.2020.104547 SN - 0010-0277 SN - 1873-7838 VL - 208 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Kliegl, Reinhold A1 - Hohenstein, Sven A1 - Yan, Ming A1 - McDonald, Scott A. T1 - How preview space/time translates into preview cost/benefit for fixation durations during reading JF - The quarterly journal of experimental psychology N2 - Eye-movement control during reading depends on foveal and parafoveal information. If the parafoveal preview of the next word is suppressed, reading is less efficient. A linear mixed model (LMM) reanalysis of McDonald (2006) confirmed his observation that preview benefit may be limited to parafoveal words that have been selected as the saccade target. Going beyond the original analyses, in the same LMM, we examined how the preview effect (i.e., the difference in single-fixation duration, SFD, between random-letter and identical preview) depends on the gaze duration on the pretarget word and on the amplitude of the saccade moving the eye onto the target word. There were two key results: (a) The shorter the saccade amplitude (i.e., the larger preview space), the shorter a subsequent SFD with an identical preview; this association was not observed with a random-letter preview. (b) However, the longer the gaze duration on the pretarget word, the longer the subsequent SFD on the target, with the difference between random-letter string and identical previews increasing with preview time. A third patternincreasing cost of a random-letter string in the parafovea associated with shorter saccade amplitudeswas observed for target gaze durations. Thus, LMMs revealed that preview effects, which are typically summarized under preview benefit, are a complex mixture of preview cost and preview benefit and vary with preview space and preview time. The consequence for reading is that parafoveal preview may not only facilitate, but also interfere with lexical access. KW - Eye movements KW - Reading KW - Preview effects KW - Linear mixed model KW - Boundary paradigm Y1 - 2013 U6 - https://doi.org/10.1080/17470218.2012.658073 SN - 1747-0218 SN - 1747-0226 VL - 66 IS - 3 SP - 581 EP - 600 PB - Wiley CY - Hove ER - TY - JOUR A1 - Laurinavichyute, Anna A1 - Sekerina, Irina A. A1 - Alexeeva, Svetlana A1 - Bagdasaryan, Kristine A1 - Kliegl, Reinhold T1 - Russian Sentence Corpus: Benchmark measures of eye movements in reading in Russian JF - Behavior research methods : a journal of the Psychonomic Society N2 - This article introduces a new corpus of eye movements in silent readingthe Russian Sentence Corpus (RSC). Russian uses the Cyrillic script, which has not yet been investigated in cross-linguistic eye movement research. As in every language studied so far, we confirmed the expected effects of low-level parameters, such as word length, frequency, and predictability, on the eye movements of skilled Russian readers. These findings allow us to add Slavic languages using Cyrillic script (exemplified by Russian) to the growing number of languages with different orthographies, ranging from the Roman-based European languages to logographic Asian ones, whose basic eye movement benchmarks conform to the universal comparative science of reading (Share, 2008). We additionally report basic descriptive corpus statistics and three exploratory investigations of the effects of Russian morphology on the basic eye movement measures, which illustrate the kinds of questions that researchers can answer using the RSC. The annotated corpus is freely available from its project page at the Open Science Framework: https://osf.io/x5q2r/. KW - Reading KW - Eye movements KW - Russian KW - Ambiguity KW - Part of speech KW - Corpus Y1 - 2019 U6 - https://doi.org/10.3758/s13428-018-1051-6 SN - 1554-351X SN - 1554-3528 VL - 51 IS - 3 SP - 1161 EP - 1178 PB - Springer CY - New York ER - TY - JOUR A1 - Ohl, Sven A1 - Kliegl, Reinhold T1 - Revealing the time course of signals influencing the generation of JF - Vision research : an international journal for functional aspects of vision. N2 - Saccadic eye movements are frequently followed by smaller secondary saccades which are generally assumed to correct for the error in primary saccade landing position. However, secondary saccades can also occur after accurate primary saccades and they are often as small as microsaccades, therefore raising the need to further scrutinize the processes involved in secondary saccade generation. Following up a previous study, we analyzed secondary saccades using rate analysis which allows us to quantify experimental effects as shifts in distributions, therefore going beyond comparisons of mean differences. We use Aalen’s additive hazards model to delineate the time course of key influences on the secondary saccade rate. In addition to the established effect of primary saccade error, we observed a time-varying influence of under- vs. overshooting – with a higher risk of generating secondary saccades following undershoots. Moreover, increasing target eccentricity influenced the programming of secondary saccades, therefore demonstrating that error-unrelated variables co-determine secondary saccade programs. Our results provide new insights into the generative mechanisms of small saccades during postsaccadic fixation that need to be accounted for by secondary saccade models. KW - Eye movements KW - Corrective saccades KW - Secondary saccades KW - Rate analysis KW - Survival analysis Y1 - 2016 U6 - https://doi.org/10.1016/j.visres.2016.06.007 SN - 0042-6989 SN - 1878-5646 VL - 124 SP - 52 EP - 58 PB - Elsevier CY - Oxford ER - TY - JOUR A1 - Pan, Jinger A1 - Yan, Ming A1 - Laubrock, Jochen A1 - Shu, Hua A1 - Kliegl, Reinhold T1 - Saccade-target selection of dyslexic children when reading Chinese JF - Vision research : an international journal for functional aspects of vision. N2 - This study investigates the eye movements of dyslexic children and their age-matched controls when reading Chinese. Dyslexic children exhibited more and longer fixations than age-matched control children, and an increase of word length resulted in a greater increase in the number of fixations and gaze durations for the dyslexic than for the control readers. The report focuses on the finding that there was a significant difference between the two groups in the fixation landing position as a function of word length in single-fixation cases, while there was no such difference in the initial fixation of multi-fixation cases. We also found that both groups had longer incoming saccade amplitudes while the launch sites were closer to the word in single fixation cases than in multi-fixation cases. Our results suggest that dyslexic children's inefficient lexical processing, in combination with the absence of orthographic word boundaries in Chinese, leads them to select saccade targets at the beginning of words conservatively. These findings provide further evidence for parafoveal word segmentation during reading of Chinese sentences. KW - Chinese KW - Dyslexic children KW - Eye movements KW - Saccade-target selection KW - Reading Y1 - 2014 U6 - https://doi.org/10.1016/j.visres.2014.01.014 SN - 0042-6989 SN - 1878-5646 VL - 97 SP - 24 EP - 30 PB - Elsevier CY - Oxford ER - TY - JOUR A1 - Risse, Sarah A1 - Hohenstein, Sven A1 - Kliegl, Reinhold A1 - Engbert, Ralf T1 - A theoretical analysis of the perceptual span based on SWIFT simulations of the n+2 boundary paradigm JF - Visual cognition N2 - Eye-movement experiments suggest that the perceptual span during reading is larger than the fixated word, asymmetric around the fixation position, and shrinks in size contingent on the foveal processing load. We used the SWIFT model of eye-movement control during reading to test these hypotheses and their implications under the assumption of graded parallel processing of all words inside the perceptual span. Specifically, we simulated reading in the boundary paradigm and analysed the effects of denying the model to have valid preview of a parafoveal word n + 2 two words to the right of fixation. Optimizing the model parameters for the valid preview condition only, we obtained span parameters with remarkably realistic estimates conforming to the empirical findings on the size of the perceptual span. More importantly, the SWIFT model generated parafoveal processing up to word n + 2 without fitting the model to such preview effects. Our results suggest that asymmetry and dynamic modulation are plausible properties of the perceptual span in a parallel word-processing model such as SWIFT. Moreover, they seem to guide the flexible distribution of processing resources during reading between foveal and parafoveal words. KW - Eye movements KW - Reading KW - Computational modelling KW - Perceptual span KW - Preview Y1 - 2014 U6 - https://doi.org/10.1080/13506285.2014.881444 SN - 1350-6285 SN - 1464-0716 VL - 22 IS - 3-4 SP - 283 EP - 308 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Tsai, Jie-Li A1 - Kliegl, Reinhold A1 - Yan, Ming T1 - Parafoveal semantic information extraction in traditional Chinese reading JF - Acta psychologica : international journal of psychonomics N2 - Semantic information extraction from the parafovea has been reported only in simplified Chinese for a special subset of characters and its generalizability has been questioned. This study uses traditional Chinese, which differs from simplified Chinese in visual complexity and in mapping semantic forms, to demonstrate access to parafoveal semantic information during reading of this script. Preview duration modulates various types (identical, phonological, and unrelated) of parafoveal information extraction. Parafoveal semantic extraction is more elusive in English; therefore, we conclude that such effects in Chinese are presumably caused by substantial cross-language differences from alphabetic scripts. The property of Chinese characters carrying rich lexical information in a small region provides the possibility of semantic extraction in the parafovea. KW - Semantic preview benefit KW - Chinese reading KW - Eye movements Y1 - 2012 U6 - https://doi.org/10.1016/j.actpsy.2012.06.004 SN - 0001-6918 SN - 1873-6297 VL - 141 IS - 1 SP - 17 EP - 23 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - von der Malsburg, Titus Raban A1 - Kliegl, Reinhold A1 - Vasishth, Shravan T1 - Determinants of Scanpath Regularity in Reading JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society N2 - Scanpaths have played an important role in classic research on reading behavior. Nevertheless, they have largely been neglected in later research perhaps due to a lack of suitable analytical tools. Recently, von der Malsburg and Vasishth (2011) proposed a new measure for quantifying differences between scanpaths and demonstrated that this measure can recover effects that were missed with the traditional eyetracking measures. However, the sentences used in that study were difficult to process and scanpath effects accordingly strong. The purpose of the present study was to test the validity, sensitivity, and scope of applicability of the scanpath measure, using simple sentences that are typically read from left to right. We derived predictions for the regularity of scanpaths from the literature on oculomotor control, sentence processing, and cognitive aging and tested these predictions using the scanpath measure and a large database of eye movements. All predictions were confirmed: Sentences with short words and syntactically more difficult sentences elicited more irregular scanpaths. Also, older readers produced more irregular scanpaths than younger readers. In addition, we found an effect that was not reported earlier: Syntax had a smaller influence on the eye movements of older readers than on those of young readers. We discuss this interaction of syntactic parsing cost with age in terms of shifts in processing strategies and a decline of executive control as readers age. Overall, our results demonstrate the validity and sensitivity of the scanpath measure and thus establish it as a productive and versatile tool for reading research. KW - Eye movements KW - Reading KW - Scanpaths KW - Language understanding KW - Oculo-motor control KW - Individual differences KW - Aging KW - Development Y1 - 2015 U6 - https://doi.org/10.1111/cogs.12208 SN - 0364-0213 SN - 1551-6709 VL - 39 IS - 7 SP - 1675 EP - 1703 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Yan, Ming A1 - Zhou, Wei A1 - Shu, Hua A1 - Yusupu, Rizwangul A1 - Miao, Dongxia A1 - Kruegel, Andre A1 - Kliegl, Reinhold T1 - Eye movements guided by morphological structure: Evidence from the Uighur language JF - Cognition : international journal of cognitive science N2 - It is generally accepted that low-level features (e.g., inter-word spaces) are responsible for saccade-target selection in eye-movement control during reading. In two experiments using Uighur script known for its rich suffixes, we demonstrate that, in addition to word length and launch site, the number of suffixes influences initial landing positions. We also demonstrate an influence of word frequency. These results are difficult to explain purely by low-level guidance of eye movements and indicate that due to properties specific to Uighur script low-level visual information and high-level information such as morphological structure of parafoveal words jointly influence saccade programming. (C) 2014 Elsevier B.V. All rights reserved. KW - Eye movements KW - Morphological structure KW - Landing position KW - Uighur Y1 - 2014 U6 - https://doi.org/10.1016/j.cognition.2014.03.008 SN - 0010-0277 SN - 1873-7838 VL - 132 IS - 2 SP - 181 EP - 215 PB - Elsevier CY - Amsterdam ER -