TY - JOUR A1 - Apel, Jens K. A1 - Revie, Gavin F. A1 - Cangelosi, Angelo A1 - Ellis, Rob A1 - Goslin, Jeremy A1 - Fischer, Martin H. T1 - Attention deployment during memorizing and executing complex instructions JF - Experimental brain research N2 - We investigated the mental rehearsal of complex action instructions by recording spontaneous eye movements of healthy adults as they looked at objects on a monitor. Participants heard consecutive instructions, each of the form "move [object] to [location]''. Instructions were only to be executed after a go signal, by manipulating all objects successively with a mouse. Participants re-inspected previously mentioned objects already while listening to further instructions. This rehearsal behavior broke down after 4 instructions, coincident with participants' instruction span, as determined from subsequent execution accuracy. These results suggest that spontaneous eye movements while listening to instructions predict their successful execution. KW - Assembly task KW - Eye movements KW - Overt attention KW - Rehearsal KW - Sequential instruction KW - Working memory Y1 - 2011 U6 - https://doi.org/10.1007/s00221-011-2827-4 SN - 0014-4819 VL - 214 IS - 2 SP - 249 EP - 259 PB - Springer CY - New York ER - TY - JOUR A1 - Cajar, Anke A1 - Engbert, Ralf A1 - Laubrock, Jochen T1 - Spatial frequency processing in the central and peripheral visual field during scene viewing JF - Vision research : an international journal for functional aspects of vision. N2 - Visuospatial attention and gaze control depend on the interaction of foveal and peripheral processing. The foveal and peripheral regions of the visual field are differentially sensitive to parts of the spatial frequency spectrum. In two experiments, we investigated how the selective attenuation of spatial frequencies in the central or the peripheral visual field affects eye-movement behavior during real-world scene viewing. Gaze-contingent low-pass or high-pass filters with varying filter levels (i.e., cutoff frequencies; Experiment 1) or filter sizes (Experiment 2) were applied. Compared to unfiltered control conditions, mean fixation durations increased most with central high-pass and peripheral low-pass filtering. Increasing filter size prolonged fixation durations with peripheral filtering, but not with central filtering. Increasing filter level prolonged fixation durations with low-pass filtering, but not with high-pass filtering. These effects indicate that fixation durations are not always longer under conditions of increased processing difficulty. Saccade amplitudes largely adapted to processing difficulty: amplitudes increased with central filtering and decreased with peripheral filtering; the effects strengthened with increasing filter size and filter level. In addition, we observed a trade-off between saccade timing and saccadic selection, since saccade amplitudes were modulated when fixation durations were unaffected by the experimental manipulations. We conclude that interactions of perception and gaze control are highly sensitive to experimental manipulations of input images as long as the residual information can still be accessed for gaze control. (C) 2016 Elsevier Ltd. All rights reserved. KW - Eye movements KW - Scene viewing KW - Spatial frequencies KW - Gaze-contingent displays Y1 - 2016 U6 - https://doi.org/10.1016/j.visres.2016.05.008 SN - 0042-6989 SN - 1878-5646 VL - 127 SP - 186 EP - 197 PB - Elsevier CY - Oxford ER - TY - JOUR A1 - Cunnings, Ian A1 - Patterson, Clare A1 - Felser, Claudia T1 - Variable binding and coreference in sentence comprehension: Evidence from eye movements JF - Journal of memory and language KW - Pronoun resolution KW - Eye movements KW - Reading KW - Memory retrieval Y1 - 2014 U6 - https://doi.org/10.1016/j.jml.2013.10.001 SN - 0749-596X SN - 1096-0821 VL - 71 SP - 39 EP - 56 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Engelmann, Felix A1 - Vasishth, Shravan A1 - Engbert, Ralf A1 - Kliegl, Reinhold T1 - A framework for modeling the interaction of syntactic processing and eye movement control JF - Topics in cognitive science N2 - We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. KW - Sentence comprehension KW - Eye movements KW - Reading KW - Parsing difficulty KW - Working memory KW - Surprisal KW - Computational modeling Y1 - 2013 U6 - https://doi.org/10.1111/tops.12026 SN - 1756-8757 VL - 5 IS - 3 SP - 452 EP - 474 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Fernandez, Gerardo A1 - Laubrock, Jochen A1 - Mandolesi, Pablo A1 - Colombo, Oscar A1 - Agamennoni, Osvaldo T1 - Difficulties in predicting upcoming words JF - Journal of clinical and experimental neuropsychology KW - Eye movements Y1 - 2014 U6 - https://doi.org/10.1080/13803395.2014.892060 SN - 1380-3395 SN - 1744-411X VL - 36 IS - 3 SP - 302 EP - 316 PB - Taylor & Francis Group CY - Philadelphia ER - TY - JOUR A1 - Hanne, Sandra A1 - Sekerina, Irina A. A1 - Vasishth, Shravan A1 - Burchert, Frank A1 - De Bleser, Ria T1 - Chance in agrammatic sentence comprehension what does it really mean? Evidence from eye movements of German agrammatic aphasic patients JF - Aphasiology : an international, interdisciplinary journal N2 - Background: In addition to the canonical subject-verb-object (SVO) word order, German also allows for non-canonical order (OVS), and the case-marking system supports thematic role interpretation. Previous eye-tracking studies (Kamide et al., 2003; Knoeferle, 2007) have shown that unambiguous case information in non-canonical sentences is processed incrementally. For individuals with agrammatic aphasia, comprehension of non-canonical sentences is at chance level (Burchert et al., 2003). The trace deletion hypothesis (Grodzinsky 1995, 2000) claims that this is due to structural impairments in syntactic representations, which force the individual with aphasia (IWA) to apply a guessing strategy. However, recent studies investigating online sentence processing in aphasia (Caplan et al., 2007; Dickey et al., 2007) found that divergences exist in IWAs' sentence-processing routines depending on whether they comprehended non-canonical sentences correctly or not, pointing rather to a processing deficit explanation. Aims: The aim of the current study was to investigate agrammatic IWAs' online and offline sentence comprehension simultaneously in order to reveal what online sentence-processing strategies they rely on and how these differ from controls' processing routines. We further asked whether IWAs' offline chance performance for non-canonical sentences does indeed result from guessing. Methods Procedures: We used the visual-world paradigm and measured eye movements (as an index of online sentence processing) of controls (N = 8) and individuals with aphasia (N = 7) during a sentence-picture matching task. Additional offline measures were accuracy and reaction times. Outcomes Results: While the offline accuracy results corresponded to the pattern predicted by the TDH, IWAs' eye movements revealed systematic differences depending on the response accuracy. Conclusions: These findings constitute evidence against attributing IWAs' chance performance for non-canonical structures to mere guessing. Instead, our results support processing deficit explanations and characterise the agrammatic parser as deterministic and inefficient: it is slowed down, affected by intermittent deficiencies in performing syntactic operations, and fails to compute reanalysis even when one is detected. KW - Eye movements KW - Non-canonical sentences KW - Agrammatic aphasia KW - Broca's aphasia KW - Chance performance KW - Online and offline processing KW - Sentence comprehension disorders KW - German syntax Y1 - 2011 U6 - https://doi.org/10.1080/02687038.2010.489256 SN - 0268-7038 VL - 25 IS - 2 SP - 221 EP - 244 PB - Wiley CY - Hove ER - TY - JOUR A1 - Hartmann, Matthias A1 - Laubrock, Jochen A1 - Fischer, Martin H. T1 - The visual number world BT - a dynamic approach to study the mathematical mind JF - The quarterly journal of experimental psychology N2 - In the domain of language research, the simultaneous presentation of a visual scene and its auditory description (i.e., the visual world paradigm) has been used to reveal the timing of mental mechanisms. Here we apply this rationale to the domain of numerical cognition in order to explore the differences between fast and slow arithmetic performance, and to further study the role of spatial-numerical associations during mental arithmetic. We presented 30 healthy adults simultaneously with visual displays containing four numbers and with auditory addition and subtraction problems. Analysis of eye movements revealed that participants look spontaneously at the numbers they currently process (operands, solution). Faster performance was characterized by shorter latencies prior to fixating the relevant numbers and fewer revisits to the first operand while computing the solution. These signatures of superior task performance were more pronounced for addition and visual numbers arranged in ascending order, and for subtraction and numbers arranged in descending order (compared to the opposite pairings). Our results show that the visual number world-paradigm provides on-line access to the mind during mental arithmetic, is able to capture variability in arithmetic performance, and is sensitive to visual layout manipulations that are otherwise not reflected in response time measurements. KW - Eye movements KW - Mental arithmetic KW - Mental number line KW - Visual world paradigm Y1 - 2018 U6 - https://doi.org/10.1080/17470218.2016.1240812 SN - 1747-0218 SN - 1747-0226 VL - 71 IS - 1 SP - 28 EP - 36 PB - Sage Publ. CY - London ER - TY - JOUR A1 - Hartmann, Matthias A1 - Martarelli, Corinna S. A1 - Mast, Fred W. A1 - Stocker, Kurt T1 - Eye movements during mental time travel follow a diagonal line JF - Consciousness and cognition N2 - Recent research showed that past events are associated with the back and left side, whereas future events are associated with the front and right side of space. These spatial-temporal associations have an impact on our sensorimotor system: thinking about one's past and future leads to subtle body sways in the sagittal dimension of space (Miles, Nind, & Macrae, 2010). In this study we investigated whether mental time travel leads to sensorimotor correlates in the horizontal dimension of space. Participants were asked to mentally displace themselves into the past or future while measuring their spontaneous eye movements on a blank screen. Eye gaze was directed more rightward and upward when thinking about the future than when thinking about the past. Our results provide further insight into the spatial nature of temporal thoughts, and show that not only body, but also eye movements follow a (diagonal) "time line" during mental time travel. (C) 2014 Elsevier Inc. All rights reserved. KW - Mental time travel KW - Eye movements KW - Mental time line KW - Spatial-temporal association KW - Future KW - Past KW - Embodied cognition KW - Metaphors KW - Mental number line Y1 - 2014 U6 - https://doi.org/10.1016/j.concog.2014.09.007 SN - 1053-8100 SN - 1090-2376 VL - 30 SP - 201 EP - 209 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Hohenstein, Sven A1 - Matuschek, Hannes A1 - Kliegl, Reinhold T1 - Linked linear mixed models: A joint analysis of fixation locations and fixation durations in natural reading JF - Psychonomic bulletin & review : a journal of the Psychonomic Society N2 - The complexity of eye-movement control during reading allows measurement of many dependent variables, the most prominent ones being fixation durations and their locations in words. In current practice, either variable may serve as dependent variable or covariate for the other in linear mixed models (LMMs) featuring also psycholinguistic covariates of word recognition and sentence comprehension. Rather than analyzing fixation location and duration with separate LMMs, we propose linking the two according to their sequential dependency. Specifically, we include predicted fixation location (estimated in the first LMM from psycholinguistic covariates) and its associated residual fixation location as covariates in the second, fixation-duration LMM. This linked LMM affords a distinction between direct and indirect effects (mediated through fixation location) of psycholinguistic covariates on fixation durations. Results confirm the robustness of distributed processing in the perceptual span. They also offer a resolution of the paradox of the inverted optimal viewing position (IOVP) effect (i.e., longer fixation durations in the center than at the beginning and end of words) although the opposite (i.e., an OVP effect) is predicted from default assumptions of psycholinguistic processing efficiency: The IOVP effect in fixation durations is due to the residual fixation-location covariate, presumably driven primarily by saccadic error, and the OVP effect (at least the left part of it) is uncovered with the predicted fixation-location covariate, capturing the indirect effects of psycholinguistic covariates. We expect that linked LMMs will be useful for the analysis of other dynamically related multiple outcomes, a conundrum of most psychonomic research. KW - Linear mixed model KW - Model linkage KW - Eye movements KW - Reading Y1 - 2017 U6 - https://doi.org/10.3758/s13423-016-1138-y SN - 1069-9384 SN - 1531-5320 VL - 24 SP - 637 EP - 651 PB - Springer CY - New York ER - TY - JOUR A1 - Hyona, Jukka A1 - Yan, Ming A1 - Vainio, Seppo T1 - Morphological structure influences the initial landing position in words during reading Finnish JF - The quarterly journal of experimental psychology N2 - The preferred viewing location in words [Rayner, K. (1979). Eye guidance in reading: Fixation locations within words. Perception, 8, 21–30] during reading is near the word centre. Parafoveal word length information is utilized to guide the eyes toward it. A recent study by Yan and colleagues [Yan, M., Zhou, W., Shu, H., Yusupu, R., Miao, D., Krügel, A., & Kliegl, R. (2014). Eye movements guided by morphological structure: Evidence from the Uighur language. Cognition, 132, 181–215] demonstrated that the word’s morphological structure may also be used in saccadic targeting. The study was conducted in a morphologically rich language, Uighur. The present study aimed at replicating their main findings in another morphologically rich language, Finnish. Similarly to Yan et al., it was found that the initial fixation landed closer to the word beginning for morphologically complex than for monomorphemic words. Word frequency, saccade launch site, and word length were also found to influence the initial landing position. It is concluded that in addition to low-level factors (word length and saccade launch site), also higher level factors related to the word’s morphological structure and frequency may be utilized in saccade programming during reading. KW - Eye movements KW - Morphological structure KW - Reading KW - Saccades KW - Word frequency Y1 - 2018 U6 - https://doi.org/10.1080/17470218.2016.1267233 SN - 1747-0218 SN - 1747-0226 VL - 71 IS - 1 SP - 122 EP - 130 PB - Routledge, Taylor & Francis Group CY - Abingdon ER -