TY  - JOUR
A1  - Lange, Elke B.
A1  - Engbert, Ralf
T1  - Differentiating between verbal and spatial encoding using eye-movement recordings
JF  - The quarterly journal of experimental psychology
N2  - Visual information processing is guided by an active mechanism generating saccadic eye movements to salient stimuli. Here we investigate the specific contribution of saccades to memory encoding of verbal and spatial properties in a serial recall task. In the first experiment, participants moved their eyes freely without specific instruction. We demonstrate the existence of qualitative differences in eye-movement strategies during verbal and spatial memory encoding. While verbal memory encoding was characterized by shifting the gaze to the to-be-encoded stimuli, saccadic activity was suppressed during spatial encoding. In the second experiment, participants were required to suppress saccades by fixating centrally during encoding or to make precise saccades onto the memory items. Active suppression of saccades had no effect on memory performance, but tracking the upcoming stimuli decreased memory performance dramatically in both tasks, indicating a resource bottleneck between display-controlled saccadic control and memory encoding. We conclude that optimized encoding strategies for verbal and spatial features are underlying memory performance in serial recall, but such strategies work on an involuntary level only and do not support memory encoding when they are explicitly required by the task.
KW  - Working memory
KW  - Serial recall
KW  - Eye movements
Y1  - 2013
U6  - https://doi.org/10.1080/17470218.2013.772214
SN  - 1747-0218
VL  - 66
IS  - 9
SP  - 1840
EP  - 1857
PB  - Wiley
CY  - Hove
ER  - 
TY  - JOUR
A1  - Engelmann, Felix
A1  - Vasishth, Shravan
A1  - Engbert, Ralf
A1  - Kliegl, Reinhold
T1  - A framework for modeling the interaction of syntactic processing and eye movement control
JF  - Topics in cognitive science
N2  - We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control.
KW  - Sentence comprehension
KW  - Eye movements
KW  - Reading
KW  - Parsing difficulty
KW  - Working memory
KW  - Surprisal
KW  - Computational modeling
Y1  - 2013
U6  - https://doi.org/10.1111/tops.12026
SN  - 1756-8757
VL  - 5
IS  - 3
SP  - 452
EP  - 474
PB  - Wiley-Blackwell
CY  - Hoboken
ER  -