Refine
Year of publication
Document Type
- Article (210)
- Postprint (14)
- Conference Proceeding (7)
- Monograph/Edited Volume (3)
- Review (2)
- Doctoral Thesis (1)
- Part of Periodical (1)
- Preprint (1)
Is part of the Bibliography
- yes (239) (remove)
Keywords
- Eye movements (12)
- reading (12)
- eye movements (11)
- Reading (10)
- Chinese (9)
- perceptual span (5)
- preview benefit (5)
- Eye movement (4)
- Linear mixed model (4)
- individual differences (4)
Institute
- Department Psychologie (199)
- Department Linguistik (16)
- Strukturbereich Kognitionswissenschaften (10)
- Department Sport- und Gesundheitswissenschaften (8)
- Institut für Physik und Astronomie (5)
- Extern (3)
- Humanwissenschaftliche Fakultät (3)
- Fakultät für Gesundheitswissenschaften (2)
- Lehreinheit für Wirtschafts-Arbeit-Technik (2)
- Institut für Chemie (1)
Brain-electric correlates of reading have traditionally been studied with word-by-word presentation, a condition that eliminates important aspects of the normal reading process and precludes direct comparisons between neural activity and oculomotor behavior. In the present study, we investigated effects of word predictability on eye movements (EM) and fixation-related brain potentials (FRPs) during natural sentence reading. Electroencephalogram (EEG) and EM (via video-based eye tracking) were recorded simultaneously while subjects read heterogeneous German sentences, moving their eyes freely over the text. FRPs were time-locked to first-pass reading fixations and analyzed according to the cloze probability of the currently fixated word. We replicated robust effects of word predictability on EMs and the N400 component in FRPs. The data were then used to model the relation among fixation duration, gaze duration, and N400 amplitude, and to trace the time course of EEG effects relative to effects in EM behavior. In an extended Methodological Discussion section, we review 4 technical and data-analytical problems that need to be addressed when FRPs are recorded in free-viewing situations (such as reading, visual search, or scene perception) and propose solutions. Results suggest that EEG recordings during normal vision are feasible and useful to consolidate findings from EEG and eye-tracking studies.
We examine how the size of saccadic under-/overshoot and target eccentricity influence the latency, amplitude and orientation of secondary (micro-)saccades. In our experiment, a target appeared at an eccentricity of either 6 degrees or 14 degrees of visual angle. Subjects were instructed to direct their gaze as quickly as possible to the target and hold fixation at the new location until the end of the trial. Typically, increasing saccadic error is associated with faster and larger secondary saccades. We show that secondary saccades at distant in contrast to close targets have in a specific error range a shorter latency, larger amplitude, and follow more often the direction of the primary saccade. Finally, we demonstrate that an undershooting primary saccade is followed almost exclusively by secondary saccades into the same direction while overshooting primary saccades are followed by secondary saccades into both directions. This supports the notion that under- and overshooting imply different consequences for postsaccadic oculomotor processing. Results are discussed using a model, introduced by Rolfs, Kliegl, and Engbert (2008), to account for the generation of microsaccades. We argue that the dynamic interplay of target eccentricity and the magnitude of the saccadic under-/overshoot can be explained by a different strength of activation in the two hemispheres of the saccadic motor map in this model.
Multivariate analyses of fixation durations in reading with linear mixed and additive mixed models
(2012)
The development of theories and computational models of reading requires an understanding of processing constraints, in particular of timelines related to word recognition and oculomotor control. Timelines of word recognition are usually determined with event-related potentials (ERPs) recorded under conditions of serial visual presentation (SVP) of words; timelines of oculomotor control are derived from parameters of eye movements (EMs) during natural reading. We describe two strategies to integrate these approaches. One is to collect ERPs and EMs in separate SVP and natural reading experiments for the same experimental material (but different subjects). The other strategy is to co-register EMs and ERPs during natural reading from the same subjects. Both strategies yield data that allow us to determine how lexical properties influence ERPs (e.g., the N400 component) and EMs (e.g., fixation durations) across neighboring words. We review our recent research on the effects of frequency and predictability of words on both EM and ERP measures with reference to current models of eye-movement control during reading. Results are in support of the proposition that lexical access is distributed across several fixations and across brain-electric potentials measured on neighboring words.
Parameters of a formal working-memory model were estimated for verbal and spatial memory updating of children. The model proposes interference though feature overwriting and through confusion of whole elements as the primary cause of working-memory capacity limits. We tested 2 age groups each containing 1 group of normal intelligence and I deficit group. For young children the deficit was developmental dyslexia; for older children it was a general learning difficulty. The interference model predicts less interference through overwriting but more through confusion of whole elements for the dyslexic children than for their age-matched controls. Older children exhibited less interference through confusion of whole elements and a higher processing rate than young children, but general learning difficulty was associated with slower processing than in the age-matched control group. Furthermore, the difference between verbal and spatial updating mapped onto several meaningful dissociations of model parameters.
Preview fixation duration modulates identical and semantic preview benefit in Chinese reading
(2012)
Semantic preview benefit from parafoveal words is critical for proposals of distributed lexical processing during reading. Semantic preview benefit has been demonstrated for Chinese reading with the boundary paradigm in which unrelated or semantically related previews of a target word N + 1 are replaced by the target word once the eyes cross an invisible boundary located after word N (Yan et al., 2009); for the target word in position N + 2, only identical compared to unrelated-word preview led to shorter fixation times on the target word (Yan et al., in press). A reanalysis of these data reveals that identical and semantic preview benefits depend on preview duration (i.e., the fixation duration on the preboundary word). Identical preview benefit from word N + 1 increased with preview duration. The identical preview benefit was also significant for N + 2, but did not significantly interact with preview duration. The previously reported semantic preview benefit from word N + 1 was mainly due to single- or first-fixation durations following short previews. We discuss implications for notions of serial attention shifts and parallel distributed processing of words during reading.
Semantic processing from parafoveal words is an elusive phenomenon in alphabetic languages, but it has been demonstrated only for a restricted set of noncompound Chinese characters. Using the gaze-contingent boundary paradigm, this experiment examined whether parafoveal lexical and sublexical semantic information was extracted from compound preview characters. Results generalized parafoveal semantic processing to this representative set of Chinese characters and extended the parafoveal processing to radical (sublexical) level semantic information extraction. Implications for notions of parafoveal information extraction during Chinese reading are discussed.
Three ERP experiments examined the effect of word presentation rate (i.e., stimulus onset asynchrony, SOA) on the time course of word frequency and predictability effects in sentence reading. In Experiments 1 and 2, sentences were presented word-by-word in the screen center at an SOA of 700 and 490 ms, respectively. While these rates are typical for psycholinguistic ERP research, natural reading happens at a considerably faster pace. Accordingly. Experiment 3 employed a near-normal SOA of 280 ms, which approximated the rate of normal reading. Main results can be summarized as follows: (1) The onset latency of early frequency effects decreases gradually with increasing presentation rates. (2) An early interaction between top-down and bottom-up processing is observed only under a near-normal SOA. (3) N400 predictability effects occur later and are smaller at a near-normal (i.e., high) presentation rate than at the lower rates commonly used in ERP experiments. (4) ERP morphology is different at the shortest compared to longer SOAs. Together, the results point to a special role of a near-normal presentation rate for visual word recognition and therefore suggest that SOA should be taken into account in research of natural reading.
During natural reading, a parafoveal preview of the upcoming word facilitates its subsequent recognition (e.g., shorter fixation durations compared to masked preview) but nothing is known about the neural correlates of this so-called preview benefit. Furthermore, while the evidence is strong that readers preprocess orthographic features of upcoming words, it is controversial whether word meaning can also be accessed parafoveally. We investigated the timing, scope, and electrophysiological correlates of parafoveal information use in reading by simultaneously recording eye movements and fixation-related brain potentials (FRPs) while participants read word lists fluently from left to right. For one word the target (e.g., "blade") parafoveal information was manipulated by showing an identical ("blade"), semantically related ("knife"), or unrelated ("sugar") word as preview. In boundary trials, the preview was shown parafoveally but changed to the correct target word during the incoming saccade. Replicating classic findings, target words were fixated shorter after identical previews. In the EEG, this benefit was reflected in an occipitotemporal preview positivity between 200 and 280 ms. In contrast, there was no facilitation from related previews. In parafoveal-on-foveal trials, preview and target were embedded at neighboring list positions without a display change. Consecutive fixation of two related words produced N400 priming effects, but only shortly (160 ms) after the second word was directly fixated. Results demonstrate that neural responses to words are substantially altered by parafoveal preprocessing under normal reading conditions. We found no evidence that word meaning contributes to these effects. Saccade-contingent display manipulations can be combined with EEG recordings to study extrafoveal perception in vision.
During reading information is acquired from word(s) beyond the word that is currently looked at. It is still an open question whether such parafoveal information can influence the current viewing of a word, and if so, whether such parafoveal-on-foveal effects are attributable to distributed processing or to mislocated fixations which occur when the eyes are directed at a parafoveal word but land on another word instead. In two display-change experiments, we orthogonally manipulated the preview and target difficulty of word n+2 to investigate the role of mislocated fixations on the previous word n+1. When the eyes left word n, an easy or difficult word n+2 preview was replaced by an easy or difficult n+2 target word. In Experiment 1, n+2 processing difficulty was manipulated by means of word frequency (i.e., easy high-frequency vs. difficult low-frequency word n+2). In Experiment 2, we varied the visual familiarity of word n+2 (i.e., easy lower-case vs. difficult alternating-case writing). Fixations on the short word n+1, which were likely to be mislocated, were nevertheless not influenced by the difficulty of the adjacent word n+2, the hypothesized target of the mislocated fixation. Instead word n+1 was influenced by the preview difficulty of word n+2, representing a delayed parafoveal-on-foveal effect. The results challenge the mislocated-fixation hypothesis as an explanation of parafoveal-on-foveal effects and provide new insight into the complex spatial and temporal effect structure of processing inside the perceptual span during reading.
Semantic information extraction from the parafovea has been reported only in simplified Chinese for a special subset of characters and its generalizability has been questioned. This study uses traditional Chinese, which differs from simplified Chinese in visual complexity and in mapping semantic forms, to demonstrate access to parafoveal semantic information during reading of this script. Preview duration modulates various types (identical, phonological, and unrelated) of parafoveal information extraction. Parafoveal semantic extraction is more elusive in English; therefore, we conclude that such effects in Chinese are presumably caused by substantial cross-language differences from alphabetic scripts. The property of Chinese characters carrying rich lexical information in a small region provides the possibility of semantic extraction in the parafovea.
Primary saccades are often followed by small secondary saccades, which are generally thought to reduce the distance between the saccade endpoint and target location. Accumulated evidence demonstrates that secondary saccades are subject to various influences, among which retinal feedback during postsaccadic fixation constitutes only one important signal. Recently, we reported that target eccentricity and an orientation bias influence the generation of secondary saccades. In the present study, we examine secondary saccades in the absence of postsaccadic visual feedback. Although extraretinal signals (e.g., efference copy) have received widespread attention in eye-movement studies, it is still unclear whether an extraretinal error signal contributes to the programming of secondary saccades. We have observed that secondary saccade latency and amplitude depend on primary saccade error despite the absence of postsaccadic visual feedback. Strong evidence for an extraretinal error signal influencing secondary saccade programming is given by the observation that secondary saccades are more likely to be oriented in a direction opposite to the primary saccade as primary saccade error shifts from target undershoot to overshoot. We further show how the functional relationship between primary saccade landing position and secondary saccade characteristics varies as a function of target eccentricity. We propose that initial target eccentricity and an extraretinal error signal codetermine the postsaccadic activity distribution in the saccadic motor map when no visual feedback is available.
How preview space/time translates into preview cost/benefit for fixation durations during reading
(2013)
Eye-movement control during reading depends on foveal and parafoveal information. If the parafoveal preview of the next word is suppressed, reading is less efficient. A linear mixed model (LMM) reanalysis of McDonald (2006) confirmed his observation that preview benefit may be limited to parafoveal words that have been selected as the saccade target. Going beyond the original analyses, in the same LMM, we examined how the preview effect (i.e., the difference in single-fixation duration, SFD, between random-letter and identical preview) depends on the gaze duration on the pretarget word and on the amplitude of the saccade moving the eye onto the target word. There were two key results: (a) The shorter the saccade amplitude (i.e., the larger preview space), the shorter a subsequent SFD with an identical preview; this association was not observed with a random-letter preview. (b) However, the longer the gaze duration on the pretarget word, the longer the subsequent SFD on the target, with the difference between random-letter string and identical previews increasing with preview time. A third patternincreasing cost of a random-letter string in the parafovea associated with shorter saccade amplitudeswas observed for target gaze durations. Thus, LMMs revealed that preview effects, which are typically summarized under preview benefit, are a complex mixture of preview cost and preview benefit and vary with preview space and preview time. The consequence for reading is that parafoveal preview may not only facilitate, but also interfere with lexical access.
Task demands and individual differences have been linked reliably to word skipping during reading. Such differences in fixation probability may imply a selection effect for multivariate analyses of eye-movement corpora if selection effects correlate with word properties of skipped words. For example, with fewer fixations on short and highly frequent words the power to detect parafoveal-on-foveal effects is reduced. We demonstrate that increasing the fixation probability on function words with a manipulation of the expected difficulty and frequency of questions reduces an age difference in skipping probability (i.e., old adults become comparable to young adults) and helps to uncover significant parafoveal-on-foveal effects in this group of old adults. We discuss implications for the comparison of results of eye-movement research based on multivariate analysis of corpus data with those from display-contingent manipulations of target words.
The main goal of our target article was to provide concrete recommendations for improving the replicability of research findings. Most of the comments focus on this point. In addition, a few comments were concerned with the distinction between replicability and generalizability and the role of theory in replication. We address all comments within the conceptual structure of the target article and hope to convince readers that replication in psychological science amounts to much more than hitting the lottery twice.
Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate in psychology towards concrete recommendations for improvement. We focus on research practices but also offer guidelines for reviewers, editors, journal management, teachers, granting institutions, and university promotion committees, highlighting some of the emerging and existing practical solutions that can facilitate implementation of these recommendations. The challenges for improving replicability in psychological science are systemic. Improvement can occur only if changes are made at many levels of practice, evaluation, and reward.
Parafoveal semantic processing has recently been well documented in reading Chinese sentences, presumably because of language-specific features. However, because of a large variation of fixation landing positions on pretarget words, some preview words actually were located in foveal vision when readers' eyes landed close to the end of the pretarget words. None of the previous studies has completely ruled out a possibility that the semantic preview effects might mainly arise from these foveally processed preview words. This case, whether previously observed positive evidence for parafoveal semantic processing can still hold, has been called into question. Using linear mixed models, we demonstrate in this study that semantic preview benefit from word N+1 decreased if fixation on pretarget word N was close to the preview. We argue that parafoveal semantic processing is not a consequence of foveally processed preview words.
Additive and interactive effects of word frequency, stimulus quality, and semantic priming have been used to test theoretical claims about the cognitive architecture of word-reading processes. Additive effects among these factors have been taken as evidence for discrete-stage models of word reading. We present evidence from linear mixed-model analyses applied to 2 lexical decision experiments indicating that apparent additive effects can be the product of aggregating over- and underadditive interaction effects that are modulated by recent trial history, particularly the lexical status and stimulus quality of the previous trial's target. Even a simple practice effect expressed as improved response speed across trials was powerfully modulated by the nature of the previous target item. These results suggest that additivity and interaction between factors may reflect trial-to-trial variation in stimulus representations and decision processes rather than fundamental differences in processing architecture.
Dyslexic children are known to be slower than normal readers in rapid automatized naming (RAN). This suggests that dyslexics encounter local processing difficulties, which presumably induce a narrower perceptual span. Consequently, dyslexics should suffer less than normal readers from removing parafoveal preview. Here we used a gaze-contingent moving window paradigm in a RAN task to experimentally test this prediction. Results indicate that dyslexics extract less parafoveal information than control children. We propose that more attentional resources are recruited to the foveal processing because of dyslexics' less automatized translation of visual symbols into phonological output, thereby causing a reduction of the perceptual span. This in turn leads to less efficient preactivation of parafoveal information and, hence, more difficulty in processing the next foveal item.
We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short Time Out regressions (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control.
We tested the limits of working-memory capacity (WMC) of young adults, old adults, and children with a memory-updating task. The task consisted of mentally shifting spatial positions within a grid according to arrows, their color signaling either only go (control) or go/no-go conditions. The interference model (IM) of Oberauer and Kliegl (2006) was simultaneously fitted to the data of all groups. In addition to the 3 main model parameters (feature overlap, noise, and processing rate), we estimated the time for switching between go and no-go steps as a new model parameter. In this study, we examined the IM parameters across the life span. The IM parameter estimates show that (a) conditions were not different in interference by feature overlap and interference by confusion; (b) switching costs time; (c) young adults and children were less susceptible than old adults to interference due to feature overlap; (d) noise was highest for children, followed by old and young adults; (e) old adults differed from children and young adults in lower processing rate; and (f) children and old adults had a larger switch cost between go steps and no-go steps. Thus, the results of this study indicated that across age, the IM parameters contribute distinctively for explaining the limits of WMC.
It is well established that fixation durations during reading vary with processing difficulty, but there are different views on how oculomotor control, visual perception, shifts of attention, and lexical (and higher cognitive) processing are coordinated. Evidence for a one-to-one translation of input delay into saccadic latency would provide a much needed constraint for current theoretical proposals. Here, we tested predictions of such a direct-control perspective using the stimulus-onset delay (SOD) paradigm. Words in sentences were initially masked and, on fixation, were individually unmasked with a delay (0-, 33-, 66-, 99-ms SODs). In Experiment 1, SODs were constant for all words in a sentence; in Experiment 2, SODs were manipulated on target words, while nontargets were unmasked without delay. In accordance with predictions of direct control, nonzero SODs entailed equivalent increases in fixation durations in both experiments. Yet, a population of short fixations pointed to rapid saccades as a consequence of low-level information at nonoptimal viewing positions rather than of lexical processing. Implications of these results for theoretical accounts of oculomotor control are discussed.
We measured Chinese dyslexic and control children's eye movements during rapid automatized naming (RAN) with alphanumeric (digits) and symbolic (dice surfaces) stimuli. Both types of stimuli required identical oral responses, controlling for effects associated with speech production. Results showed that naming dice was much slower than naming digits for both groups, but group differences in eye-movement measures and in the eye-voice span (i.e. the distance between the currently fixated item and the voiced item) were generally larger in digit-RAN than in dice-RAN. In addition, dyslexics were less efficient in parafoveal processing in these RAN tasks. Since the two RAN tasks required the same phonological output and on the assumption that naming dice is less practiced than naming digits in general, the results suggest that the translation of alphanumeric visual symbols into phonological codes is less efficient in dyslexic children. The dissociation of the print-to-sound conversion and phonological representation suggests that the degree of automaticity in translation from visual symbols to phonological codes in addition to phonological processing per se is also critical to understanding dyslexia.
Sequential and coordinative complexity : age-based processing limitations in figural transformation
(1993)
Dimensions of cognitive complexity in figural transformations were examined in the context of adult age differences. Sequential complexity was manipulated through figural transformations of single objects in a multiple- object array. Coordinative complexity was induced through spatial or nonspatial transformations of the entire array. Results confirmed the prediction that age-related slowing is larger in coordinative complexity than in sequential complexity conditions. The effect was stable across 8 sessions (Exp 1), was obtained when age groups were equated in accuracy with criterion-referenced testing (Exp 2), and was corroborated by age-differential probabilities of error types (Exps 1 and 2). A model is proposed attributing age effects under coordinative complexity to 2 factors: (1) basic- level slowing and (2) time-consuming reiterations through the processing sequence due to age-related working memory failures. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Cognitive plasticity
(2002)
Über rezeptive Gedächtnisse
(2005)
Messung von Blickbewegungen
(2006)
An lterative algorithm for the estimation of the distribution of mislocated fixations during reading
(2007)
Parafoveal load of word N+1 modulates preprocessing effectiveness of word N+2 in chinese reading
(2010)
Parameters of a formal working-memory model were estimated for verbal and spatial memory updating of children. The model proposes interference though feature overwriting and through confusion of whole elements as the primary cause of working-memory capacity limits. We tested 2 age groups each containing 1 group of normal intelligence and 1 deficit group. For young children the deficit was developmental dyslexia; for older children it was a general learning difficulty. The interference model predicts less interference through overwriting but more through confusion of whole elements for the dyslexic children than for their age-matched controls. Older children exhibited less interference through confusion of whole elements and a higher processing rate than young children, but general learning difficulty was associated with slower processing than in the age-matched control group. Furthermore, the difference between verbal and spatial updating mapped onto several meaningful dissociations of model parameters.
Following up on research suggesting an age-related reduction in the rightward extent of the perceptual span during reading (Rayner, Castelhano, & Yang, 2009), we compared old and young adults in an N + 2-boundary paradigm in which a nonword preview of word N + 2 or word N + 2 itself is replaced by the target word once the eyes cross an invisible boundary located after word N. The intermediate word N + 1 was always three letters long. Gaze durations on word N + 2 were significantly shorter for identical than nonword N + 2 preview both for young and for old adults, with no significant difference in this preview benefit. Young adults, however, did modulate their gaze duration on word N more strongly than old adults in response to the difficulty of the parafoveal word N + 1. Taken together, the results suggest a dissociation of preview benefit and parafoveal-on-foveal effect. Results are discussed in terms of age-related decline in resilience towards distributed processing while simultaneously preserving the ability to integrate parafoveal information into foveal processing. As such, the present results relate to proposals of regulatory compensation strategies older adults use to secure an overall reading speed very similar to that of young adults. (PsycINFO Database Record (c) 2011 APA, all rights reserved)
Eye fixation durations during normal reading correlate with processing difficulty, but the specific cognitive mechanisms reflected in these measures are not well understood. This study finds support in German readers' eye fixations for two distinct difficulty metrics: surprisal, which reflects the change in probabilities across syntactic analyses as new words are integrated; and retrieval, which quantifies comprehension difficulty in terms of working memory constraints. We examine the predictions of both metrics using a family of dependency parsers indexed by an upper limit on the number of candidate syntactic analyses they retain at successive words. Surprisal models all fixation measures and regression probability. By contrast, retrieval does not model any measure in serial processing. As more candidate analyses are considered in parallel at each word, retrieval can account for the same measures as surprisal. This pattern suggests an important role for ranked parallelism in theories of sentence comprehension.
Mit der lexikalischen Datenbank dlexDB stellen wir der psychologischen und linguistischen Forschung im World Wide Web online statistische Kennwerte für eine Vielzahl von verarbeitungsrelevanten Merkmalen von Wörtern zur Verfügung. Diese Kennwerte umfassen die durch CELEX (Baayen, Piepenbrock und Gulikers, 1995) bekannten Variablen der Häufigkeiten von Wortformen und Lemmata in Texten geschriebener Sprache. Darüber hinaus berechnen wir eine Reihe neuer Kennwerte wie die Häufigkeiten von Silben, Morphemen, Zeichenfolgen und Mehrwortverbindungen sowie Wortähnlichkeitsmaße. Die Datengrundlage bildet das Kernkorpus des Digitalen Wörterbuchs der deutschen Sprache (DWDS) mit über 100 Millionen laufenden Wörtern. Wir illustrieren die Validität dieser Kennwerte mit neuen Ergebnissen zu ihrem Einfluss auf Fixationsdauern beim Lesen von Sätzen.