TY - JOUR A1 - Pan, Jinger A1 - Yan, Ming A1 - Laubrock, Jochen T1 - Semantic preview benefit and cost BT - evidence from parafoveal fast-priming paradigm JF - Cognition : international journal of cognitive science N2 - How is semantic information in the mental lexicon accessed and selected during reading? Readers process information of both the foveal and parafoveal words. Recent eye-tracking studies hint at bi-phasic lexical activation dynamics, demonstrating that semantically related parafoveal previews can either facilitate, or interfere with lexical processing of target words in comparison to unrelated previews, with the size and direction of the effect depending on exposure time to parafoveal previews. However, evidence to date is only correlational, because exposure time was determined by participants' pre-target fixation durations. Here we experimentally controlled parafoveal preview exposure duration using a combination of the gaze-contingent fast-priming and boundary paradigms. We manipulated preview duration and examined the time course of parafoveal semantic activation during the oral reading of Chinese sentences in three experiments. Semantic previews led to faster lexical access of target words than unrelated previews only when the previews were presented briefly (80 ms in Experiments 1 and 3). Longer exposure time (100 ms or 150 ms) eliminated semantic preview effects, and full preview without duration limit resulted in preview cost, i.e., a reversal of preview benefit. Our results indicate that high-level semantic information can be obtained from parafoveal words and the size and direction of the parafoveal semantic effect depends on the level of lexical activation. KW - parafoveal KW - oral reading KW - Chinese KW - semantic preview cost Y1 - 2020 U6 - https://doi.org/10.1016/j.cognition.2020.104452 SN - 0010-0277 SN - 1873-7838 VL - 205 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Felisatti, Arianna A1 - Aagten-Murphy, David A1 - Laubrock, Jochen A1 - Shaki, Samuel A1 - Fischer, Martin H. T1 - The brain’s asymmetric frequency tuning BT - asymmetric behavior originates from asymmetric perception JF - Symmetry / Molecular Diversity Preservation International (MDPI) N2 - To construct a coherent multi-modal percept, vertebrate brains extract low-level features (such as spatial and temporal frequencies) from incoming sensory signals. However, because frequency processing is lateralized with the right hemisphere favouring low frequencies while the left favours higher frequencies, this introduces asymmetries between the hemispheres. Here, we describe how this lateralization shapes the development of several cognitive domains, ranging from visuo-spatial and numerical cognition to language, social cognition, and even aesthetic appreciation, and leads to the emergence of asymmetries in behaviour. We discuss the neuropsychological and educational implications of these emergent asymmetries and suggest future research approaches. KW - asymmetry KW - global KW - local KW - spatial frequencies KW - temporal frequencies KW - embodied cognition Y1 - 2020 U6 - https://doi.org/10.3390/sym12122083 SN - 2073-8994 VL - 12 IS - 12 PB - MDPI CY - Basel ER - TY - JOUR A1 - Tseng, Chiao-I A1 - Laubrock, Jochen A1 - Bateman, John A. T1 - The impact of multimodal cohesion on attention and interpretation in film JF - Discourse, context & media N2 - This article presents results of an exploratory investigation combining multimodal cohesion analysis and eye-tracking studies. Multimodal cohesion, as a tool of multimodal discourse analysis, goes beyond lin-guistic cohesive mechanisms to enable the construction of cross-modal discourse structures that system-atically relate technical details of audio, visual and verbal modalities. Patterns of multimodal cohesion from these discourse structures were used to design eye-tracking experiments and questionnaires in order to empirically investigate how auditory and visual cohesive cues affect attention and comprehen-sion. We argue that the cross-modal structures of cohesion revealed by our method offer a strong methodology for addressing empirical questions concerning viewers' comprehension of narrative settings and the comparative salience of visual, verbal and audio cues. Analyses are presented of the beginning of Hitchcock's The Birds (1963) and a sketch from Monty Python filmed in 1971. Our approach balances the narrative-based issue of how narrative elements in film guide meaning interpretation and the recipient -based question of where a film viewer's attention is directed during viewing and how this affects comprehension. KW - Film KW - Cohesion KW - Discourse semantics KW - Multimodality KW - Eye-tracking KW - Attention Y1 - 2021 U6 - https://doi.org/10.1016/j.dcm.2021.100544 SN - 2211-6958 VL - 44 PB - Amsterdam [u.a.] CY - Oxford ER - TY - JOUR A1 - Pan, Jinger A1 - Laubrock, Jochen A1 - Yan, Ming T1 - Phonological consistency effects in Chinese sentence reading JF - Scientific studies of reading N2 - In two eye-tracking experiments, we investigated the processing of information about phonological consistency of Chinese phonograms during sentence reading. In Experiment 1, we adopted the error disruption paradigm in silent reading and found significant effects of phonological consistency and homophony in the foveal vision, but only in a late processing stage. Adding oral reading to Experiment 2, we found both effects shifted to earlier indices of parafoveal processing. Specifically, low-consistency characters led to a better homophonic foveal recovery effect in Experiment 1 and stronger homophonic preview benefits in Experiment 2. These findings suggest that phonological consistency information can be obtained during sentence reading, and compared to the low-consistency previews the high-consistency previews are processed faster, which leads to greater interference to the recognition of target characters. Y1 - 2020 U6 - https://doi.org/10.1080/10888438.2020.1789146 SN - 1088-8438 SN - 1532-799X VL - 25 IS - 4 SP - 335 EP - 350 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Felisatti, Arianna A1 - Laubrock, Jochen A1 - Shaki, Samuel A1 - Fischer, Martin H. T1 - A biological foundation for spatial–numerical associations BT - the brain's asymmetric frequency tuning JF - Annals of the New York Academy of Sciences N2 - "Left" and "right" coordinates control our spatial behavior and even influence abstract thoughts. For number concepts, horizontal spatial-numerical associations (SNAs) have been widely documented: we associate few with left and many with right. Importantly, increments are universally coded on the right side even in preverbal humans and nonhuman animals, thus questioning the fundamental role of directional cultural habits, such as reading or finger counting. Here, we propose a biological, nonnumerical mechanism for the origin of SNAs on the basis of asymmetric tuning of animal brains for different spatial frequencies (SFs). The resulting selective visual processing predicts both universal SNAs and their context-dependence. We support our proposal by analyzing the stimuli used to document SNAs in newborns for their SF content. As predicted, the SFs contained in visual patterns with few versus many elements preferentially engage right versus left brain hemispheres, respectively, thus predicting left-versus rightward behavioral biases. Our "brain's asymmetric frequency tuning" hypothesis explains the perceptual origin of horizontal SNAs for nonsymbolic visual numerosities and might be extensible to the auditory domain. KW - hemispheric asymmetry KW - numerical cognition KW - SNARC effect KW - spatial KW - frequency tuning KW - spatial-numerical associations KW - spatial vision Y1 - 2020 U6 - https://doi.org/10.1111/nyas.14418 SN - 0077-8923 SN - 1749-6632 VL - 1477 IS - 1 SP - 44 EP - 53 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Cajar, Anke A1 - Engbert, Ralf A1 - Laubrock, Jochen T1 - How spatial frequencies and color drive object search in real-world scenes BT - a new eye-movement corpus JF - Journal of vision N2 - When studying how people search for objects in scenes, the inhomogeneity of the visual field is often ignored. Due to physiological limitations, peripheral vision is blurred and mainly uses coarse-grained information (i.e., low spatial frequencies) for selecting saccade targets, whereas high-acuity central vision uses fine-grained information (i.e., high spatial frequencies) for analysis of details. Here we investigated how spatial frequencies and color affect object search in real-world scenes. Using gaze-contingent filters, we attenuated high or low frequencies in central or peripheral vision while viewers searched color or grayscale scenes. Results showed that peripheral filters and central high-pass filters hardly affected search accuracy, whereas accuracy dropped drastically with central low-pass filters. Peripheral filtering increased the time to localize the target by decreasing saccade amplitudes and increasing number and duration of fixations. The use of coarse-grained information in the periphery was limited to color scenes. Central filtering increased the time to verify target identity instead, especially with low-pass filters. We conclude that peripheral vision is critical for object localization and central vision is critical for object identification. Visual guidance during peripheral object localization is dominated by low-frequency color information, whereas high-frequency information, relatively independent of color, is most important for object identification in central vision. KW - scene viewing KW - eye movements KW - object search KW - central and peripheral KW - vision KW - spatial frequencies KW - color KW - gaze-contingent displays Y1 - 2020 U6 - https://doi.org/10.1167/jov.20.7.8 SN - 1534-7362 VL - 20 IS - 7 PB - Association for Research in Vision and Opthalmology CY - Rockville ER - TY - JOUR A1 - Meixner, Johannes M. A1 - Nixon, Jessie S. A1 - Laubrock, Jochen T1 - The perceptual span is dynamically adjusted in response to foveal load by beginning readers JF - Journal of experimental psychology : general N2 - The perceptual span describes the size of the visual field from which information is obtained during a fixation in reading. Its size depends on characteristics of writing system and reader, but-according to the foveal load hypothesis-it is also adjusted dynamically as a function of lexical processing difficulty. Using the moving window paradigm to manipulate the amount of preview, here we directly test whether the perceptual span shrinks as foveal word difficulty increases. We computed the momentary size of the span from word-based eye-movement measures as a function of foveal word frequency, allowing us to separately describe the perceptual span for information affecting spatial saccade targeting and temporal saccade execution. First fixation duration and gaze duration on the upcoming (parafoveal) word N + 1 were significantly shorter when the current (foveal) word N was more frequent. We show that the word frequency effect is modulated by window size. Fixation durations on word N + 1 decreased with high-frequency words N, but only for large windows, that is, when sufficient parafoveal preview was available. This provides strong support for the foveal load hypothesis. To investigate the development of the foveal load effect, we analyzed data from three waves of a longitudinal study on the perceptual span with German children in Grades 1 to 6. Perceptual span adjustment emerged early in development at around second grade and remained stable in later grades. We conclude that the local modulation of the perceptual span indicates a general cognitive process, perhaps an attentional gradient with rapid readjustment. KW - eye movements KW - attention KW - perceptual span KW - foveal load KW - reading KW - development Y1 - 2022 U6 - https://doi.org/10.1037/xge0001140 SN - 0096-3445 SN - 1939-2222 VL - 151 IS - 6 SP - 1219 EP - 1232 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Pan, Jinger A1 - Yan, Ming A1 - Laubrock, Jochen T1 - Perceptual span in oral reading BT - the case of Chinese JF - Scientific Studies of Reading N2 - The present study explores the perceptual span, that is, the physical extent of the area from which useful visual information is obtained during a single fixation, during oral reading of Chinese sentences. Characters outside a window of legible text were replaced by visually similar characters. Results show that the influence of window size on the perceptual span was consistent across different fixation and oculomotor measures. To maintain normal reading behavior when reading aloud, it was necessary to have information provided from three characters to the right of the fixation. Together with findings from previous research, our findings suggest that the physical size of the perceptual span is smaller when reading aloud than in silent reading. This is in agreement with previous studies in English, suggesting that the mechanisms causing the reduced span in oral reading have a common base that generalizes across languages and writing systems. Y1 - 2017 U6 - https://doi.org/10.1080/10888438.2017.1283694 SN - 1088-8438 SN - 1532-799X VL - 21 SP - 254 EP - 263 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - JOUR A1 - Cajar, Anke A1 - Engbert, Ralf A1 - Laubrock, Jochen T1 - Potsdam Eye-Movement Corpus for Scene Memorization and Search With Color and Spatial-Frequency Filtering JF - Frontiers in psychology / Frontiers Research Foundation KW - eye movements KW - corpus dataset KW - scene viewing KW - object search KW - scene memorization KW - spatial frequencies KW - color KW - central and peripheral vision Y1 - 2022 U6 - https://doi.org/10.3389/fpsyg.2022.850482 SN - 1664-1078 VL - 13 SP - 1 EP - 7 PB - Frontiers Research Foundation CY - Lausanne, Schweiz ER - TY - JOUR A1 - Hartmann, Matthias A1 - Laubrock, Jochen A1 - Fischer, Martin H. T1 - The visual number world BT - a dynamic approach to study the mathematical mind JF - The quarterly journal of experimental psychology N2 - In the domain of language research, the simultaneous presentation of a visual scene and its auditory description (i.e., the visual world paradigm) has been used to reveal the timing of mental mechanisms. Here we apply this rationale to the domain of numerical cognition in order to explore the differences between fast and slow arithmetic performance, and to further study the role of spatial-numerical associations during mental arithmetic. We presented 30 healthy adults simultaneously with visual displays containing four numbers and with auditory addition and subtraction problems. Analysis of eye movements revealed that participants look spontaneously at the numbers they currently process (operands, solution). Faster performance was characterized by shorter latencies prior to fixating the relevant numbers and fewer revisits to the first operand while computing the solution. These signatures of superior task performance were more pronounced for addition and visual numbers arranged in ascending order, and for subtraction and numbers arranged in descending order (compared to the opposite pairings). Our results show that the visual number world-paradigm provides on-line access to the mind during mental arithmetic, is able to capture variability in arithmetic performance, and is sensitive to visual layout manipulations that are otherwise not reflected in response time measurements. KW - Eye movements KW - Mental arithmetic KW - Mental number line KW - Visual world paradigm Y1 - 2018 U6 - https://doi.org/10.1080/17470218.2016.1240812 SN - 1747-0218 SN - 1747-0226 VL - 71 IS - 1 SP - 28 EP - 36 PB - Sage Publ. CY - London ER -