Refine
Year of publication
Document Type
- Article (20)
- Postprint (9)
- Doctoral Thesis (6)
Is part of the Bibliography
- yes (35)
Keywords
- eye-tracking (35) (remove)
Institute
- Department Linguistik (20)
- Strukturbereich Kognitionswissenschaften (4)
- Department Psychologie (3)
- Department Sport- und Gesundheitswissenschaften (2)
- Department Erziehungswissenschaft (1)
- Department Grundschulpädagogik (1)
- Hasso-Plattner-Institut für Digital Engineering GmbH (1)
- Humanwissenschaftliche Fakultät (1)
- Institut für Romanistik (1)
- Strukturbereich Bildungswissenschaften (1)
Many studies have suggested that emotional stimuli orient and engage attention. There is also evidence that animate stimuli, such as those from humans and animals, cause attentional bias. However, categorical and emotional factors are usually mixed, and it is unclear to what extent human context influences attentional allocation. To address this issue, we tracked participants' eye movements while they viewed pictures with animals and inanimate images (i.e., category) as focal objects. These pictures had either negative or neutral emotional valence, and either human body parts or nonhuman parts were near the focal objects (i.e., context). The picture's valence, arousal, position, size, and most of the low-level visual features were matched across categories. The results showed that nonhuman animals were more likely to be attended to and to be attended to for longer times than inanimate objects. The same pattern held for the human contexts (vs. nonhuman contexts). The effects of emotional valence, category, and context interacted. Specifically, in images with a negative valence, focal animals and objects with human context had comparable numbers of gaze fixations and gaze duration. These results highlighted the attentional bias to animate parts of a picture and clarified that the effects of category, valence, and picture context interacted to influence attentional allocation.
Exercise or not?
(2023)
Objective: Individuals’ decisions to engage in exercise are often the result of in-the-moment choices between exercise and a competing behavioral alternative. The purpose of this study was to investigate processes that occur in-the-moment (i.e., situated processes) when individuals are faced with the choice between exercise and a behavioral alternative during a computerized task. These were analyzed against the background of interindividual differences in individuals’ automatic valuation and controlled evaluation of exercise.
Method: In a behavioral alternatives task 101 participants were asked whether they would rather choose an exercise option or a behavioral alternative in 25 trials. Participants’ gaze behavior (first gaze and fixations) was recorded using eye-tracking. An exercise-specific affect misattribution procedure (AMP) was used to assess participants’ automatic valuation of exercise before the task. After the task, self-reported feelings towards exercise (controlled evaluation) and usual weekly exercise volume were assessed. Mixed effects models with random effects for subjects and trials were used for data analysis.
Results: Choosing exercise was positively correlated with individuals’ automatic valuation (r = 0.20, p = 0.05), controlled evaluation (r = 0.58, p < 0.001), and their weekly exercise volume (r = 0.43, p < 0.001). Participants showed no bias in their initial gaze or number of fixations towards the exercise or the non-exercise alternative. However, participants were 1.30 times more likely to fixate on the chosen alternative first and more frequently, but this gaze behavior was not related to individuals’ automatic valuation, controlled evaluation, or weekly exercise volume.
Conclusion: The results suggest that situated processes arising from defined behavioral alternatives may be independent of individuals’ general preferences. Despite one’s best general intention to exercise more, the choice of a non-exercise alternative behavior may seem more appealing in-the-moment and eventually be chosen. New psychological theories of health behavior change should therefore better consider the role of potentially conflicting alternatives when it comes to initiating physical activity or exercise.
Exercise or not?
(2023)
Objective: Individuals’ decisions to engage in exercise are often the result of in-the-moment choices between exercise and a competing behavioral alternative. The purpose of this study was to investigate processes that occur in-the-moment (i.e., situated processes) when individuals are faced with the choice between exercise and a behavioral alternative during a computerized task. These were analyzed against the background of interindividual differences in individuals’ automatic valuation and controlled evaluation of exercise.
Method: In a behavioral alternatives task 101 participants were asked whether they would rather choose an exercise option or a behavioral alternative in 25 trials. Participants’ gaze behavior (first gaze and fixations) was recorded using eye-tracking. An exercise-specific affect misattribution procedure (AMP) was used to assess participants’ automatic valuation of exercise before the task. After the task, self-reported feelings towards exercise (controlled evaluation) and usual weekly exercise volume were assessed. Mixed effects models with random effects for subjects and trials were used for data analysis.
Results: Choosing exercise was positively correlated with individuals’ automatic valuation (r = 0.20, p = 0.05), controlled evaluation (r = 0.58, p < 0.001), and their weekly exercise volume (r = 0.43, p < 0.001). Participants showed no bias in their initial gaze or number of fixations towards the exercise or the non-exercise alternative. However, participants were 1.30 times more likely to fixate on the chosen alternative first and more frequently, but this gaze behavior was not related to individuals’ automatic valuation, controlled evaluation, or weekly exercise volume.
Conclusion: The results suggest that situated processes arising from defined behavioral alternatives may be independent of individuals’ general preferences. Despite one’s best general intention to exercise more, the choice of a non-exercise alternative behavior may seem more appealing in-the-moment and eventually be chosen. New psychological theories of health behavior change should therefore better consider the role of potentially conflicting alternatives when it comes to initiating physical activity or exercise.
In a preferential looking paradigm, we studied how children's looking behavior and pupillary response were modulated by the degree of phonological mismatch between the correct label of a target referent and its manipulated form. We manipulated degree of mismatch by introducing one or more featural changes to the target label. Both looking behavior and pupillary response were sensitive to degree of mismatch, corroborating previous studies that found differential responses in one or the other measure. Using time-course analyses, we present for the first time results demonstrating full separability among conditions (detecting difference not only between one vs. more, but also between two and three featural changes). Furthermore, the correct labels and small featural changes were associated with stable target preference, while large featural changes were associated with oscillating looking behavior, suggesting significant shifts in looking preference over time. These findings further support and extend the notion that early words are represented in great detail, containing subphonemic information.
With the spread of smart phones capable of taking high-resolution photos and the development of high-speed mobile data infrastructure, digital visual media is becoming one of the most important forms of modern communication. With this development, however, also comes a devaluation of images as a media form with the focus becoming the frequency at which visual content is generated instead of the quality of the content. In this work, an interactive system using image-abstraction techniques and an eye tracking sensor is presented, which allows users to experience diverting and dynamic artworks that react to their eye movement. The underlying modular architecture enables a variety of different interaction techniques that share common design principles, making the interface as intuitive as possible. The resulting experience allows users to experience a game-like interaction in which they aim for a reward, the artwork, while being held under constraints, e.g., not blinking. The co nscious eye movements that are required by some interaction techniques hint an interesting, possible future extension for this work into the field of relaxation exercises and concentration training.
It is well established in language acquisition research that monolingual children and adult second language learners misinterpret sentences with the universal quantifier every and make quantifier-spreading errors that are attributed to a preference for a match in number between two sets of objects. The present Visual World eye-tracking study tested bilingual heritage Russian–English adults and investigated how they interpret of sentences like Every alligator lies in a bathtub in both languages. Participants performed a sentence–picture verification task while their eye movements were recorded. Pictures showed three pairs of alligators in bathtubs and two extra objects: elephants (Control condition), bathtubs (Overexhaustive condition), or alligators (Underexhaustive condition). Monolingual adults performed at ceiling in all conditions. Heritage language (HL) adults made 20% q-spreading errors, but only in the Overexhaustive condition, and when they made an error they spent more time looking at the two extra bathtubs during the Verb region. We attribute q-spreading in HL speakers to cognitive overload caused by the necessity to integrate conflicting sources of information, i.e. the spoken sentences in their weaker, heritage, language and attention-demanding visual context, that differed with respect to referential salience.
It is well established in language acquisition research that monolingual children and adult second language learners misinterpret sentences with the universal quantifier every and make quantifier-spreading errors that are attributed to a preference for a match in number between two sets of objects. The present Visual World eye-tracking study tested bilingual heritage Russian-English adults and investigated how they interpret of sentences like Every alligator lies in a bathtub in both languages. Participants performed a sentence-picture verification task while their eye movements were recorded. Pictures showed three pairs of alligators in bathtubs and two extra objects: elephants (Control condition), bathtubs (Overexhaustive condition), or alligators (Underexhaustive condition). Monolingual adults performed at ceiling in all conditions. Heritage language (HL) adults made 20% q-spreading errors, but only in the Overexhaustive condition, and when they made an error they spent more time looking at the two extra bathtubs during the Verb region. We attribute q-spreading in HL speakers to cognitive overload caused by the necessity to integrate conflicting sources of information, i.e. the spoken sentences in their weaker, heritage, language and attention-demanding visual context, that differed with respect to referential salience.
Dependency Resolution Difficulty Increases with Distance in Persian Separable Complex Predicates
(2016)
Delaying the appearance of a verb in a noun-verb dependency tends to increase processing difficulty at the verb; one explanation for this locality effect is decay and/or interference of the noun in working memory. Surprisal, an expectation-based account, predicts that delaying the appearance of a verb either renders it no more predictable or more predictable, leading respectively to a prediction of no effect of distance or a facilitation. Recently, Husain et al. (2014) suggested that when the exact identity of the upcoming verb is predictable (strong predictability), increasing argument-verb distance leads to facilitation effects, which is consistent with surprisal; but when the exact identity of the upcoming verb is not predictable (weak predictability), locality effects are seen. We investigated Husain et al.'s proposal using Persian complex predicates (CPs), which consist of a non-verbal element—a noun in the current study—and a verb. In CPs, once the noun has been read, the exact identity of the verb is highly predictable (strong predictability); this was confirmed using a sentence completion study. In two self-paced reading (SPR) and two eye-tracking (ET) experiments, we delayed the appearance of the verb by interposing a relative clause (Experiments 1 and 3) or a long PP (Experiments 2 and 4). We also included a simple Noun-Verb predicate configuration with the same distance manipulation; here, the exact identity of the verb was not predictable (weak predictability). Thus, the design crossed Predictability Strength and Distance. We found that, consistent with surprisal, the verb in the strong predictability conditions was read faster than in the weak predictability conditions. Furthermore, greater verb-argument distance led to slower reading times; strong predictability did not neutralize or attenuate the locality effects. As regards the effect of distance on dependency resolution difficulty, these four experiments present evidence in favor of working memory accounts of argument-verb dependency resolution, and against the surprisal-based expectation account of Levy (2008). However, another expectation-based measure, entropy, which was computed using the offline sentence completion data, predicts reading times in Experiment 1 but not in the other experiments. Because participants tend to produce more ungrammatical continuations in the long-distance condition in Experiment 1, we suggest that forgetting due to memory overload leads to greater entropy at the verb.
Dependency Resolution Difficulty Increases with Distance in Persian Separable Complex Predicates
(2016)
Delaying the appearance of a verb in a noun-verb dependency tends to increase processing difficulty at the verb; one explanation for this locality effect is decay and/or interference of the noun in working memory. Surprisal, an expectation-based account, predicts that delaying the appearance of a verb either renders it no more predictable or more predictable, leading respectively to a prediction of no effect of distance or a facilitation. Recently, Husain et al. (2014) suggested that when the exact identity of the upcoming verb is predictable (strong predictability), increasing argument-verb distance leads to facilitation effects, which is consistent with surprisal; but when the exact identity of the upcoming verb is not predictable (weak predictability), locality effects are seen. We investigated Husain et al.'s proposal using Persian complex predicates (CPs), which consist of a non-verbal element—a noun in the current study—and a verb. In CPs, once the noun has been read, the exact identity of the verb is highly predictable (strong predictability); this was confirmed using a sentence completion study. In two self-paced reading (SPR) and two eye-tracking (ET) experiments, we delayed the appearance of the verb by interposing a relative clause (Experiments 1 and 3) or a long PP (Experiments 2 and 4). We also included a simple Noun-Verb predicate configuration with the same distance manipulation; here, the exact identity of the verb was not predictable (weak predictability). Thus, the design crossed Predictability Strength and Distance. We found that, consistent with surprisal, the verb in the strong predictability conditions was read faster than in the weak predictability conditions. Furthermore, greater verb-argument distance led to slower reading times; strong predictability did not neutralize or attenuate the locality effects. As regards the effect of distance on dependency resolution difficulty, these four experiments present evidence in favor of working memory accounts of argument-verb dependency resolution, and against the surprisal-based expectation account of Levy (2008). However, another expectation-based measure, entropy, which was computed using the offline sentence completion data, predicts reading times in Experiment 1 but not in the other experiments. Because participants tend to produce more ungrammatical continuations in the long-distance condition in Experiment 1, we suggest that forgetting due to memory overload leads to greater entropy at the verb.
This article derives from two interdisciplinary research projects funded by the UK Arts and Humanities Research Council, involving the application of psychological experimental techniques to the study of poetic form and reader response. It discusses the semantic and expressive effects of space and pattern in innovative forms of contemporary British and American poetry. After referring to some historical and theoretical contexts for these issues, the article analyses the results of experiments using eye-tracking, manipulations of text, memory tests and readers' recorded responses and interpretations. The first group of poems studied were lineated, with extended spaces within lines and displacement of lines from the left margin. Referring to a poem from Geoffrey Hill'sCanaan(1996), the authors show that such use of space may serve to articulate syntactical structures, but may also promote richer interpretation by encouraging cross-linear semantic connections. The second technique studied was the break from linear into postlinear poetry, as an initially lineated sequence shifts to pages of dispersed text. In readings of Susan Howe'sPythagorean Silence(fromThe Europe of Trusts, 1990), the authors detected more radical effects of space, shape and pattern, with associated consequences for interpretative strategies and aesthetic responses. Finally, the article discusses the potential for both mutual support and heuristic challenge between an empirical study of reader response, and a historical-theoretical approach as exemplified by Jerome McGann's interpretation ofPythagorean Silence.