Refine
Year of publication
Document Type
- Article (85)
- Postprint (25)
- Other (11)
- Preprint (11)
- Conference Proceeding (3)
- Review (3)
- Monograph/Edited Volume (1)
- Part of a Book (1)
Is part of the Bibliography
- yes (140)
Keywords
- embodied cognition (28)
- SNARC (20)
- numerical cognition (20)
- SNARC effect (13)
- mental number line (13)
- Mental number line (12)
- mental arithmetic (10)
- Embodied cognition (9)
- operational momentum (9)
- Numerical cognition (7)
Institute
- Department Psychologie (77)
- Strukturbereich Kognitionswissenschaften (31)
- Humanwissenschaftliche Fakultät (11)
- Strukturbereich Bildungswissenschaften (4)
- Department Linguistik (2)
- Department für Inklusionspädagogik (2)
- Extern (2)
- Institut für Philosophie (2)
- Department Sport- und Gesundheitswissenschaften (1)
- Hasso-Plattner-Institut für Digital Engineering GmbH (1)
This study investigated how touching and being touched by a humanoid robot affects human physiology, impressions of the interaction, and attitudes towards humanoid robots. 21 healthy adult participants completed a 3 (touch style: touching, being touched, pointing) x 2 (body part: hand vs buttock) within-subject design using a Pepper robot. Skin conductance response (SCR) was measured during each interaction. Perceived impressions of the interaction (i.e., friendliness, comfort, arousal) were measured per questionnaire after each interaction. Participants' demographics and their attitude towards robots were also considered. We found shorter SCR rise times in the being touched compared to the touching condition, possibly reflecting psychological alertness to the unpredictability of robot-initiated contacts. The hand condition had shorter rise times than the buttock condition. Most participants evaluated the hand condition as most friendly and comfortable and the robot-initiated interactions as most arousing. Interacting with Pepper improved attitudes towards robots. Our findings require future studies with larger samples and improved procedures. They have implications for robot design in all domains involving tactile interactions, such as caring and intimacy.
Mimicking non-verbal emotional expressions and empathy development in simulated consultations
(2018)
Objective: To explore the feasibility of applying an experimental design to study the relationship between non-verbal emotions and empathy development in simulated consultations.
Method: In video-recorded simulated consultations, twenty clinicians were randomly allocated to either an experimental group (instructed to mimic non-verbal emotions of a simulated patient, SP) or a control group (no such instruction). Baseline empathy scores were obtained before consultation, relational empathy was rated by SP after consultation. Multilevel logistic regression modelled the probability of mimicry occurrence, controlling for baseline empathy and clinical experience. ANCOVA compared group differences on relational empathy and consultation smoothness.
Results: Instructed mimicry lasted longer than spontaneous mimicry. Mimicry was marginally related to improved relational empathy. SP felt being treated more like a whole person during consultations with spontaneous mimicry. Clinicians who displayed spontaneous mimicry felt consultations went more smoothly.
Conclusion: The experimental approach improved our understanding of how non-verbal emotional mimicry contributed to relational empathy development during consultations. Further work should ascertain the potential of instructed mimicry to enhance empathy development.
Practice implications: Understanding how non-verbal emotional mimicry impacts on patients’ perceived clinician empathy during consultations may inform training and intervention programme development.
There has been increasing interest in the spatial mapping of various perceptual and cognitive magnitudes, such as expanding the spatial-numerical association of response codes (SNARC) effect into domains outside of numerical cognition. Recently, De Tommaso and Prpic (Attention, Perception, & Psychophysics, 82, 2765-2773, 2020) reported in this journal that only fast tempos over 104 beats per minute have spatial associations, with more right-sided associations and faster responses for faster tempos. After discussing the role of perceived loudness and possible response strategies, we propose and recommend methodological improvements for further research.
A large number of experimental findings from neuroscience and experimental psychology demonstrated interactions between spatial cognition and numerical cognition. In particular, many researchers posited a horizontal mental number line, where small numbers are thought of as being to the left of larger numbers. This review synthesizes work on the mental association between space and number, indicating the existence of multiple spatial mappings: recent research has found associations between number and vertical space, as well as associations between number and near/far space. We discuss number space in three dimensions with an eye on potential origins of the different number mappings, and how these number mappings fit in with our current knowledge of brain organization and brain-culture interactions. We derive novel predictions and show how this research fits into a general view of cognition as embodied, grounded and situated. (C) 2015 Elsevier Ltd. All rights reserved.
Previous research on the interplay between static manual postures and visual attention revealed enhanced visual selection near the hands (near-hand effect). During active movements there is also superior visual performance when moving toward compared to away from the stimulus (direction effect). The "modulated visual pathways" hypothesis argues that differential involvement of magno- and parvocellular visual processing streams causes the near-hand effect. The key finding supporting this hypothesis is an increase in temporal and a reduction in spatial processing in near-hand space (Gozli et al., 2012). Since this hypothesis has, so far, only been tested with static hand postures, we provide a conceptual replication of Gozli et al.'s (2012) result with moving hands, thus also probing the generality of the direction effect. Participants performed temporal or spatial gap discriminations while their right hand was moving below the display. In contrast to Gozli et al (2012), temporal gap discrimination was superior at intermediate and not near hand proximity. In spatial gap discrimination, a direction effect without hand proximity effect suggests that pragmatic attentional maps overshadowed temporal/spatial processing biases for far/near-hand space.
Moving arms
(2018)
Embodied cognition postulates a bi-directional link between the human body and its cognitive functions. Whether this holds for higher cognitive functions such as problem solving is unknown. We predicted that arm movement manipulations performed by the participants could affect the problem-solving solutions. We tested this prediction in quantitative reasoning tasks that allowed two solutions to each problem (addition or subtraction). In two studies with healthy adults (N=53 and N=50), we found an effect of problem-congruent movements on problem solutions. Consistent with embodied cognition, sensorimotor information gained via right or left arm movements affects the solution in different types of problem-solving tasks.
Moving arms
(2018)
Embodied cognition postulates a bi-directional link between the human body and its cognitive functions. Whether this holds for higher cognitive functions such as problem solving is unknown. We predicted that arm movement manipulations performed by the participants could affect the problem-solving solutions. We tested this prediction in quantitative reasoning tasks that allowed two solutions to each problem (addition or subtraction). In two studies with healthy adults (N=53 and N=50), we found an effect of problem-congruent movements on problem solutions. Consistent with embodied cognition, sensorimotor information gained via right or left arm movements affects the solution in different types of problem-solving tasks.
Finger-based numerical representations have gained increasing research interest. However, their description and assessment often refer to different numerical principles of ordinality, cardinality and 1-to-1 correspondence. Our aim was to investigate similarities and differences between these principles in finger-based numerical representations. Sixty-eight healthy adults performed ordinal finger counting, cardinal finger montring (showing the number of gestures) and finger-to-number mapping with twisted arms and fingers. We found that counting gestures and montring postures were identical for Number 10 but differed to varying degrees for other numbers. Interestingly, there was no systematic relation between finger-to-number mapping and ordinal finger counting habits. These data question the assumption of a unitary embodied finger-based numerical representation, but suggest that different finger-based representations co-exist and can be recruited flexibly depending on the numerical aspects to be conveyed.
Numerical cognitions such as spatial-numerical associations have been observed to be influenced by grounded, embodied and situated factors. For the case of finger counting, grounded and embodied influences have been reported. However, situated influences, e.g., that reported counting habits change with perception and action within a given situation, have not been systematically examined. To pursue the issue of situatedness of reported finger-counting habits, 458 participants were tested in three separate groups: (1) spontaneous condition: counting with both hands available, (2) perceptual condition: counting with horizontal (left-to-right) perceptual arrangement of fingers (3) perceptual and proprioceptive condition: counting with horizontal (left-to-right) perceptual arrangement of fingers and with busy dominant hand. Report of typical counting habits differed strongly between the three conditions. 28 % reported to start counting with the left hand in the spontaneous counting condition (1), 54 % in the perceptual condition (2) and 62 % in the perceptual and proprioceptive condition (3). Additionally, all participants in the spontaneous counting group showed a symmetry-based counting pattern (with the thumb as number 6), while in the two other groups, a considerable number of participants exhibited a spatially continuous counting pattern (with the pinkie as number 6). Taken together, the study shows that reported finger-counting habits depend on the perceptual and proprioceptive situation and thus are strongly influenced by situated cognition. We suggest that this account reconciles apparently contradictory previous findings of different counting preferences regarding the starting hand in different examination situations.
The embodied cognition framework suggests that neural systems for perception and action are engaged during higher cognitive processes. In an event-related fMRI study, we tested this claim for the abstract domain of numerical symbol processing: is the human cortical motor system part of the representation of numbers, and is organization of numerical knowledge influenced by individual finger counting habits? Developmental studies suggest a link between numerals and finger counting habits due to the acquisition of numerical skills through finger counting in childhood. In the present study, digits 1 to 9 and the corresponding number words were presented visually to adults with different finger counting habits, i.e. left- and right-starters who reported that they usually start counting small numbers with their left and right hand, respectively. Despite the absence of overt hand movements, the hemisphere contralateral to the hand used for counting small numbers was activated when small numbers were presented. The correspondence between finger counting habits and hemispheric motor activation is consistent with an intrinsic functional link between finger counting and number processing.
There is evidence both for mental number representations along a horizontal mental number line with larger numbers to the right of smaller numbers (for Western cultures) and a physically grounded, vertical representation where “more is up.” Few studies have compared effects in the horizontal and vertical dimension and none so far have combined both dimensions within a single paradigm where numerical magnitude was task-irrelevant and none of the dimensions was primed by a response dimension. We now investigated number representations over both dimensions, building on findings that mental representations of numbers and space co-activate each other. In a Go/No-go experiment, participants were auditorily primed with a relatively small or large number and then visually presented with quasi-randomly distributed distractor symbols and one Arabic target number (in Go trials only). Participants pressed a central button whenever they detected the target number and elsewise refrained from responding. Responses were not more efficient when small numbers were presented to the left and large numbers to the right. However, results indicated that large numbers were associated with upper space more strongly than small numbers. This suggests that in two-dimensional space when no response dimension is given, numbers are conceptually associated with vertical, but not horizontal space.
There is evidence both for mental number representations along a horizontal mental number line with larger numbers to the right of smaller numbers (for Western cultures) and a physically grounded, vertical representation where “more is up.” Few studies have compared effects in the horizontal and vertical dimension and none so far have combined both dimensions within a single paradigm where numerical magnitude was task-irrelevant and none of the dimensions was primed by a response dimension. We now investigated number representations over both dimensions, building on findings that mental representations of numbers and space co-activate each other. In a Go/No-go experiment, participants were auditorily primed with a relatively small or large number and then visually presented with quasi-randomly distributed distractor symbols and one Arabic target number (in Go trials only). Participants pressed a central button whenever they detected the target number and elsewise refrained from responding. Responses were not more efficient when small numbers were presented to the left and large numbers to the right. However, results indicated that large numbers were associated with upper space more strongly than small numbers. This suggests that in two-dimensional space when no response dimension is given, numbers are conceptually associated with vertical, but not horizontal space.
Stimulating numbers
(2018)
Finger counting is one of the first steps in the development of mature number concepts. With a one-to-one correspondence of fingers to numbers in Western finger counting, fingers hold two numerical meanings: one is based on the number of fingers raised and the second is based on their ordinal position within the habitual finger counting sequence. This study investigated how these two numerical meanings of fingers are intertwined with numerical cognition in adults. Participants received tactile stimulation on their fingertips of one hand and named either the number of fingers stimulated (2, 3, or 4 fingers; Experiment 1) or the number of stimulations on one fingertip (2, 3, or 4 stimulations; Experiment 2). Responses were faster and more accurate when the set of stimulated fingers corresponded to finger counting habits (Experiment 1) and when the number of stimulations matched the ordinal position of the stimulated finger (Experiment 2). These results show that tactile numerosity perception is affected by individual finger counting habits and that those habits give numerical meaning to single fingers.
Canonical finger postures, as used in counting, activate number knowledge, but the exact mechanism for this priming effect is unclear. Here we dissociated effects of visual versus motor priming of number concepts. In Experiment 1, participants were exposed either to pictures of canonical finger postures (visual priming) or actively produced the same finger postures (motor priming) and then used foot responses to rapidly classify auditory numbers (targets) as smaller or larger than 5. Classification times revealed that manually adopted but not visually perceived postures primed magnitude classifications. Experiment 2 obtained motor priming of number processing through finger postures also with vocal responses. Priming only occurred through canonical and not through non-canonical finger postures. Together, these results provide clear evidence for motor priming of number knowledge. Relative contributions of vision and action for embodied numerical cognition and the importance of canonicity of postures are discussed.
1 + 2 is more than 2 + 1: Violations of commutativity and identity axioms in mental arithmetic
(2015)
Over the past decade or so, a large number of studies have revealed that conceptual meaning is sensitive to situational context. More recently, similar contextual influences have been documented in the domain of number knowledge. Here we show such context dependency in a length production task. Adult participants saw single digit addition problems of the form n1 + n2 and produced the sum by changing bi-directionally the length of a horizontally extended line, using radially arranged buttons. We found that longer lines were produced when n1 < n2 compared to n1 > n2 and that unit size increased with result size. Thus, the mathematical axioms of commutativity and identity do not seem to hold in mental addition. We discuss implications of these observations for our understanding of cognitive mechanisms involved in mental arithmetic and for situated cognition generally.
Mental arithmetic is characterised by a tendency to overestimate addition and to underestimate subtraction results: the operational momentum (OM) effect. Here, motivated by contentious explanations of this effect, we developed and tested an arithmetic heuristics and biases model that predicts reverse OM due to cognitive anchoring effects. Participants produced bi-directional lines with lengths corresponding to the results of arithmetic problems. In two experiments, we found regular OM with zero problems (e.g., 3+0, 3-0) but reverse OM with non-zero problems (e.g., 2+1, 4-1). In a third experiment, we tested the prediction of our model. Our results suggest the presence of at least three competing biases in mental arithmetic: a more-or-less heuristic, a sign-space association and an anchoring bias. We conclude that mental arithmetic exhibits shortcuts for decision-making similar to traditional domains of reasoning and problem-solving.
Western adults associate small numbers with left space and large numbers with right space. Where does this pervasive spatial-numerical association come from? In this study, we first recorded directional counting preferences in adults with different reading experiences (left to right, right to left, mixed, and illiterate) and observed a clear relationship between reading and counting directions. We then recorded directional counting preferences in pre-schoolers and elementary school children from three of these reading cultures (left to right, right to left, and mixed). Culture-specific counting biases existed before reading acquisition in children as young as 3 years and were subsequently modified by early reading experience. Together, our results suggest that both directional counting and scanning activities contribute to number-space associations.
Mental arithmetic exhibits various biases. Among those is a tendency to overestimate addition and to underestimate subtraction outcomes. Does such “operational momentum” (OM) also affect multiplication and division? Twenty-six adults produced lines whose lengths corresponded to the correct outcomes of multiplication and division problems shown in symbolic format. We found a reliable tendency to over-estimate division outcomes, i.e., reverse OM. We suggest that anchoring on the first operand (a tendency to use this number as a reference for further quantitative reasoning) contributes to cognitive biases in mental arithmetic.
Mental arithmetic exhibits various biases. Among those is a tendency to overestimate addition and to underestimate subtraction outcomes. Does such “operational momentum” (OM) also affect multiplication and division? Twenty-six adults produced lines whose lengths corresponded to the correct outcomes of multiplication and division problems shown in symbolic format. We found a reliable tendency to over-estimate division outcomes, i.e., reverse OM. We suggest that anchoring on the first operand (a tendency to use this number as a reference for further quantitative reasoning) contributes to cognitive biases in mental arithmetic.
Spatial-numerical associations (SNAs) have been studied extensively in the past two decades, always requiring either explicit magnitude processing or explicit spatial-directional processing. This means that the typical finding of an association of small numbers with left or bottom space and of larger numbers with right or top space could be due to these requirements and not the conceptual representation of numbers. The present study compares explicit and implicit magnitude processing in an implicit spatial-directional task and identifies SNAs as artefacts of either explicit magnitude processing or explicit spatial-directional processing; they do not reveal spatial conceptual links. This finding requires revision of current accounts of the relationship between numbers and space.
Several chronometric biases in numerical cognition have informed our understanding of a mental number line (MNL). Complementing this approach, we investigated spatial performance in a magnitude comparison task. Participants located the larger or smaller number of a pair on a horizontal line representing the interval from 0 to 10. Experiments 1 and 2 used only number pairs one unit apart and found that digits were localized farther to the right with "select larger" instructions than with "select smaller" instructions. However, when numerical distance was varied (Experiment 3), digits were localized away from numerically near neighbors. This repulsion effect reveals context-specific distortions in number representation not previously noticed with chronometric measures.
Removing spatial responses reveals spatial concepts even in a culture with mixed reading habits
(2014)
A recent cross-cultural comparison (Shaki, Fischer, & Petrusic, 2009) suggested that spatially consistent processing habits for words and numbers are a necessary condition for the spatial representation of numbers (Spatial-Numerical Association of Response Codes; SNARC effect). Here we reexamine the SNARC in Israelis who read text from right to left but numbers from left to right. We show that, despite these spatially inconsistent processing habits, a SNARC effect still emerges when the response dimension is spatially orthogonal to the conflicting processing dimension. These results clarify the cognitive conditions for spatial-numerical mappings.
Magnitude estimation has been studied since the beginnings of scientific psychology and constitutes a fundamental aspect of human behavior. Yet, it has apparently never been noticed that estimates depend on the spatial arrangement used. We tested 167 adults in three experiments to show that the spatial layout of stimuli and responses systematically distorts number estimation, length production, and weight reproduction performance. The direction of distortion depends on the observer's counting habits, but does not seem to reflect the use of spatially associated number concepts. Our results imply that all quantitative estimates are contaminated by a "spell of space" whenever stimuli or responses are spatially distributed.
Magnitude estimation has been studied since the beginnings of scientific psychology and constitutes a fundamental aspect of human behavior. Yet, it has apparently never been noticed that estimates depend on the spatial arrangement used. We tested 167 adults in three experiments to show that the spatial layout of stimuli and responses systematically distorts number estimation, length production, and weight reproduction performance. The direction of distortion depends on the observer's counting habits, but does not seem to reflect the use of spatially associated number concepts. Our results imply that all quantitative estimates are contaminated by a "spell of space" whenever stimuli or responses are spatially distributed.
Spinal muscular atrophy (SMA) and Duchenne muscular dystrophy (DMD) both are rare genetic neuromuscular diseases with progressive loss of motor ability. The neuromotor developmental course of those diseases is well documented. In contrast, there is only little evidence about characteristics of general and specific cognitive development. In both conditions the final motor outcome is characterized by an inability to move autonomously: children with SMA never accomplish independent motoric exploration of their environment, while children with DMD do but later lose this ability again. These profound differences in developmental pathways might affect cognitive development of SMA vs. DMD children, as cognition is shaped by individual motor experiences. DMD patients show impaired executive functions, working memory, and verbal IQ, whereas only motor ability seems to be impaired in SMA. Advanced cognitive capacity in SMA may serve as a compensatory mechanism for achieving in education, career progression, and social satisfaction. This study aimed to relate differences in basic numerical concepts and arithmetic achievement in SMA and DMD patients to differences in their motor development and resulting sensorimotor and environmental experiences. Horizontal and vertical spatial-numerical associations were explored in SMA/DMD children ranging between 6 and 12 years through the random number generation task. Furthermore, arithmetic skills as well as general cognitive ability were assessed. Groups differed in spatial number processing as well as in arithmetic and domain-general cognitive functions. Children with SMA showed no horizontal and even reversed vertical spatial-numerical associations. Children with DMD on the other hand revealed patterns in spatial numerical associations comparable to healthy developing children. From the embodied Cognition perspective, early sensorimotor experience does play a role in development of mental number representations. However, it remains open whether and how this becomes relevant for the acquisition of higher order cognitive and arithmetic skills.
Spinal muscular atrophy (SMA) and Duchenne muscular dystrophy (DMD) both are rare genetic neuromuscular diseases with progressive loss of motor ability. The neuromotor developmental course of those diseases is well documented. In contrast, there is only little evidence about characteristics of general and specific cognitive development. In both conditions the final motor outcome is characterized by an inability to move autonomously: children with SMA never accomplish independent motoric exploration of their environment, while children with DMD do but later lose this ability again. These profound differences in developmental pathways might affect cognitive development of SMA vs. DMD children, as cognition is shaped by individual motor experiences. DMD patients show impaired executive functions, working memory, and verbal IQ, whereas only motor ability seems to be impaired in SMA. Advanced cognitive capacity in SMA may serve as a compensatory mechanism for achieving in education, career progression, and social satisfaction. This study aimed to relate differences in basic numerical concepts and arithmetic achievement in SMA and DMD patients to differences in their motor development and resulting sensorimotor and environmental experiences. Horizontal and vertical spatial-numerical associations were explored in SMA/DMD children ranging between 6 and 12 years through the random number generation task. Furthermore, arithmetic skills as well as general cognitive ability were assessed. Groups differed in spatial number processing as well as in arithmetic and domain-general cognitive functions. Children with SMA showed no horizontal and even reversed vertical spatial-numerical associations. Children with DMD on the other hand revealed patterns in spatial numerical associations comparable to healthy developing children. From the embodied Cognition perspective, early sensorimotor experience does play a role in development of mental number representations. However, it remains open whether and how this becomes relevant for the acquisition of higher order cognitive and arithmetic skills.
What features of a poem make it captivating, and which cognitive mechanisms are sensitive to these features? We addressed these questions experimentally by measuring pupillary responses of 40 participants who listened to a series of Limericks. The Limericks ended with either a semantic, syntactic, rhyme or metric violation. Compared to a control condition without violations, only the rhyme violation condition induced a reliable pupillary response. An anomaly-rating study on the same stimuli showed that all violations were reliably detectable relative to the control condition, but the anomaly induced by rhyme violations was perceived as most severe. Together, our data suggest that rhyme violations in Limericks may induce an emotional response beyond mere anomaly detection.
Language and Arithmetic
(2018)
We examined cross-domain semantic priming effects between arithmetic and language. We paired subtractions with their linguistic equivalent, exception phrases (EPs) with positive quantifiers (e.g., "everybody except John") while pairing additions with their own linguistic equivalent, EPs with negative quantifiers (e.g., "nobody except John"; Moltmann, 1995). We hypothesized that EPs with positive quantifiers prime subtractions and inhibit additions while EPs with negative quantifiers prime additions and inhibit subtractions. Furthermore, we expected similar priming and inhibition effects from arithmetic into semantics. Our design allowed for a bidirectional analysis by using one trial's target as the prime for the next trial. Two experiments failed to show significant priming effects in either direction. Implications and possible shortcomings are explored in the general discussion.
Language and Arithmetic
(2018)
We examined cross-domain semantic priming effects between arithmetic and language. We paired subtractions with their linguistic equivalent, exception phrases (EPs) with positive quantifiers (e.g., “everybody except John”) while pairing additions with their own linguistic equivalent, EPs with negative quantifiers (e.g., “nobody except John”; Moltmann, 1995). We hypothesized that EPs with positive quantifiers prime subtractions and inhibit additions while EPs with negative quantifiers prime additions and inhibit subtractions. Furthermore, we expected similar priming and inhibition effects from arithmetic into semantics. Our design allowed for a bidirectional analysis by using one trial's target as the prime for the next trial. Two experiments failed to show significant priming effects in either direction. Implications and possible shortcomings are explored in the general discussion.
Language and Arithmetic
(2018)
We examined cross-domain semantic priming effects between arithmetic and language. We paired subtractions with their linguistic equivalent, exception phrases (EPs) with positive quantifiers (e.g., “everybody except John”) while pairing additions with their own linguistic equivalent, EPs with negative quantifiers (e.g., “nobody except John”; Moltmann, 1995). We hypothesized that EPs with positive quantifiers prime subtractions and inhibit additions while EPs with negative quantifiers prime additions and inhibit subtractions. Furthermore, we expected similar priming and inhibition effects from arithmetic into semantics. Our design allowed for a bidirectional analysis by using one trial's target as the prime for the next trial. Two experiments failed to show significant priming effects in either direction. Implications and possible shortcomings are explored in the general discussion.
This article derives from two interdisciplinary research projects funded by the UK Arts and Humanities Research Council, involving the application of psychological experimental techniques to the study of poetic form and reader response. It discusses the semantic and expressive effects of space and pattern in innovative forms of contemporary British and American poetry. After referring to some historical and theoretical contexts for these issues, the article analyses the results of experiments using eye-tracking, manipulations of text, memory tests and readers' recorded responses and interpretations. The first group of poems studied were lineated, with extended spaces within lines and displacement of lines from the left margin. Referring to a poem from Geoffrey Hill'sCanaan(1996), the authors show that such use of space may serve to articulate syntactical structures, but may also promote richer interpretation by encouraging cross-linear semantic connections. The second technique studied was the break from linear into postlinear poetry, as an initially lineated sequence shifts to pages of dispersed text. In readings of Susan Howe'sPythagorean Silence(fromThe Europe of Trusts, 1990), the authors detected more radical effects of space, shape and pattern, with associated consequences for interpretative strategies and aesthetic responses. Finally, the article discusses the potential for both mutual support and heuristic challenge between an empirical study of reader response, and a historical-theoretical approach as exemplified by Jerome McGann's interpretation ofPythagorean Silence.
Mental arithmetic shows systematic spatial biases. The association between numbers and space is well documented, but it is unknown whether arithmetic operation signs also have spatial associations and whether or not they contribute to spatial biases found in arithmetic. Adult participants classified plus and minus signs with left and right button presses under two counterbalanced response rules. Results from two experiments showed that spatially congruent responses (i.e., right-side responses for the plus sign and left-side responses for the minus sign) were responded to faster than spatially incongruent ones (i.e., left-side responses for the plus sign and right-side responses for the minus sign). We also report correlations between this novel operation sign spatial association (OSSA) effect and other spatial biases in number processing. In a control experiment with no explicit processing requirements for the operation signs there were no sign-related spatial biases. Overall, the results suggest that (a) arithmetic operation signs can evoke spatial associations (OSSA), (b) experience with arithmetic operations probably underlies the OSSA, and (c) the OSSA only partially contributes to spatial biases in arithmetic.
Number processing evokes spatial biases, both when dealing with single digits and in more complex mental calculations. Here we investigated whether these two biases have a common origin, by examining their flexibility. Participants pointed to the locations of arithmetic results on a visually presented line with an inverted, right-to-left number arrangement. We found directionally opposite spatial biases for mental arithmetic and for a parity task administered both before and after the arithmetic task. We discuss implications of this dissociation in our results for the task-dependent cognitive representation of numbers.
There is accumulating evidence suggesting an association of numbers with physical space. However, the origin of such spatial-numerical associations (SNAs) is still debated. In the present study we investigated the development of two SNAs in a cross-sectional study involving children, young and middle-aged adults as well as the elderly: (1) the SNARC (spatial-numerical association of response codes) effect, reflecting a directional SNA; and (2) the numerical bisection bias in a line bisection task with numerical flankers. Results revealed a consistent SNARC effect in all age groups that continuously increased with age. In contrast, a numerical bisection bias was only observed for children and elderly participants, implying an U-shaped distribution of this bias across age groups. Additionally, individual SNARC effects and numerical bisection biases did not correlate significantly. We argue that the SNARC effect seems to be influenced by longer-lasting experiences of cultural constraints such as reading and writing direction and may thus reflect embodied representations. Contrarily, the numerical bisection bias may originate from insufficient inhibition of the semantic influence of irrelevant numerical flankers, which should be more pronounced in children and elderly people due to development and decline of cognitive control, respectively. As there is an ongoing debate on the origins of SNAs in general and the SNARC effect in particular, the present results are discussed in light of these differing accounts in an integrative approach. However, taken together, the present pattern of results suggests that different cognitive mechanisms underlie the SNARC effect and the numerical bisection bias.
Research in cognitive neuroscience has shown that brain structures serving perceptual, emotional, and motor processes are also recruited during the understanding of language when it refers to emotion, perception, and action. However, the exact linguistic and extralinguistic conditions under which such language-induced activity in modality-specific cortex is triggered are not yet well understood. The purpose of this study is to introduce a simple experimental technique that allows for the online measure of language-induced activity in motor structures of the brain. This technique consists in the use of a grip force sensor that captures subtle grip force variations while participants listen to words and sentences. Since grip force reflects activity in motor brain structures, the continuous monitoring of force fluctuations provides a fine-grained estimation of motor activity across time. In other terms, this method allows for both localization of the source of language-induced activity to motor brain structures and high temporal resolution of the recorded data. To facilitate comparison of the data to be collected with this tool, we present two experiments that describe in detail the technical setup, the nature of the recorded data, and the analyses (including justification about the data filtering and artifact rejection) that we applied. We also discuss how the tool could be used in other domains of behavioral research.
TEST is a novel taxonomy of knowledge representations based on three distinct hierarchically organized representational features: Tropism, Embodiment, and Situatedness. Tropic representational features reflect constraints of the physical world on the agent's ability to form, reactivate, and enrich embodied (i.e., resulting from the agent's bodily constraints) conceptual representations embedded in situated contexts. The proposed hierarchy entails that representations can, in principle, have tropic features without necessarily having situated and/or embodied features. On the other hand, representations that are situated and/or embodied are likely to be simultaneously tropic. Hence, although we propose tropism as the most general term, the hierarchical relationship between embodiment and situatedness is more on a par, such that the dominance of one component over the other relies on the distinction between offline storage versus online generation as well as on representation-specific properties.
Two experiments investigated (1) how activation of manual affordances is triggered by visual and linguistic cues to manipulable objects and (2) whether graspable object parts play a special role in this process. Participants pressed a key to categorize manipulable target objects copresented with manipulable distractor objects on a computer screen. Three factors were varied in Experiment 1: (1) the target's and (2) the distractor's handles' orientation congruency with the lateral manual response and (3) the Visual Focus on one of the objects. In Experiment 2, a linguistic cue factor was added to these three factors-participants heard the name of one of the two objects prior to the target display onset. Analysis of participants' motor and oculomotor behaviour confirmed that perceptual and linguistic cues potentiated activation of grasp affordances. Both target- and distractor-related affordance effects were modulated by the presence of visual and linguistic cues. However, a differential visual attention mechanism subserved activation of compatibility effects associated with target and distractor objects. We also registered an independent implicit attention attraction effect from objects' handles, suggesting that graspable parts automatically attract attention during object viewing. This effect was further amplified by visual but not linguistic cues, thus providing initial evidence for a recent hypothesis about differential roles of visual and linguistic information in potentiating stable and variable affordances (Borghi in Language and action in cognitive neuroscience. Psychology Press, London, 2012).
We examined the spontaneous association between numbers and space by documenting attention deployment and the time course of associated spatial-numerical mapping with and without overt oculomotor responses. In Experiment 1, participants maintained central fixation while listening to number names. In Experiment 2, they made horizontal target-direct saccades following auditory number presentation. In both experiments, we continuously measured spontaneous ocular drift in horizontal space during and after number presentation. Experiment 2 also measured visual-probe-directed saccades following number presentation. Reliable ocular drift congruent with a horizontal mental number line emerged during and after number presentation in both experiments. Our results provide new evidence for the implicit and automatic nature of the oculomotor resonance effect associated with the horizontal spatial-numerical mapping mechanism.
We examined the spontaneous association between numbers and space by documenting attention deployment and the time course of associated spatial-numerical mapping with and without overt oculomotor responses. In Experiment 1, participants maintained central fixation while listening to number names. In Experiment 2, they made horizontal target-direct saccades following auditory number presentation. In both experiments, we continuously measured spontaneous ocular drift in horizontal space during and after number presentation. Experiment 2 also measured visual-probe-directed saccades following number presentation. Reliable ocular drift congruent with a horizontal mental number line emerged during and after number presentation in both experiments. Our results provide new evidence for the implicit and automatic nature of the oculomotor resonance effect associated with the horizontal spatial-numerical mapping mechanism.
A crucial question facing cognitive science concerns the nature of conceptual representations as well as the constraints on the interactions between them. One specific question we address in this paper is what makes cross-representational interplay possible? We offer two distinct theoretical scenarios: according to the first scenario, co-activated knowledge representations interact with the help of an interface established between them via congruent activation in a mediating third-party general cognitive mechanism, e.g., attention. According to the second scenario, co-activated knowledge representations interact due to an overlap between their features, for example when they share a magnitude component. First, we make a case for cross representational interplay based on grounded and situated theories of cognition. Second, we discuss interface-based interactions between distinct (i.e., non-overlapping) knowledge representations. Third, we discuss how co-activated representations may share their architecture via partial overlap. Finally, we outline constraints regarding the flexibility of these proposed mechanisms.
We investigated automatic Spatial-Numerical Association of Response Codes (SNARC) effect in auditory number processing. Two experiments continually measured spatial characteristics of ocular drift at central fixation during and after auditory number presentation. Consistent with the notion of a spatially oriented mental number line, we found spontaneous magnitude-dependent gaze adjustments, both with and without a concurrent saccadic task. This fixation adjustment (1) had a small-number/left-lateralized bias and (2) it was biphasic as it emerged for a short time around the point of lexical access and it received later robust representation around following number onset. This pattern suggests a two-step mechanism of sensorimotor mapping between numbers and space a first-pass bottom-up activation followed by a top-down and more robust horizontal SNARC Our results inform theories of number processing as well as simulation-based approaches to cognition by identifying the characteristics of an oculomotor resonance phenomenon. (C) 2015 Elsevier B.V. All rights reserved.
Serial and parallel processes in eye movement control - current controversies and future directions
(2013)
In this editorial for the Special Issue on Serial and Parallel Processing in Reading we explore the background to the current debate concerning whether the word recognition processes in reading are strictly serialsequential or take place in an overlapping parallel fashion. We consider the history of the controversy and some of the underlying assumptions, together with an analysis of the types of evidence and arguments that have been adduced to both sides of the debate, concluding that both accounts necessarily presuppose some weakening of, or elasticity in, the eyemind assumption. We then consider future directions, both for reading research and for scene viewing, and wrap up the editorial with a brief overview of the following articles and their conclusions.
There is a debate about whether and why we overestimate addition and underestimate subtraction results (Operational Momentum or OM effect). Spatial-attentional accounts of OM compete with a model which postulates that OM reflects a weighted combination of multiple arithmetic heuristics and biases (AHAB). This study addressed this debate with the theoretically diagnostic distinction between zero problems (e.g., 3 + 0, 3 - 0) and non-zero problems (e.g., 2 + 1, 4 - 1) because AHAB, in contrast to all other accounts, uniquely predicts reverse OM for the latter problem type. In two tests (line-length production and time production), participants indeed produced shorter lines and under-estimated time intervals in non-zero additions compared with subtractions. This predicted interaction between operation and problem type extends OM to non-spatial magnitudes and highlights the strength of AHAB regarding different problem types and modalities during the mental manipulation of magnitudes. They also suggest that OM reflects methodological details, whereas reverse OM is the more representative behavioural signature of mental arithmetic.
The force of numbers
(2021)
The study has two objectives: (1) to introduce grip force recording as a new technique for studying embodied numerical processing; and (2) to demonstrate how three competing accounts of numerical magnitude representation can be tested by using this new technique: the Mental Number Line (MNL), A Theory of Magnitude (ATOM) and Embodied Cognition (finger counting-based) account. While 26 healthy adults processed visually presented single digits in a go/no-go n-back paradigm, their passive holding forces for two small sensors were recorded in both hands. Spontaneous and unconscious grip force changes related to number magnitude occurred in the left hand already 100-140 ms after stimulus presentation and continued systematically. Our results support a two-step model of number processing where an initial stage is related to the automatic activation of all stimulus properties whereas a later stage consists of deeper conscious processing of the stimulus. This interpretation generalizes previous work with linguistic stimuli and elaborates the timeline of embodied cognition. We hope that the use of grip force recording will advance the field of numerical cognition research.
In numerical processing, the functional role of Spatial-Numerical Associations (SNAs, such as the association of smaller numbers with left space and larger numbers with right space, the Mental Number Line hypothesis) is debated. Most studies demonstrate SNAs with lateralized responses, and there is little evidence that SNAs appear when no response is required. We recorded passive holding grip forces in no-go trials during number processing. In Experiment 1, participants performed a surface numerical decision task (“Is it a number or a letter?”). In Experiment 2, we used a deeper semantic task (“Is this number larger or smaller than five?”). Despite instruction to keep their grip force constant, participants' spontaneous grip force changed in both experiments: Smaller numbers led to larger force increase in the left than in the right hand in the numerical decision task (500–700 ms after stimulus onset). In the semantic task, smaller numbers again led to larger force increase in the left hand, and larger numbers increased the right-hand holding force. This effect appeared earlier (180 ms) and lasted longer (until 580 ms after stimulus onset). This is the first demonstration of SNAs with passive holding force. Our result suggests that (1) explicit motor response is not a prerequisite for SNAs to appear, and (2) the timing and strength of SNAs are task-dependent. (216 words).
In numerical processing, the functional role of Spatial-Numerical Associations (SNAs, such as the association of smaller numbers with left space and larger numbers with right space, the Mental Number Line hypothesis) is debated. Most studies demonstrate SNAs with lateralized responses, and there is little evidence that SNAs appear when no response is required. We recorded passive holding grip forces in no-go trials during number processing. In Experiment 1, participants performed a surface numerical decision task (“Is it a number or a letter?”). In Experiment 2, we used a deeper semantic task (“Is this number larger or smaller than five?”). Despite instruction to keep their grip force constant, participants' spontaneous grip force changed in both experiments: Smaller numbers led to larger force increase in the left than in the right hand in the numerical decision task (500–700 ms after stimulus onset). In the semantic task, smaller numbers again led to larger force increase in the left hand, and larger numbers increased the right-hand holding force. This effect appeared earlier (180 ms) and lasted longer (until 580 ms after stimulus onset). This is the first demonstration of SNAs with passive holding force. Our result suggests that (1) explicit motor response is not a prerequisite for SNAs to appear, and (2) the timing and strength of SNAs are task-dependent. (216 words).
Background and Aims: Ostarek et al. (2019) claimed a conclusive
demonstration that language comprehension relies profoundly on
visual simulations. They presented participants with visual noise during sentence-picture verification (SPV) and measured lateralized button response speed. The authors selectively eliminated the classical congruency effect (faster yes decisions when pictures match the objects implied by the sentences) with ‘‘high level’’ noise made from images of other objects. However, that visual noise included tool pictures, known to activate lateralized motor affordances. Moreover, some of their sentences described motor actions. This raises the question whether motor simulation may have contaminated their results.
Methods: Replicating Ostarek et al. (2019), 33 right-handed
participants performed SPV but either without visual noise or while viewing (a) only left-handled or (b) only right-handled or (c) alternatingly left- and right-handled tools. Accuracy and reaction times of manual yes responses were analyzed. Additionally, hand-relatedness of sentences was rated.
Results: Replicating Ostarek et al. (2019), the classical SPV congruency effect appeared without noise and vanished when alternatingly handled tools were presented. Crucially, it reappeared when noise objects were consistently either left- or righthandled. Higher hand-relatedness of sentence content reduced SPV performance and accuracy was lower with right-handled noise.
Conclusion: First, we demonstrated an interaction between motor-
related language, visual affordances and motor responses in SPV.
This result supports the embodied view of language processing.
Second, we identified a motor process not previously known in SPV. This extends our understanding of mental simulation and calls for methodological controls in future studies.
How to not induce SNAs
(2023)
People respond faster to smaller numbers in their left space and to larger numbers in their right space. Here we argue that movements in space contribute to the formation of spatial-numerical associations (SNAs). We studied the impact of continuous isometric forces along the horizontal or vertical cardinal axes on SNAs while participants performed random number production and arithmetic verification tasks. Our results suggest that such isometric directional force do not suffice to induce SNAs.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Embodied number processing
(2015)
The aim of the present study was to test the functional relevance of the spatial concepts UP or DOWN for words that use these concepts either literally (space) or metaphorically (time, valence). A functional relevance would imply a symmetrical relationship between the spatial concepts and words related to these concepts, showing that processing words activate the related spatial concepts on one hand, but also that an activation of the concepts will ease the retrieval of a related word on the other. For the latter, the rotation angle of participant's body position was manipulated either to an upright or a head-down tilted body position to activate the related spatial concept. Afterwards participants produced in a within-subject design previously memorized words of the concepts space, time and valence according to the pace of a metronome. All words were related either to the spatial concept UP or DOWN. The results including Bayesian analyses show (1) a significant interaction between body position and words using the concepts UP and DOWN literally, (2) a marginal significant interaction between body position and temporal words and (3) no effect between body position and valence words. However, post-hoc analyses suggest no difference between experiments. Thus, the authors concluded that integrating sensorimotor experiences is indeed of functional relevance for all three concepts of space, time and valence. However, the strength of this functional relevance depends on how close words are linked to mental concepts representing vertical space.
The development of interface technologies is driven by the goal of making interaction more positive through natural action-control mappings.
In Virtual Reality (VR), the entire body is potentially involved for interaction, using such mappings with a maximum of degrees of freedom. The downside is the increase in interaction complexity, which can dramatically influence interface design.
A cognitive perspective on detailed aspects of interaction patterns is lacking in common interface design guidelines, although it can be helpful to make this complexity controllable and, thus, make interaction behavior predictable.
In the present study, the distinction between grounding, embodiment, and situatedness (the GES framework) is applied to organize aspects of interactions and to compare them with each other.
In two experiments, zooming into or out of emotional pictures through changes of arm span was examined in VR. There are qualitatively different aspects during such an interaction: i) perceptual aspects caused by zooming are fundamental for human behavior (Grounding: closer objects appear bigger) and ii) aspects of gestures correspond to the physical characteristics of the agents (Embodiment: little distance of hands signals little or, in contrast, "creating more detail").
The GES-framework sets aspects of Grounding against aspects of Embodiment, thus allowing to predict human behavior regarding these qualitatively different aspects.
For the zooming procedure, the study shows that Grounding can overrule Embodiment in interaction design.
Thus, we propose GES as a cognitive framework that can help to inform interaction guidelines for user interface design in VR.
“Ick bin een Berlina”
(2024)
Background: Robots are increasingly used as interaction partners with humans. Social robots are designed to follow expected behavioral norms when engaging with humans and are available with different voices and even accents. Some studies suggest that people prefer robots to speak in the user’s dialect, while others indicate a preference for different dialects.
Methods: Our study examined the impact of the Berlin dialect on perceived trustworthiness and competence of a robot. One hundred and twenty German native speakers (Mage = 32 years, SD = 12 years) watched an online video featuring a NAO robot speaking either in the Berlin dialect or standard German and assessed its trustworthiness and competence.
Results: We found a positive relationship between participants’ self-reported Berlin dialect proficiency and trustworthiness in the dialect-speaking robot. Only when controlled for demographic factors, there was a positive association between participants’ dialect proficiency, dialect performance and their assessment of robot’s competence for the standard German-speaking robot. Participants’ age, gender, length of residency in Berlin, and device used to respond also influenced assessments. Finally, the robot’s competence positively predicted its trustworthiness.
Discussion: Our results inform the design of social robots and emphasize the importance of device control in online experiments.
The Human Takes It All
(2020)
Background: The increasing involvement of social robots in human lives raises the question as to how humans perceive social robots. Little is known about human perception of synthesized voices.
Aim: To investigate which synthesized voice parameters predict the speaker's eeriness and voice likability; to determine if individual listener characteristics (e.g., personality, attitude toward robots, age) influence synthesized voice evaluations; and to explore which paralinguistic features subjectively distinguish humans from robots/artificial agents.
Methods: 95 adults (62 females) listened to randomly presented audio-clips of three categories: synthesized (Watson, IBM), humanoid (robot Sophia, Hanson Robotics), and human voices (five clips/category). Voices were rated on intelligibility, prosody, trustworthiness, confidence, enthusiasm, pleasantness, human-likeness, likability, and naturalness. Speakers were rated on appeal, credibility, human-likeness, and eeriness. Participants' personality traits, attitudes to robots, and demographics were obtained.
Results: The human voice and human speaker characteristics received reliably higher scores on all dimensions except for eeriness. Synthesized voice ratings were positively related to participants' agreeableness and neuroticism. Females rated synthesized voices more positively on most dimensions. Surprisingly, interest in social robots and attitudes toward robots played almost no role in voice evaluation. Contrary to the expectations of an uncanny valley, when the ratings of human-likeness for both the voice and the speaker characteristics were higher, they seemed less eerie to the participants. Moreover, when the speaker's voice was more humanlike, it was more liked by the participants. This latter point was only applicable to one of the synthesized voices. Finally, pleasantness and trustworthiness of the synthesized voice predicted the likability of the speaker's voice. Qualitative content analysis identified intonation, sound, emotion, and imageability/embodiment as diagnostic features.
Discussion: Humans clearly prefer human voices, but manipulating diagnostic speech features might increase acceptance of synthesized voices and thereby support human-robot interaction. There is limited evidence that human-likeness of a voice is negatively linked to the perceived eeriness of the speaker.
The Human Takes It All
(2020)
Background: The increasing involvement of social robots in human lives raises the question as to how humans perceive social robots. Little is known about human perception of synthesized voices.
Aim: To investigate which synthesized voice parameters predict the speaker's eeriness and voice likability; to determine if individual listener characteristics (e.g., personality, attitude toward robots, age) influence synthesized voice evaluations; and to explore which paralinguistic features subjectively distinguish humans from robots/artificial agents.
Methods: 95 adults (62 females) listened to randomly presented audio-clips of three categories: synthesized (Watson, IBM), humanoid (robot Sophia, Hanson Robotics), and human voices (five clips/category). Voices were rated on intelligibility, prosody, trustworthiness, confidence, enthusiasm, pleasantness, human-likeness, likability, and naturalness. Speakers were rated on appeal, credibility, human-likeness, and eeriness. Participants' personality traits, attitudes to robots, and demographics were obtained.
Results: The human voice and human speaker characteristics received reliably higher scores on all dimensions except for eeriness. Synthesized voice ratings were positively related to participants' agreeableness and neuroticism. Females rated synthesized voices more positively on most dimensions. Surprisingly, interest in social robots and attitudes toward robots played almost no role in voice evaluation. Contrary to the expectations of an uncanny valley, when the ratings of human-likeness for both the voice and the speaker characteristics were higher, they seemed less eerie to the participants. Moreover, when the speaker's voice was more humanlike, it was more liked by the participants. This latter point was only applicable to one of the synthesized voices. Finally, pleasantness and trustworthiness of the synthesized voice predicted the likability of the speaker's voice. Qualitative content analysis identified intonation, sound, emotion, and imageability/embodiment as diagnostic features.
Discussion: Humans clearly prefer human voices, but manipulating diagnostic speech features might increase acceptance of synthesized voices and thereby support human-robot interaction. There is limited evidence that human-likeness of a voice is negatively linked to the perceived eeriness of the speaker.
Peripersonal space is the space surrounding our body, where multisensory integration of stimuli and action execution take place. The size of peripersonal space is flexible and subject to change by various personal and situational factors. The dynamic representation of our peripersonal space modulates our spatial behaviors towards other individuals. During the COVID-19 pandemic, this spatial behavior was modified by two further factors: social distancing and wearing a face mask. Evidence from offline and online studies on the impact of a face mask on pro-social behavior is mixed. In an attempt to clarify the role of face masks as pro-social or anti-social signals, 235 observers participated in the present online study. They watched pictures of two models standing at three different distances from each other (50, 90 and 150 cm), who were either wearing a face mask or not and were either interacting by initiating a hand shake or just standing still. The observers’ task was to classify the model by gender. Our results show that observers react fastest, and therefore show least avoidance, for the shortest distances (50 and 90 cm) but only when models wear a face mask and do not interact. Thus, our results document both pro- and anti-social consequences of face masks as a result of the complex interplay between social distancing and interactive behavior. Practical implications of these findings are discussed.
Peripersonal space is the space surrounding our body, where multisensory integration of stimuli and action execution take place. The size of peripersonal space is flexible and subject to change by various personal and situational factors. The dynamic representation of our peripersonal space modulates our spatial behaviors towards other individuals. During the COVID-19 pandemic, this spatial behavior was modified by two further factors: social distancing and wearing a face mask. Evidence from offline and online studies on the impact of a face mask on pro-social behavior is mixed. In an attempt to clarify the role of face masks as pro-social or anti-social signals, 235 observers participated in the present online study. They watched pictures of two models standing at three different distances from each other (50, 90 and 150 cm), who were either wearing a face mask or not and were either interacting by initiating a hand shake or just standing still. The observers’ task was to classify the model by gender. Our results show that observers react fastest, and therefore show least avoidance, for the shortest distances (50 and 90 cm) but only when models wear a face mask and do not interact. Thus, our results document both pro- and anti-social consequences of face masks as a result of the complex interplay between social distancing and interactive behavior. Practical implications of these findings are discussed.
Idioms in the World
(2019)
Idioms in the World
(2019)
The direction of object enumeration reflects children's enculturation but previous work on the development of such spatial preferences has been inconsistent. Therefore, we documented directional preferences in finger counting, object counting, and picture naming for children (4 groups from 3 to 6 years, N = 104) and adults (N = 56). We found a right-side preference for finger counting in 3- to 6-year-olds and a left-side preference for counting objects and naming pictures by 6 years of age. Children were consistent in their special preferences when comparing object counting and picture naming, but not in other task pairings. Finally, spatial preferences were not related to cardinality comprehension. These results, together with other recent work, suggest a gradual development of spatial-numerical associations from early non-directional mappings into culturally constrained directional mappings.
This editorial introduces a set of papers on differential embodiment in spatial tasks. According to the theoretical notion of embodied cognition, our experiences of acting in the world, and the constraints of our sensory and motor systems, strongly shape our cognitive functions. In the current set of papers, the authors were asked to particularly consider idiosyncratic or differential embodied cognition in the context of spatial tasks and processes. In each contribution, differential embodiment is considered from one of two complementary perspectives: either by considering unusual individuals, who have atypical bodies or uncommon experiences of interacting with the world; or by exploring individual differences in the general population that reflect the naturally occurring variability in embodied processes. Our editorial summarizes the contributions to this special issue and discusses the insights they offer. We conclude from this collection of papers that exploring differences in the recruitment and involvement of embodied processes can be highly informative, and can add an extra dimension to our understanding of spatial cognitive functions. Taking a broader perspective, it can also shed light on important theoretical and empirical questions concerning the nature of embodied cognition per se.
Rodin has it!
(2020)
We report a new discovery on the role of hands in guiding attention, using the classic Stroop effect as our assay. We show that the Stroop effect diminishes, hence selective attention improves, when observers hold their chin, emulating Rodin's famous sculpture, "The Thinker." In two experiments we show that the Rodin posture improves the selectivity of attention as efficiently as holding the hands nearby the visual stimulus (the near-hands effect). Because spatial proximity to the displayed stimulus is neither present nor intended, the presence of the Rodin effect implies that attentional prioritization by the hands is not limited to the space between the hands.
While the influence of spatial-numerical associations in number categorization tasks has been well established, their role in mental arithmetic is less clear. It has been hypothesized that mental addition leads to rightward and upward shifts of spatial attention (along the "mental number line"), whereas subtraction leads to leftward and downward shifts. We addressed this hypothesis by analyzing spontaneous eye movements during mental arithmetic. Participants solved verbally presented arithmetic problems (e.g., 2 + 7, 8-3) aloud while looking at a blank screen. We found that eye movements reflected spatial biases in the ongoing mental operation: Gaze position shifted more upward when participants solved addition compared to subtraction problems, and the horizontal gaze position was partly determined by the magnitude of the operands. Interestingly, the difference between addition and subtraction trials was driven by the operator (plus vs. minus) but was not influenced by the computational process. Thus, our results do not support the idea of a mental movement toward the solution during arithmetic but indicate a semantic association between operation and space.
Spatial-numerical associations (small numbers-left/lower space and large numbers-right/upper space) are regularly found in simple number categorization tasks. These associations were taken as evidence for a spatially oriented mental number line. However, the role of spatial-numerical associations during more complex number processing, such as counting or mental arithmetic is less clear. Here, we investigated whether counting is associated with a movement along the mental number line. Participants counted aloud upward or downward in steps of 3 for 45 s while looking at a blank screen. Gaze position during upward counting shifted rightward and upward, while the pattern for downward counting was less clear. Our results, therefore, confirm the hypothesis of a movement along the mental number line for addition. We conclude that space is not only used to represent number magnitudes but also to actively operate on numbers in more complex tasks such as counting, and that the eyes reflect this spatial mental operation.
While the influence of spatial-numerical associations in number categorization tasks has been well established, their role in mental arithmetic is less clear. It has been hypothesized that mental addition leads to rightward and upward shifts of spatial attention (along the "mental number line"), whereas subtraction leads to leftward and downward shifts. We addressed this hypothesis by analyzing spontaneous eye movements during mental arithmetic. Participants solved verbally presented arithmetic problems (e.g., 2 + 7, 8-3) aloud while looking at a blank screen. We found that eye movements reflected spatial biases in the ongoing mental operation: Gaze position shifted more upward when participants solved addition compared to subtraction problems, and the horizontal gaze position was partly determined by the magnitude of the operands. Interestingly, the difference between addition and subtraction trials was driven by the operator (plus vs. minus) but was not influenced by the computational process. Thus, our results do not support the idea of a mental movement toward the solution during arithmetic but indicate a semantic association between operation and space.
The visual number world
(2018)
In the domain of language research, the simultaneous presentation of a visual scene and its auditory description (i.e., the visual world paradigm) has been used to reveal the timing of mental mechanisms. Here we apply this rationale to the domain of numerical cognition in order to explore the differences between fast and slow arithmetic performance, and to further study the role of spatial-numerical associations during mental arithmetic. We presented 30 healthy adults simultaneously with visual displays containing four numbers and with auditory addition and subtraction problems. Analysis of eye movements revealed that participants look spontaneously at the numbers they currently process (operands, solution). Faster performance was characterized by shorter latencies prior to fixating the relevant numbers and fewer revisits to the first operand while computing the solution. These signatures of superior task performance were more pronounced for addition and visual numbers arranged in ascending order, and for subtraction and numbers arranged in descending order (compared to the opposite pairings). Our results show that the visual number world-paradigm provides on-line access to the mind during mental arithmetic, is able to capture variability in arithmetic performance, and is sensitive to visual layout manipulations that are otherwise not reflected in response time measurements.
A growing body of research shows that the human brain acts differently when performing a task together with another person than when performing the same task alone. In this study, we investigated the influence of a co-actor on numerical cognition using a joint random number generation (RNG) task. We found that participants generated relatively smaller numbers when they were located to the left (vs. right) of a co-actor (Experiment 1), as if the two individuals shared a mental number line and predominantly selected numbers corresponding to their relative body position. Moreover, the mere presence of another person on the left or right side or the processing of numbers from loudspeaker on the left or right side had no influence on the magnitude of generated numbers (Experiment 2), suggesting that a bias in RNG only emerged during interpersonal interactions. Interestingly, the effect of relative body position on RNG was driven by participants with high trait empathic concern towards others, pointing towards a mediating role of feelings of sympathy for joint compatibility effects. Finally, the spatial bias emerged only after the co-actors swapped their spatial position, suggesting that joint spatial representations are constructed only after the spatial reference frame became salient. In contrast to previous studies, our findings cannot be explained by action co-representation because the consecutive production of numbers does not involve conflict at the motor response level. Our results therefore suggest that spatial reference coding, rather than motor mirroring, can determine joint compatibility effects. Our results demonstrate how physical properties of interpersonal situations, such as the relative body position, shape seemingly abstract cognition.
Die nun begonnene Reihe „studieren++“ resultiert aus einer von der Universität Potsdam angebotenen Vorlesungsreihe. Das Besondere an dieser Vorlesungsreihe ist der multidisziplinäre Anspruch und die konsequent umgesetzte Zusammenarbeit über Disziplingrenzen hinweg. Die nicht nur über Instituts-, sondern über Fakultätsgrenzen praktizierte Interdisziplinarität erlaubt die Betrachtung eines Problems oder Sachverhalts aus unterschiedlichen Blickwinkeln. Wissenschaftliche Fragestellungen sind komplex und nicht immer auf eine Disziplin beschränkt. Sie in ihrer Gänze erfassen und nachhaltige Lösungsstrategien oder Konzepte entwickeln zu können gelingt oft nur durch eine multidisziplinäre Kooperation. Eine Lehrveranstaltung wie die vorliegende ist nicht nur für die Studierenden einer Universität eine hervorragende Möglichkeit, um über die Grenzen der eigenen Disziplin hinaus zu blicken und die Zusammenarbeit mit Wissenschaftlerinnen und Wissenschaftlern aus anderen Bereichen zu pflegen. So lernt man, sich in andere Sichtweisen hineinzuversetzen und sich zwischen den Disziplinen zu bewegen – eine Kompetenz, die in der hochkomplexen Arbeitswelt von heute von hohem Nutzen ist.
Der vorliegende erste Band der Reihe hat „Raum und Zahl“ zum Thema und ist aus einer Ringvorlesung aus dem Wintersemester 2013/2014 entstanden. Drei der fünf Fakultäten, insgesamt neun Institute der Universität Potsdam, haben sich an der Vorlesung beteiligt und sich dieses spannenden Themas angenommen. Als jemand, der sich jahrelang wissenschaftlich mit algorithmischer Geometrie sowie mit raumbezogenen Datenbanken und Navigationssystemen beschäftigt hat, kann ich nur bekräftigen, dass die Bezüge zwischen Raum und Zahl, zwischen Räumen und Zahlen, noch viel stärker im öffentlichen Bewusstsein verankert gehören. Räume auch quantitativ zu erfassen und zu verstehen ist eine Kulturtechnik, die an Wichtigkeit eher noch zunimmt, vor allem vor dem Hintergrund, dass wir genetisch nicht allzu gut auf derartige Herausforderungen vorbereitet sind. Denn viele unserer einschlägigen Gene entstammen noch aus der Zeit der Savanne, einer Zeit, zu der das Raumkonzept sich fast ausschließlich auf die unmittelbare räumliche Umgebung bezog und Zahlen jenseits von 10 nur wenig Relevanz für das eigene Überleben hatten.
Als Präsident der Universität Potsdam freut es mich ganz besonders, dass sich die hier vertretenen Wissenschaftler bereit erklärt haben, ihre Überlegungen mit den Studierenden und ihren Kolleginnen und Kollegen zu teilen. Herrn Kollegen Hans-Joachim Petsche möchte ich für sein Engagement danken und ihm zu dieser gelungenen Reihe gratulieren. Der Geist der Wissenschaft, der nicht nur einsam im Büro oder Labor gelebt wird, sondern gerade an einer Universität auch aktiv nach außen getragen werden sollte, wird hier in besonderer Weise sichtbar. Ich wünsche Ihnen viel Freude bei der Lektüre des Bandes und freue mich auf weitere Veröffentlichungen in dieser Reihe.
Even before formal schooling, children map numbers onto space in a directional manner. The origin of this preliterate spatial–numerical association is still debated. We investigated the role of enculturation for shaping the directionality of the association between numbers and space, focusing on counting behavior in 3- to 5-year-old preliterate children. Two studies provide evidence that, after observing reading from storybooks (left-to-right or right-to-left reading) children change their counting direction in line with the direction of observed reading. Just observing visuospatial directional movements had no such effect on counting direction. Complementarily, we document that book illustrations, prevalent in children’s cultures, exhibit directionality that conforms to the direction of a culture’s written language. We propose that shared book reading activates spatiotemporal representations of order in young children, which in turn affect their spatial representation of numbers.
We examined how the frequency of the fixated word influences the spatiotemporal distribution of covert attention during reading. Participants discriminated gaze-contingent probes that occurred with different spatial and temporal offsets from randomly chosen fixation points during reading. We found that attention was initially focused at fixation and that subsequent defocusing was slower when the fixated word was lower in frequency. Later in a fixation, attention oriented more towards the next saccadic target for high- than for low-frequency words. These results constitute the first report of the time course of the effect of load on attentional engagement and orienting in reading. They are discussed in the context of serial and parallel models of reading.
Due to their multifunctionality, tablets offer tremendous advantages for research on handwriting dynamics or for interactive use of learning apps in schools. Further, the widespread use of tablet computers has had a great impact on handwriting in the current generation. But, is it advisable to teach how to write and to assess handwriting in pre- and primary schoolchildren on tablets rather than on paper? Since handwriting is not automatized before the age of 10 years, children's handwriting movements require graphomotor and visual feedback as well as permanent control of movement execution during handwriting. Modifications in writing conditions, for instance the smoother writing surface of a tablet, might influence handwriting performance in general and in particular those of non-automatized beginning writers. In order to investigate how handwriting performance is affected by a difference in friction of the writing surface, we recruited three groups with varying levels of handwriting automaticity: 25 preschoolers, 27 second graders, and 25 adults. We administered three tasks measuring graphomotor abilities, visuomotor abilities, and handwriting performance (only second graders and adults). We evaluated two aspects of handwriting performance: the handwriting quality with a visual score and the handwriting dynamics using online handwriting measures [e.g., writing duration, writing velocity, strokes and number of inversions in velocity (NIV)]. In particular, NIVs which describe the number of velocity peaks during handwriting are directly related to the level of handwriting automaticity. In general, we found differences between writing on paper compared to the tablet. These differences were partly task-dependent. The comparison between tablet and paper revealed a faster writing velocity for all groups and all tasks on the tablet which indicates that all participants—even the experienced writers—were influenced by the lower friction of the tablet surface. Our results for the group-comparison show advancing levels in handwriting automaticity from preschoolers to second graders to adults, which confirms that our method depicts handwriting performance in groups with varying degrees of handwriting automaticity. We conclude that the smoother tablet surface requires additional control of handwriting movements and therefore might present an additional challenge for learners of handwriting.
Due to their multifunctionality, tablets offer tremendous advantages for research on handwriting dynamics or for interactive use of learning apps in schools. Further, the widespread use of tablet computers has had a great impact on handwriting in the current generation. But, is it advisable to teach how to write and to assess handwriting in pre- and primary schoolchildren on tablets rather than on paper? Since handwriting is not automatized before the age of 10 years, children's handwriting movements require graphomotor and visual feedback as well as permanent control of movement execution during handwriting. Modifications in writing conditions, for instance the smoother writing surface of a tablet, might influence handwriting performance in general and in particular those of non-automatized beginning writers. In order to investigate how handwriting performance is affected by a difference in friction of the writing surface, we recruited three groups with varying levels of handwriting automaticity: 25 preschoolers, 27 second graders, and 25 adults. We administered three tasks measuring graphomotor abilities, visuomotor abilities, and handwriting performance (only second graders and adults). We evaluated two aspects of handwriting performance: the handwriting quality with a visual score and the handwriting dynamics using online handwriting measures [e.g., writing duration, writing velocity, strokes and number of inversions in velocity (NIV)]. In particular, NIVs which describe the number of velocity peaks during handwriting are directly related to the level of handwriting automaticity. In general, we found differences between writing on paper compared to the tablet. These differences were partly task-dependent. The comparison between tablet and paper revealed a faster writing velocity for all groups and all tasks on the tablet which indicates that all participants—even the experienced writers—were influenced by the lower friction of the tablet surface. Our results for the group-comparison show advancing levels in handwriting automaticity from preschoolers to second graders to adults, which confirms that our method depicts handwriting performance in groups with varying degrees of handwriting automaticity. We conclude that the smoother tablet surface requires additional control of handwriting movements and therefore might present an additional challenge for learners of handwriting.
Our study addresses the following research questions: Are there differences between handwriting movements on paper and on a tablet computer? Can experienced writers, such as most adults, adapt their graphomotor execution during writing to a rather unfamiliar surface for instance a tablet computer? We examined the handwriting performance of adults in three tasks with different complexity: (a) graphomotor abilities, (b) visuomotor abilities and (c) handwriting. Each participant performed each task twice, once on paper and once on a tablet computer with a pen. We tested 25 participants by measuring their writing duration, in air time, number of pen lifts, writing velocity and number of inversions in velocity. The data were analyzed using linear mixed-effects modeling with repeated measures. Our results reveal differences between writing on paper and on a tablet computer which were partly task-dependent. Our findings also show that participants were able to adapt their graphomotor execution to the smoother surface of the tablet computer during the tasks. (C) 2016 Elsevier B.V. All rights reserved.
Research on problem solving offers insights into how humans process task-related information and which strategies they use (Newell and Simon, 1972; Öllinger et al., 2014). Problem solving can be defined as the search for possible changes in one's mind (Kahneman, 2003). In a recent study, Adams et al. (2021) assessed whether the predominant problem solving strategy when making changes involves adding or subtracting elements. In order to do this, they used several examples of simple problems, such as editing text or making visual patterns symmetrical, either in naturalistic settings or on-line. The essence of the authors' findings is a strong preference to add rather than subtract elements across a diverse range of problems, including the stabilizing of artifacts, creating symmetrical patterns, or editing texts. More specifically, they succeeded in demonstrating that “participants were less likely to identify advantageous subtractive changes when the task did not (vs. did) cue them to consider subtraction, when they had only one opportunity (vs. several) to recognize the shortcomings of an additive search strategy or when they were under a higher (vs. lower) cognitive load” (Adams et al., 2021, p. 258).
Addition and subtraction are generally defined as de-contextualized mathematical operations using abstract symbols (Russell, 1903/1938). Nevertheless, understanding of both symbols and operations is informed by everyday activities, such as making or breaking objects (Lakoff and Núñez, 2000; Fischer and Shaki, 2018). The universal attribution of “addition bias” or “subtraction neglect” to problem solving activities is perhaps a convenient shorthand but it overlooks influential framing effects beyond those already acknowledged in the report and the accompanying commentary (Meyvis and Yoon, 2021).
Most importantly, while Adams et al.'s study addresses an important issue, their very method of verbally instructing participants, together with lack of control over several known biases, might render their findings less than conclusive. Below, we discuss our concerns that emerged from the identified biases, namely those regarding the instructions and the experimental materials. Moreover, we refer to research from mathematical cognition that provides new insights into Adams et al.'s findings.
Research on problem solving offers insights into how humans process task-related information and which strategies they use (Newell and Simon, 1972; Öllinger et al., 2014). Problem solving can be defined as the search for possible changes in one's mind (Kahneman, 2003). In a recent study, Adams et al. (2021) assessed whether the predominant problem solving strategy when making changes involves adding or subtracting elements. In order to do this, they used several examples of simple problems, such as editing text or making visual patterns symmetrical, either in naturalistic settings or on-line. The essence of the authors' findings is a strong preference to add rather than subtract elements across a diverse range of problems, including the stabilizing of artifacts, creating symmetrical patterns, or editing texts. More specifically, they succeeded in demonstrating that “participants were less likely to identify advantageous subtractive changes when the task did not (vs. did) cue them to consider subtraction, when they had only one opportunity (vs. several) to recognize the shortcomings of an additive search strategy or when they were under a higher (vs. lower) cognitive load” (Adams et al., 2021, p. 258).
Addition and subtraction are generally defined as de-contextualized mathematical operations using abstract symbols (Russell, 1903/1938). Nevertheless, understanding of both symbols and operations is informed by everyday activities, such as making or breaking objects (Lakoff and Núñez, 2000; Fischer and Shaki, 2018). The universal attribution of “addition bias” or “subtraction neglect” to problem solving activities is perhaps a convenient shorthand but it overlooks influential framing effects beyond those already acknowledged in the report and the accompanying commentary (Meyvis and Yoon, 2021).
Most importantly, while Adams et al.'s study addresses an important issue, their very method of verbally instructing participants, together with lack of control over several known biases, might render their findings less than conclusive. Below, we discuss our concerns that emerged from the identified biases, namely those regarding the instructions and the experimental materials. Moreover, we refer to research from mathematical cognition that provides new insights into Adams et al.'s findings.
Commentary
(2015)
Numerical knowledge, including number concepts and arithmetic procedures, seems to be a clear-cut case for abstract symbol manipulation. Yet, evidence from perceptual and motor behaviour reveals that natural number knowledge and simple arithmetic also remain closely associated with modal experiences. Following a review of behavioural, animal and neuroscience studies of number processing, we propose a revised understanding of psychological number concepts as grounded in physical constraints, embodied in experience and situated through task-specific intentions. The idea that number concepts occupy a range of positions on the continuum between abstract and modal conceptual knowledge also accounts for systematic heuristics and biases in mental arithmetic, thus inviting psycho-logical approaches to the study of the mathematical mind.
Even simple mental arithmetic is fraught with cognitive biases. For example, adding repeated numbers (so-called tie problems, e.g., 2 + 2) not only has a speed and accuracy advantage over adding different numbers (e.g., 1 + 3) but may also lead to under-representation of the result relative to a standard value (Charras et al., 2012, 2014). Does the tie advantage merely reflect easier encoding or retrieval compared to non-ties, or also a distorted result representation? To answer this question, 47 healthy adults performed two tasks, both of which indicated under-representation of tie results: In a result-to-position pointing task (Experiment 1) we measured the spatial mapping of numbers and found a left-bias for tie compared to non-tie problems. In a result-to-line-length production task (Experiment 2) we measured the underlying magnitude representation directly and obtained shorter lines for tie-compared to non-tie problems. These observations suggest that the processing benefit of tie problems comes at the cost of representational reduction of result meaning. This conclusion is discussed in the context of a recent model of arithmetic heuristics and biases.