Refine
Year of publication
Document Type
Language
- English (74)
Is part of the Bibliography
- yes (74)
Keywords
- embodied cognition (13)
- SNARC (10)
- Mental number line (9)
- SNARC effect (8)
- numerical cognition (8)
- Embodied cognition (6)
- Numerical cognition (6)
- mental number line (6)
- Mental arithmetic (4)
- Embodiment (3)
Institute
- Department Psychologie (74) (remove)
This study investigated how touching and being touched by a humanoid robot affects human physiology, impressions of the interaction, and attitudes towards humanoid robots. 21 healthy adult participants completed a 3 (touch style: touching, being touched, pointing) x 2 (body part: hand vs buttock) within-subject design using a Pepper robot. Skin conductance response (SCR) was measured during each interaction. Perceived impressions of the interaction (i.e., friendliness, comfort, arousal) were measured per questionnaire after each interaction. Participants' demographics and their attitude towards robots were also considered. We found shorter SCR rise times in the being touched compared to the touching condition, possibly reflecting psychological alertness to the unpredictability of robot-initiated contacts. The hand condition had shorter rise times than the buttock condition. Most participants evaluated the hand condition as most friendly and comfortable and the robot-initiated interactions as most arousing. Interacting with Pepper improved attitudes towards robots. Our findings require future studies with larger samples and improved procedures. They have implications for robot design in all domains involving tactile interactions, such as caring and intimacy.
Mimicking non-verbal emotional expressions and empathy development in simulated consultations
(2018)
Objective: To explore the feasibility of applying an experimental design to study the relationship between non-verbal emotions and empathy development in simulated consultations.
Method: In video-recorded simulated consultations, twenty clinicians were randomly allocated to either an experimental group (instructed to mimic non-verbal emotions of a simulated patient, SP) or a control group (no such instruction). Baseline empathy scores were obtained before consultation, relational empathy was rated by SP after consultation. Multilevel logistic regression modelled the probability of mimicry occurrence, controlling for baseline empathy and clinical experience. ANCOVA compared group differences on relational empathy and consultation smoothness.
Results: Instructed mimicry lasted longer than spontaneous mimicry. Mimicry was marginally related to improved relational empathy. SP felt being treated more like a whole person during consultations with spontaneous mimicry. Clinicians who displayed spontaneous mimicry felt consultations went more smoothly.
Conclusion: The experimental approach improved our understanding of how non-verbal emotional mimicry contributed to relational empathy development during consultations. Further work should ascertain the potential of instructed mimicry to enhance empathy development.
Practice implications: Understanding how non-verbal emotional mimicry impacts on patients’ perceived clinician empathy during consultations may inform training and intervention programme development.
There has been increasing interest in the spatial mapping of various perceptual and cognitive magnitudes, such as expanding the spatial-numerical association of response codes (SNARC) effect into domains outside of numerical cognition. Recently, De Tommaso and Prpic (Attention, Perception, & Psychophysics, 82, 2765-2773, 2020) reported in this journal that only fast tempos over 104 beats per minute have spatial associations, with more right-sided associations and faster responses for faster tempos. After discussing the role of perceived loudness and possible response strategies, we propose and recommend methodological improvements for further research.
A large number of experimental findings from neuroscience and experimental psychology demonstrated interactions between spatial cognition and numerical cognition. In particular, many researchers posited a horizontal mental number line, where small numbers are thought of as being to the left of larger numbers. This review synthesizes work on the mental association between space and number, indicating the existence of multiple spatial mappings: recent research has found associations between number and vertical space, as well as associations between number and near/far space. We discuss number space in three dimensions with an eye on potential origins of the different number mappings, and how these number mappings fit in with our current knowledge of brain organization and brain-culture interactions. We derive novel predictions and show how this research fits into a general view of cognition as embodied, grounded and situated. (C) 2015 Elsevier Ltd. All rights reserved.
Previous research on the interplay between static manual postures and visual attention revealed enhanced visual selection near the hands (near-hand effect). During active movements there is also superior visual performance when moving toward compared to away from the stimulus (direction effect). The "modulated visual pathways" hypothesis argues that differential involvement of magno- and parvocellular visual processing streams causes the near-hand effect. The key finding supporting this hypothesis is an increase in temporal and a reduction in spatial processing in near-hand space (Gozli et al., 2012). Since this hypothesis has, so far, only been tested with static hand postures, we provide a conceptual replication of Gozli et al.'s (2012) result with moving hands, thus also probing the generality of the direction effect. Participants performed temporal or spatial gap discriminations while their right hand was moving below the display. In contrast to Gozli et al (2012), temporal gap discrimination was superior at intermediate and not near hand proximity. In spatial gap discrimination, a direction effect without hand proximity effect suggests that pragmatic attentional maps overshadowed temporal/spatial processing biases for far/near-hand space.
Moving arms
(2018)
Embodied cognition postulates a bi-directional link between the human body and its cognitive functions. Whether this holds for higher cognitive functions such as problem solving is unknown. We predicted that arm movement manipulations performed by the participants could affect the problem-solving solutions. We tested this prediction in quantitative reasoning tasks that allowed two solutions to each problem (addition or subtraction). In two studies with healthy adults (N=53 and N=50), we found an effect of problem-congruent movements on problem solutions. Consistent with embodied cognition, sensorimotor information gained via right or left arm movements affects the solution in different types of problem-solving tasks.
The embodied cognition framework suggests that neural systems for perception and action are engaged during higher cognitive processes. In an event-related fMRI study, we tested this claim for the abstract domain of numerical symbol processing: is the human cortical motor system part of the representation of numbers, and is organization of numerical knowledge influenced by individual finger counting habits? Developmental studies suggest a link between numerals and finger counting habits due to the acquisition of numerical skills through finger counting in childhood. In the present study, digits 1 to 9 and the corresponding number words were presented visually to adults with different finger counting habits, i.e. left- and right-starters who reported that they usually start counting small numbers with their left and right hand, respectively. Despite the absence of overt hand movements, the hemisphere contralateral to the hand used for counting small numbers was activated when small numbers were presented. The correspondence between finger counting habits and hemispheric motor activation is consistent with an intrinsic functional link between finger counting and number processing.
Stimulating numbers
(2018)
Finger counting is one of the first steps in the development of mature number concepts. With a one-to-one correspondence of fingers to numbers in Western finger counting, fingers hold two numerical meanings: one is based on the number of fingers raised and the second is based on their ordinal position within the habitual finger counting sequence. This study investigated how these two numerical meanings of fingers are intertwined with numerical cognition in adults. Participants received tactile stimulation on their fingertips of one hand and named either the number of fingers stimulated (2, 3, or 4 fingers; Experiment 1) or the number of stimulations on one fingertip (2, 3, or 4 stimulations; Experiment 2). Responses were faster and more accurate when the set of stimulated fingers corresponded to finger counting habits (Experiment 1) and when the number of stimulations matched the ordinal position of the stimulated finger (Experiment 2). These results show that tactile numerosity perception is affected by individual finger counting habits and that those habits give numerical meaning to single fingers.
1 + 2 is more than 2 + 1: Violations of commutativity and identity axioms in mental arithmetic
(2015)
Over the past decade or so, a large number of studies have revealed that conceptual meaning is sensitive to situational context. More recently, similar contextual influences have been documented in the domain of number knowledge. Here we show such context dependency in a length production task. Adult participants saw single digit addition problems of the form n1 + n2 and produced the sum by changing bi-directionally the length of a horizontally extended line, using radially arranged buttons. We found that longer lines were produced when n1 < n2 compared to n1 > n2 and that unit size increased with result size. Thus, the mathematical axioms of commutativity and identity do not seem to hold in mental addition. We discuss implications of these observations for our understanding of cognitive mechanisms involved in mental arithmetic and for situated cognition generally.
Western adults associate small numbers with left space and large numbers with right space. Where does this pervasive spatial-numerical association come from? In this study, we first recorded directional counting preferences in adults with different reading experiences (left to right, right to left, mixed, and illiterate) and observed a clear relationship between reading and counting directions. We then recorded directional counting preferences in pre-schoolers and elementary school children from three of these reading cultures (left to right, right to left, and mixed). Culture-specific counting biases existed before reading acquisition in children as young as 3 years and were subsequently modified by early reading experience. Together, our results suggest that both directional counting and scanning activities contribute to number-space associations.
Spatial-numerical associations (SNAs) have been studied extensively in the past two decades, always requiring either explicit magnitude processing or explicit spatial-directional processing. This means that the typical finding of an association of small numbers with left or bottom space and of larger numbers with right or top space could be due to these requirements and not the conceptual representation of numbers. The present study compares explicit and implicit magnitude processing in an implicit spatial-directional task and identifies SNAs as artefacts of either explicit magnitude processing or explicit spatial-directional processing; they do not reveal spatial conceptual links. This finding requires revision of current accounts of the relationship between numbers and space.
Several chronometric biases in numerical cognition have informed our understanding of a mental number line (MNL). Complementing this approach, we investigated spatial performance in a magnitude comparison task. Participants located the larger or smaller number of a pair on a horizontal line representing the interval from 0 to 10. Experiments 1 and 2 used only number pairs one unit apart and found that digits were localized farther to the right with "select larger" instructions than with "select smaller" instructions. However, when numerical distance was varied (Experiment 3), digits were localized away from numerically near neighbors. This repulsion effect reveals context-specific distortions in number representation not previously noticed with chronometric measures.
Removing spatial responses reveals spatial concepts even in a culture with mixed reading habits
(2014)
A recent cross-cultural comparison (Shaki, Fischer, & Petrusic, 2009) suggested that spatially consistent processing habits for words and numbers are a necessary condition for the spatial representation of numbers (Spatial-Numerical Association of Response Codes; SNARC effect). Here we reexamine the SNARC in Israelis who read text from right to left but numbers from left to right. We show that, despite these spatially inconsistent processing habits, a SNARC effect still emerges when the response dimension is spatially orthogonal to the conflicting processing dimension. These results clarify the cognitive conditions for spatial-numerical mappings.
Magnitude estimation has been studied since the beginnings of scientific psychology and constitutes a fundamental aspect of human behavior. Yet, it has apparently never been noticed that estimates depend on the spatial arrangement used. We tested 167 adults in three experiments to show that the spatial layout of stimuli and responses systematically distorts number estimation, length production, and weight reproduction performance. The direction of distortion depends on the observer's counting habits, but does not seem to reflect the use of spatially associated number concepts. Our results imply that all quantitative estimates are contaminated by a "spell of space" whenever stimuli or responses are spatially distributed.
Magnitude estimation has been studied since the beginnings of scientific psychology and constitutes a fundamental aspect of human behavior. Yet, it has apparently never been noticed that estimates depend on the spatial arrangement used. We tested 167 adults in three experiments to show that the spatial layout of stimuli and responses systematically distorts number estimation, length production, and weight reproduction performance. The direction of distortion depends on the observer's counting habits, but does not seem to reflect the use of spatially associated number concepts. Our results imply that all quantitative estimates are contaminated by a "spell of space" whenever stimuli or responses are spatially distributed.
Spinal muscular atrophy (SMA) and Duchenne muscular dystrophy (DMD) both are rare genetic neuromuscular diseases with progressive loss of motor ability. The neuromotor developmental course of those diseases is well documented. In contrast, there is only little evidence about characteristics of general and specific cognitive development. In both conditions the final motor outcome is characterized by an inability to move autonomously: children with SMA never accomplish independent motoric exploration of their environment, while children with DMD do but later lose this ability again. These profound differences in developmental pathways might affect cognitive development of SMA vs. DMD children, as cognition is shaped by individual motor experiences. DMD patients show impaired executive functions, working memory, and verbal IQ, whereas only motor ability seems to be impaired in SMA. Advanced cognitive capacity in SMA may serve as a compensatory mechanism for achieving in education, career progression, and social satisfaction. This study aimed to relate differences in basic numerical concepts and arithmetic achievement in SMA and DMD patients to differences in their motor development and resulting sensorimotor and environmental experiences. Horizontal and vertical spatial-numerical associations were explored in SMA/DMD children ranging between 6 and 12 years through the random number generation task. Furthermore, arithmetic skills as well as general cognitive ability were assessed. Groups differed in spatial number processing as well as in arithmetic and domain-general cognitive functions. Children with SMA showed no horizontal and even reversed vertical spatial-numerical associations. Children with DMD on the other hand revealed patterns in spatial numerical associations comparable to healthy developing children. From the embodied Cognition perspective, early sensorimotor experience does play a role in development of mental number representations. However, it remains open whether and how this becomes relevant for the acquisition of higher order cognitive and arithmetic skills.
Spinal muscular atrophy (SMA) and Duchenne muscular dystrophy (DMD) both are rare genetic neuromuscular diseases with progressive loss of motor ability. The neuromotor developmental course of those diseases is well documented. In contrast, there is only little evidence about characteristics of general and specific cognitive development. In both conditions the final motor outcome is characterized by an inability to move autonomously: children with SMA never accomplish independent motoric exploration of their environment, while children with DMD do but later lose this ability again. These profound differences in developmental pathways might affect cognitive development of SMA vs. DMD children, as cognition is shaped by individual motor experiences. DMD patients show impaired executive functions, working memory, and verbal IQ, whereas only motor ability seems to be impaired in SMA. Advanced cognitive capacity in SMA may serve as a compensatory mechanism for achieving in education, career progression, and social satisfaction. This study aimed to relate differences in basic numerical concepts and arithmetic achievement in SMA and DMD patients to differences in their motor development and resulting sensorimotor and environmental experiences. Horizontal and vertical spatial-numerical associations were explored in SMA/DMD children ranging between 6 and 12 years through the random number generation task. Furthermore, arithmetic skills as well as general cognitive ability were assessed. Groups differed in spatial number processing as well as in arithmetic and domain-general cognitive functions. Children with SMA showed no horizontal and even reversed vertical spatial-numerical associations. Children with DMD on the other hand revealed patterns in spatial numerical associations comparable to healthy developing children. From the embodied Cognition perspective, early sensorimotor experience does play a role in development of mental number representations. However, it remains open whether and how this becomes relevant for the acquisition of higher order cognitive and arithmetic skills.
Mental arithmetic shows systematic spatial biases. The association between numbers and space is well documented, but it is unknown whether arithmetic operation signs also have spatial associations and whether or not they contribute to spatial biases found in arithmetic. Adult participants classified plus and minus signs with left and right button presses under two counterbalanced response rules. Results from two experiments showed that spatially congruent responses (i.e., right-side responses for the plus sign and left-side responses for the minus sign) were responded to faster than spatially incongruent ones (i.e., left-side responses for the plus sign and right-side responses for the minus sign). We also report correlations between this novel operation sign spatial association (OSSA) effect and other spatial biases in number processing. In a control experiment with no explicit processing requirements for the operation signs there were no sign-related spatial biases. Overall, the results suggest that (a) arithmetic operation signs can evoke spatial associations (OSSA), (b) experience with arithmetic operations probably underlies the OSSA, and (c) the OSSA only partially contributes to spatial biases in arithmetic.
Research in cognitive neuroscience has shown that brain structures serving perceptual, emotional, and motor processes are also recruited during the understanding of language when it refers to emotion, perception, and action. However, the exact linguistic and extralinguistic conditions under which such language-induced activity in modality-specific cortex is triggered are not yet well understood. The purpose of this study is to introduce a simple experimental technique that allows for the online measure of language-induced activity in motor structures of the brain. This technique consists in the use of a grip force sensor that captures subtle grip force variations while participants listen to words and sentences. Since grip force reflects activity in motor brain structures, the continuous monitoring of force fluctuations provides a fine-grained estimation of motor activity across time. In other terms, this method allows for both localization of the source of language-induced activity to motor brain structures and high temporal resolution of the recorded data. To facilitate comparison of the data to be collected with this tool, we present two experiments that describe in detail the technical setup, the nature of the recorded data, and the analyses (including justification about the data filtering and artifact rejection) that we applied. We also discuss how the tool could be used in other domains of behavioral research.
TEST is a novel taxonomy of knowledge representations based on three distinct hierarchically organized representational features: Tropism, Embodiment, and Situatedness. Tropic representational features reflect constraints of the physical world on the agent's ability to form, reactivate, and enrich embodied (i.e., resulting from the agent's bodily constraints) conceptual representations embedded in situated contexts. The proposed hierarchy entails that representations can, in principle, have tropic features without necessarily having situated and/or embodied features. On the other hand, representations that are situated and/or embodied are likely to be simultaneously tropic. Hence, although we propose tropism as the most general term, the hierarchical relationship between embodiment and situatedness is more on a par, such that the dominance of one component over the other relies on the distinction between offline storage versus online generation as well as on representation-specific properties.
Two experiments investigated (1) how activation of manual affordances is triggered by visual and linguistic cues to manipulable objects and (2) whether graspable object parts play a special role in this process. Participants pressed a key to categorize manipulable target objects copresented with manipulable distractor objects on a computer screen. Three factors were varied in Experiment 1: (1) the target's and (2) the distractor's handles' orientation congruency with the lateral manual response and (3) the Visual Focus on one of the objects. In Experiment 2, a linguistic cue factor was added to these three factors-participants heard the name of one of the two objects prior to the target display onset. Analysis of participants' motor and oculomotor behaviour confirmed that perceptual and linguistic cues potentiated activation of grasp affordances. Both target- and distractor-related affordance effects were modulated by the presence of visual and linguistic cues. However, a differential visual attention mechanism subserved activation of compatibility effects associated with target and distractor objects. We also registered an independent implicit attention attraction effect from objects' handles, suggesting that graspable parts automatically attract attention during object viewing. This effect was further amplified by visual but not linguistic cues, thus providing initial evidence for a recent hypothesis about differential roles of visual and linguistic information in potentiating stable and variable affordances (Borghi in Language and action in cognitive neuroscience. Psychology Press, London, 2012).
A crucial question facing cognitive science concerns the nature of conceptual representations as well as the constraints on the interactions between them. One specific question we address in this paper is what makes cross-representational interplay possible? We offer two distinct theoretical scenarios: according to the first scenario, co-activated knowledge representations interact with the help of an interface established between them via congruent activation in a mediating third-party general cognitive mechanism, e.g., attention. According to the second scenario, co-activated knowledge representations interact due to an overlap between their features, for example when they share a magnitude component. First, we make a case for cross representational interplay based on grounded and situated theories of cognition. Second, we discuss interface-based interactions between distinct (i.e., non-overlapping) knowledge representations. Third, we discuss how co-activated representations may share their architecture via partial overlap. Finally, we outline constraints regarding the flexibility of these proposed mechanisms.
We investigated automatic Spatial-Numerical Association of Response Codes (SNARC) effect in auditory number processing. Two experiments continually measured spatial characteristics of ocular drift at central fixation during and after auditory number presentation. Consistent with the notion of a spatially oriented mental number line, we found spontaneous magnitude-dependent gaze adjustments, both with and without a concurrent saccadic task. This fixation adjustment (1) had a small-number/left-lateralized bias and (2) it was biphasic as it emerged for a short time around the point of lexical access and it received later robust representation around following number onset. This pattern suggests a two-step mechanism of sensorimotor mapping between numbers and space a first-pass bottom-up activation followed by a top-down and more robust horizontal SNARC Our results inform theories of number processing as well as simulation-based approaches to cognition by identifying the characteristics of an oculomotor resonance phenomenon. (C) 2015 Elsevier B.V. All rights reserved.
Serial and parallel processes in eye movement control - current controversies and future directions
(2013)
In this editorial for the Special Issue on Serial and Parallel Processing in Reading we explore the background to the current debate concerning whether the word recognition processes in reading are strictly serialsequential or take place in an overlapping parallel fashion. We consider the history of the controversy and some of the underlying assumptions, together with an analysis of the types of evidence and arguments that have been adduced to both sides of the debate, concluding that both accounts necessarily presuppose some weakening of, or elasticity in, the eyemind assumption. We then consider future directions, both for reading research and for scene viewing, and wrap up the editorial with a brief overview of the following articles and their conclusions.
There is a debate about whether and why we overestimate addition and underestimate subtraction results (Operational Momentum or OM effect). Spatial-attentional accounts of OM compete with a model which postulates that OM reflects a weighted combination of multiple arithmetic heuristics and biases (AHAB). This study addressed this debate with the theoretically diagnostic distinction between zero problems (e.g., 3 + 0, 3 - 0) and non-zero problems (e.g., 2 + 1, 4 - 1) because AHAB, in contrast to all other accounts, uniquely predicts reverse OM for the latter problem type. In two tests (line-length production and time production), participants indeed produced shorter lines and under-estimated time intervals in non-zero additions compared with subtractions. This predicted interaction between operation and problem type extends OM to non-spatial magnitudes and highlights the strength of AHAB regarding different problem types and modalities during the mental manipulation of magnitudes. They also suggest that OM reflects methodological details, whereas reverse OM is the more representative behavioural signature of mental arithmetic.
The force of numbers
(2021)
The study has two objectives: (1) to introduce grip force recording as a new technique for studying embodied numerical processing; and (2) to demonstrate how three competing accounts of numerical magnitude representation can be tested by using this new technique: the Mental Number Line (MNL), A Theory of Magnitude (ATOM) and Embodied Cognition (finger counting-based) account. While 26 healthy adults processed visually presented single digits in a go/no-go n-back paradigm, their passive holding forces for two small sensors were recorded in both hands. Spontaneous and unconscious grip force changes related to number magnitude occurred in the left hand already 100-140 ms after stimulus presentation and continued systematically. Our results support a two-step model of number processing where an initial stage is related to the automatic activation of all stimulus properties whereas a later stage consists of deeper conscious processing of the stimulus. This interpretation generalizes previous work with linguistic stimuli and elaborates the timeline of embodied cognition. We hope that the use of grip force recording will advance the field of numerical cognition research.
Background and Aims: Ostarek et al. (2019) claimed a conclusive
demonstration that language comprehension relies profoundly on
visual simulations. They presented participants with visual noise during sentence-picture verification (SPV) and measured lateralized button response speed. The authors selectively eliminated the classical congruency effect (faster yes decisions when pictures match the objects implied by the sentences) with ‘‘high level’’ noise made from images of other objects. However, that visual noise included tool pictures, known to activate lateralized motor affordances. Moreover, some of their sentences described motor actions. This raises the question whether motor simulation may have contaminated their results.
Methods: Replicating Ostarek et al. (2019), 33 right-handed
participants performed SPV but either without visual noise or while viewing (a) only left-handled or (b) only right-handled or (c) alternatingly left- and right-handled tools. Accuracy and reaction times of manual yes responses were analyzed. Additionally, hand-relatedness of sentences was rated.
Results: Replicating Ostarek et al. (2019), the classical SPV congruency effect appeared without noise and vanished when alternatingly handled tools were presented. Crucially, it reappeared when noise objects were consistently either left- or righthandled. Higher hand-relatedness of sentence content reduced SPV performance and accuracy was lower with right-handled noise.
Conclusion: First, we demonstrated an interaction between motor-
related language, visual affordances and motor responses in SPV.
This result supports the embodied view of language processing.
Second, we identified a motor process not previously known in SPV. This extends our understanding of mental simulation and calls for methodological controls in future studies.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Embodied number processing
(2015)
Rodin has it!
(2020)
We report a new discovery on the role of hands in guiding attention, using the classic Stroop effect as our assay. We show that the Stroop effect diminishes, hence selective attention improves, when observers hold their chin, emulating Rodin's famous sculpture, "The Thinker." In two experiments we show that the Rodin posture improves the selectivity of attention as efficiently as holding the hands nearby the visual stimulus (the near-hands effect). Because spatial proximity to the displayed stimulus is neither present nor intended, the presence of the Rodin effect implies that attentional prioritization by the hands is not limited to the space between the hands.
While the influence of spatial-numerical associations in number categorization tasks has been well established, their role in mental arithmetic is less clear. It has been hypothesized that mental addition leads to rightward and upward shifts of spatial attention (along the "mental number line"), whereas subtraction leads to leftward and downward shifts. We addressed this hypothesis by analyzing spontaneous eye movements during mental arithmetic. Participants solved verbally presented arithmetic problems (e.g., 2 + 7, 8-3) aloud while looking at a blank screen. We found that eye movements reflected spatial biases in the ongoing mental operation: Gaze position shifted more upward when participants solved addition compared to subtraction problems, and the horizontal gaze position was partly determined by the magnitude of the operands. Interestingly, the difference between addition and subtraction trials was driven by the operator (plus vs. minus) but was not influenced by the computational process. Thus, our results do not support the idea of a mental movement toward the solution during arithmetic but indicate a semantic association between operation and space.
The visual number world
(2018)
In the domain of language research, the simultaneous presentation of a visual scene and its auditory description (i.e., the visual world paradigm) has been used to reveal the timing of mental mechanisms. Here we apply this rationale to the domain of numerical cognition in order to explore the differences between fast and slow arithmetic performance, and to further study the role of spatial-numerical associations during mental arithmetic. We presented 30 healthy adults simultaneously with visual displays containing four numbers and with auditory addition and subtraction problems. Analysis of eye movements revealed that participants look spontaneously at the numbers they currently process (operands, solution). Faster performance was characterized by shorter latencies prior to fixating the relevant numbers and fewer revisits to the first operand while computing the solution. These signatures of superior task performance were more pronounced for addition and visual numbers arranged in ascending order, and for subtraction and numbers arranged in descending order (compared to the opposite pairings). Our results show that the visual number world-paradigm provides on-line access to the mind during mental arithmetic, is able to capture variability in arithmetic performance, and is sensitive to visual layout manipulations that are otherwise not reflected in response time measurements.
A growing body of research shows that the human brain acts differently when performing a task together with another person than when performing the same task alone. In this study, we investigated the influence of a co-actor on numerical cognition using a joint random number generation (RNG) task. We found that participants generated relatively smaller numbers when they were located to the left (vs. right) of a co-actor (Experiment 1), as if the two individuals shared a mental number line and predominantly selected numbers corresponding to their relative body position. Moreover, the mere presence of another person on the left or right side or the processing of numbers from loudspeaker on the left or right side had no influence on the magnitude of generated numbers (Experiment 2), suggesting that a bias in RNG only emerged during interpersonal interactions. Interestingly, the effect of relative body position on RNG was driven by participants with high trait empathic concern towards others, pointing towards a mediating role of feelings of sympathy for joint compatibility effects. Finally, the spatial bias emerged only after the co-actors swapped their spatial position, suggesting that joint spatial representations are constructed only after the spatial reference frame became salient. In contrast to previous studies, our findings cannot be explained by action co-representation because the consecutive production of numbers does not involve conflict at the motor response level. Our results therefore suggest that spatial reference coding, rather than motor mirroring, can determine joint compatibility effects. Our results demonstrate how physical properties of interpersonal situations, such as the relative body position, shape seemingly abstract cognition.
Even before formal schooling, children map numbers onto space in a directional manner. The origin of this preliterate spatial–numerical association is still debated. We investigated the role of enculturation for shaping the directionality of the association between numbers and space, focusing on counting behavior in 3- to 5-year-old preliterate children. Two studies provide evidence that, after observing reading from storybooks (left-to-right or right-to-left reading) children change their counting direction in line with the direction of observed reading. Just observing visuospatial directional movements had no such effect on counting direction. Complementarily, we document that book illustrations, prevalent in children’s cultures, exhibit directionality that conforms to the direction of a culture’s written language. We propose that shared book reading activates spatiotemporal representations of order in young children, which in turn affect their spatial representation of numbers.
Even simple mental arithmetic is fraught with cognitive biases. For example, adding repeated numbers (so-called tie problems, e.g., 2 + 2) not only has a speed and accuracy advantage over adding different numbers (e.g., 1 + 3) but may also lead to under-representation of the result relative to a standard value (Charras et al., 2012, 2014). Does the tie advantage merely reflect easier encoding or retrieval compared to non-ties, or also a distorted result representation? To answer this question, 47 healthy adults performed two tasks, both of which indicated under-representation of tie results: In a result-to-position pointing task (Experiment 1) we measured the spatial mapping of numbers and found a left-bias for tie compared to non-tie problems. In a result-to-line-length production task (Experiment 2) we measured the underlying magnitude representation directly and obtained shorter lines for tie-compared to non-tie problems. These observations suggest that the processing benefit of tie problems comes at the cost of representational reduction of result meaning. This conclusion is discussed in the context of a recent model of arithmetic heuristics and biases.
The literature on spatial associations during number processing is dominated by the SNARC (spatial-numerical association of response codes) effect. We describe spatial biases found for single digits and pairs of numbers, first in the "original" speeded parity task and then extending the scope to encompass different tasks, a range of measures, and various populations. Then we review theoretical accounts before surveying the emerging evidence for similar spatial associations during mental arithmetic. We conclude that the mental number line hypothesis and an embodied approach are useful frameworks for further studies.
It has been debated whether negative number concepts are cognitively represented on the same mental number line as positive number concepts. The present study reviews this debate and identifies limitations of previous studies. A method with nonspatial stimuli and responses is applied to overcome these limitations and to document a systematic implicit association of negative numbers with left space, thus indicating a leftward extension of the mental number line. Importantly, this result only held for left-to-right counting adults. Implications for the experiential basis of abstract conceptual knowledge are discussed.
We assessed the automaticity of spatial-numerical and spatial-musical associations by testing their intentionality and load sensitivity in a dual-task paradigm. In separate sessions, 16 healthy adults performed magnitude and pitch comparisons on sung numbers with variable pitch. Stimuli and response alternatives were identical, but the relevant stimulus attribute (pitch or number) differed between tasks. Concomitant tasks required retention of either color or location information. Results show that spatial associations of both magnitude and pitch are load sensitive and that the spatial association for pitch is more powerful than that for magnitude. These findings argue against the automaticity of spatial mappings in either stimulus dimension.
Freely available software has popularized "mousetracking" to study cognitive processing; this involves the on-line recording of cursor positions while participants move a computer mouse to indicate their choice. Movement trajectories of the cursor can then be reconstructed off-line to assess the efficiency of responding in time and across space. Here we focus on the process of selecting among alternative numerical responses. Several studies have recently measured the mathematical mind with cursor movements while people decided about number magnitude or parity, computed sums or differences, or simply located numbers on a number line. After some general methodological considerations about mouse tracking we discuss several conceptual concerns that become particularly evident when "mousing" the mathematical mind.
Spatial numerical associations (SNAs) are prevalent yet their origin is poorly understood. We first consider the possible prime role of reading habits in shaping SNAs and list three observations that argue against a prominent influence of this role: (1) directional reading habits for numbers may conflict with those for non-numerical symbols, (2) short-term experimental manipulations can overrule the impact of decades of reading experience, (3) SNAs predate the acquisition of reading. As a promising alternative, we discuss behavioral, neuroscientific, and neuropsychological evidence in support of finger counting as the most likely initial determinant of SNAs. Implications of this "manumerical cognition" stance for the distinction between grounded, embodied, and situated cognition are discussed.
There is much recent interest in the idea that we represent our knowledge together with the sensory and motor features that were activated during its acquisition. This paper reviews the evidence for such "embodiment" in the domain of numerical cognition, a traditional stronghold of abstract theories of knowledge representation. The focus is on spatial-numerical associations, such as the SNARC effect (small numbers are associated with left space, larger numbers with right space). Using empirical evidence from behavioral research, I first describe sensory and motor biases induced by SNARC, thus identifying numbers as embodied concepts. Next, I propose a hierarchical relationship between grounded, embodied, and situated aspects of number knowledge. This hierarchical conceptualization helps to understand the variety of SNARC-related findings and yields testable predictions about numerical cognition. I report several such tests, ranging from cross-cultural comparisons of horizontal and vertical SNARC effects (Shaki and Fischer in J Exp Psychol Hum Percept Perform 38(3): 804-809, 2012) to motor cortical activation studies in adults with left- and right-hand counting preferences (Tschentscher et al. in NeuroImage 59: 3139-3148, 2012). It is concluded that the diagnostic features for each level of the proposed hierarchical knowledge representation, together with the spatial associations of numbers, make the domain of numerical knowledge an ideal testing ground for embodied cognition research.
The current study explored effects of continuous hand motion on the allocation of visual attention. A concurrent paradigm was used to combine visually concealed continuous hand movements with an attentionally demanding letter discrimination task. The letter probe appeared contingent upon the moving right hand passing through one of six positions. Discrimination responses were then collected via a keyboard press with the static left hand. Both the right hand's position and its movement direction systematically contributed to participants' visual sensitivity. Discrimination performance increased substantially when the right hand was distant from, but moving toward the visual probe location (replicating the far-hand effect, Festrnan et al., 2013). However, this effect disappeared when the probe appeared close to the static left hand, supporting the view that static and dynamic features of both hands combine in modulating pragmatic maps of attention.
Previous research on the interaction between manual action and visual perception has focused on discrete movements or static postures and discovered better performance near the hands (the near-hand effect). However, in everyday behaviors, the hands are usually moving continuously between possible targets. Therefore, the current study explored the effects of continuous hand motion on the allocation of visual attention. Eleven healthy adults performed a visual discrimination task during cyclical concealed hand movements underneath a display. Both the current hand position and its movement direction systematically contributed to participants' visual sensitivity. Discrimination performance increased substantially when the hand was distant from but moving toward the visual probe location (a far-hand effect). Implications of this novel observation are discussed.
"Left" and "right" coordinates control our spatial behavior and even influence abstract thoughts. For number concepts, horizontal spatial-numerical associations (SNAs) have been widely documented: we associate few with left and many with right. Importantly, increments are universally coded on the right side even in preverbal humans and nonhuman animals, thus questioning the fundamental role of directional cultural habits, such as reading or finger counting. Here, we propose a biological, nonnumerical mechanism for the origin of SNAs on the basis of asymmetric tuning of animal brains for different spatial frequencies (SFs). The resulting selective visual processing predicts both universal SNAs and their context-dependence. We support our proposal by analyzing the stimuli used to document SNAs in newborns for their SF content. As predicted, the SFs contained in visual patterns with few versus many elements preferentially engage right versus left brain hemispheres, respectively, thus predicting left-versus rightward behavioral biases. Our "brain's asymmetric frequency tuning" hypothesis explains the perceptual origin of horizontal SNAs for nonsymbolic visual numerosities and might be extensible to the auditory domain.
Lee and Schwarz (L&S) suggest that separation is the grounded procedure underlying cleansing effects in different psychological domains. Here, we interpret L&S's account from a hierarchical view of cognition that considers the influence of physical properties and sensorimotor constraints on mental representations. This approach allows theoretical integration and generalization of L&S's account to the domain of formal quantitative reasoning.
To construct a coherent multi-modal percept, vertebrate brains extract low-level features (such as spatial and temporal frequencies) from incoming sensory signals. However, because frequency processing is lateralized with the right hemisphere favouring low frequencies while the left favours higher frequencies, this introduces asymmetries between the hemispheres. Here, we describe how this lateralization shapes the development of several cognitive domains, ranging from visuo-spatial and numerical cognition to language, social cognition, and even aesthetic appreciation, and leads to the emergence of asymmetries in behaviour. We discuss the neuropsychological and educational implications of these emergent asymmetries and suggest future research approaches.
Number processing induces spatial attention shifts to the left or right side for small or large numbers, respectively. This spatial-numerical association (SNA) extends to mental calculation, such that subtractions and additions induce left or right biases, respectively. However, the time course of activating SNAs during mental calculation is unclear. Here, we addressed this issue by measuring visual position discrimination during auditory calculation. Thirty-four healthy adults listened in each trial to five successive elements of arithmetic facts (first operand, operator, second operand, equal and result) and verbally classified their correctness. After each element (except for the result), a fixation dot moved equally often to either the left or right side and participants pressed left or right buttons to discriminate its movement direction (four times per trial). First and second operand magnitude (small/large), operation (addition/subtraction), result correctness (right/wrong) and movement direction (left/right) were balanced across 128 trials. Manual reaction times of dot movement discriminations were considered in relation to previous arithmetic elements. We found no evidence of early attentional shifts after first operand and operator presentation. Discrimination performance was modulated consistent with SNAs after the second operand, suggesting that attentional shifts occur once there is access to all elements necessary to complete an arithmetic operation. Such late-occurring attention shifts may reflect a combination of multiple element-specific biases and confirm their functional role in mental calculation.
Number to me, space to you
(2022)
Recent work has shown that number concepts activate both spatial and magnitude representations. According to the social co-representation literature which has shown that participants typically represent task components assigned to others together with their own, we asked whether explicit magnitude meaning and explicit spatial coding must be present in a single mind, or can be distributed across two minds, to generate a spatial-numerical congruency effect. In a shared go/no-go task that eliminated peripheral spatial codes, we assigned explicit magnitude processing to participants and spatial processing to either human or non-human co-agents. The spatial-numerical congruency effect emerged only with human co-agents. We demonstrate an inter-personal level of conceptual congruency between space and number that arises from a shared conceptual representation not contaminated by peripheral spatial codes. Theoretical implications of this finding for numerical cognition are discussed.
There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.
This special issue, "Concrete constraints of abstract concepts", addresses the role of concrete determinants, both external and internal to the human body, in acquisition, processing and use of abstract concepts while at the same time presenting to the readers an overview of methods used to assess their representation.
"BreaThink"
(2021)
Cognition is shaped by signals from outside and within the body. Following recent evidence of interoceptive signals modulating higher-level cognition, we examined whether breathing changes the production and perception of quantities. In Experiment 1, 22 adults verbally produced on average larger random numbers after inhaling than after exhaling. In Experiment 2, 24 further adults estimated the numerosity of dot patterns that were briefly shown after either inhaling or exhaling. Again, we obtained on average larger responses following inhalation than exhalation. These converging results extend models of situated cognition according to which higher-level cognition is sensitive to transient interoceptive states.
In the number-to-position methodology, a number is presented on each trial and the observer places it on a straight line in a position that corresponds to its felt subjective magnitude. In the novel modification introduced in this study, the two-numbers-to-two-positions method, a pair of numbers rather than a single number is presented on each trial and the observer places them in appropriate positions on the same line. Responses in this method indicate not only the subjective magnitude of each single number but, simultaneously, provide a direct estimation of their subjective numerical distance. The results of four experiments provide strong evidence for a linear representation of numbers and, commensurately, for the linear representation of numerical distances. We attribute earlier results that indicate a logarithmic representation to the ordered nature of numbers and to the task used and not to a truly non-linear underlying representation.
We measured memory span for assembly instructions involving objects with handles oriented to the left or right side. Right-handed participants remembered more instructions when objects' handles were spatially congruent with the hand used in forthcoming assembly actions. No such affordance-based memory benefit was found for left-handed participants. These results are discussed in terms of motor simulation as an embodied rehearsal mechanism.
A growing literature has suggested that processing of visual information presented near the hands is facilitated. In this study, we investigated whether the near-hands superiority effect also occurs with the hands moving. In two experiments, participants performed a cyclical bimanual movement task requiring concurrent visual identification of briefly presented letters. For both the static and dynamic hand conditions, the results showed improved letter recognition performance with the hands closer to the stimuli. The finding that the encoding advantage for near-hand stimuli also occurred with the hands moving suggests that the effect is regulated in real time, in accordance with the concept of a bimodal neural system that dynamically updates hand position in external space.