Refine
Year of publication
Document Type
- Article (85)
- Postprint (25)
- Other (11)
- Preprint (11)
- Conference Proceeding (3)
- Review (3)
- Monograph/Edited Volume (1)
- Part of a Book (1)
Is part of the Bibliography
- yes (140)
Keywords
- embodied cognition (28)
- SNARC (20)
- numerical cognition (20)
- SNARC effect (13)
- mental number line (13)
- Mental number line (12)
- mental arithmetic (10)
- Embodied cognition (9)
- operational momentum (9)
- Numerical cognition (7)
Institute
- Department Psychologie (77)
- Strukturbereich Kognitionswissenschaften (31)
- Humanwissenschaftliche Fakultät (11)
- Strukturbereich Bildungswissenschaften (4)
- Department Linguistik (2)
- Department für Inklusionspädagogik (2)
- Extern (2)
- Institut für Philosophie (2)
- Department Sport- und Gesundheitswissenschaften (1)
- Hasso-Plattner-Institut für Digital Engineering GmbH (1)
The development of interface technologies is driven by the goal of making interaction more positive through natural action-control mappings.
In Virtual Reality (VR), the entire body is potentially involved for interaction, using such mappings with a maximum of degrees of freedom. The downside is the increase in interaction complexity, which can dramatically influence interface design.
A cognitive perspective on detailed aspects of interaction patterns is lacking in common interface design guidelines, although it can be helpful to make this complexity controllable and, thus, make interaction behavior predictable.
In the present study, the distinction between grounding, embodiment, and situatedness (the GES framework) is applied to organize aspects of interactions and to compare them with each other.
In two experiments, zooming into or out of emotional pictures through changes of arm span was examined in VR. There are qualitatively different aspects during such an interaction: i) perceptual aspects caused by zooming are fundamental for human behavior (Grounding: closer objects appear bigger) and ii) aspects of gestures correspond to the physical characteristics of the agents (Embodiment: little distance of hands signals little or, in contrast, "creating more detail").
The GES-framework sets aspects of Grounding against aspects of Embodiment, thus allowing to predict human behavior regarding these qualitatively different aspects.
For the zooming procedure, the study shows that Grounding can overrule Embodiment in interaction design.
Thus, we propose GES as a cognitive framework that can help to inform interaction guidelines for user interface design in VR.
“Ick bin een Berlina”
(2024)
Background: Robots are increasingly used as interaction partners with humans. Social robots are designed to follow expected behavioral norms when engaging with humans and are available with different voices and even accents. Some studies suggest that people prefer robots to speak in the user’s dialect, while others indicate a preference for different dialects.
Methods: Our study examined the impact of the Berlin dialect on perceived trustworthiness and competence of a robot. One hundred and twenty German native speakers (Mage = 32 years, SD = 12 years) watched an online video featuring a NAO robot speaking either in the Berlin dialect or standard German and assessed its trustworthiness and competence.
Results: We found a positive relationship between participants’ self-reported Berlin dialect proficiency and trustworthiness in the dialect-speaking robot. Only when controlled for demographic factors, there was a positive association between participants’ dialect proficiency, dialect performance and their assessment of robot’s competence for the standard German-speaking robot. Participants’ age, gender, length of residency in Berlin, and device used to respond also influenced assessments. Finally, the robot’s competence positively predicted its trustworthiness.
Discussion: Our results inform the design of social robots and emphasize the importance of device control in online experiments.
Finger-based representation of numbers is a high-level cognitive strategy to assist numerical and arithmetic processing in children and adults. It is unclear whether this paradigm builds on simple perceptual features or comprises several attributes through embodiment. Here we describe the development and initial testing of an experimental setup to study embodiment during a finger-based numerical task using Virtual Reality (VR) and a low-cost tactile stimulator that is easy to build. Using VR allows us to create new ways to study finger-based numerical representation using a virtual hand that can be manipulated in ways our hand cannot, such as decoupling tactile and visual stimuli. The goal is to present a new methodology that can allow researchers to study embodiment through this new approach, maybe shedding new light on the cognitive strategy behind the finger-based representation of numbers. In this case, a critical methodological requirement is delivering precisely targeted sensory stimuli to specific effectors while simultaneously recording their behavior and engaging the participant in a simulated experience. We tested the device's capability by stimulating users in different experimental configurations. Results indicate that our device delivers reliable tactile stimulation to all fingers of a participant's hand without losing motion tracking quality during an ongoing task. This is reflected by an accuracy of over 95% in participants detecting stimulation of a single finger or multiple fingers in sequential stimulation as indicated by experiments with sixteen participants. We discuss possible application scenarios, explain how to apply our methodology to study the embodiment of finger-based numerical representations and other high-level cognitive functions, and discuss potential further developments of the device based on the data obtained in our testing.
How to not induce SNAs
(2023)
People respond faster to smaller numbers in their left space and to larger numbers in their right space. Here we argue that movements in space contribute to the formation of spatial-numerical associations (SNAs). We studied the impact of continuous isometric forces along the horizontal or vertical cardinal axes on SNAs while participants performed random number production and arithmetic verification tasks. Our results suggest that such isometric directional force do not suffice to induce SNAs.
There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.
This special issue, "Concrete constraints of abstract concepts", addresses the role of concrete determinants, both external and internal to the human body, in acquisition, processing and use of abstract concepts while at the same time presenting to the readers an overview of methods used to assess their representation.
Magnitude estimation has been studied since the beginnings of scientific psychology and constitutes a fundamental aspect of human behavior. Yet, it has apparently never been noticed that estimates depend on the spatial arrangement used. We tested 167 adults in three experiments to show that the spatial layout of stimuli and responses systematically distorts number estimation, length production, and weight reproduction performance. The direction of distortion depends on the observer's counting habits, but does not seem to reflect the use of spatially associated number concepts. Our results imply that all quantitative estimates are contaminated by a "spell of space" whenever stimuli or responses are spatially distributed.
There is a debate about whether and why we overestimate addition and underestimate subtraction results (Operational Momentum or OM effect). Spatial-attentional accounts of OM compete with a model which postulates that OM reflects a weighted combination of multiple arithmetic heuristics and biases (AHAB). This study addressed this debate with the theoretically diagnostic distinction between zero problems (e.g., 3 + 0, 3 - 0) and non-zero problems (e.g., 2 + 1, 4 - 1) because AHAB, in contrast to all other accounts, uniquely predicts reverse OM for the latter problem type. In two tests (line-length production and time production), participants indeed produced shorter lines and under-estimated time intervals in non-zero additions compared with subtractions. This predicted interaction between operation and problem type extends OM to non-spatial magnitudes and highlights the strength of AHAB regarding different problem types and modalities during the mental manipulation of magnitudes. They also suggest that OM reflects methodological details, whereas reverse OM is the more representative behavioural signature of mental arithmetic.
Number to me, space to you
(2022)
Recent work has shown that number concepts activate both spatial and magnitude representations. According to the social co-representation literature which has shown that participants typically represent task components assigned to others together with their own, we asked whether explicit magnitude meaning and explicit spatial coding must be present in a single mind, or can be distributed across two minds, to generate a spatial-numerical congruency effect. In a shared go/no-go task that eliminated peripheral spatial codes, we assigned explicit magnitude processing to participants and spatial processing to either human or non-human co-agents. The spatial-numerical congruency effect emerged only with human co-agents. We demonstrate an inter-personal level of conceptual congruency between space and number that arises from a shared conceptual representation not contaminated by peripheral spatial codes. Theoretical implications of this finding for numerical cognition are discussed.
To construct a coherent multi-modal percept, vertebrate brains extract low-level features (such as spatial and temporal frequencies) from incoming sensory signals. However, because frequency processing is lateralized with the right hemisphere favouring low frequencies while the left favours higher frequencies, this introduces asymmetries between the hemispheres. Here, we describe how this lateralization shapes the development of several cognitive domains, ranging from visuo-spatial and numerical cognition to language, social cognition, and even aesthetic appreciation, and leads to the emergence of asymmetries in behaviour. We discuss the neuropsychological and educational implications of these emergent asymmetries and suggest future research approaches.
Lee and Schwarz (L&S) suggest that separation is the grounded procedure underlying cleansing effects in different psychological domains. Here, we interpret L&S's account from a hierarchical view of cognition that considers the influence of physical properties and sensorimotor constraints on mental representations. This approach allows theoretical integration and generalization of L&S's account to the domain of formal quantitative reasoning.
There has been increasing interest in the spatial mapping of various perceptual and cognitive magnitudes, such as expanding the spatial-numerical association of response codes (SNARC) effect into domains outside of numerical cognition. Recently, De Tommaso and Prpic (Attention, Perception, & Psychophysics, 82, 2765-2773, 2020) reported in this journal that only fast tempos over 104 beats per minute have spatial associations, with more right-sided associations and faster responses for faster tempos. After discussing the role of perceived loudness and possible response strategies, we propose and recommend methodological improvements for further research.
This study investigated how touching and being touched by a humanoid robot affects human physiology, impressions of the interaction, and attitudes towards humanoid robots. 21 healthy adult participants completed a 3 (touch style: touching, being touched, pointing) x 2 (body part: hand vs buttock) within-subject design using a Pepper robot. Skin conductance response (SCR) was measured during each interaction. Perceived impressions of the interaction (i.e., friendliness, comfort, arousal) were measured per questionnaire after each interaction. Participants' demographics and their attitude towards robots were also considered. We found shorter SCR rise times in the being touched compared to the touching condition, possibly reflecting psychological alertness to the unpredictability of robot-initiated contacts. The hand condition had shorter rise times than the buttock condition. Most participants evaluated the hand condition as most friendly and comfortable and the robot-initiated interactions as most arousing. Interacting with Pepper improved attitudes towards robots. Our findings require future studies with larger samples and improved procedures. They have implications for robot design in all domains involving tactile interactions, such as caring and intimacy.
The force of numbers
(2021)
The study has two objectives: (1) to introduce grip force recording as a new technique for studying embodied numerical processing; and (2) to demonstrate how three competing accounts of numerical magnitude representation can be tested by using this new technique: the Mental Number Line (MNL), A Theory of Magnitude (ATOM) and Embodied Cognition (finger counting-based) account. While 26 healthy adults processed visually presented single digits in a go/no-go n-back paradigm, their passive holding forces for two small sensors were recorded in both hands. Spontaneous and unconscious grip force changes related to number magnitude occurred in the left hand already 100-140 ms after stimulus presentation and continued systematically. Our results support a two-step model of number processing where an initial stage is related to the automatic activation of all stimulus properties whereas a later stage consists of deeper conscious processing of the stimulus. This interpretation generalizes previous work with linguistic stimuli and elaborates the timeline of embodied cognition. We hope that the use of grip force recording will advance the field of numerical cognition research.
Rodin has it!
(2020)
We report a new discovery on the role of hands in guiding attention, using the classic Stroop effect as our assay. We show that the Stroop effect diminishes, hence selective attention improves, when observers hold their chin, emulating Rodin's famous sculpture, "The Thinker." In two experiments we show that the Rodin posture improves the selectivity of attention as efficiently as holding the hands nearby the visual stimulus (the near-hands effect). Because spatial proximity to the displayed stimulus is neither present nor intended, the presence of the Rodin effect implies that attentional prioritization by the hands is not limited to the space between the hands.
"Left" and "right" coordinates control our spatial behavior and even influence abstract thoughts. For number concepts, horizontal spatial-numerical associations (SNAs) have been widely documented: we associate few with left and many with right. Importantly, increments are universally coded on the right side even in preverbal humans and nonhuman animals, thus questioning the fundamental role of directional cultural habits, such as reading or finger counting. Here, we propose a biological, nonnumerical mechanism for the origin of SNAs on the basis of asymmetric tuning of animal brains for different spatial frequencies (SFs). The resulting selective visual processing predicts both universal SNAs and their context-dependence. We support our proposal by analyzing the stimuli used to document SNAs in newborns for their SF content. As predicted, the SFs contained in visual patterns with few versus many elements preferentially engage right versus left brain hemispheres, respectively, thus predicting left-versus rightward behavioral biases. Our "brain's asymmetric frequency tuning" hypothesis explains the perceptual origin of horizontal SNAs for nonsymbolic visual numerosities and might be extensible to the auditory domain.
Number processing induces spatial attention shifts to the left or right side for small or large numbers, respectively. This spatial-numerical association (SNA) extends to mental calculation, such that subtractions and additions induce left or right biases, respectively. However, the time course of activating SNAs during mental calculation is unclear. Here, we addressed this issue by measuring visual position discrimination during auditory calculation. Thirty-four healthy adults listened in each trial to five successive elements of arithmetic facts (first operand, operator, second operand, equal and result) and verbally classified their correctness. After each element (except for the result), a fixation dot moved equally often to either the left or right side and participants pressed left or right buttons to discriminate its movement direction (four times per trial). First and second operand magnitude (small/large), operation (addition/subtraction), result correctness (right/wrong) and movement direction (left/right) were balanced across 128 trials. Manual reaction times of dot movement discriminations were considered in relation to previous arithmetic elements. We found no evidence of early attentional shifts after first operand and operator presentation. Discrimination performance was modulated consistent with SNAs after the second operand, suggesting that attentional shifts occur once there is access to all elements necessary to complete an arithmetic operation. Such late-occurring attention shifts may reflect a combination of multiple element-specific biases and confirm their functional role in mental calculation.
Magnitude estimation has been studied since the beginnings of scientific psychology and constitutes a fundamental aspect of human behavior. Yet, it has apparently never been noticed that estimates depend on the spatial arrangement used. We tested 167 adults in three experiments to show that the spatial layout of stimuli and responses systematically distorts number estimation, length production, and weight reproduction performance. The direction of distortion depends on the observer's counting habits, but does not seem to reflect the use of spatially associated number concepts. Our results imply that all quantitative estimates are contaminated by a "spell of space" whenever stimuli or responses are spatially distributed.
Stimulating numbers
(2018)
Finger counting is one of the first steps in the development of mature number concepts. With a one-to-one correspondence of fingers to numbers in Western finger counting, fingers hold two numerical meanings: one is based on the number of fingers raised and the second is based on their ordinal position within the habitual finger counting sequence. This study investigated how these two numerical meanings of fingers are intertwined with numerical cognition in adults. Participants received tactile stimulation on their fingertips of one hand and named either the number of fingers stimulated (2, 3, or 4 fingers; Experiment 1) or the number of stimulations on one fingertip (2, 3, or 4 stimulations; Experiment 2). Responses were faster and more accurate when the set of stimulated fingers corresponded to finger counting habits (Experiment 1) and when the number of stimulations matched the ordinal position of the stimulated finger (Experiment 2). These results show that tactile numerosity perception is affected by individual finger counting habits and that those habits give numerical meaning to single fingers.
In numerical processing, the functional role of Spatial-Numerical Associations (SNAs, such as the association of smaller numbers with left space and larger numbers with right space, the Mental Number Line hypothesis) is debated. Most studies demonstrate SNAs with lateralized responses, and there is little evidence that SNAs appear when no response is required. We recorded passive holding grip forces in no-go trials during number processing. In Experiment 1, participants performed a surface numerical decision task (“Is it a number or a letter?”). In Experiment 2, we used a deeper semantic task (“Is this number larger or smaller than five?”). Despite instruction to keep their grip force constant, participants' spontaneous grip force changed in both experiments: Smaller numbers led to larger force increase in the left than in the right hand in the numerical decision task (500–700 ms after stimulus onset). In the semantic task, smaller numbers again led to larger force increase in the left hand, and larger numbers increased the right-hand holding force. This effect appeared earlier (180 ms) and lasted longer (until 580 ms after stimulus onset). This is the first demonstration of SNAs with passive holding force. Our result suggests that (1) explicit motor response is not a prerequisite for SNAs to appear, and (2) the timing and strength of SNAs are task-dependent. (216 words).
In numerical processing, the functional role of Spatial-Numerical Associations (SNAs, such as the association of smaller numbers with left space and larger numbers with right space, the Mental Number Line hypothesis) is debated. Most studies demonstrate SNAs with lateralized responses, and there is little evidence that SNAs appear when no response is required. We recorded passive holding grip forces in no-go trials during number processing. In Experiment 1, participants performed a surface numerical decision task (“Is it a number or a letter?”). In Experiment 2, we used a deeper semantic task (“Is this number larger or smaller than five?”). Despite instruction to keep their grip force constant, participants' spontaneous grip force changed in both experiments: Smaller numbers led to larger force increase in the left than in the right hand in the numerical decision task (500–700 ms after stimulus onset). In the semantic task, smaller numbers again led to larger force increase in the left hand, and larger numbers increased the right-hand holding force. This effect appeared earlier (180 ms) and lasted longer (until 580 ms after stimulus onset). This is the first demonstration of SNAs with passive holding force. Our result suggests that (1) explicit motor response is not a prerequisite for SNAs to appear, and (2) the timing and strength of SNAs are task-dependent. (216 words).
Background and Aims: Ostarek et al. (2019) claimed a conclusive
demonstration that language comprehension relies profoundly on
visual simulations. They presented participants with visual noise during sentence-picture verification (SPV) and measured lateralized button response speed. The authors selectively eliminated the classical congruency effect (faster yes decisions when pictures match the objects implied by the sentences) with ‘‘high level’’ noise made from images of other objects. However, that visual noise included tool pictures, known to activate lateralized motor affordances. Moreover, some of their sentences described motor actions. This raises the question whether motor simulation may have contaminated their results.
Methods: Replicating Ostarek et al. (2019), 33 right-handed
participants performed SPV but either without visual noise or while viewing (a) only left-handled or (b) only right-handled or (c) alternatingly left- and right-handled tools. Accuracy and reaction times of manual yes responses were analyzed. Additionally, hand-relatedness of sentences was rated.
Results: Replicating Ostarek et al. (2019), the classical SPV congruency effect appeared without noise and vanished when alternatingly handled tools were presented. Crucially, it reappeared when noise objects were consistently either left- or righthandled. Higher hand-relatedness of sentence content reduced SPV performance and accuracy was lower with right-handled noise.
Conclusion: First, we demonstrated an interaction between motor-
related language, visual affordances and motor responses in SPV.
This result supports the embodied view of language processing.
Second, we identified a motor process not previously known in SPV. This extends our understanding of mental simulation and calls for methodological controls in future studies.
Peripersonal space is the space surrounding our body, where multisensory integration of stimuli and action execution take place. The size of peripersonal space is flexible and subject to change by various personal and situational factors. The dynamic representation of our peripersonal space modulates our spatial behaviors towards other individuals. During the COVID-19 pandemic, this spatial behavior was modified by two further factors: social distancing and wearing a face mask. Evidence from offline and online studies on the impact of a face mask on pro-social behavior is mixed. In an attempt to clarify the role of face masks as pro-social or anti-social signals, 235 observers participated in the present online study. They watched pictures of two models standing at three different distances from each other (50, 90 and 150 cm), who were either wearing a face mask or not and were either interacting by initiating a hand shake or just standing still. The observers’ task was to classify the model by gender. Our results show that observers react fastest, and therefore show least avoidance, for the shortest distances (50 and 90 cm) but only when models wear a face mask and do not interact. Thus, our results document both pro- and anti-social consequences of face masks as a result of the complex interplay between social distancing and interactive behavior. Practical implications of these findings are discussed.
Peripersonal space is the space surrounding our body, where multisensory integration of stimuli and action execution take place. The size of peripersonal space is flexible and subject to change by various personal and situational factors. The dynamic representation of our peripersonal space modulates our spatial behaviors towards other individuals. During the COVID-19 pandemic, this spatial behavior was modified by two further factors: social distancing and wearing a face mask. Evidence from offline and online studies on the impact of a face mask on pro-social behavior is mixed. In an attempt to clarify the role of face masks as pro-social or anti-social signals, 235 observers participated in the present online study. They watched pictures of two models standing at three different distances from each other (50, 90 and 150 cm), who were either wearing a face mask or not and were either interacting by initiating a hand shake or just standing still. The observers’ task was to classify the model by gender. Our results show that observers react fastest, and therefore show least avoidance, for the shortest distances (50 and 90 cm) but only when models wear a face mask and do not interact. Thus, our results document both pro- and anti-social consequences of face masks as a result of the complex interplay between social distancing and interactive behavior. Practical implications of these findings are discussed.
"BreaThink"
(2021)
Cognition is shaped by signals from outside and within the body. Following recent evidence of interoceptive signals modulating higher-level cognition, we examined whether breathing changes the production and perception of quantities. In Experiment 1, 22 adults verbally produced on average larger random numbers after inhaling than after exhaling. In Experiment 2, 24 further adults estimated the numerosity of dot patterns that were briefly shown after either inhaling or exhaling. Again, we obtained on average larger responses following inhalation than exhalation. These converging results extend models of situated cognition according to which higher-level cognition is sensitive to transient interoceptive states.
A crucial question facing cognitive science concerns the nature of conceptual representations as well as the constraints on the interactions between them. One specific question we address in this paper is what makes cross-representational interplay possible? We offer two distinct theoretical scenarios: according to the first scenario, co-activated knowledge representations interact with the help of an interface established between them via congruent activation in a mediating third-party general cognitive mechanism, e.g., attention. According to the second scenario, co-activated knowledge representations interact due to an overlap between their features, for example when they share a magnitude component. First, we make a case for cross representational interplay based on grounded and situated theories of cognition. Second, we discuss interface-based interactions between distinct (i.e., non-overlapping) knowledge representations. Third, we discuss how co-activated representations may share their architecture via partial overlap. Finally, we outline constraints regarding the flexibility of these proposed mechanisms.
Research in cognitive neuroscience has shown that brain structures serving perceptual, emotional, and motor processes are also recruited during the understanding of language when it refers to emotion, perception, and action. However, the exact linguistic and extralinguistic conditions under which such language-induced activity in modality-specific cortex is triggered are not yet well understood. The purpose of this study is to introduce a simple experimental technique that allows for the online measure of language-induced activity in motor structures of the brain. This technique consists in the use of a grip force sensor that captures subtle grip force variations while participants listen to words and sentences. Since grip force reflects activity in motor brain structures, the continuous monitoring of force fluctuations provides a fine-grained estimation of motor activity across time. In other terms, this method allows for both localization of the source of language-induced activity to motor brain structures and high temporal resolution of the recorded data. To facilitate comparison of the data to be collected with this tool, we present two experiments that describe in detail the technical setup, the nature of the recorded data, and the analyses (including justification about the data filtering and artifact rejection) that we applied. We also discuss how the tool could be used in other domains of behavioral research.
Research on problem solving offers insights into how humans process task-related information and which strategies they use (Newell and Simon, 1972; Öllinger et al., 2014). Problem solving can be defined as the search for possible changes in one's mind (Kahneman, 2003). In a recent study, Adams et al. (2021) assessed whether the predominant problem solving strategy when making changes involves adding or subtracting elements. In order to do this, they used several examples of simple problems, such as editing text or making visual patterns symmetrical, either in naturalistic settings or on-line. The essence of the authors' findings is a strong preference to add rather than subtract elements across a diverse range of problems, including the stabilizing of artifacts, creating symmetrical patterns, or editing texts. More specifically, they succeeded in demonstrating that “participants were less likely to identify advantageous subtractive changes when the task did not (vs. did) cue them to consider subtraction, when they had only one opportunity (vs. several) to recognize the shortcomings of an additive search strategy or when they were under a higher (vs. lower) cognitive load” (Adams et al., 2021, p. 258).
Addition and subtraction are generally defined as de-contextualized mathematical operations using abstract symbols (Russell, 1903/1938). Nevertheless, understanding of both symbols and operations is informed by everyday activities, such as making or breaking objects (Lakoff and Núñez, 2000; Fischer and Shaki, 2018). The universal attribution of “addition bias” or “subtraction neglect” to problem solving activities is perhaps a convenient shorthand but it overlooks influential framing effects beyond those already acknowledged in the report and the accompanying commentary (Meyvis and Yoon, 2021).
Most importantly, while Adams et al.'s study addresses an important issue, their very method of verbally instructing participants, together with lack of control over several known biases, might render their findings less than conclusive. Below, we discuss our concerns that emerged from the identified biases, namely those regarding the instructions and the experimental materials. Moreover, we refer to research from mathematical cognition that provides new insights into Adams et al.'s findings.
Research on problem solving offers insights into how humans process task-related information and which strategies they use (Newell and Simon, 1972; Öllinger et al., 2014). Problem solving can be defined as the search for possible changes in one's mind (Kahneman, 2003). In a recent study, Adams et al. (2021) assessed whether the predominant problem solving strategy when making changes involves adding or subtracting elements. In order to do this, they used several examples of simple problems, such as editing text or making visual patterns symmetrical, either in naturalistic settings or on-line. The essence of the authors' findings is a strong preference to add rather than subtract elements across a diverse range of problems, including the stabilizing of artifacts, creating symmetrical patterns, or editing texts. More specifically, they succeeded in demonstrating that “participants were less likely to identify advantageous subtractive changes when the task did not (vs. did) cue them to consider subtraction, when they had only one opportunity (vs. several) to recognize the shortcomings of an additive search strategy or when they were under a higher (vs. lower) cognitive load” (Adams et al., 2021, p. 258).
Addition and subtraction are generally defined as de-contextualized mathematical operations using abstract symbols (Russell, 1903/1938). Nevertheless, understanding of both symbols and operations is informed by everyday activities, such as making or breaking objects (Lakoff and Núñez, 2000; Fischer and Shaki, 2018). The universal attribution of “addition bias” or “subtraction neglect” to problem solving activities is perhaps a convenient shorthand but it overlooks influential framing effects beyond those already acknowledged in the report and the accompanying commentary (Meyvis and Yoon, 2021).
Most importantly, while Adams et al.'s study addresses an important issue, their very method of verbally instructing participants, together with lack of control over several known biases, might render their findings less than conclusive. Below, we discuss our concerns that emerged from the identified biases, namely those regarding the instructions and the experimental materials. Moreover, we refer to research from mathematical cognition that provides new insights into Adams et al.'s findings.
The visual number world
(2018)
In the domain of language research, the simultaneous presentation of a visual scene and its auditory description (i.e., the visual world paradigm) has been used to reveal the timing of mental mechanisms. Here we apply this rationale to the domain of numerical cognition in order to explore the differences between fast and slow arithmetic performance, and to further study the role of spatial-numerical associations during mental arithmetic. We presented 30 healthy adults simultaneously with visual displays containing four numbers and with auditory addition and subtraction problems. Analysis of eye movements revealed that participants look spontaneously at the numbers they currently process (operands, solution). Faster performance was characterized by shorter latencies prior to fixating the relevant numbers and fewer revisits to the first operand while computing the solution. These signatures of superior task performance were more pronounced for addition and visual numbers arranged in ascending order, and for subtraction and numbers arranged in descending order (compared to the opposite pairings). Our results show that the visual number world-paradigm provides on-line access to the mind during mental arithmetic, is able to capture variability in arithmetic performance, and is sensitive to visual layout manipulations that are otherwise not reflected in response time measurements.
Mental arithmetic is characterised by a tendency to overestimate addition and to underestimate subtraction results: the operational momentum (OM) effect. Here, motivated by contentious explanations of this effect, we developed and tested an arithmetic heuristics and biases model that predicts reverse OM due to cognitive anchoring effects. Participants produced bi-directional lines with lengths corresponding to the results of arithmetic problems. In two experiments, we found regular OM with zero problems (e.g., 3+0, 3-0) but reverse OM with non-zero problems (e.g., 2+1, 4-1). In a third experiment, we tested the prediction of our model. Our results suggest the presence of at least three competing biases in mental arithmetic: a more-or-less heuristic, a sign-space association and an anchoring bias. We conclude that mental arithmetic exhibits shortcuts for decision-making similar to traditional domains of reasoning and problem-solving.
Mimicking non-verbal emotional expressions and empathy development in simulated consultations
(2018)
Objective: To explore the feasibility of applying an experimental design to study the relationship between non-verbal emotions and empathy development in simulated consultations.
Method: In video-recorded simulated consultations, twenty clinicians were randomly allocated to either an experimental group (instructed to mimic non-verbal emotions of a simulated patient, SP) or a control group (no such instruction). Baseline empathy scores were obtained before consultation, relational empathy was rated by SP after consultation. Multilevel logistic regression modelled the probability of mimicry occurrence, controlling for baseline empathy and clinical experience. ANCOVA compared group differences on relational empathy and consultation smoothness.
Results: Instructed mimicry lasted longer than spontaneous mimicry. Mimicry was marginally related to improved relational empathy. SP felt being treated more like a whole person during consultations with spontaneous mimicry. Clinicians who displayed spontaneous mimicry felt consultations went more smoothly.
Conclusion: The experimental approach improved our understanding of how non-verbal emotional mimicry contributed to relational empathy development during consultations. Further work should ascertain the potential of instructed mimicry to enhance empathy development.
Practice implications: Understanding how non-verbal emotional mimicry impacts on patients’ perceived clinician empathy during consultations may inform training and intervention programme development.
Even before formal schooling, children map numbers onto space in a directional manner. The origin of this preliterate spatial–numerical association is still debated. We investigated the role of enculturation for shaping the directionality of the association between numbers and space, focusing on counting behavior in 3- to 5-year-old preliterate children. Two studies provide evidence that, after observing reading from storybooks (left-to-right or right-to-left reading) children change their counting direction in line with the direction of observed reading. Just observing visuospatial directional movements had no such effect on counting direction. Complementarily, we document that book illustrations, prevalent in children’s cultures, exhibit directionality that conforms to the direction of a culture’s written language. We propose that shared book reading activates spatiotemporal representations of order in young children, which in turn affect their spatial representation of numbers.
Spatial-numerical associations (SNAs) have been studied extensively in the past two decades, always requiring either explicit magnitude processing or explicit spatial-directional processing. This means that the typical finding of an association of small numbers with left or bottom space and of larger numbers with right or top space could be due to these requirements and not the conceptual representation of numbers. The present study compares explicit and implicit magnitude processing in an implicit spatial-directional task and identifies SNAs as artefacts of either explicit magnitude processing or explicit spatial-directional processing; they do not reveal spatial conceptual links. This finding requires revision of current accounts of the relationship between numbers and space.
Spinal muscular atrophy (SMA) and Duchenne muscular dystrophy (DMD) both are rare genetic neuromuscular diseases with progressive loss of motor ability. The neuromotor developmental course of those diseases is well documented. In contrast, there is only little evidence about characteristics of general and specific cognitive development. In both conditions the final motor outcome is characterized by an inability to move autonomously: children with SMA never accomplish independent motoric exploration of their environment, while children with DMD do but later lose this ability again. These profound differences in developmental pathways might affect cognitive development of SMA vs. DMD children, as cognition is shaped by individual motor experiences. DMD patients show impaired executive functions, working memory, and verbal IQ, whereas only motor ability seems to be impaired in SMA. Advanced cognitive capacity in SMA may serve as a compensatory mechanism for achieving in education, career progression, and social satisfaction. This study aimed to relate differences in basic numerical concepts and arithmetic achievement in SMA and DMD patients to differences in their motor development and resulting sensorimotor and environmental experiences. Horizontal and vertical spatial-numerical associations were explored in SMA/DMD children ranging between 6 and 12 years through the random number generation task. Furthermore, arithmetic skills as well as general cognitive ability were assessed. Groups differed in spatial number processing as well as in arithmetic and domain-general cognitive functions. Children with SMA showed no horizontal and even reversed vertical spatial-numerical associations. Children with DMD on the other hand revealed patterns in spatial numerical associations comparable to healthy developing children. From the embodied Cognition perspective, early sensorimotor experience does play a role in development of mental number representations. However, it remains open whether and how this becomes relevant for the acquisition of higher order cognitive and arithmetic skills.
Spinal muscular atrophy (SMA) and Duchenne muscular dystrophy (DMD) both are rare genetic neuromuscular diseases with progressive loss of motor ability. The neuromotor developmental course of those diseases is well documented. In contrast, there is only little evidence about characteristics of general and specific cognitive development. In both conditions the final motor outcome is characterized by an inability to move autonomously: children with SMA never accomplish independent motoric exploration of their environment, while children with DMD do but later lose this ability again. These profound differences in developmental pathways might affect cognitive development of SMA vs. DMD children, as cognition is shaped by individual motor experiences. DMD patients show impaired executive functions, working memory, and verbal IQ, whereas only motor ability seems to be impaired in SMA. Advanced cognitive capacity in SMA may serve as a compensatory mechanism for achieving in education, career progression, and social satisfaction. This study aimed to relate differences in basic numerical concepts and arithmetic achievement in SMA and DMD patients to differences in their motor development and resulting sensorimotor and environmental experiences. Horizontal and vertical spatial-numerical associations were explored in SMA/DMD children ranging between 6 and 12 years through the random number generation task. Furthermore, arithmetic skills as well as general cognitive ability were assessed. Groups differed in spatial number processing as well as in arithmetic and domain-general cognitive functions. Children with SMA showed no horizontal and even reversed vertical spatial-numerical associations. Children with DMD on the other hand revealed patterns in spatial numerical associations comparable to healthy developing children. From the embodied Cognition perspective, early sensorimotor experience does play a role in development of mental number representations. However, it remains open whether and how this becomes relevant for the acquisition of higher order cognitive and arithmetic skills.
Numerical knowledge, including number concepts and arithmetic procedures, seems to be a clear-cut case for abstract symbol manipulation. Yet, evidence from perceptual and motor behaviour reveals that natural number knowledge and simple arithmetic also remain closely associated with modal experiences. Following a review of behavioural, animal and neuroscience studies of number processing, we propose a revised understanding of psychological number concepts as grounded in physical constraints, embodied in experience and situated through task-specific intentions. The idea that number concepts occupy a range of positions on the continuum between abstract and modal conceptual knowledge also accounts for systematic heuristics and biases in mental arithmetic, thus inviting psycho-logical approaches to the study of the mathematical mind.
Language and Arithmetic
(2018)
We examined cross-domain semantic priming effects between arithmetic and language. We paired subtractions with their linguistic equivalent, exception phrases (EPs) with positive quantifiers (e.g., "everybody except John") while pairing additions with their own linguistic equivalent, EPs with negative quantifiers (e.g., "nobody except John"; Moltmann, 1995). We hypothesized that EPs with positive quantifiers prime subtractions and inhibit additions while EPs with negative quantifiers prime additions and inhibit subtractions. Furthermore, we expected similar priming and inhibition effects from arithmetic into semantics. Our design allowed for a bidirectional analysis by using one trial's target as the prime for the next trial. Two experiments failed to show significant priming effects in either direction. Implications and possible shortcomings are explored in the general discussion.
In the number-to-position methodology, a number is presented on each trial and the observer places it on a straight line in a position that corresponds to its felt subjective magnitude. In the novel modification introduced in this study, the two-numbers-to-two-positions method, a pair of numbers rather than a single number is presented on each trial and the observer places them in appropriate positions on the same line. Responses in this method indicate not only the subjective magnitude of each single number but, simultaneously, provide a direct estimation of their subjective numerical distance. The results of four experiments provide strong evidence for a linear representation of numbers and, commensurately, for the linear representation of numerical distances. We attribute earlier results that indicate a logarithmic representation to the ordered nature of numbers and to the task used and not to a truly non-linear underlying representation.
Moving arms
(2018)
Embodied cognition postulates a bi-directional link between the human body and its cognitive functions. Whether this holds for higher cognitive functions such as problem solving is unknown. We predicted that arm movement manipulations performed by the participants could affect the problem-solving solutions. We tested this prediction in quantitative reasoning tasks that allowed two solutions to each problem (addition or subtraction). In two studies with healthy adults (N=53 and N=50), we found an effect of problem-congruent movements on problem solutions. Consistent with embodied cognition, sensorimotor information gained via right or left arm movements affects the solution in different types of problem-solving tasks.
The Human Takes It All
(2020)
Background: The increasing involvement of social robots in human lives raises the question as to how humans perceive social robots. Little is known about human perception of synthesized voices.
Aim: To investigate which synthesized voice parameters predict the speaker's eeriness and voice likability; to determine if individual listener characteristics (e.g., personality, attitude toward robots, age) influence synthesized voice evaluations; and to explore which paralinguistic features subjectively distinguish humans from robots/artificial agents.
Methods: 95 adults (62 females) listened to randomly presented audio-clips of three categories: synthesized (Watson, IBM), humanoid (robot Sophia, Hanson Robotics), and human voices (five clips/category). Voices were rated on intelligibility, prosody, trustworthiness, confidence, enthusiasm, pleasantness, human-likeness, likability, and naturalness. Speakers were rated on appeal, credibility, human-likeness, and eeriness. Participants' personality traits, attitudes to robots, and demographics were obtained.
Results: The human voice and human speaker characteristics received reliably higher scores on all dimensions except for eeriness. Synthesized voice ratings were positively related to participants' agreeableness and neuroticism. Females rated synthesized voices more positively on most dimensions. Surprisingly, interest in social robots and attitudes toward robots played almost no role in voice evaluation. Contrary to the expectations of an uncanny valley, when the ratings of human-likeness for both the voice and the speaker characteristics were higher, they seemed less eerie to the participants. Moreover, when the speaker's voice was more humanlike, it was more liked by the participants. This latter point was only applicable to one of the synthesized voices. Finally, pleasantness and trustworthiness of the synthesized voice predicted the likability of the speaker's voice. Qualitative content analysis identified intonation, sound, emotion, and imageability/embodiment as diagnostic features.
Discussion: Humans clearly prefer human voices, but manipulating diagnostic speech features might increase acceptance of synthesized voices and thereby support human-robot interaction. There is limited evidence that human-likeness of a voice is negatively linked to the perceived eeriness of the speaker.
The Human Takes It All
(2020)
Background: The increasing involvement of social robots in human lives raises the question as to how humans perceive social robots. Little is known about human perception of synthesized voices.
Aim: To investigate which synthesized voice parameters predict the speaker's eeriness and voice likability; to determine if individual listener characteristics (e.g., personality, attitude toward robots, age) influence synthesized voice evaluations; and to explore which paralinguistic features subjectively distinguish humans from robots/artificial agents.
Methods: 95 adults (62 females) listened to randomly presented audio-clips of three categories: synthesized (Watson, IBM), humanoid (robot Sophia, Hanson Robotics), and human voices (five clips/category). Voices were rated on intelligibility, prosody, trustworthiness, confidence, enthusiasm, pleasantness, human-likeness, likability, and naturalness. Speakers were rated on appeal, credibility, human-likeness, and eeriness. Participants' personality traits, attitudes to robots, and demographics were obtained.
Results: The human voice and human speaker characteristics received reliably higher scores on all dimensions except for eeriness. Synthesized voice ratings were positively related to participants' agreeableness and neuroticism. Females rated synthesized voices more positively on most dimensions. Surprisingly, interest in social robots and attitudes toward robots played almost no role in voice evaluation. Contrary to the expectations of an uncanny valley, when the ratings of human-likeness for both the voice and the speaker characteristics were higher, they seemed less eerie to the participants. Moreover, when the speaker's voice was more humanlike, it was more liked by the participants. This latter point was only applicable to one of the synthesized voices. Finally, pleasantness and trustworthiness of the synthesized voice predicted the likability of the speaker's voice. Qualitative content analysis identified intonation, sound, emotion, and imageability/embodiment as diagnostic features.
Discussion: Humans clearly prefer human voices, but manipulating diagnostic speech features might increase acceptance of synthesized voices and thereby support human-robot interaction. There is limited evidence that human-likeness of a voice is negatively linked to the perceived eeriness of the speaker.