Refine
Year of publication
Document Type
- Article (79)
- Postprint (23)
- Preprint (11)
- Other (10)
- Conference Proceeding (3)
- Review (3)
- Monograph/Edited Volume (1)
- Part of a Book (1)
Is part of the Bibliography
- yes (131)
Keywords
- embodied cognition (27)
- numerical cognition (19)
- SNARC (18)
- SNARC effect (13)
- mental number line (13)
- Mental number line (12)
- mental arithmetic (10)
- Embodied cognition (9)
- operational momentum (9)
- Numerical cognition (7)
Institute
- Department Psychologie (71)
- Strukturbereich Kognitionswissenschaften (28)
- Humanwissenschaftliche Fakultät (11)
- Strukturbereich Bildungswissenschaften (4)
- Department Linguistik (2)
- Department für Inklusionspädagogik (2)
- Institut für Philosophie (2)
- Department Sport- und Gesundheitswissenschaften (1)
- Extern (1)
- Institut für Biochemie und Biologie (1)
Spatial numerical associations (SNAs) are prevalent yet their origin is poorly understood. We first consider the possible prime role of reading habits in shaping SNAs and list three observations that argue against a prominent influence of this role: (1) directional reading habits for numbers may conflict with those for non-numerical symbols, (2) short-term experimental manipulations can overrule the impact of decades of reading experience, (3) SNAs predate the acquisition of reading. As a promising alternative, we discuss behavioral, neuroscientific, and neuropsychological evidence in support of finger counting as the most likely initial determinant of SNAs. Implications of this "manumerical cognition" stance for the distinction between grounded, embodied, and situated cognition are discussed.
We investigated the mental rehearsal of complex action instructions by recording spontaneous eye movements of healthy adults as they looked at objects on a monitor. Participants heard consecutive instructions, each of the form "move [object] to [location]''. Instructions were only to be executed after a go signal, by manipulating all objects successively with a mouse. Participants re-inspected previously mentioned objects already while listening to further instructions. This rehearsal behavior broke down after 4 instructions, coincident with participants' instruction span, as determined from subsequent execution accuracy. These results suggest that spontaneous eye movements while listening to instructions predict their successful execution.
The closer the better
(2012)
A growing literature has suggested that processing of visual information presented near the hands is facilitated. In this study, we investigated whether the near-hands superiority effect also occurs with the hands moving. In two experiments, participants performed a cyclical bimanual movement task requiring concurrent visual identification of briefly presented letters. For both the static and dynamic hand conditions, the results showed improved letter recognition performance with the hands closer to the stimuli. The finding that the encoding advantage for near-hand stimuli also occurred with the hands moving suggests that the effect is regulated in real time, in accordance with the concept of a bimodal neural system that dynamically updates hand position in external space.
The embodied cognition framework suggests that neural systems for perception and action are engaged during higher cognitive processes. In an event-related fMRI study, we tested this claim for the abstract domain of numerical symbol processing: is the human cortical motor system part of the representation of numbers, and is organization of numerical knowledge influenced by individual finger counting habits? Developmental studies suggest a link between numerals and finger counting habits due to the acquisition of numerical skills through finger counting in childhood. In the present study, digits 1 to 9 and the corresponding number words were presented visually to adults with different finger counting habits, i.e. left- and right-starters who reported that they usually start counting small numbers with their left and right hand, respectively. Despite the absence of overt hand movements, the hemisphere contralateral to the hand used for counting small numbers was activated when small numbers were presented. The correspondence between finger counting habits and hemispheric motor activation is consistent with an intrinsic functional link between finger counting and number processing.
A growing literature has suggested that processing of visual information presented near the hands is facilitated. In this study, we investigated whether the near-hands superiority effect also occurs with the hands moving. In two experiments, participants performed a cyclical bimanual movement task requiring concurrent visual identification of briefly presented letters. For both the static and dynamic hand conditions, the results showed improved letter recognition performance with the hands closer to the stimuli. The finding that the encoding advantage for near-hand stimuli also occurred with the hands moving suggests that the effect is regulated in real time, in accordance with the concept of a bimodal neural system that dynamically updates hand position in external space.
There is much recent interest in the idea that we represent our knowledge together with the sensory and motor features that were activated during its acquisition. This paper reviews the evidence for such "embodiment" in the domain of numerical cognition, a traditional stronghold of abstract theories of knowledge representation. The focus is on spatial-numerical associations, such as the SNARC effect (small numbers are associated with left space, larger numbers with right space). Using empirical evidence from behavioral research, I first describe sensory and motor biases induced by SNARC, thus identifying numbers as embodied concepts. Next, I propose a hierarchical relationship between grounded, embodied, and situated aspects of number knowledge. This hierarchical conceptualization helps to understand the variety of SNARC-related findings and yields testable predictions about numerical cognition. I report several such tests, ranging from cross-cultural comparisons of horizontal and vertical SNARC effects (Shaki and Fischer in J Exp Psychol Hum Percept Perform 38(3): 804-809, 2012) to motor cortical activation studies in adults with left- and right-hand counting preferences (Tschentscher et al. in NeuroImage 59: 3139-3148, 2012). It is concluded that the diagnostic features for each level of the proposed hierarchical knowledge representation, together with the spatial associations of numbers, make the domain of numerical knowledge an ideal testing ground for embodied cognition research.
This editorial introduces a set of papers on differential embodiment in spatial tasks. According to the theoretical notion of embodied cognition, our experiences of acting in the world, and the constraints of our sensory and motor systems, strongly shape our cognitive functions. In the current set of papers, the authors were asked to particularly consider idiosyncratic or differential embodied cognition in the context of spatial tasks and processes. In each contribution, differential embodiment is considered from one of two complementary perspectives: either by considering unusual individuals, who have atypical bodies or uncommon experiences of interacting with the world; or by exploring individual differences in the general population that reflect the naturally occurring variability in embodied processes. Our editorial summarizes the contributions to this special issue and discusses the insights they offer. We conclude from this collection of papers that exploring differences in the recruitment and involvement of embodied processes can be highly informative, and can add an extra dimension to our understanding of spatial cognitive functions. Taking a broader perspective, it can also shed light on important theoretical and empirical questions concerning the nature of embodied cognition per se.
We measured memory span for assembly instructions involving objects with handles oriented to the left or right side. Right-handed participants remembered more instructions when objects' handles were spatially congruent with the hand used in forthcoming assembly actions. No such affordance-based memory benefit was found for left-handed participants. These results are discussed in terms of motor simulation as an embodied rehearsal mechanism.
Western adults associate small numbers with left space and large numbers with right space. Where does this pervasive spatial-numerical association come from? In this study, we first recorded directional counting preferences in adults with different reading experiences (left to right, right to left, mixed, and illiterate) and observed a clear relationship between reading and counting directions. We then recorded directional counting preferences in pre-schoolers and elementary school children from three of these reading cultures (left to right, right to left, and mixed). Culture-specific counting biases existed before reading acquisition in children as young as 3 years and were subsequently modified by early reading experience. Together, our results suggest that both directional counting and scanning activities contribute to number-space associations.
A recent cross-cultural comparison (Shaki, Fischer, & Petrusic, 2009) suggested that spatially consistent processing habits for words and numbers are a necessary condition for the spatial representation of numbers (Spatial-Numerical Association of Response Codes; SNARC effect). Here we reexamine the SNARC in Israelis who read text from right to left but numbers from left to right. We show that, despite these spatially inconsistent processing habits, a SNARC effect still emerges when the response dimension is spatially orthogonal to the conflicting processing dimension. These results clarify the cognitive conditions for spatial-numerical mappings.
Several chronometric biases in numerical cognition have informed our understanding of a mental number line (MNL). Complementing this approach, we investigated spatial performance in a magnitude comparison task. Participants located the larger or smaller number of a pair on a horizontal line representing the interval from 0 to 10. Experiments 1 and 2 used only number pairs one unit apart and found that digits were localized farther to the right with "select larger" instructions than with "select smaller" instructions. However, when numerical distance was varied (Experiment 3), digits were localized away from numerically near neighbors. This repulsion effect reveals context-specific distortions in number representation not previously noticed with chronometric measures.
Serial and parallel processes in eye movement control - current controversies and future directions
(2013)
In this editorial for the Special Issue on Serial and Parallel Processing in Reading we explore the background to the current debate concerning whether the word recognition processes in reading are strictly serialsequential or take place in an overlapping parallel fashion. We consider the history of the controversy and some of the underlying assumptions, together with an analysis of the types of evidence and arguments that have been adduced to both sides of the debate, concluding that both accounts necessarily presuppose some weakening of, or elasticity in, the eyemind assumption. We then consider future directions, both for reading research and for scene viewing, and wrap up the editorial with a brief overview of the following articles and their conclusions.
We examined how the frequency of the fixated word influences the spatiotemporal distribution of covert attention during reading. Participants discriminated gaze-contingent probes that occurred with different spatial and temporal offsets from randomly chosen fixation points during reading. We found that attention was initially focused at fixation and that subsequent defocusing was slower when the fixated word was lower in frequency. Later in a fixation, attention oriented more towards the next saccadic target for high- than for low-frequency words. These results constitute the first report of the time course of the effect of load on attentional engagement and orienting in reading. They are discussed in the context of serial and parallel models of reading.
We assessed the automaticity of spatial-numerical and spatial-musical associations by testing their intentionality and load sensitivity in a dual-task paradigm. In separate sessions, 16 healthy adults performed magnitude and pitch comparisons on sung numbers with variable pitch. Stimuli and response alternatives were identical, but the relevant stimulus attribute (pitch or number) differed between tasks. Concomitant tasks required retention of either color or location information. Results show that spatial associations of both magnitude and pitch are load sensitive and that the spatial association for pitch is more powerful than that for magnitude. These findings argue against the automaticity of spatial mappings in either stimulus dimension.
This article derives from two interdisciplinary research projects funded by the UK Arts and Humanities Research Council, involving the application of psychological experimental techniques to the study of poetic form and reader response. It discusses the semantic and expressive effects of space and pattern in innovative forms of contemporary British and American poetry. After referring to some historical and theoretical contexts for these issues, the article analyses the results of experiments using eye-tracking, manipulations of text, memory tests and readers' recorded responses and interpretations. The first group of poems studied were lineated, with extended spaces within lines and displacement of lines from the left margin. Referring to a poem from Geoffrey Hill'sCanaan(1996), the authors show that such use of space may serve to articulate syntactical structures, but may also promote richer interpretation by encouraging cross-linear semantic connections. The second technique studied was the break from linear into postlinear poetry, as an initially lineated sequence shifts to pages of dispersed text. In readings of Susan Howe'sPythagorean Silence(fromThe Europe of Trusts, 1990), the authors detected more radical effects of space, shape and pattern, with associated consequences for interpretative strategies and aesthetic responses. Finally, the article discusses the potential for both mutual support and heuristic challenge between an empirical study of reader response, and a historical-theoretical approach as exemplified by Jerome McGann's interpretation ofPythagorean Silence.
What features of a poem make it captivating, and which cognitive mechanisms are sensitive to these features? We addressed these questions experimentally by measuring pupillary responses of 40 participants who listened to a series of Limericks. The Limericks ended with either a semantic, syntactic, rhyme or metric violation. Compared to a control condition without violations, only the rhyme violation condition induced a reliable pupillary response. An anomaly-rating study on the same stimuli showed that all violations were reliably detectable relative to the control condition, but the anomaly induced by rhyme violations was perceived as most severe. Together, our data suggest that rhyme violations in Limericks may induce an emotional response beyond mere anomaly detection.
Two experiments investigated (1) how activation of manual affordances is triggered by visual and linguistic cues to manipulable objects and (2) whether graspable object parts play a special role in this process. Participants pressed a key to categorize manipulable target objects copresented with manipulable distractor objects on a computer screen. Three factors were varied in Experiment 1: (1) the target's and (2) the distractor's handles' orientation congruency with the lateral manual response and (3) the Visual Focus on one of the objects. In Experiment 2, a linguistic cue factor was added to these three factors-participants heard the name of one of the two objects prior to the target display onset. Analysis of participants' motor and oculomotor behaviour confirmed that perceptual and linguistic cues potentiated activation of grasp affordances. Both target- and distractor-related affordance effects were modulated by the presence of visual and linguistic cues. However, a differential visual attention mechanism subserved activation of compatibility effects associated with target and distractor objects. We also registered an independent implicit attention attraction effect from objects' handles, suggesting that graspable parts automatically attract attention during object viewing. This effect was further amplified by visual but not linguistic cues, thus providing initial evidence for a recent hypothesis about differential roles of visual and linguistic information in potentiating stable and variable affordances (Borghi in Language and action in cognitive neuroscience. Psychology Press, London, 2012).
The current study explored effects of continuous hand motion on the allocation of visual attention. A concurrent paradigm was used to combine visually concealed continuous hand movements with an attentionally demanding letter discrimination task. The letter probe appeared contingent upon the moving right hand passing through one of six positions. Discrimination responses were then collected via a keyboard press with the static left hand. Both the right hand's position and its movement direction systematically contributed to participants' visual sensitivity. Discrimination performance increased substantially when the right hand was distant from, but moving toward the visual probe location (replicating the far-hand effect, Festrnan et al., 2013). However, this effect disappeared when the probe appeared close to the static left hand, supporting the view that static and dynamic features of both hands combine in modulating pragmatic maps of attention.
Previous research on the interaction between manual action and visual perception has focused on discrete movements or static postures and discovered better performance near the hands (the near-hand effect). However, in everyday behaviors, the hands are usually moving continuously between possible targets. Therefore, the current study explored the effects of continuous hand motion on the allocation of visual attention. Eleven healthy adults performed a visual discrimination task during cyclical concealed hand movements underneath a display. Both the current hand position and its movement direction systematically contributed to participants' visual sensitivity. Discrimination performance increased substantially when the hand was distant from but moving toward the visual probe location (a far-hand effect). Implications of this novel observation are discussed.
The literature on spatial associations during number processing is dominated by the SNARC (spatial-numerical association of response codes) effect. We describe spatial biases found for single digits and pairs of numbers, first in the "original" speeded parity task and then extending the scope to encompass different tasks, a range of measures, and various populations. Then we review theoretical accounts before surveying the emerging evidence for similar spatial associations during mental arithmetic. We conclude that the mental number line hypothesis and an embodied approach are useful frameworks for further studies.
Mental arithmetic shows systematic spatial biases. The association between numbers and space is well documented, but it is unknown whether arithmetic operation signs also have spatial associations and whether or not they contribute to spatial biases found in arithmetic. Adult participants classified plus and minus signs with left and right button presses under two counterbalanced response rules. Results from two experiments showed that spatially congruent responses (i.e., right-side responses for the plus sign and left-side responses for the minus sign) were responded to faster than spatially incongruent ones (i.e., left-side responses for the plus sign and right-side responses for the minus sign). We also report correlations between this novel operation sign spatial association (OSSA) effect and other spatial biases in number processing. In a control experiment with no explicit processing requirements for the operation signs there were no sign-related spatial biases. Overall, the results suggest that (a) arithmetic operation signs can evoke spatial associations (OSSA), (b) experience with arithmetic operations probably underlies the OSSA, and (c) the OSSA only partially contributes to spatial biases in arithmetic.
Freely available software has popularized "mousetracking" to study cognitive processing; this involves the on-line recording of cursor positions while participants move a computer mouse to indicate their choice. Movement trajectories of the cursor can then be reconstructed off-line to assess the efficiency of responding in time and across space. Here we focus on the process of selecting among alternative numerical responses. Several studies have recently measured the mathematical mind with cursor movements while people decided about number magnitude or parity, computed sums or differences, or simply located numbers on a number line. After some general methodological considerations about mouse tracking we discuss several conceptual concerns that become particularly evident when "mousing" the mathematical mind.
Removing spatial responses reveals spatial concepts even in a culture with mixed reading habits
(2014)
TEST is a novel taxonomy of knowledge representations based on three distinct hierarchically organized representational features: Tropism, Embodiment, and Situatedness. Tropic representational features reflect constraints of the physical world on the agent's ability to form, reactivate, and enrich embodied (i.e., resulting from the agent's bodily constraints) conceptual representations embedded in situated contexts. The proposed hierarchy entails that representations can, in principle, have tropic features without necessarily having situated and/or embodied features. On the other hand, representations that are situated and/or embodied are likely to be simultaneously tropic. Hence, although we propose tropism as the most general term, the hierarchical relationship between embodiment and situatedness is more on a par, such that the dominance of one component over the other relies on the distinction between offline storage versus online generation as well as on representation-specific properties.
Numerical cognitions such as spatial-numerical associations have been observed to be influenced by grounded, embodied and situated factors. For the case of finger counting, grounded and embodied influences have been reported. However, situated influences, e.g., that reported counting habits change with perception and action within a given situation, have not been systematically examined. To pursue the issue of situatedness of reported finger-counting habits, 458 participants were tested in three separate groups: (1) spontaneous condition: counting with both hands available, (2) perceptual condition: counting with horizontal (left-to-right) perceptual arrangement of fingers (3) perceptual and proprioceptive condition: counting with horizontal (left-to-right) perceptual arrangement of fingers and with busy dominant hand. Report of typical counting habits differed strongly between the three conditions. 28 % reported to start counting with the left hand in the spontaneous counting condition (1), 54 % in the perceptual condition (2) and 62 % in the perceptual and proprioceptive condition (3). Additionally, all participants in the spontaneous counting group showed a symmetry-based counting pattern (with the thumb as number 6), while in the two other groups, a considerable number of participants exhibited a spatially continuous counting pattern (with the pinkie as number 6). Taken together, the study shows that reported finger-counting habits depend on the perceptual and proprioceptive situation and thus are strongly influenced by situated cognition. We suggest that this account reconciles apparently contradictory previous findings of different counting preferences regarding the starting hand in different examination situations.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.
Embodied number processing
(2015)
Finger-based numerical representations have gained increasing research interest. However, their description and assessment often refer to different numerical principles of ordinality, cardinality and 1-to-1 correspondence. Our aim was to investigate similarities and differences between these principles in finger-based numerical representations. Sixty-eight healthy adults performed ordinal finger counting, cardinal finger montring (showing the number of gestures) and finger-to-number mapping with twisted arms and fingers. We found that counting gestures and montring postures were identical for Number 10 but differed to varying degrees for other numbers. Interestingly, there was no systematic relation between finger-to-number mapping and ordinal finger counting habits. These data question the assumption of a unitary embodied finger-based numerical representation, but suggest that different finger-based representations co-exist and can be recruited flexibly depending on the numerical aspects to be conveyed.
1 + 2 is more than 2 + 1: Violations of commutativity and identity axioms in mental arithmetic
(2015)
Over the past decade or so, a large number of studies have revealed that conceptual meaning is sensitive to situational context. More recently, similar contextual influences have been documented in the domain of number knowledge. Here we show such context dependency in a length production task. Adult participants saw single digit addition problems of the form n1 + n2 and produced the sum by changing bi-directionally the length of a horizontally extended line, using radially arranged buttons. We found that longer lines were produced when n1 < n2 compared to n1 > n2 and that unit size increased with result size. Thus, the mathematical axioms of commutativity and identity do not seem to hold in mental addition. We discuss implications of these observations for our understanding of cognitive mechanisms involved in mental arithmetic and for situated cognition generally.
We investigated automatic Spatial-Numerical Association of Response Codes (SNARC) effect in auditory number processing. Two experiments continually measured spatial characteristics of ocular drift at central fixation during and after auditory number presentation. Consistent with the notion of a spatially oriented mental number line, we found spontaneous magnitude-dependent gaze adjustments, both with and without a concurrent saccadic task. This fixation adjustment (1) had a small-number/left-lateralized bias and (2) it was biphasic as it emerged for a short time around the point of lexical access and it received later robust representation around following number onset. This pattern suggests a two-step mechanism of sensorimotor mapping between numbers and space a first-pass bottom-up activation followed by a top-down and more robust horizontal SNARC Our results inform theories of number processing as well as simulation-based approaches to cognition by identifying the characteristics of an oculomotor resonance phenomenon. (C) 2015 Elsevier B.V. All rights reserved.
A large number of experimental findings from neuroscience and experimental psychology demonstrated interactions between spatial cognition and numerical cognition. In particular, many researchers posited a horizontal mental number line, where small numbers are thought of as being to the left of larger numbers. This review synthesizes work on the mental association between space and number, indicating the existence of multiple spatial mappings: recent research has found associations between number and vertical space, as well as associations between number and near/far space. We discuss number space in three dimensions with an eye on potential origins of the different number mappings, and how these number mappings fit in with our current knowledge of brain organization and brain-culture interactions. We derive novel predictions and show how this research fits into a general view of cognition as embodied, grounded and situated. (C) 2015 Elsevier Ltd. All rights reserved.
Number processing evokes spatial biases, both when dealing with single digits and in more complex mental calculations. Here we investigated whether these two biases have a common origin, by examining their flexibility. Participants pointed to the locations of arithmetic results on a visually presented line with an inverted, right-to-left number arrangement. We found directionally opposite spatial biases for mental arithmetic and for a parity task administered both before and after the arithmetic task. We discuss implications of this dissociation in our results for the task-dependent cognitive representation of numbers.
The direction of object enumeration reflects children's enculturation but previous work on the development of such spatial preferences has been inconsistent. Therefore, we documented directional preferences in finger counting, object counting, and picture naming for children (4 groups from 3 to 6 years, N = 104) and adults (N = 56). We found a right-side preference for finger counting in 3- to 6-year-olds and a left-side preference for counting objects and naming pictures by 6 years of age. Children were consistent in their special preferences when comparing object counting and picture naming, but not in other task pairings. Finally, spatial preferences were not related to cardinality comprehension. These results, together with other recent work, suggest a gradual development of spatial-numerical associations from early non-directional mappings into culturally constrained directional mappings.
While the influence of spatial-numerical associations in number categorization tasks has been well established, their role in mental arithmetic is less clear. It has been hypothesized that mental addition leads to rightward and upward shifts of spatial attention (along the "mental number line"), whereas subtraction leads to leftward and downward shifts. We addressed this hypothesis by analyzing spontaneous eye movements during mental arithmetic. Participants solved verbally presented arithmetic problems (e.g., 2 + 7, 8-3) aloud while looking at a blank screen. We found that eye movements reflected spatial biases in the ongoing mental operation: Gaze position shifted more upward when participants solved addition compared to subtraction problems, and the horizontal gaze position was partly determined by the magnitude of the operands. Interestingly, the difference between addition and subtraction trials was driven by the operator (plus vs. minus) but was not influenced by the computational process. Thus, our results do not support the idea of a mental movement toward the solution during arithmetic but indicate a semantic association between operation and space.
Commentary
(2015)