The development of interface technologies is driven by the goal of making interaction more positive through natural action-control mappings.
In Virtual Reality (VR), the entire body is potentially involved for interaction, using such mappings with a maximum of degrees of freedom. The downside is the increase in interaction complexity, which can dramatically influence interface design.
A cognitive perspective on detailed aspects of interaction patterns is lacking in common interface design guidelines, although it can be helpful to make this complexity controllable and, thus, make interaction behavior predictable.
In the present study, the distinction between grounding, embodiment, and situatedness (the GES framework) is applied to organize aspects of interactions and to compare them with each other.
In two experiments, zooming into or out of emotional pictures through changes of arm span was examined in VR. There are qualitatively different aspects during such an interaction: i) perceptual aspects caused by zooming are fundamental for human behavior (Grounding: closer objects appear bigger) and ii) aspects of gestures correspond to the physical characteristics of the agents (Embodiment: little distance of hands signals little or, in contrast, "creating more detail").
The GES-framework sets aspects of Grounding against aspects of Embodiment, thus allowing to predict human behavior regarding these qualitatively different aspects.
For the zooming procedure, the study shows that Grounding can overrule Embodiment in interaction design.
Thus, we propose GES as a cognitive framework that can help to inform interaction guidelines for user interface design in VR.
A crucial question facing cognitive science concerns the nature of conceptual representations as well as the constraints on the interactions between them. One specific question we address in this paper is what makes cross-representational interplay possible? We offer two distinct theoretical scenarios: according to the first scenario, co-activated knowledge representations interact with the help of an interface established between them via congruent activation in a mediating third-party general cognitive mechanism, e.g., attention. According to the second scenario, co-activated knowledge representations interact due to an overlap between their features, for example when they share a magnitude component. First, we make a case for cross representational interplay based on grounded and situated theories of cognition. Second, we discuss interface-based interactions between distinct (i.e., non-overlapping) knowledge representations. Third, we discuss how co-activated representations may share their architecture via partial overlap. Finally, we outline constraints regarding the flexibility of these proposed mechanisms.
Elicitation materials like language portraits are useful to investigate people's perceptions about the languages that they know. This study uses portraits to analyse the underlying conceptualisations people exhibit when reflecting on their language repertoires. Conceptualisations as manifestations of cultural cognition are the purview of cognitive sociolinguistics. The present study advances portrait methodology as it analyses data from structured language portraits of 105 South African youth as a linguistic corpus from both qualitative and quantitative perspectives. The approach enables the uncovering of (a) prominent underlying conceptualisations of African language(s) and the body, and (b) the differences and similarities of these conceptualisations vis-a-vis previous cognitive (socio) linguistic studies of embodied language experiences. In our analysis, African home languages emerged both as 'languages of the heart' linked to cultural identity and as 'languages of the head' linked to cognitive strength and control. Moreover, the notion of 'degrees of proficiency' or 'magnitude' of language knowledge emerged more prominently than in previous studies of embodied language experience.
Idioms in the World
(2019)
Idioms in the World
(2019)
Lean back and relax
(2018)
Frustration is a powerful instigator of anger-based aggression. We hypothesized that the impact of a frustration on anger and aggressive behavior is reduced in a state of feeling relaxed, which is considered incompatible with the experience of anger. Seventy-nine participants received frustrating feedback either when sitting upright or sitting in a reclined position and were then given a chance to act aggressively toward the frustrator. Feelings of anger and relaxation were assessed before and after the frustration. Participants in the reclined position felt more relaxed than those sitting upright, which indirectly predicted less aggressive behavior via lower anger. The results are consistent with theories of incompatible states and embodiment and have implications for using body-related cues to mitigate anger-based aggression.
This essay takes an Anglophone Cultural Studies approach to reflect on the interdependence among as well as the individual (implicit) impact of the elements constituting our (embodied) power structures. These are, e.g., bodily experience/s such as shame and fear, everyday and institutional discourses and practices, but also manifestations of differences and particularities that we transform into phenomena such as “norms”, “binary systems” and “binary organisations”. The analysis of seemingly cyclic “Othering processes” and patterns of violence shows how people who identify as trans*, inter*, or non-binary have to live through and embody epistemological, emotional, and/or physical violence. At the same time, the descriptions illustrate numberless potential forms of resistance and change.
This essay takes an Anglophone Cultural Studies approach to reflect on the interdependence among as well as the individual (implicit) impact of the elements constituting our (embodied) power structures. These are, e.g., bodily experience/s such as shame and fear, everyday and institutional discourses and practices, but also manifestations of differences and particularities that we transform into phenomena such as “norms”, “binary systems” and “binary organisations”. The analysis of seemingly cyclic “Othering processes” and patterns of violence shows how people who identify as trans*, inter*, or non-binary have to live through and embody epistemological, emotional, and/or physical violence. At the same time, the descriptions illustrate numberless potential forms of resistance and change.
Transdualism
(2018)
The author introduces the concept of transdualism to critique dualism without relying on a dualistic model of critique, the modus operandi necessary for a critique against sexual dualism and hetero/cisnormativity. Transdualism offers an opportunity to dwell within that operation by staying below (not beyond) the “dualism,” that is, below the logic of either/or. The essay will explore the notion of “transdualism” through the hexagram Tai of the Yi Jing, which is often used in medical contexts to illustrate the body-of-orifices of Huangdi Neijing or the Inner Canon of the Yellow Emperor. The author reads this body-of-orifices, which is primarily represented by its nine major bodily tunnels, with yinyang philosophy as gender/sex indeterminant and shows that the Inner Canon's yinyang body-of-orifices points to something more transgressive, which could unsettle from within the naturalism of gender and sexual dualism and the nature/culture as well as other dualistic divides that have informed contemporary critical rethinking of embodiment. By unpacking the hexagram Tai alongside Inner Canon's body-of-orifices. as well as contemporary feminist, queer, and transgender theorizations of the body and sexuality, this essay aims at rethinking the materio-discursive complexity of the body-of-orifices, which has been either dualistically separated into antagonisms between man and woman, sex and gender, body and discourse, yin and yang; or one-sidedly reduced to a function of “social construction,” knowable only through language—or problematically lumped together in a gender-is-fluid postmodern “both-and,” which supposedly overcomes the metaphysico-theological “either/or.”
This study is concerned with repair practices that a teacher and students employ to restore intersubjectivity when faced with interactional problems in a Content and Language Integrated Learning (CLIL) classroom. Adopting a conversation analytic (CA) approach, it examines the interactional treatment of students’ verbal and embodied trouble displays in a video-recorded, teacher-fronted geography lesson held in English at a German high school. At the same time, it explores to what extent the repair practices employed are fitted to this specific interactional context. The analysis shows that students’ verbal trouble displays often result in extensive repair sequences, whereas students’ embodied trouble displays are usually met with teacher self-repair in the transition space. In this way, the latter are resolved much earlier and more quickly. The study further reveals practices like reformulation and translation to be especially useful for repairing interactional problems in classrooms in which a foreign language is used as the medium of instruction. The findings may be of interest for prospective as well as practicing teachers in that they provide relevant insights into how interactional trouble can be successfully managed in (CLIL) classroom interaction.