Refine
Language
- English (6)
Is part of the Bibliography
- yes (6)
Keywords
- human-robot interaction (3)
- paralinguistic features (2)
- synthesized voice (2)
- text-to-speech (2)
- uncanny valley (2)
- Buttocks (1)
- Empathy (1)
- Experimental design (1)
- Human– robot intimate relationships (1)
- Human– robot tactile interaction (1)
- Mimicry (1)
- Non-verbal emotion (1)
- Robot Pepper (1)
- Skin conductance (1)
- competence (1)
- dialect (1)
- humanoid (1)
- intentionality (1)
- robot voice (1)
- social robot (1)
- social robots (1)
- trust (1)
- turing test (1)
- verbal reports (1)
Mimicking non-verbal emotional expressions and empathy development in simulated consultations
(2018)
Objective: To explore the feasibility of applying an experimental design to study the relationship between non-verbal emotions and empathy development in simulated consultations.
Method: In video-recorded simulated consultations, twenty clinicians were randomly allocated to either an experimental group (instructed to mimic non-verbal emotions of a simulated patient, SP) or a control group (no such instruction). Baseline empathy scores were obtained before consultation, relational empathy was rated by SP after consultation. Multilevel logistic regression modelled the probability of mimicry occurrence, controlling for baseline empathy and clinical experience. ANCOVA compared group differences on relational empathy and consultation smoothness.
Results: Instructed mimicry lasted longer than spontaneous mimicry. Mimicry was marginally related to improved relational empathy. SP felt being treated more like a whole person during consultations with spontaneous mimicry. Clinicians who displayed spontaneous mimicry felt consultations went more smoothly.
Conclusion: The experimental approach improved our understanding of how non-verbal emotional mimicry contributed to relational empathy development during consultations. Further work should ascertain the potential of instructed mimicry to enhance empathy development.
Practice implications: Understanding how non-verbal emotional mimicry impacts on patients’ perceived clinician empathy during consultations may inform training and intervention programme development.
This study investigated how touching and being touched by a humanoid robot affects human physiology, impressions of the interaction, and attitudes towards humanoid robots. 21 healthy adult participants completed a 3 (touch style: touching, being touched, pointing) x 2 (body part: hand vs buttock) within-subject design using a Pepper robot. Skin conductance response (SCR) was measured during each interaction. Perceived impressions of the interaction (i.e., friendliness, comfort, arousal) were measured per questionnaire after each interaction. Participants' demographics and their attitude towards robots were also considered. We found shorter SCR rise times in the being touched compared to the touching condition, possibly reflecting psychological alertness to the unpredictability of robot-initiated contacts. The hand condition had shorter rise times than the buttock condition. Most participants evaluated the hand condition as most friendly and comfortable and the robot-initiated interactions as most arousing. Interacting with Pepper improved attitudes towards robots. Our findings require future studies with larger samples and improved procedures. They have implications for robot design in all domains involving tactile interactions, such as caring and intimacy.
The Human Takes It All
(2020)
Background: The increasing involvement of social robots in human lives raises the question as to how humans perceive social robots. Little is known about human perception of synthesized voices.
Aim: To investigate which synthesized voice parameters predict the speaker's eeriness and voice likability; to determine if individual listener characteristics (e.g., personality, attitude toward robots, age) influence synthesized voice evaluations; and to explore which paralinguistic features subjectively distinguish humans from robots/artificial agents.
Methods: 95 adults (62 females) listened to randomly presented audio-clips of three categories: synthesized (Watson, IBM), humanoid (robot Sophia, Hanson Robotics), and human voices (five clips/category). Voices were rated on intelligibility, prosody, trustworthiness, confidence, enthusiasm, pleasantness, human-likeness, likability, and naturalness. Speakers were rated on appeal, credibility, human-likeness, and eeriness. Participants' personality traits, attitudes to robots, and demographics were obtained.
Results: The human voice and human speaker characteristics received reliably higher scores on all dimensions except for eeriness. Synthesized voice ratings were positively related to participants' agreeableness and neuroticism. Females rated synthesized voices more positively on most dimensions. Surprisingly, interest in social robots and attitudes toward robots played almost no role in voice evaluation. Contrary to the expectations of an uncanny valley, when the ratings of human-likeness for both the voice and the speaker characteristics were higher, they seemed less eerie to the participants. Moreover, when the speaker's voice was more humanlike, it was more liked by the participants. This latter point was only applicable to one of the synthesized voices. Finally, pleasantness and trustworthiness of the synthesized voice predicted the likability of the speaker's voice. Qualitative content analysis identified intonation, sound, emotion, and imageability/embodiment as diagnostic features.
Discussion: Humans clearly prefer human voices, but manipulating diagnostic speech features might increase acceptance of synthesized voices and thereby support human-robot interaction. There is limited evidence that human-likeness of a voice is negatively linked to the perceived eeriness of the speaker.
The Human Takes It All
(2020)
Background: The increasing involvement of social robots in human lives raises the question as to how humans perceive social robots. Little is known about human perception of synthesized voices.
Aim: To investigate which synthesized voice parameters predict the speaker's eeriness and voice likability; to determine if individual listener characteristics (e.g., personality, attitude toward robots, age) influence synthesized voice evaluations; and to explore which paralinguistic features subjectively distinguish humans from robots/artificial agents.
Methods: 95 adults (62 females) listened to randomly presented audio-clips of three categories: synthesized (Watson, IBM), humanoid (robot Sophia, Hanson Robotics), and human voices (five clips/category). Voices were rated on intelligibility, prosody, trustworthiness, confidence, enthusiasm, pleasantness, human-likeness, likability, and naturalness. Speakers were rated on appeal, credibility, human-likeness, and eeriness. Participants' personality traits, attitudes to robots, and demographics were obtained.
Results: The human voice and human speaker characteristics received reliably higher scores on all dimensions except for eeriness. Synthesized voice ratings were positively related to participants' agreeableness and neuroticism. Females rated synthesized voices more positively on most dimensions. Surprisingly, interest in social robots and attitudes toward robots played almost no role in voice evaluation. Contrary to the expectations of an uncanny valley, when the ratings of human-likeness for both the voice and the speaker characteristics were higher, they seemed less eerie to the participants. Moreover, when the speaker's voice was more humanlike, it was more liked by the participants. This latter point was only applicable to one of the synthesized voices. Finally, pleasantness and trustworthiness of the synthesized voice predicted the likability of the speaker's voice. Qualitative content analysis identified intonation, sound, emotion, and imageability/embodiment as diagnostic features.
Discussion: Humans clearly prefer human voices, but manipulating diagnostic speech features might increase acceptance of synthesized voices and thereby support human-robot interaction. There is limited evidence that human-likeness of a voice is negatively linked to the perceived eeriness of the speaker.
“Ick bin een Berlina”
(2024)
Background: Robots are increasingly used as interaction partners with humans. Social robots are designed to follow expected behavioral norms when engaging with humans and are available with different voices and even accents. Some studies suggest that people prefer robots to speak in the user’s dialect, while others indicate a preference for different dialects.
Methods: Our study examined the impact of the Berlin dialect on perceived trustworthiness and competence of a robot. One hundred and twenty German native speakers (Mage = 32 years, SD = 12 years) watched an online video featuring a NAO robot speaking either in the Berlin dialect or standard German and assessed its trustworthiness and competence.
Results: We found a positive relationship between participants’ self-reported Berlin dialect proficiency and trustworthiness in the dialect-speaking robot. Only when controlled for demographic factors, there was a positive association between participants’ dialect proficiency, dialect performance and their assessment of robot’s competence for the standard German-speaking robot. Participants’ age, gender, length of residency in Berlin, and device used to respond also influenced assessments. Finally, the robot’s competence positively predicted its trustworthiness.
Discussion: Our results inform the design of social robots and emphasize the importance of device control in online experiments.