1
|
Linnunsalo S, Yrttiaho S, Turati C, Quadrelli E, Peltola MJ, Hietanen JK. Infants' psychophysiological responses to eye contact with a human and with a humanoid robot. Biol Psychol 2024:108858. [PMID: 39159718 DOI: 10.1016/j.biopsycho.2024.108858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2024] [Revised: 06/25/2024] [Accepted: 08/15/2024] [Indexed: 08/21/2024]
Abstract
Eye contact with a human and with a humanoid robot elicits attention- and affect-related psychophysiological responses. However, these responses have mostly been studied in adults, leaving their developmental origin poorly understood. In this study, 114 infants (6-8 months old) viewed direct and averted gaze directions of a live human and an embodied humanoid robot while their heart rate deceleration (attention orienting), skin conductance (affective arousal), and facial muscle activity (affective valence) were measured. In addition, a non-humanoid object (a vase) was used as a control stimulus. Infants' attention orienting was stronger to averted versus direct gaze of a human and a robot, but indifferent to the averted versus direct orientation of the non-humanoid object. Moreover, infants' attention orienting was equally intensive toward a human and a robot, but less intensive toward a non-humanoid object. Affective arousal was insensitive to gaze direction and did not differ between the human, the robot, and the non-humanoid object. Facial muscle responses showed sensitivity to the gaze direction of a human and of a robot but not to the orientation of the non-humanoid object. These results suggest that infants recognize the attentional and affective/affiliative significance not only in a human's gaze but also in a robot's gaze.
Collapse
Affiliation(s)
- Samuli Linnunsalo
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland.
| | - Santeri Yrttiaho
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland
| | - Chiara Turati
- Department of Psychology, Università degli Studi di Milano-Bicocca, Milan, Italy
| | - Ermanno Quadrelli
- Department of Psychology, Università degli Studi di Milano-Bicocca, Milan, Italy
| | - Mikko J Peltola
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland
| | - Jari K Hietanen
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland.
| |
Collapse
|
2
|
Chen J, Zhang Y, Wu Y. The impact of differential pricing subject on consumer behavior. BMC Psychol 2024; 12:431. [PMID: 39123225 PMCID: PMC11311943 DOI: 10.1186/s40359-024-01928-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Accepted: 07/26/2024] [Indexed: 08/12/2024] Open
Abstract
The escalating use of artificial intelligence in marketing significantly impacts all aspects of consumer life. This research, grounded in attribution theory and S-O-R theory, employs scenario-based experimental methods to simulate two distinct purchasing contexts. The aim is to investigate consumers' psychological and behavioral responses to AI-initiated pricing. Through SPSS analysis of variance and Bootstrap analysis, the mechanisms of influence of AI-initiated pricing on consumer behavior are tested, revealing the mediating variables of mind perception and consumer perceived ethicality, as well as the mediating variables of perceived enterprise control. Data were collected from Chinese customers to test the model of this study. A total of 841 valid questionnaires were analyzed using ANOVA and Bootstrap analysis with SPSS. The results show that: (1) Consumers exhibit higher repurchase and word-of-mouth recommendation behaviors and lower complaint and switching behaviors for AI-initiated pricing compared to marketers; (2) AI-initiated pricing leads to diminished mind perceptions and augmented ethical perceptions among consumers. Ethical perceptions serve as a complete mediator, while mind perceptions play a less significant mediating role; (3) Perceived enterprise control plays a moderating role in the impact of AI-initiated pricing on consumer behavior. That is, when consumers know that the enterprise can control pricing agents, AI-initiated pricing leads to lower repurchase and word-of-mouth recommendation behaviors, and higher instances of complaining and switching behaviors than humans.
Collapse
Affiliation(s)
- Jinsong Chen
- School of Business Administration, Guizhou University of Finance and Economics, Guiyang, Guizhou, 550025, The People's Republic of China
| | - Yuexin Zhang
- School of Business Administration, Guizhou University of Finance and Economics, Guiyang, Guizhou, 550025, The People's Republic of China.
- School of Culture and Tourism, Chongqing City Management College, Chongqing, 401331, The People's Republic of China.
| | - Yumin Wu
- School of Business Administration, Guizhou University of Finance and Economics, Guiyang, Guizhou, 550025, The People's Republic of China
| |
Collapse
|
3
|
Jacobs OL, Pazhoohi F, Kingstone A. Large language models have divergent effects on self-perceptions of mind and the attributes considered uniquely human. Conscious Cogn 2024; 124:103733. [PMID: 39116598 DOI: 10.1016/j.concog.2024.103733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 07/16/2024] [Accepted: 07/25/2024] [Indexed: 08/10/2024]
Abstract
The rise of powerful Large Language Models (LLMs) provides a compelling opportunity to investigate the consequences of anthropomorphism, particularly regarding how their exposure may influence the way individuals view themselves (self-perception) and other people (other-perception). Using a mind perception framework, we examined attributions of agency (the ability to do) and experience (the ability to feel). Participants evaluated their agentic and experiential capabilities and the extent to which these features are uniquely human before and after exposure to LLM responses. Post-exposure, participants increased evaluations of their agentic and experiential qualities while decreasing their perception that agency and experience are considered to be uniquely human. These results indicate that anthropomorphizing LLMs impacts attributions of mind for humans in fundamentally divergent ways: enhancing the perception of one's own mind while reducing its uniqueness for others. These results open up a range of future questions regarding how anthropomorphism can affect mind perception toward humans.
Collapse
Affiliation(s)
- Oliver L Jacobs
- Department of Psychology, University of British Columbia, Canada.
| | - Farid Pazhoohi
- School of Psychology, University of Plymouth, United Kingdom
| | - Alan Kingstone
- Department of Psychology, University of British Columbia, Canada
| |
Collapse
|
4
|
Valori I, Fan Y, Jung MM, Fairhurst MT. Propensity to trust shapes perceptions of comforting touch between trustworthy human and robot partners. Sci Rep 2024; 14:6747. [PMID: 38514732 PMCID: PMC10957953 DOI: 10.1038/s41598-024-57582-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 03/19/2024] [Indexed: 03/23/2024] Open
Abstract
Touching a friend to comfort or be comforted is a common prosocial behaviour, firmly based in mutual trust. Emphasising the interactive nature of trust and touch, we suggest that vulnerability, reciprocity and individual differences shape trust and perceptions of touch. We further investigate whether these elements also apply to companion robots. Participants (n = 152) were exposed to four comics depicting human-human or human-robot exchanges. Across conditions, one character was sad, the other initiated touch to comfort them, and the touchee reciprocated the touch. Participants first rated trustworthiness of a certain character (human or robot in a vulnerable or comforting role), then evaluated the two touch phases (initiation and reciprocity) in terms of interaction realism, touch appropriateness and pleasantness, affective state (valence and arousal) attributed to the characters. Results support an interactive account of trust and touch, with humans being equally trustworthy when comforting or showing vulnerability, and reciprocity of touch buffering sadness. Although these phenomena seem unique to humans, propensity to trust technology reduces the gap between how humans and robots are perceived. Two distinct trust systems emerge: one for human interactions and another for social technologies, both necessitating trust as a fundamental prerequisite for meaningful physical contact.
Collapse
Affiliation(s)
- Irene Valori
- Chair of Acoustics and Haptics, Technische Universität Dresden, Dresden, Germany.
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Universität Dresden, Dresden, Germany.
| | - Yichen Fan
- Chair of Industrial Design Engineering, Technische Universität Dresden, Dresden, Germany
- 6G-Life, Dresden, Germany
| | - Merel M Jung
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands
| | - Merle T Fairhurst
- Chair of Acoustics and Haptics, Technische Universität Dresden, Dresden, Germany
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Universität Dresden, Dresden, Germany
- 6G-Life, Dresden, Germany
| |
Collapse
|
5
|
Momen A, Hugenberg K, Wiese E. Social perception of robots is shaped by beliefs about their minds. Sci Rep 2024; 14:5459. [PMID: 38443378 PMCID: PMC10914716 DOI: 10.1038/s41598-024-53187-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 01/29/2024] [Indexed: 03/07/2024] Open
Abstract
Roboticists often imbue robots with human-like physical features to increase the likelihood that they are afforded benefits known to be associated with anthropomorphism. Similarly, deepfakes often employ computer-generated human faces to attempt to create convincing simulacra of actual humans. In the present work, we investigate whether perceivers' higher-order beliefs about faces (i.e., whether they represent actual people or android robots) modulate the extent to which perceivers deploy face-typical processing for social stimuli. Past work has shown that perceivers' recognition performance is more impacted by the inversion of faces than objects, thus highlighting that faces are processed holistically (i.e., as Gestalt), whereas objects engage feature-based processing. Here, we use an inversion task to examine whether face-typical processing is attenuated when actual human faces are labeled as non-human (i.e., android robot). This allows us to employ a task shown to be differentially sensitive to social (i.e., faces) and non-social (i.e., objects) stimuli while also randomly assigning face stimuli to seem real or fake. The results show smaller inversion effects when face stimuli were believed to represent android robots compared to when they were believed to represent humans. This suggests that robots strongly resembling humans may still fail to be perceived as "social" due pre-existing beliefs about their mechanistic nature. Theoretical and practical implications of this research are discussed.
Collapse
Affiliation(s)
- Ali Momen
- United States Air Force Academy, Colorado Springs, CO, USA.
- George Mason University, Fairfax, VA, USA.
| | | | - Eva Wiese
- George Mason University, Fairfax, VA, USA.
- Berlin Institute of Technology, Berlin, Germany.
| |
Collapse
|
6
|
Jacobs OL, Pazhoohi F, Kingstone A. Self-discrepancies in mind perception for actual, ideal, and ought selves and partners. PLoS One 2023; 18:e0295515. [PMID: 38091324 PMCID: PMC10718412 DOI: 10.1371/journal.pone.0295515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 11/24/2023] [Indexed: 12/18/2023] Open
Abstract
Defining and measuring self-discrepancies in mind perception between how an individual sees their actual self in comparison to their ideal or ought self has a long but challenging history in psychology. Here we present a new approach for measuring and operationalizing discrepancies of mind by employing the mind perception framework that has been applied successfully to a variety of other psychological constructs. Across two studies (N = 265, N = 205), participants were recruited online to fill in a modified version of the mind perception survey with questions pertaining to three domains (actual, ideal, ought) and two agents (self versus partner). The results revealed that participants idealized and thought they ought to have greater agency (the ability to do) and diminished experience (the ability to feel) for both themselves and their partner. Sex differences were also examined across both studies, and while minor differences emerged, the effects were not robust across the collective evidence from both studies. The overall findings suggest that the mind perception approach can be used to distill a large number of qualities of mind into meaningful facets for interpretation in relation to self-discrepancy theory. This method can breathe new life into the field with future investigations directed at understanding self-discrepancies in relation to prosocial behaviour and psychological well-being.
Collapse
Affiliation(s)
- Oliver L. Jacobs
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada
| | - Farid Pazhoohi
- School of Psychology, University of Plymouth, Plymouth, England, United Kingdom
| | - Alan Kingstone
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
7
|
Parenti L, Belkaid M, Wykowska A. Differences in Social Expectations About Robot Signals and Human Signals. Cogn Sci 2023; 47:e13393. [PMID: 38133602 DOI: 10.1111/cogs.13393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Revised: 11/22/2023] [Accepted: 11/27/2023] [Indexed: 12/23/2023]
Abstract
In our daily lives, we are continually involved in decision-making situations, many of which take place in the context of social interaction. Despite the ubiquity of such situations, there remains a gap in our understanding of how decision-making unfolds in social contexts, and how communicative signals, such as social cues and feedback, impact the choices we make. Interestingly, there is a new social context to which humans are recently increasingly more frequently exposed-social interaction with not only other humans but also artificial agents, such as robots or avatars. Given these new technological developments, it is of great interest to address the question of whether-and in what way-social signals exhibited by non-human agents influence decision-making. The present study aimed to examine whether robot non-verbal communicative behavior has an effect on human decision-making. To this end, we implemented a two-alternative-choice task where participants were to guess which of two presented cups was covering a ball. This game was an adaptation of a "Shell Game." A robot avatar acted as a game partner producing social cues and feedback. We manipulated robot's cues (pointing toward one of the cups) before the participant's decision and the robot's feedback ("thumb up" or no feedback) after the decision. We found that participants were slower (compared to other conditions) when cues were mostly invalid and the robot reacted positively to wins. We argue that this was due to the incongruence of the signals (cue vs. feedback), and thus violation of expectations. In sum, our findings show that incongruence in pre- and post-decision social signals from a robot significantly influences task performance, highlighting the importance of understanding expectations toward social robots for effective human-robot interactions.
Collapse
Affiliation(s)
- Lorenzo Parenti
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia (IIT)
- Department of Psychology, University of Turin
| | - Marwen Belkaid
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia (IIT)
- ETIS UMR 8051, CY Cergy Paris Université, ENSEA, CNRS
| | - Agnieszka Wykowska
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia (IIT)
| |
Collapse
|
8
|
Linnunsalo S, Küster D, Yrttiaho S, Peltola MJ, Hietanen JK. Psychophysiological responses to eye contact with a humanoid robot: Impact of perceived intentionality. Neuropsychologia 2023; 189:108668. [PMID: 37619935 DOI: 10.1016/j.neuropsychologia.2023.108668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 06/20/2023] [Accepted: 08/21/2023] [Indexed: 08/26/2023]
Abstract
Eye contact with a social robot has been shown to elicit similar psychophysiological responses to eye contact with another human. However, it is becoming increasingly clear that the attention- and affect-related psychophysiological responses differentiate between direct (toward the observer) and averted gaze mainly when viewing embodied faces that are capable of social interaction, whereas pictorial or pre-recorded stimuli have no such capability. It has been suggested that genuine eye contact, as indicated by the differential psychophysiological responses to direct and averted gaze, requires a feeling of being watched by another mind. Therefore, we measured event-related potentials (N170 and frontal P300) with EEG, facial electromyography, skin conductance, and heart rate deceleration responses to seeing a humanoid robot's direct versus averted gaze, while manipulating the impression of the robot's intentionality. The results showed that the N170 and the facial zygomatic responses were greater to direct than to averted gaze of the robot, and independent of the robot's intentionality, whereas the frontal P300 responses were more positive to direct than to averted gaze only when the robot appeared intentional. The study provides further evidence that the gaze behavior of a social robot elicits attentional and affective responses and adds that the robot's seemingly autonomous social behavior plays an important role in eliciting higher-level socio-cognitive processing.
Collapse
Affiliation(s)
- Samuli Linnunsalo
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland.
| | - Dennis Küster
- Cognitive Systems Lab, Department of Computer Science, University of Bremen, Bremen, Germany
| | - Santeri Yrttiaho
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland
| | - Mikko J Peltola
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland; Tampere Institute for Advanced Study, Tampere University, Tampere, Finland
| | - Jari K Hietanen
- Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, Tampere, Finland.
| |
Collapse
|
9
|
Abubshait A, Weis PP, Momen A, Wiese E. Perceptual discrimination in the face perception of robots is attenuated compared to humans. Sci Rep 2023; 13:16708. [PMID: 37794045 PMCID: PMC10550918 DOI: 10.1038/s41598-023-42510-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 09/11/2023] [Indexed: 10/06/2023] Open
Abstract
When interacting with groups of robots, we tend to perceive them as a homogenous group where all group members have similar capabilities. This overgeneralization of capabilities is potentially due to a lack of perceptual experience with robots or a lack of motivation to see them as individuals (i.e., individuation). This can undermine trust and performance in human-robot teams. One way to overcome this issue is by designing robots that can be individuated such that each team member can be provided tasks based on its actual skills. In two experiments, we examine if humans can effectively individuate robots: Experiment 1 (n = 225) investigates how individuation performance of robot stimuli compares to that of human stimuli that either belong to a social ingroup or outgroup. Experiment 2 (n = 177) examines to what extent robots' physical human-likeness (high versus low) affects individuation performance. Results show that although humans are able to individuate robots, they seem to individuate them to a lesser extent than both ingroup and outgroup human stimuli (Experiment 1). Furthermore, robots that are physically more humanlike are initially individuated better compared to robots that are physically less humanlike; this effect, however, diminishes over the course of the experiment, suggesting that the individuation of robots can be learned quite quickly (Experiment 2). Whether differences in individuation performance with robot versus human stimuli is primarily due to a reduced perceptual experience with robot stimuli or due to motivational aspects (i.e., robots as potential social outgroup) should be examined in future studies.
Collapse
Affiliation(s)
- Abdulaziz Abubshait
- Italian Institute of Technology, Genoa, Italy.
- George Mason University, Fairfax, VA, USA.
| | - Patrick P Weis
- George Mason University, Fairfax, VA, USA
- Julius Maximilians University, Würzburg, Germany
| | - Ali Momen
- George Mason University, Fairfax, VA, USA
- Air Force Academy, Colorado Springs, CO, USA
| | - Eva Wiese
- George Mason University, Fairfax, VA, USA
- Berlin Institute of Technology, Berlin, Germany
| |
Collapse
|
10
|
Hapuarachchi H, Higashihata K, Sugiura M, Sato A, Itakura S, Kitazaki M. Empathic embarrassment towards non-human agents in virtual environments. Sci Rep 2023; 13:13914. [PMID: 37699941 PMCID: PMC10497614 DOI: 10.1038/s41598-023-41042-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Accepted: 08/21/2023] [Indexed: 09/14/2023] Open
Abstract
Humans feel empathic embarrassment by witnessing others go through embarrassing situations. We examined whether we feel such empathic embarrassment even with robot avatars. Participants observed a human avatar and a robot avatar face a series of embarrassing and non-embarrassing scenarios. We collected data for their empathic embarrassment and the cognitive empathy on a 7-point Likert scale. Both empathic embarrassment and cognitive empathy were significantly higher in the embarrassed condition compared to the non-embarrassed condition with both avatars, and the cognitive empathy was significantly higher with the human avatar. There was a tendency of participants showing a higher level of skin conductance while watching the human avatar go through embarrassing situations compared to the robot avatar. A following experiment showed that the average plausibility of the embarrassed condition was significantly higher with the human avatar compared to the robot avatar. However, plausibility scores for emotion were not significantly different among the conditions. These results suggest that humans can feel empathic embarrassment as well as cognitive empathy for robot avatars while cognitive empathy for robot avatars is comparatively lower, and that part of the empathic difference between human and robot avatars might be due to the difference of their plausibility.
Collapse
Affiliation(s)
- Harin Hapuarachchi
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan.
| | - Kento Higashihata
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan
| | - Maruta Sugiura
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan
| | - Atsushi Sato
- Faculty of Humanities, University of Toyama, Toyama, Japan
| | - Shoji Itakura
- Center for Baby Science, Doshisha University, Kyoto, Japan
| | - Michiteru Kitazaki
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan.
| |
Collapse
|
11
|
Longin L, Bahrami B, Deroy O. Intelligence brings responsibility - Even smart AI assistants are held responsible. iScience 2023; 26:107494. [PMID: 37609629 PMCID: PMC10440553 DOI: 10.1016/j.isci.2023.107494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 06/07/2023] [Accepted: 07/22/2023] [Indexed: 08/24/2023] Open
Abstract
People will not hold cars responsible for traffic accidents, yet they do when artificial intelligence (AI) is involved. AI systems are held responsible when they act or merely advise a human agent. Does this mean that as soon as AI is involved responsibility follows? To find out, we examined whether purely instrumental AI systems stay clear of responsibility. We compared AI-powered with non-AI-powered car warning systems and measured their responsibility rating alongside their human users. Our findings show that responsibility is shared when the warning system is powered by AI but not by a purely mechanical system, even though people consider both systems as mere tools. Surprisingly, whether the warning prevents the accident introduces an outcome bias: the AI takes higher credit than blame depending on what the human manages or fails to do.
Collapse
Affiliation(s)
- Louis Longin
- Faculty of Philosophy, Philosophy of Science and the Study of Religion, LMU Munich, Geschwister-Scholl-Platz 1, 80539 Munich, Germany
| | - Bahador Bahrami
- Crowd Cognition Group, Department of General Psychology and Education, LMU-Munich, Gabelsbergerstraße 62, 80333 Munich, Germany
| | - Ophelia Deroy
- Faculty of Philosophy, Philosophy of Science and the Study of Religion, LMU Munich, Geschwister-Scholl-Platz 1, 80539 Munich, Germany
- Munich Centre for Neurosciences-Brain & Mind, Großhaderner Str. 2, 82152 Munich, Germany
- Institute of Philosophy, School of Advanced Study, University of London, Senate House, Malet Street, London WC1E 7HU, UK
| |
Collapse
|
12
|
Ehrlich SK, Dean-Leon E, Tacca N, Armleder S, Dimova-Edeleva V, Cheng G. Human-robot collaborative task planning using anticipatory brain responses. PLoS One 2023; 18:e0287958. [PMID: 37432954 DOI: 10.1371/journal.pone.0287958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Accepted: 06/19/2023] [Indexed: 07/13/2023] Open
Abstract
Human-robot interaction (HRI) describes scenarios in which both human and robot work as partners, sharing the same environment or complementing each other on a joint task. HRI is characterized by the need for high adaptability and flexibility of robotic systems toward their human interaction partners. One of the major challenges in HRI is task planning with dynamic subtask assignment, which is particularly challenging when subtask choices of the human are not readily accessible by the robot. In the present work, we explore the feasibility of using electroencephalogram (EEG) based neuro-cognitive measures for online robot learning of dynamic subtask assignment. To this end, we demonstrate in an experimental human subject study, featuring a joint HRI task with a UR10 robotic manipulator, the presence of EEG measures indicative of a human partner anticipating a takeover situation from human to robot or vice-versa. The present work further proposes a reinforcement learning based algorithm employing these measures as a neuronal feedback signal from the human to the robot for dynamic learning of subtask-assignment. The efficacy of this algorithm is validated in a simulation-based study. The simulation results reveal that even with relatively low decoding accuracies, successful robot learning of subtask-assignment is feasible, with around 80% choice accuracy among four subtasks within 17 minutes of collaboration. The simulation results further reveal that scalability to more subtasks is feasible and mainly accompanied with longer robot learning times. These findings demonstrate the usability of EEG-based neuro-cognitive measures to mediate the complex and largely unsolved problem of human-robot collaborative task planning.
Collapse
Affiliation(s)
- Stefan K Ehrlich
- Chair for Cognitive Systems, Department of Electrical Engineering, TUM School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
| | - Emmanuel Dean-Leon
- Department of Electrical Engineering, Automation, Chalmers University of Technology, Göteborg, Sweden
| | - Nicholas Tacca
- Battelle Memorial Institute, Columbus, OH, United States of America
| | - Simon Armleder
- Chair for Cognitive Systems, Department of Electrical Engineering, TUM School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
| | - Viktorija Dimova-Edeleva
- MIRMI - Munich Institute of Robotics and Machine Intelligence, formerly MSRM, Technical University of Munich, Munich, Germany
| | - Gordon Cheng
- Chair for Cognitive Systems, Department of Electrical Engineering, TUM School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
- Center of Competence NeuroEngineering, Technical University of Munich, München, Germany
| |
Collapse
|
13
|
Vuong QH, La VP, Nguyen MH, Jin R, La MK, Le TT. How AI's Self-Prolongation Influences People's Perceptions of Its Autonomous Mind: The Case of U.S. Residents. Behav Sci (Basel) 2023; 13:470. [PMID: 37366721 DOI: 10.3390/bs13060470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Revised: 05/25/2023] [Accepted: 06/02/2023] [Indexed: 06/28/2023] Open
Abstract
The expanding integration of artificial intelligence (AI) in various aspects of society makes the infosphere around us increasingly complex. Humanity already faces many obstacles trying to have a better understanding of our own minds, but now we have to continue finding ways to make sense of the minds of AI. The issue of AI's capability to have independent thinking is of special attention. When dealing with such an unfamiliar concept, people may rely on existing human properties, such as survival desire, to make assessments. Employing information-processing-based Bayesian Mindsponge Framework (BMF) analytics on a dataset of 266 residents in the United States, we found that the more people believe that an AI agent seeks continued functioning, the more they believe in that AI agent's capability of having a mind of its own. Moreover, we also found that the above association becomes stronger if a person is more familiar with personally interacting with AI. This suggests a directional pattern of value reinforcement in perceptions of AI. As the information processing of AI becomes even more sophisticated in the future, it will be much harder to set clear boundaries about what it means to have an autonomous mind.
Collapse
Affiliation(s)
- Quan-Hoang Vuong
- Centre for Interdisciplinary Social Research, Phenikaa University, Yen Nghia Ward, Ha Dong District, Hanoi 100803, Vietnam
| | - Viet-Phuong La
- Centre for Interdisciplinary Social Research, Phenikaa University, Yen Nghia Ward, Ha Dong District, Hanoi 100803, Vietnam
- A.I. for Social Data Lab (AISDL), Vuong & Associates, Hanoi 100000, Vietnam
| | - Minh-Hoang Nguyen
- Centre for Interdisciplinary Social Research, Phenikaa University, Yen Nghia Ward, Ha Dong District, Hanoi 100803, Vietnam
| | - Ruining Jin
- Civil, Commercial and Economic Law School, China University of Political Science and Law, Beijing 100088, China
| | - Minh-Khanh La
- School of Electrical and Electronic Engineering, Hanoi University of Science and Technology, Hanoi 100000, Vietnam
| | - Tam-Tri Le
- Centre for Interdisciplinary Social Research, Phenikaa University, Yen Nghia Ward, Ha Dong District, Hanoi 100803, Vietnam
| |
Collapse
|
14
|
Sarigul B, Urgen BA. Audio–Visual Predictive Processing in the Perception of Humans and Robots. Int J Soc Robot 2023. [DOI: 10.1007/s12369-023-00990-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/09/2023]
Abstract
AbstractRecent work in cognitive science suggests that our expectations affect visual perception. With the rise of artificial agents in human life in the last few decades, one important question is whether our expectations about non-human agents such as humanoid robots affect how we perceive them. In the present study, we addressed this question in an audio–visual context. Participants reported whether a voice embedded in a noise belonged to a human or a robot. Prior to this judgment, they were presented with a human or a robot image that served as a cue and allowed them to form an expectation about the category of the voice that would follow. This cue was either congruent or incongruent with the category of the voice. Our results show that participants were faster and more accurate when the auditory target was preceded by a congruent cue than an incongruent cue. This was true regardless of the human-likeness of the robot. Overall, these results suggest that our expectations affect how we perceive non-human agents and shed light on future work in robot design.
Collapse
|
15
|
Roesler E, Heuring M, Onnasch L. (Hu)man-Like Robots: The Impact of Anthropomorphism and Language on Perceived Robot Gender. Int J Soc Robot 2023:1-12. [PMID: 37359431 PMCID: PMC10027596 DOI: 10.1007/s12369-023-00975-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/07/2023] [Indexed: 03/23/2023]
Abstract
Implementing anthropomorphic features to robots is a frequently used approach to create positive perceptions in human-robot interaction. However, anthropomorphism does not always lead to positive consequences and might trigger a more gendered perception of robots. More precisely, anthropomorphic features of robots seem to evoke a male-robot bias. Yet, it is unclear if this bias is induced via a male appearance of higher anthropomorphic robots, a general male-technology bias, or even due to language aspects. As the word robot is differently grammatically gendered in different languages, this might be associated with the representation of robot gender. To target these open questions, we investigated how the degree of anthropomorphism and the way the word robot is gendered in different languages, as well as within one language influence the perceived gender of the robot. We therefore conducted two online-studies in which participants were presented with pictures of differently anthropomorphic robots. The first study investigated two different samples from which one was conducted in German, as grammatically-gendered language, and one in English as natural gender language. We did not find significant differences between both languages. Robots with a higher degree of anthropomorphism were perceived as significantly more male than neutral or female. The second study investigated the effect of grammatically-gendered descriptions (feminine, masculine, neuter) on the perception of robots. This study revealed that masculine grammatical gender tends to reinforce a male ascription of gender-neutral robots. The results suggest that the male-robot bias found in previous studies seems to be associated with appearance of most anthropomorphic robots, and the grammatical gender the robot is referenced by.
Collapse
Affiliation(s)
- Eileen Roesler
- Department of Psychology and Ergonomics, Technische Universität Berlin, Marchstr. 12, 10587 Berlin, Germany
| | - Maris Heuring
- Department of Psychology and Ergonomics, Technische Universität Berlin, Marchstr. 12, 10587 Berlin, Germany
| | - Linda Onnasch
- Department of Psychology and Ergonomics, Technische Universität Berlin, Marchstr. 12, 10587 Berlin, Germany
| |
Collapse
|
16
|
Sahaï A, Caspar E, De Beir A, Grynszpan O, Pacherie E, Berberian B. Modulations of one's sense of agency during human-machine interactions: A behavioural study using a full humanoid robot. Q J Exp Psychol (Hove) 2023; 76:606-620. [PMID: 35400221 DOI: 10.1177/17470218221095841] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Although previous investigations reported a reduced sense of agency when individuals act with traditional machines, little is known about the mechanisms underpinning interactions with human-like automata. The aim of this study was twofold: (1) to investigate the effect of the machine's physical appearance on the individuals' sense of agency and (2) to explore the cognitive mechanisms underlying the individuals' sense of agency when they are engaged in a joint task. Twenty-eight participants performed a joint Simon task together with another human or an automated artificial system as a co-agent. The physical appearance of the automated artificial system was manipulated so that participants could cooperate either with a servomotor or a full humanoid robot during the joint task. Both participants' response times and temporal estimations of action-output delays (i.e., an implicit measure of agency) were collected. Results showed that participants' sense of agency for self- and other-generated actions sharply declined during interactions with the servomotor compared with the human-human interactions. Interestingly, participants' sense of agency for self- and other-generated actions was reinforced when participants interacted with the humanoid robot compared with the servomotor. These results are discussed further.
Collapse
Affiliation(s)
- Aïsha Sahaï
- Département d'Etudes Cognitives, ENS, EHESS, CNRS, PSL Research University, Institut Jean-Nicod, Paris, France.,Département Traitement de l'Information et Systèmes, ONERA, The French Aerospace Lab, Salon-de-Provence, France
| | - Emilie Caspar
- Department of Experimental Psychology, Social & Moral Brain Lab, Ghent University, Ghent, Belgium
| | - Albert De Beir
- Robotics & Multibody Mechanics Research Group, Vrij Universiteit Brussel (VUB), Bruxelles, Belgium
| | - Ouriel Grynszpan
- Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur, LIMSI-CNRS, Université Paris-Sud, Orsay, France
| | - Elisabeth Pacherie
- Département d'Etudes Cognitives, ENS, EHESS, CNRS, PSL Research University, Institut Jean-Nicod, Paris, France
| | - Bruno Berberian
- Département Traitement de l'Information et Systèmes, ONERA, The French Aerospace Lab, Salon-de-Provence, France
| |
Collapse
|
17
|
Attitudinal Tensions in the Joint Pursuit of Explainable and Trusted AI. Minds Mach (Dordr) 2023. [DOI: 10.1007/s11023-023-09628-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2023]
|
18
|
Vouloutsi V, Cominelli L, Dogar M, Lepora N, Zito C, Martinez-Hernandez U. Towards Living Machines: current and future trends of tactile sensing, grasping, and social robotics. BIOINSPIRATION & BIOMIMETICS 2023; 18:025002. [PMID: 36720166 DOI: 10.1088/1748-3190/acb7b9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 01/31/2023] [Indexed: 06/18/2023]
Abstract
The development of future technologies can be highly influenced by our deeper understanding of the principles that underlie living organisms. The Living Machines conference aims at presenting (among others) the interdisciplinary work of behaving systems based on such principles. Celebrating the 10 years of the conference, we present the progress and future challenges of some of the key themes presented in the robotics workshop of the Living Machines conference. More specifically, in this perspective paper, we focus on the advances in the field of biomimetics and robotics for the creation of artificial systems that can robustly interact with their environment, ranging from tactile sensing, grasping, and manipulation to the creation of psychologically plausible agents.
Collapse
Affiliation(s)
| | | | - Mehmet Dogar
- University of Leeds, School of Computing, Leeds LS2 9JT, United Kingdom
| | - Nathan Lepora
- Department of Engineering Mathematics, Faculty of Engineering, University of Bristol and Bristol Robotics Laboratory, Bristol, United Kingdom
| | - Claudio Zito
- Technology Innovation Institute (TII), Abu Dhabi, United Arab Emirates
| | - Uriel Martinez-Hernandez
- Department of Electronic and Electrical Engineering, Faculty of Engineering and Design, University of Bath, Bath, United Kingdom
| |
Collapse
|
19
|
Smiles and Angry Faces vs. Nods and Head Shakes: Facial Expressions at the Service of Autonomous Vehicles. MULTIMODAL TECHNOLOGIES AND INTERACTION 2023. [DOI: 10.3390/mti7020010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
When deciding whether to cross the street or not, pedestrians take into consideration information provided by both vehicle kinematics and the driver of an approaching vehicle. It will not be long, however, before drivers of autonomous vehicles (AVs) will be unable to communicate their intention to pedestrians, as they will be engaged in activities unrelated to driving. External human–machine interfaces (eHMIs) have been developed to fill the communication gap that will result by offering information to pedestrians about the situational awareness and intention of an AV. Several anthropomorphic eHMI concepts have employed facial expressions to communicate vehicle intention. The aim of the present study was to evaluate the efficiency of emotional (smile; angry expression) and conversational (nod; head shake) facial expressions in communicating vehicle intention (yielding; non-yielding). Participants completed a crossing intention task where they were tasked with deciding appropriately whether to cross the street or not. Emotional expressions communicated vehicle intention more efficiently than conversational expressions, as evidenced by the lower latency in the emotional expression condition compared to the conversational expression condition. The implications of our findings for the development of anthropomorphic eHMIs that employ facial expressions to communicate vehicle intention are discussed.
Collapse
|
20
|
Zonca J, Folsø A, Sciutti A. Social Influence Under Uncertainty in Interaction with Peers, Robots and Computers. Int J Soc Robot 2023. [DOI: 10.1007/s12369-022-00959-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
AbstractTaking advice from others requires confidence in their competence. This is important for interaction with peers, but also for collaboration with social robots and artificial agents. Nonetheless, we do not always have access to information about others’ competence or performance. In these uncertain environments, do our prior beliefs about the nature and the competence of our interacting partners modulate our willingness to rely on their judgments? In a joint perceptual decision making task, participants made perceptual judgments and observed the simulated estimates of either a human participant, a social humanoid robot or a computer. Then they could modify their estimates based on this feedback. Results show participants’ belief about the nature of their partner biased their compliance with its judgments: participants were more influenced by the social robot than human and computer partners. This difference emerged strongly at the very beginning of the task and decreased with repeated exposure to empirical feedback on the partner’s responses, disclosing the role of prior beliefs in social influence under uncertainty. Furthermore, the results of our functional task suggest an important difference between human–human and human–robot interaction in the absence of overt socially relevant signal from the partner: the former is modulated by social normative mechanisms, whereas the latter is guided by purely informational mechanisms linked to the perceived competence of the partner.
Collapse
|
21
|
Wilson A, Stefanik C, Shank DB. How do people judge the immorality of artificial intelligence versus humans committing moral wrongs in real-world situations? COMPUTERS IN HUMAN BEHAVIOR REPORTS 2022. [DOI: 10.1016/j.chbr.2022.100229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
|
22
|
Dino MJS, Davidson PM, Dion KW, Szanton SL, Ong IL. Nursing and human-computer interaction in healthcare robots for older people: An integrative review. INTERNATIONAL JOURNAL OF NURSING STUDIES ADVANCES 2022; 4:100072. [PMID: 38745638 PMCID: PMC11080351 DOI: 10.1016/j.ijnsa.2022.100072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 03/01/2022] [Accepted: 03/02/2022] [Indexed: 10/18/2022] Open
Abstract
Objectives This study examined the published works related to healthcare robotics for older people using the attributes of health, nursing, and the human-computer interaction framework. Design An integrative literature review. Methods A search strategy captured 55 eligible articles from databases (CINAHL, Embase, IEEE Xplore, and PubMed) and hand-searching approaches. Bibliometric and content analyses grounded on the health and nursing attributes and human-computer interaction framework were performed using MAXQDA. Finally, results were verified using critical friend feedback by a second reviewer. Results Most articles were from multiple authorship, published in non-nursing journals, and originating from developed economies. They primarily focused on applying healthcare robots in practice settings, physical health, and communication tasks. Using the human-computer interaction framework, it was found that older adults frequently served as the primary users while nurses, healthcare providers, and researchers functioned as secondary users and operators. Research articles focused on the usability, functionality, and acceptability of robotic systems. At the same time, theoretical papers explored the frameworks and the value of empathy and emotion in robots, human-computer interaction and nursing models and theories supporting healthcare practice, and gerontechnology. Current robotic systems are less anthropomorphic, operated through real-time direct and supervisory inputs, and mainly equipped with visual and auditory sensors and actuators with limited capability in performing health assessments. Conclusion Results communicate the need for technological competency among nurses, advancements in increasing healthcare robot humanness, and the importance of conscientious efforts from an interdisciplinary research team in improving robotic system usability and utility for the care of older adults.
Collapse
Affiliation(s)
- Michael Joseph S. Dino
- School of Nursing, Johns Hopkins University, 525 N Wolfe St, Baltimore, MD 21205, USA
- Our Lady of Fatima University, 120 McArthur Highway, Marulas, Valenzuela City 1440, Philippines
| | - Patricia M. Davidson
- School of Nursing, Johns Hopkins University, 525 N Wolfe St, Baltimore, MD 21205, USA
- University of Wollongong, The Vice-Chancellor's Unit Building 36, University of Wollongong, NSW 2522, Australia
| | - Kenneth W. Dion
- School of Nursing, Johns Hopkins University, 525 N Wolfe St, Baltimore, MD 21205, USA
| | - Sarah L. Szanton
- School of Nursing, Johns Hopkins University, 525 N Wolfe St, Baltimore, MD 21205, USA
| | - Irvin L. Ong
- School of Nursing, Johns Hopkins University, 525 N Wolfe St, Baltimore, MD 21205, USA
- Our Lady of Fatima University, 120 McArthur Highway, Marulas, Valenzuela City 1440, Philippines
| |
Collapse
|
23
|
Hogenhuis A, Hortensius R. Domain-specific and domain-general neural network engagement during human-robot interactions. Eur J Neurosci 2022; 56:5902-5916. [PMID: 36111622 PMCID: PMC9828180 DOI: 10.1111/ejn.15823] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 08/03/2022] [Indexed: 01/12/2023]
Abstract
To what extent do domain-general and domain-specific neural network engagement generalize across interactions with human and artificial agents? In this exploratory study, we analysed a publicly available functional MRI (fMRI) data set (n = 22) to probe the similarities and dissimilarities in neural architecture while participants conversed with another person or a robot. Incorporating trial-by-trial dynamics of the interactions, listening and speaking, we used whole-brain, region-of-interest and functional connectivity analyses to test response profiles within and across social or non-social, domain-specific and domain-general networks, that is, the person perception, theory-of-mind, object-specific, language and multiple-demand networks. Listening to a robot compared to a human resulted in higher activation in the language network, especially in areas associated with listening comprehension, and in the person perception network. No differences in activity of the theory-of-mind network were found. Results from the functional connectivity analysis showed no difference between interactions with a human or robot in within- and between-network connectivity. Together, these results suggest that although largely similar regions are activated when speaking to a human and to a robot, activity profiles during listening point to a dissociation at a lower level or perceptual level, but not higher order cognitive level.
Collapse
Affiliation(s)
- Ann Hogenhuis
- Liberal Arts and SciencesUtrecht UniversityUtrechtThe Netherlands
| | - Ruud Hortensius
- Department of PsychologyUtrecht UniversityUtrechtThe Netherlands
| |
Collapse
|
24
|
Momen A, Hugenberg K, Wiese E. Robots engage face-processing less strongly than humans. FRONTIERS IN NEUROERGONOMICS 2022; 3:959578. [PMID: 38235446 PMCID: PMC10790943 DOI: 10.3389/fnrgo.2022.959578] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 09/20/2022] [Indexed: 01/19/2024]
Abstract
Robot faces often differ from human faces in terms of their facial features (e.g., lack of eyebrows) and spatial relationships between these features (e.g., disproportionately large eyes), which can influence the degree to which social brain [i.e., Fusiform Face Area (FFA), Superior Temporal Sulcus (STS); Haxby et al., 2000] areas process them as social individuals that can be discriminated from other agents in terms of their perceptual features and person attributes. Of interest in this work is whether robot stimuli are processed in a less social manner than human stimuli. If true, this could undermine human-robot interactions (HRIs) because human partners could potentially fail to perceive robots as individual agents with unique features and capabilities-a phenomenon known as outgroup homogeneity-potentially leading to miscalibration of trust and errors in allocation of task responsibilities. In this experiment, we use the face inversion paradigm (as a proxy for neural activation in social brain areas) to examine whether face processing differs between human and robot face stimuli: if robot faces are perceived as less face-like than human-faces, the difference in recognition performance for faces presented upright compared to upside down (i.e., inversion effect) should be less pronounced for robot faces than human faces. The results demonstrate a reduced face inversion effect with robot vs. human faces, supporting the hypothesis that robot faces are processed in a less face-like manner. This suggests that roboticists should attend carefully to the design of robot faces and evaluate them based on their ability to engage face-typical processes. Specific design recommendations on how to accomplish this goal are provided in the discussion.
Collapse
Affiliation(s)
- Ali Momen
- Warfighter Effectiveness Research Center, United States Air Force Academy, Colorado Springs, CO, United States
- Department of Psychology, George Mason University, Fairfax, VA, United States
| | - Kurt Hugenberg
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, United States
| | - Eva Wiese
- Department of Psychology, George Mason University, Fairfax, VA, United States
- Institute for Psychology and Ergonomics, Technical University of Berlin, Berlin, Germany
| |
Collapse
|
25
|
Ghost on the Windshield: Employing a Virtual Human Character to Communicate Pedestrian Acknowledgement and Vehicle Intention. INFORMATION 2022. [DOI: 10.3390/info13090420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Pedestrians base their street-crossing decisions on vehicle-centric as well as driver-centric cues. In the future, however, drivers of autonomous vehicles will be preoccupied with non-driving related activities and will thus be unable to provide pedestrians with relevant communicative cues. External human–machine interfaces (eHMIs) hold promise for filling the expected communication gap by providing information about a vehicle’s situational awareness and intention. In this paper, we present an eHMI concept that employs a virtual human character (VHC) to communicate pedestrian acknowledgement and vehicle intention (non-yielding; cruising; yielding). Pedestrian acknowledgement is communicated via gaze direction while vehicle intention is communicated via facial expression. The effectiveness of the proposed anthropomorphic eHMI concept was evaluated in the context of a monitor-based laboratory experiment where the participants performed a crossing intention task (self-paced, two-alternative forced choice) and their accuracy in making appropriate street-crossing decisions was measured. In each trial, they were first presented with a 3D animated sequence of a VHC (male; female) that either looked directly at them or clearly to their right while producing either an emotional (smile; angry expression; surprised expression), a conversational (nod; head shake), or a neutral (neutral expression; cheek puff) facial expression. Then, the participants were asked to imagine they were pedestrians intending to cross a one-way street at a random uncontrolled location when they saw an autonomous vehicle equipped with the eHMI approaching from the right and indicate via mouse click whether they would cross the street in front of the oncoming vehicle or not. An implementation of the proposed concept where non-yielding intention is communicated via the VHC producing either an angry expression, a surprised expression, or a head shake; cruising intention is communicated via the VHC puffing its cheeks; and yielding intention is communicated via the VHC nodding, was shown to be highly effective in ensuring the safety of a single pedestrian or even two co-located pedestrians without compromising traffic flow in either case. The implications for the development of intuitive, culture-transcending eHMIs that can support multiple pedestrians in parallel are discussed.
Collapse
|
26
|
Spatola N, Chaminade T. Precuneus brain response changes differently during human-robot and human-human dyadic social interaction. Sci Rep 2022; 12:14794. [PMID: 36042357 PMCID: PMC9427745 DOI: 10.1038/s41598-022-14207-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 06/02/2022] [Indexed: 11/12/2022] Open
Abstract
Human–human interactions (HHI) and human–robot interactions (HRI) are compared to identify differences between cognitive processes reflecting bonding in social interactions with natural and artificial agents. We capitalize on a unique corpus of neuroimaging data (fMRI) recorded while participants freely discussed with another human or a conversational robotic head, in order to study a crucial parameter of human social cognition, namely that social interactions are adaptive bidirectional processes that evolve over time. We used linear statistics to identify regions of the brain where activity changes differently when participants carry out twelve one-minute conversations, alternating between a human and a robotic interlocutor. Results show that activity in the posterior cingulate cortex, a key region associated with social cognition, increases over time in HHI but not in HRI. These results are interpreted as reflecting a process of strengthening social bonding during repeated exchanges when the interacting agent is a human, but not a robot.
Collapse
Affiliation(s)
| | - Thierry Chaminade
- Institut de Neurosciences de La Timone, UMR 7289, Aix-Marseille Université-CNRS, Marseille, France.
| |
Collapse
|
27
|
Hortensius R, Chaudhury B, Hoffmann M, Cross E. Tracking human interactions with a commercially-available robot over multiple days. OPEN RESEARCH EUROPE 2022; 2:97. [PMID: 37645308 PMCID: PMC10445930 DOI: 10.12688/openreseurope.14824.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 07/25/2022] [Indexed: 07/19/2023]
Abstract
Background: As research examining human-robot interaction moves from the laboratory to the real world, studies seeking to examine how people interact with robots face the question of which robotic platform to employ to collect data in situ. To facilitate the study of a broad range of individuals, from children to clinical populations, across diverse environments, from homes to schools, a robust, reproducible, low-cost and easy-to-use robotic platform is needed. Methods: We describe how a commercially available off-the-shelf robot, Cozmo, can be used to study embodied human-robot interactions in a wide variety of settings, including the user's home. We describe the steps required to use this affordable and flexible platform for longitudinal human-robot interaction studies. First, we outline the technical specifications and requirements of this platform and accessories. We then show how log files containing detailed data on the human-robot interaction can be collected and extracted. Finally, we detail the types of information that can be retrieved from these data. Results: We present findings from a validation that mapped the behavioural repertoire of the Cozmo robot and introduce an accompanying interactive emotion classification tool to use with this robot. This tool combined with the data extracted from the log files can provide the necessary details to understand the psychological consequences of long-term interactions. Conclusions: This low-cost robotic platform has the potential to provide the field with a variety of valuable new possibilities to study the social cognitive processes underlying human-robot interactions within and beyond the research laboratory, which are user-driven and unconstrained in both time and place.
Collapse
Affiliation(s)
- Ruud Hortensius
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
- Department of Psychology, Utrecht University, Utrecht, The Netherlands
| | - Bishakha Chaudhury
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Martin Hoffmann
- Department of Computer Science, Humboldt University Berlin, Berlin, Germany
| | - Emily Cross
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
- Department of Cognitive Science, Macquarie University, Sydney, Australia
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia
| |
Collapse
|
28
|
Abubshait A, Parenti L, Perez-Osorio J, Wykowska A. Misleading Robot Signals in a Classification Task Induce Cognitive Load as Measured by Theta Synchronization Between Frontal and Temporo-parietal Brain Regions. FRONTIERS IN NEUROERGONOMICS 2022; 3:838136. [PMID: 38235447 PMCID: PMC10790903 DOI: 10.3389/fnrgo.2022.838136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 06/01/2022] [Indexed: 01/19/2024]
Abstract
As technological advances progress, we find ourselves in situations where we need to collaborate with artificial agents (e.g., robots, autonomous machines and virtual agents). For example, autonomous machines will be part of search and rescue missions, space exploration and decision aids during monitoring tasks (e.g., baggage-screening at the airport). Efficient communication in these scenarios would be crucial to interact fluently. While studies examined the positive and engaging effect of social signals (i.e., gaze communication) on human-robot interaction, little is known about the effects of conflicting robot signals on the human actor's cognitive load. Moreover, it is unclear from a social neuroergonomics perspective how different brain regions synchronize or communicate with one another to deal with the cognitive load induced by conflicting signals in social situations with robots. The present study asked if neural oscillations that correlate with conflict processing are observed between brain regions when participants view conflicting robot signals. Participants classified different objects based on their color after a robot (i.e., iCub), presented on a screen, simulated handing over the object to them. The robot proceeded to cue participants (with a head shift) to the correct or incorrect target location. Since prior work has shown that unexpected cues can interfere with oculomotor planning and induces conflict, we expected that conflicting robot social signals which would interfere with the execution of actions. Indeed, we found that conflicting social signals elicited neural correlates of cognitive conflict as measured by mid-brain theta oscillations. More importantly, we found higher coherence values between mid-frontal electrode locations and posterior occipital electrode locations in the theta-frequency band for incongruent vs. congruent cues, which suggests that theta-band synchronization between these two regions allows for communication between cognitive control systems and gaze-related attentional mechanisms. We also find correlations between coherence values and behavioral performance (Reaction Times), which are moderated by the congruency of the robot signal. In sum, the influence of irrelevant social signals during goal-oriented tasks can be indexed by behavioral, neural oscillation and brain connectivity patterns. These data provide insights about a new measure for cognitive load, which can also be used in predicting human interaction with autonomous machines.
Collapse
Affiliation(s)
- Abdulaziz Abubshait
- Social Cognition in Human Robot Interaction (S4HRI), Italian Institute of Technology, Genova, Italy
| | - Lorenzo Parenti
- Social Cognition in Human Robot Interaction (S4HRI), Italian Institute of Technology, Genova, Italy
- Department of Psychology, University of Torino, Turin, Italy
| | - Jairo Perez-Osorio
- Social Cognition in Human Robot Interaction (S4HRI), Italian Institute of Technology, Genova, Italy
| | - Agnieszka Wykowska
- Social Cognition in Human Robot Interaction (S4HRI), Italian Institute of Technology, Genova, Italy
| |
Collapse
|
29
|
Kuznetsova YM. Emotional Attitudes towards the Components of the Digital Environment (Based on the Text Analysis of Network Comments). RUDN JOURNAL OF PSYCHOLOGY AND PEDAGOGICS 2022. [DOI: 10.22363/2313-1683-2022-19-2-253-281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
One of the psychological effects of digitalization is the establishment of specific relationships between a person and the cyber environment and its components. The paper presents the results of a study of the emotional component of attitudes towards the components of the digital environment, carried out using emotive-predicate analysis, a new method of computer text processing implemented in TITANIS, an advanced social media text analysis tool. Using this method, it is possible to automatically extract descriptions of emotional situations from texts in which the components of the digital environment are the cause or subject of 68 emotional states. The texts of 2048 online videos posted in the Russian-language segment of YouTube served as the material for the analysis. According to the frequency of occurrence, emotional situations involving various components of the digital environment are quite typical for even thematically irrelevant online discussions. The components of the digital environment mentioned in non-thematic discussions as participants in emotional situations are classified into the following three groups: (1) general concepts of digital technologies; (2) digital devices; (3) activities mediated by digital technologies. The lexemes of the latter group, denoting various aspects of network communication, are included in the vast majority of descriptions of emotional situations involving the components of the digital environment, and six times more often as causes of emotions than as subjects of emotional states. In general, the emotional attitude towards the components of the cyber environment as a whole is characterized as balanced, without a noticeable predominance of negative or positive emotions. However, negative states are more often attributed to the components of the cyber environment as the subjects than as the causes of emotions. The practical significance of the described method of text analysis as a means of assessing the emotional component of attitudes towards the components of the digital environment is determined by the influence that affective reactions of users have on the demand for technical innovations and the direction of their development.
Collapse
|
30
|
Weis PP, Wiese E. Know Your Cognitive Environment! Mental Models as Crucial Determinant of Offloading Preferences. HUMAN FACTORS 2022; 64:499-513. [PMID: 32955351 DOI: 10.1177/0018720820956861] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
OBJECTIVE Human problem solvers possess the ability to outsource parts of their mental processing onto cognitive "helpers" (cognitive offloading). However, suboptimal decisions regarding which helper to recruit for which task occur frequently. Here, we investigate if understanding and adjusting a specific subcomponent of mental models-beliefs about task-specific expertise-regarding these helpers could provide a comparatively easy way to improve offloading decisions. BACKGROUND Mental models afford the storage of beliefs about a helper that can be retrieved when needed. METHODS Arithmetic and social problems were solved by 192 participants. Participants could, in addition to solving a task on their own, offload cognitive processing onto a human, a robot, or one of two smartphone apps. These helpers were introduced with either task-specific (e.g., stating that an app would use machine learning to "recognize faces" and "read emotions") or task-unspecific (e.g., stating that an app was built for solving "complex cognitive tasks") descriptions of their expertise. RESULTS Providing task-specific expertise information heavily altered offloading behavior for apps but much less so for humans or robots. This suggests (1) strong preexisting mental models of human and robot helpers and (2) a strong impact of mental model adjustment for novel helpers like unfamiliar smartphone apps. CONCLUSION Creating and refining mental models is an easy approach to adjust offloading preferences and thus improve interactions with cognitive environments. APPLICATION To efficiently work in environments in which problem-solving includes consulting other people or cognitive tools ("helpers"), accurate mental models-especially regarding task-relevant expertise-are a crucial prerequisite.
Collapse
Affiliation(s)
| | - Eva Wiese
- 3298 George Mason University, Virginia, USA
| |
Collapse
|
31
|
Stange S, Hassan T, Schröder F, Konkol J, Kopp S. Self-Explaining Social Robots: An Explainable Behavior Generation Architecture for Human-Robot Interaction. Front Artif Intell 2022; 5:866920. [PMID: 35573901 PMCID: PMC9106388 DOI: 10.3389/frai.2022.866920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Accepted: 04/01/2022] [Indexed: 11/20/2022] Open
Abstract
In recent years, the ability of intelligent systems to be understood by developers and users has received growing attention. This holds in particular for social robots, which are supposed to act autonomously in the vicinity of human users and are known to raise peculiar, often unrealistic attributions and expectations. However, explainable models that, on the one hand, allow a robot to generate lively and autonomous behavior and, on the other, enable it to provide human-compatible explanations for this behavior are missing. In order to develop such a self-explaining autonomous social robot, we have equipped a robot with own needs that autonomously trigger intentions and proactive behavior, and form the basis for understandable self-explanations. Previous research has shown that undesirable robot behavior is rated more positively after receiving an explanation. We thus aim to equip a social robot with the capability to automatically generate verbal explanations of its own behavior, by tracing its internal decision-making routes. The goal is to generate social robot behavior in a way that is generally interpretable, and therefore explainable on a socio-behavioral level increasing users' understanding of the robot's behavior. In this article, we present a social robot interaction architecture, designed to autonomously generate social behavior and self-explanations. We set out requirements for explainable behavior generation architectures and propose a socio-interactive framework for behavior explanations in social human-robot interactions that enables explaining and elaborating according to users' needs for explanation that emerge within an interaction. Consequently, we introduce an interactive explanation dialog flow concept that incorporates empirically validated explanation types. These concepts are realized within the interaction architecture of a social robot, and integrated with its dialog processing modules. We present the components of this interaction architecture and explain their integration to autonomously generate social behaviors as well as verbal self-explanations. Lastly, we report results from a qualitative evaluation of a working prototype in a laboratory setting, showing that (1) the robot is able to autonomously generate naturalistic social behavior, and (2) the robot is able to verbally self-explain its behavior to the user in line with users' requests.
Collapse
Affiliation(s)
- Sonja Stange
- Social Cognitive Systems Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany
- *Correspondence: Sonja Stange
| | - Teena Hassan
- Robotics Group, Faculty 3–Mathematics and Computer Science, University of Bremen, Bremen, Germany
| | - Florian Schröder
- Social Cognitive Systems Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany
| | - Jacqueline Konkol
- Social Cognitive Systems Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany
| | - Stefan Kopp
- Social Cognitive Systems Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
32
|
Stein JP, Cimander P, Appel M. Power-Posing Robots: The Influence of a Humanoid Robot’s Posture and Size on its Perceived Dominance, Competence, Eeriness, and Threat. Int J Soc Robot 2022. [DOI: 10.1007/s12369-022-00878-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
AbstractWhen interacting with sophisticated digital technologies, people often fall back on the same interaction scripts they apply to the communication with other humans—especially if the technology in question provides strong anthropomorphic cues (e.g., a human-like embodiment). Accordingly, research indicates that observers tend to interpret the body language of social robots in the same way as they would with another human being. Backed by initial evidence, we assumed that a humanoid robot will be considered as more dominant and competent, but also as more eerie and threatening once it strikes a so-called power pose. Moreover, we pursued the research question whether these effects might be accentuated by the robot’s body size. To this end, the current study presented 204 participants with pictures of the robot NAO in different poses (expansive vs. constrictive), while also manipulating its height (child-sized vs. adult-sized). Our results show that NAO’s posture indeed exerted strong effects on perceptions of dominance and competence. Conversely, participants’ threat and eeriness ratings remained statistically independent of the robot’s depicted body language. Further, we found that the machine’s size did not affect any of the measured interpersonal perceptions in a notable way. The study findings are discussed considering limitations and future research directions.
Collapse
|
33
|
Fox S. Behavioral Ethics Ecologies of Human-Artificial Intelligence Systems. Behav Sci (Basel) 2022; 12:bs12040103. [PMID: 35447675 PMCID: PMC9029794 DOI: 10.3390/bs12040103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 04/08/2022] [Accepted: 04/08/2022] [Indexed: 11/16/2022] Open
Abstract
Historically, evolution of behaviors often took place in environments that changed little over millennia. By contrast, today, rapid changes to behaviors and environments come from the introduction of artificial intelligence (AI) and the infrastructures that facilitate its application. Behavioral ethics is concerned with how interactions between individuals and their environments can lead people to questionable decisions and dubious actions. For example, interactions between an individual’s self-regulatory resource depletion and organizational pressure to take non-ethical actions. In this paper, four fundamental questions of behavioral ecology are applied to analyze human behavioral ethics in human–AI systems. These four questions are concerned with assessing the function of behavioral traits, how behavioral traits evolve in populations, what are the mechanisms of behavioral traits, and how they can differ among different individuals. These four fundamental behavioral ecology questions are applied in analysis of human behavioral ethics in human–AI systems. This is achieved through reference to vehicle navigation systems and healthcare diagnostic systems, which are enabled by AI. Overall, the paper provides two main contributions. First, behavioral ecology analysis of behavioral ethics. Second, application of behavioral ecology questions to identify opportunities and challenges for ethical human–AI systems.
Collapse
Affiliation(s)
- Stephen Fox
- VTT Technical Research Centre of Finland, FI-02150 Espoo, Finland
| |
Collapse
|
34
|
Ciardo F, De Tommaso D, Wykowska A. Joint action with artificial agents: Human-likeness in behaviour and morphology affects sensorimotor signaling and social inclusion. COMPUTERS IN HUMAN BEHAVIOR 2022. [DOI: 10.1016/j.chb.2022.107237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
35
|
Weis PP, Herbert C. Do I still like myself? Human-robot collaboration entails emotional consequences. COMPUTERS IN HUMAN BEHAVIOR 2022. [DOI: 10.1016/j.chb.2021.107060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
36
|
Robot’s Social Gaze Affects Conflict Resolution but not Conflict Adaptations. J Cogn 2022; 5:2. [PMID: 36072111 PMCID: PMC9400601 DOI: 10.5334/joc.189] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Accepted: 09/03/2021] [Indexed: 12/04/2022] Open
Abstract
Robots are a new category of social agents that, thanks to their embodiment, can be used to train and support cognitive skills such as cognitive control. Several studies showed that cognitive control mechanisms are sensitive to affective states induced by humor, mood, and symbolic feedback such as monetary rewards. In the present study, we investigated whether the social gaze of a humanoid robot can affect cognitive control mechanisms. To this end, in two experiments, we evaluated both the conflict resolution and trial-by-trial adaptations during an auditory Simon task, as a function of the type of feedback participants received in the previous trial from the iCub robot, namely, mutual or avoiding gaze behaviour. Across three experiments, we compared the effect of mutual, avoiding (Exp1 and Exp2), and neutral (Exp3) gaze feedback between screen-based (Exp1) and physically embodied setups (Exp2 and Exp3). Results showed that iCub’s social gaze feedback modulated conflict resolution, but not conflict adaptations. Specifically, the Simon effect was increased following mutual gaze feedback from iCub. Moreover, the modulatory effect was observed for the embodied setup in which the robot could engage or avoid eye contact in real-time (Exp2) but not for the screen-based setting (Exp1). Our findings showed for the first time that social feedback in Human-Robot Interaction, such as social gaze, can be used to modulate cognitive control. The results highlight the advantage of using robots to evaluate and train complex cognitive skills in both healthy and clinical populations.
Collapse
|
37
|
Langer A, Levy-Tzedek S. Emerging Roles for Social Robots in Rehabilitation. ACM TRANSACTIONS ON HUMAN-ROBOT INTERACTION 2021. [DOI: 10.1145/3462256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Insights from social and cognitive neuroscience should inform the design of socially assistive robots for neurorehabilitation as novel roles emerge for them in human-human interactions.
Collapse
Affiliation(s)
- Allison Langer
- Perelman School of Medicine, Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA, United States
| | - Shelly Levy-Tzedek
- Recanati School for Community Health Professions, Department of Physical Therapy, Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel and Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel Freiburg Institute for Advanced Studies (FRIAS), University of Freiburg, Freiburg, Germany
| |
Collapse
|
38
|
Zonca J, Folsø A, Sciutti A. The role of reciprocity in human-robot social influence. iScience 2021; 24:103424. [PMID: 34877490 PMCID: PMC8633024 DOI: 10.1016/j.isci.2021.103424] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 10/11/2021] [Accepted: 11/05/2021] [Indexed: 11/19/2022] Open
Abstract
Humans are constantly influenced by others’ behavior and opinions. Of importance, social influence among humans is shaped by reciprocity: we follow more the advice of someone who has been taking into consideration our opinions. In the current work, we investigate whether reciprocal social influence can emerge while interacting with a social humanoid robot. In a joint task, a human participant and a humanoid robot made perceptual estimates and then could overtly modify them after observing the partner’s judgment. Results show that endowing the robot with the ability to express and modulate its own level of susceptibility to the human’s judgments represented a double-edged sword. On the one hand, participants lost confidence in the robot’s competence when the robot was following their advice; on the other hand, participants were unwilling to disclose their lack of confidence to the susceptible robot, suggesting the emergence of reciprocal mechanisms of social influence supporting human-robot collaboration. If a social robot is susceptible to our advice, we lose confidence in it However, robot’s susceptibility does not deteriorate social influence These effects do not appear during interaction with a computer Susceptible robots can promote reciprocity but also hinder social learning
Collapse
Affiliation(s)
- Joshua Zonca
- Cognitive Architecture for Collaborative Technologies (CONTACT) Unit, Italian Institute of Technology, Via Enrico Melen, 83, 16152 Genoa, GE, Italy
- Corresponding author
| | - Anna Folsø
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, 16145 Genoa, Italy
| | - Alessandra Sciutti
- Cognitive Architecture for Collaborative Technologies (CONTACT) Unit, Italian Institute of Technology, Via Enrico Melen, 83, 16152 Genoa, GE, Italy
| |
Collapse
|
39
|
Kharub I, Lwin M, Khan A, Mubin O. Perceived Service Quality in HRI: Applying the SERVBOT Framework. Front Robot AI 2021; 8:746674. [PMID: 34966790 PMCID: PMC8711722 DOI: 10.3389/frobt.2021.746674] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Accepted: 10/14/2021] [Indexed: 12/03/2022] Open
Abstract
Services are intangible in nature and as a result, it is often difficult to measure the quality of the service. In the service literature, the service is usually delivered by a human to a human customer and the quality of the service is often evaluated using the SERVQUAL dimensions. An extensive review of the literature shows there is a lack of an empirical model to assess the perceived service quality provided by a social robot. Furthermore, the social robot literature highlights key differences between human service and social robots. For example, scholars have highlighted the importance of entertainment value and engagement in the adoption of social robots in the service industry. However, it is unclear whether the SERVQUAL dimensions are appropriate to measure social robot's service quality. The paper proposes the SERVBOT model to assess a social robot's service quality. It identifies, reliability, responsiveness, assurance, empathy, and entertainment as the five dimensions of SERVBOT. Further, the research will investigate how these five factors influence emotional engagement and future intentions to use the social robot in a concierge service setting. The model was tested using student sampling, and a total of 94 responses were collected for the study. The findings indicate empathy and entertainment value as key predictors of emotional engagement. Further, emotional engagement is a strong predictor of future intention to use a social robot in a service setting. This study is the first to propose the SERVBOT model to measure social robot's service quality. The model provides a theoretical underpinning on the key service quality dimensions of a social robot and gives scholars and managers a method to track the service quality of a social robot. The study also extends on the literature by exploring the key factors that influence the use of social robots (i.e., emotional engagement).
Collapse
Affiliation(s)
- Isha Kharub
- School of Business, Western Sydney University, Sydney, NSW, Australia
| | - Michael Lwin
- School of Business, Western Sydney University, Sydney, NSW, Australia
| | - Aila Khan
- School of Business, Western Sydney University, Sydney, NSW, Australia
| | - Omar Mubin
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Sydney, NSW, Australia
| |
Collapse
|
40
|
Farizon D, Dominey PF, Ventre-Dominey J. Insights on embodiment induced by visuo-tactile stimulation during robotic telepresence. Sci Rep 2021; 11:22718. [PMID: 34811420 PMCID: PMC8609005 DOI: 10.1038/s41598-021-02091-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Accepted: 10/26/2021] [Indexed: 11/17/2022] Open
Abstract
Using a simple neuroscience-inspired procedure to beam human subjects into robots, we previously demonstrated by visuo-motor manipulations that embodiment into a robot can enhance the acceptability and closeness felt towards the robot. In that study, the feelings of likeability and closeness toward the robot were significantly related to the sense of agency, independently of the sensations of enfacement and location. Here, using the same paradigm we investigated the effect of a purely sensory manipulation on the sense of robotic embodiment associated to social cognition. Wearing a head-mounted display, participants saw the visual scene captured from the robot eyes. By positioning a mirror in front of the robot, subjects saw themselves as a robot. Tactile stimulation was provided by stroking synchronously or not with a paintbrush the same location of the subject and robot faces. In contrast to the previous motor induction of embodiment which particularly affected agency, tactile induction yields more generalized effects on the perception of ownership, location and agency. Interestingly, the links between positive social feelings towards the robot and the strength of the embodiment sensations were not observed. We conclude that the embodiment into a robot is not sufficient in itself to induce changes in social cognition.
Collapse
Affiliation(s)
- D Farizon
- INSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, 21000, Dijon, France
| | - P F Dominey
- INSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, 21000, Dijon, France
| | - J Ventre-Dominey
- INSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, 21000, Dijon, France.
| |
Collapse
|
41
|
Kohn SC, de Visser EJ, Wiese E, Lee YC, Shaw TH. Measurement of Trust in Automation: A Narrative Review and Reference Guide. Front Psychol 2021; 12:604977. [PMID: 34737716 PMCID: PMC8562383 DOI: 10.3389/fpsyg.2021.604977] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Accepted: 08/25/2021] [Indexed: 02/05/2023] Open
Abstract
With the rise of automated and autonomous agents, research examining Trust in Automation (TiA) has attracted considerable attention over the last few decades. Trust is a rich and complex construct which has sparked a multitude of measures and approaches to study and understand it. This comprehensive narrative review addresses known methods that have been used to capture TiA. We examined measurements deployed in existing empirical works, categorized those measures into self-report, behavioral, and physiological indices, and examined them within the context of an existing model of trust. The resulting work provides a reference guide for researchers, providing a list of available TiA measurement methods along with the model-derived constructs that they capture including judgments of trustworthiness, trust attitudes, and trusting behaviors. The article concludes with recommendations on how to improve the current state of TiA measurement.
Collapse
Affiliation(s)
| | - Ewart J de Visser
- Warfighter Effectiveness Research Center, United States Air Force Academy, Colorado Springs, CO, United States
| | - Eva Wiese
- George Mason University, Fairfax, VA, United States
| | - Yi-Ching Lee
- George Mason University, Fairfax, VA, United States
| | - Tyler H Shaw
- George Mason University, Fairfax, VA, United States
| |
Collapse
|
42
|
Perez-Osorio J, Abubshait A, Wykowska A. Irrelevant Robot Signals in a Categorization Task Induce Cognitive Conflict in Performance, Eye Trajectories, the N2 ERP-EEG Component, and Frontal Theta Oscillations. J Cogn Neurosci 2021; 34:108-126. [PMID: 34705044 DOI: 10.1162/jocn_a_01786] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Understanding others' nonverbal behavior is essential for social interaction, as it allows, among others, to infer mental states. Although gaze communication, a well-established nonverbal social behavior, has shown its importance in inferring others' mental states, not much is known about the effects of irrelevant gaze signals on cognitive conflict markers during collaborative settings. Here, participants completed a categorization task where they categorized objects based on their color while observing images of a robot. On each trial, participants observed the robot iCub grasping an object from a table and offering it to them to simulate a handover. Once the robot "moved" the object forward, participants were asked to categorize the object according to its color. Before participants were allowed to respond, the robot made a lateral head/gaze shift. The gaze shifts were either congruent or incongruent with the object's color. We expected that incongruent head cues would induce more errors (Study 1), would be associated with more curvature in eye-tracking trajectories (Study 2), and induce larger amplitude in electrophysiological markers of cognitive conflict (Study 3). Results of the three studies show more oculomotor interference as measured in error rates (Study 1), larger curvatures eye-tracking trajectories (Study 2), and higher amplitudes of the N2 ERP of the EEG signals as well as higher event-related spectral perturbation amplitudes (Study 3) for incongruent trials compared with congruent trials. Our findings reveal that behavioral, ocular, and electrophysiological markers can index the influence of irrelevant signals during goal-oriented tasks.
Collapse
|
43
|
A win-win situation: Does familiarity with a social robot modulate feedback monitoring and learning? COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 21:763-775. [PMID: 33821460 DOI: 10.3758/s13415-021-00895-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/16/2021] [Indexed: 01/15/2023]
Abstract
Social species rely on the ability to modulate feedback-monitoring in social contexts to adjust one's actions and obtain desired outcomes. When being awarded positive outcomes during a gambling task, feedback-monitoring is attenuated when strangers are rewarded, as less value is assigned to the awarded outcome. This difference in feedback-monitoring can be indexed by an event-related potential (ERP) component known as the Reward Positivity (RewP), whose amplitude is enhanced when receiving positive feedback. While the degree of familiarity influences the RewP, little is known about how the RewP and reinforcement learning are affected when gambling on behalf of familiar versus nonfamiliar agents, such as robots. This question becomes increasingly important given that robots may be used as teachers and/or social companions in the near future, with whom children and adults will interact with for short or long periods of time. In the present study, we examined whether feedback-monitoring when gambling on behalf of oneself compared with a robot is impacted by whether participants have familiarized themselves with the robot before the task. We expected enhanced RewP amplitude for self versus other for those who did not familiarize with the robot and that self-other differences in the RewP would be attenuated for those who familiarized with the robot. Instead, we observed that the RewP was larger when familiarization with the robot occurred, which corresponded to overall worse learning outcomes. We additionally observed an enhanced P3 effect for the high-familiarity condition, which suggests an increased motivation to reward. These findings suggest that familiarization with robots may cause a positive motivational effect, which positively affects RewP amplitudes, but interferes with learning.
Collapse
|
44
|
Papagni G, Koeszegi S. A Pragmatic Approach to the Intentional Stance Semantic, Empirical and Ethical Considerations for the Design of Artificial Agents. Minds Mach (Dordr) 2021. [DOI: 10.1007/s11023-021-09567-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
AbstractArtificial agents are progressively becoming more present in everyday-life situations and more sophisticated in their interaction affordances. In some specific cases, like Google Duplex, GPT-3 bots or Deep Mind’s AlphaGo Zero, their capabilities reach or exceed human levels. The use contexts of everyday life necessitate making such agents understandable by laypeople. At the same time, displaying human levels of social behavior has kindled the debate over the adoption of Dennett’s ‘intentional stance’. By means of a comparative analysis of the literature on robots and virtual agents, we defend the thesis that approaching these artificial agents ‘as if’ they had intentions and forms of social, goal-oriented rationality is the only way to deal with their complexity on a daily base. Specifically, we claim that this is the only viable strategy for non-expert users to understand, predict and perhaps learn from artificial agents’ behavior in everyday social contexts. Furthermore, we argue that as long as agents are transparent about their design principles and functionality, attributing intentions to their actions is not only essential, but also ethical. Additionally, we propose design guidelines inspired by the debate over the adoption of the intentional stance.
Collapse
|
45
|
Cooney M. Robot Art, in the Eye of the Beholder?: Personalized Metaphors Facilitate Communication of Emotions and Creativity. Front Robot AI 2021; 8:668986. [PMID: 34336934 PMCID: PMC8319995 DOI: 10.3389/frobt.2021.668986] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 06/30/2021] [Indexed: 11/29/2022] Open
Abstract
Socially assistive robots are being designed to support people's well-being in contexts such as art therapy where human therapists are scarce, by making art together with people in an appropriate way. A challenge is that various complex and idiosyncratic concepts relating to art, like emotions and creativity, are not yet well understood. Guided by the principles of speculative design, the current article describes the use of a collaborative prototyping approach involving artists and engineers to explore this design space, especially in regard to general and personalized art-making strategies. This led to identifying a goal: to generate representational or abstract art that connects emotionally with people's art and shows creativity. For this, an approach involving personalized "visual metaphors" was proposed, which balances the degree to which a robot's art is influenced by interacting persons. The results of a small user study via a survey provided further insight into people's perceptions: the general design was perceived as intended and appealed; as well, personalization via representational symbols appeared to lead to easier and clearer communication of emotions than via abstract symbols. In closing, the article describes a simplified demo, and discusses future challenges. Thus, the contribution of the current work lies in suggesting how a robot can seek to interact with people in an emotional and creative way through personalized art; thereby, the aim is to stimulate ideation in this promising area and facilitate acceptance of such robots in everyday human environments.
Collapse
Affiliation(s)
- Martin Cooney
- Center for Applied Intelligent Systems Research (CAISR), Department of Intelligent Systems and Digital Design, Halmstad University, Halmstad, Sweden
| |
Collapse
|
46
|
Hildt E. What Sort of Robots Do We Want to Interact With? Reflecting on the Human Side of Human-Artificial Intelligence Interaction. FRONTIERS IN COMPUTER SCIENCE 2021. [DOI: 10.3389/fcomp.2021.671012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
47
|
Competing with or Against Cozmo, the Robot: Influence of Interaction Context and Outcome on Mind Perception. Int J Soc Robot 2021. [DOI: 10.1007/s12369-020-00668-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|
48
|
Sexbots as Synthetic Companions: Comparing Attitudes of Official Sex Offenders and Non-Offenders. Int J Soc Robot 2021. [DOI: 10.1007/s12369-021-00797-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
AbstractThis is the first Italian study to examine views on sexbots of adult male sex offenders and non-offenders, and their perceptions of sexbots as sexual partners, and sexbots as a means to prevent sexual violence. In order to explore these aspects 344 adult males were involved in the study. The study carried out two types of comparisons. 100 male sex offenders were compared with 244 male non-offenders. Also, sex offenders were divided into child molesters and rapists. Preliminary findings suggest that sex offenders were less open than non-offenders to sexbots, showed a lower acceptance of them, and were more likely to dismiss the possibility of having an intimate and sexual relationship with a sexbot. Sex offenders were also less likely than non-offenders to believe that the risk of sexual violence against people could be reduced if a sexbot was used in the treatment of sex offenders. No differences were found between child molesters and rapists. Though no definitive conclusion can be drawn about what role sexbots might play in the prevention and treatment of sex offending, this study emphasizes the importance of both exploring how sexbots are both perceived and understood. Sex offenders in this study showed a high dynamic sexual risk and, paradoxically, despite, or because of, their sexual deviance (e.g. deficits in sexual self-regulation), they were more inclined to see sexbots as just machines and were reluctant to imagine them as social agents, i.e. as intimate or sexual arousal partners. How sex offenders differ in their dynamic risk and criminal careers can inform experts about the mechanisms that take place and can challenge their engagement in treatment and intervention.
Collapse
|
49
|
Marchesi S, Bossi F, Ghiglino D, De Tommaso D, Wykowska A. I Am Looking for Your Mind: Pupil Dilation Predicts Individual Differences in Sensitivity to Hints of Human-Likeness in Robot Behavior. Front Robot AI 2021; 8:653537. [PMID: 34222350 PMCID: PMC8249729 DOI: 10.3389/frobt.2021.653537] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 05/25/2021] [Indexed: 11/13/2022] Open
Abstract
The presence of artificial agents in our everyday lives is continuously increasing. Hence, the question of how human social cognition mechanisms are activated in interactions with artificial agents, such as humanoid robots, is frequently being asked. One interesting question is whether humans perceive humanoid robots as mere artifacts (interpreting their behavior with reference to their function, thereby adopting the design stance) or as intentional agents (interpreting their behavior with reference to mental states, thereby adopting the intentional stance). Due to their humanlike appearance, humanoid robots might be capable of evoking the intentional stance. On the other hand, the knowledge that humanoid robots are only artifacts should call for adopting the design stance. Thus, observing a humanoid robot might evoke a cognitive conflict between the natural tendency of adopting the intentional stance and the knowledge about the actual nature of robots, which should elicit the design stance. In the present study, we investigated the cognitive conflict hypothesis by measuring participants’ pupil dilation during the completion of the InStance Test. Prior to each pupillary recording, participants were instructed to observe the humanoid robot iCub behaving in two different ways (either machine-like or humanlike behavior). Results showed that pupil dilation and response time patterns were predictive of individual biases in the adoption of the intentional or design stance in the IST. These results may suggest individual differences in mental effort and cognitive flexibility in reading and interpreting the behavior of an artificial agent.
Collapse
Affiliation(s)
- Serena Marchesi
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genova, Italy.,Department of Computer Science, Faculty of Science and Engineering, Manchester University, Manchester, United Kingdom
| | - Francesco Bossi
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genova, Italy.,IMT School for Advanced Studies, Lucca, Italy
| | - Davide Ghiglino
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genova, Italy.,Dipartimento di Informatica, Bioingegneria, Robotica e Ingegneria dei Sistemi, Università di Genova, Genova, Italy
| | - Davide De Tommaso
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genova, Italy
| | - Agnieszka Wykowska
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
50
|
Agnati LF, Anderlini D, Guidolin D, Marcoli M, Maura G. Man is a "Rope" Stretched Between Virosphere and Humanoid Robots: On the Urgent Need of an Ethical Code for Ecosystem Survival. FOUNDATIONS OF SCIENCE 2021; 27:311-325. [PMID: 34177285 PMCID: PMC8210962 DOI: 10.1007/s10699-021-09796-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 04/21/2021] [Indexed: 06/13/2023]
Abstract
In this paper we compare the strategies applied by two successful biological components of the ecosystem, the viruses and the human beings, to interact with the environment. Viruses have had and still exert deep and vast actions on the ecosystem especially at the genome level of most of its biotic components. We discuss on the importance of the human being as contraptions maker in particular of robots, hence of machines capable of automatically carrying out complex series of actions. Beside the relevance of designing and assembling these contraptions, it is of basic importance the goal for which they are assembled and future scenarios of their possible impact on the ecosystem. We can't procrastinate the development and implementation of a highly inspired and stringent "ethical code" for human beings and humanoid robots because it will be a crucial aspect for the wellbeing of the mankind and of the entire ecosystem.
Collapse
Affiliation(s)
- Luigi F. Agnati
- Department of Neuroscience, Karolinska Institutet, Stockholm, Sweden
- Department of Biomedical Sciences, University of Modena and Reggio Emilia, Modena, Italy
| | - Deanna Anderlini
- Centre for Sensorimotor Performance, The University of Queensland, Brisbane, Australia
| | - Diego Guidolin
- Department of Neuroscience, University of Padova, Padova, Italy
| | - Manuela Marcoli
- Department of Pharmacy and Center of Excellence for Biomedical Research, University of Genova, GENOVA, Italy
| | - Guido Maura
- Department of Pharmacy and Center of Excellence for Biomedical Research, University of Genova, GENOVA, Italy
| |
Collapse
|