1
|
Yan Z, Wang Z, Ren R, Wang C, Jiang S, Zhou Y, He B. A HUG taxonomy of humans with potential in human-robot hugs. Sci Rep 2024; 14:14212. [PMID: 38902448 PMCID: PMC11190144 DOI: 10.1038/s41598-024-64825-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Accepted: 06/13/2024] [Indexed: 06/22/2024] Open
Abstract
Humans can easily perform various types of hugs in human contact and affection experience. With the prevalence of robots in social applications, they would be expected to possess the capability of hugs as humans do. However, it is still not an easy task for robots, considering the complex force and spatial constraints of robot hugs. In this work, we propose the HUG taxonomy, which distinguishes between different hugging patterns based on human demonstrations and prior knowledge. In this taxonomy, hugs are arranged according to (1) hugging tightness, (2) hugging style, and (3) bilateral coordination, resulting in 16 different hug types. We then further study the hug type preference of humans in different scenarios and roles. Furthermore, we propose a rule-based classification system to validate the potential of this taxonomy in human-robot hugs based on a humanoid robot with an E-skin of contact sensation. The HUG taxonomy could provide human hugging behavior information in advance, facilitating the action control of humanoid robots. We believe the results of our work can benefit future studies on human-robot hugging interactions.
Collapse
Affiliation(s)
- Zheng Yan
- Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai, 201210, China
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China
| | - Zhipeng Wang
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China
- College of Electronics & Information Engineering, Tongji University, Shanghai, 201804, China
| | - Ruochen Ren
- Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai, 201210, China
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China
| | - Chengjin Wang
- Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai, 201210, China
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China
| | - Shuo Jiang
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China
- College of Electronics & Information Engineering, Tongji University, Shanghai, 201804, China
| | - Yanmin Zhou
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China.
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China.
- College of Electronics & Information Engineering, Tongji University, Shanghai, 201804, China.
| | - Bin He
- State Key Laboratory of Intelligent Autonomous Systems, Shanghai, 201210, China
- Frontiers Science Center for Intelligent Autonomous Systems, Shanghai, 201210, China
- College of Electronics & Information Engineering, Tongji University, Shanghai, 201804, China
| |
Collapse
|
2
|
Onishi Y, Ogawa K, Tanaka K, Nakanishi H. Embodied, visible, and courteous: exploring robotic social touch with virtual idols. Front Robot AI 2024; 11:1240408. [PMID: 38590970 PMCID: PMC10999612 DOI: 10.3389/frobt.2024.1240408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 02/15/2024] [Indexed: 04/10/2024] Open
Abstract
In recent years, virtual idols have garnered considerable attention because they can perform activities similar to real idols. However, as they are fictitious idols with nonphysical presence, they cannot perform physical interactions such as handshake. Combining a robotic hand with a display showing virtual idols is the one of the methods to solve this problem. Nonetheless a physical handshake is possible, the form of handshake that can effectively induce the desirable behavior is unclear. In this study, we adopted a robotic hand as an interface and aimed to imitate the behavior of real idols. To test the effects of this behavior, we conducted step-wise experiments. The series of experiments revealed that the handshake by the robotic hand increased the feeling of intimacy toward the virtual idol, and it became more enjoyable to respond to a request from the virtual idol. In addition, viewing the virtual idols during the handshake increased the feeling of intimacy with the virtual idol. Moreover, the method of the hand-shake peculiar to idols, which tried to keep holding the user's hand after the conversation, increased the feeling of intimacy to the virtual idol.
Collapse
Affiliation(s)
- Yuya Onishi
- Interaction Science Laboratories, Advanced Telecommunication Research Institute International, Sorakugun, Japan
| | - Kosuke Ogawa
- Department of Mechanical Engineering, Osaka University, Suita, Japan
| | - Kazuaki Tanaka
- Faculty of Information and Human Sciences, Kyoto Institute of Technology, Kyoto, Japan
| | | |
Collapse
|
3
|
Abdulazeem N, Hu Y. Human Factors Considerations for Quantifiable Human States in Physical Human-Robot Interaction: A Literature Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:7381. [PMID: 37687837 PMCID: PMC10490212 DOI: 10.3390/s23177381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 08/11/2023] [Accepted: 08/16/2023] [Indexed: 09/10/2023]
Abstract
As the global population rapidly ages with longer life expectancy and declining birth rates, the need for healthcare services and caregivers for older adults is increasing. Current research envisions addressing this shortage by introducing domestic service robots to assist with daily activities. The successful integration of robots as domestic service providers in our lives requires them to possess efficient manipulation capabilities, provide effective physical assistance, and have adaptive control frameworks that enable them to develop social understanding during human-robot interaction. In this context, human factors, especially quantifiable ones, represent a necessary component. The objective of this paper is to conduct an unbiased review encompassing the studies on human factors studied in research involving physical interactions and strong manipulation capabilities. We identified the prevalent human factors in physical human-robot interaction (pHRI), noted the factors typically addressed together, and determined the frequently utilized assessment approaches. Additionally, we gathered and categorized proposed quantification approaches based on the measurable data for each human factor. We also formed a map of the common contexts and applications addressed in pHRI for a comprehensive understanding and easier navigation of the field. We found out that most of the studies in direct pHRI (when there is direct physical contact) focus on social behaviors with belief being the most commonly addressed human factor type. Task collaboration is moderately investigated, while physical assistance is rarely studied. In contrast, indirect pHRI studies (when the physical contact is mediated via a third item) often involve industrial settings, with physical ergonomics being the most frequently investigated human factor. More research is needed on the human factors in direct and indirect physical assistance applications, including studies that combine physical social behaviors with physical assistance tasks. We also found that while the predominant approach in most studies involves the use of questionnaires as the main method of quantification, there is a recent trend that seeks to address the quantification approaches based on measurable data.
Collapse
Affiliation(s)
| | - Yue Hu
- Active & Interactive Robotics Lab, Department of Mechanical and Mechatronics Engineering, University of Waterloo, 200 University Ave. W., Waterloo, ON N2L 3G1, Canada;
| |
Collapse
|
4
|
Khan I, Cañamero L. The Long-Term Efficacy of "Social Buffering" in Artificial Social Agents: Contextual Affective Perception Matters. Front Robot AI 2022; 9:699573. [PMID: 36185976 PMCID: PMC9520257 DOI: 10.3389/frobt.2022.699573] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 04/29/2022] [Indexed: 11/21/2022] Open
Abstract
In dynamic (social) environments, an affective state of "stress" can be adaptive and promote agent wellbeing, but maladaptive if not appropriately regulated. The presence of (and interactions with) affect-based social support has been hypothesised to provide mechanisms to regulate stress (the "social buffering" hypothesis), though the precise, underlying mechanisms are still unclear. However, the hormone oxytocin has been implicated in mediating these effects in at least two ways: by improving social appraisals and reducing the short-term release of stress hormones (i.e., cortisol), and adapting an agent's long-term stress tolerance. These effects likely facilitate an agent's long-term adaptive ability by grounding their physiological and behavioural adaptation in the (affective) social environment, though these effects also appear to be context-dependent. In this paper, we investigate whether two of the hypothesised hormonal mechanisms that underpin the "social buffering" phenomenon affect the long-term wellbeing of (artificial) social agents who share affective social bonds, across numerous social and physical environmental contexts. Building on previous findings, we hypothesise that "social buffering" effects can improve the long-term wellbeing of agents who share affective social bonds in dynamic environments, through regular prosocial interactions with social bond partners. We model some of the effects associated with oxytocin and cortisol that underpin these hypothesised mechanisms in our biologically-inspired, socially-adaptive agent model, and conduct our investigation in a small society of artificial agents whose goal is to survive in challenging environments. Our results find that, while stress can be adaptive and regulated through affective social support, long-term behavioural and physiological adaptation is determined by the contextual perception of affective social bonds, which is influenced by early-stage interactions between affective social bond partners as well as the degree of the physical and social challenges. We also show how these low-level effects associated with oxytocin and cortisol can be used as "biomarkers" of social support and environmental stress. For socially-situated artificial agents, we suggest that these "social buffering" mechanisms can adapt the (adaptive) stress mechanisms, but that the long-term efficacy of this adaptation is related to the temporal dynamics of social interactions and the contextual perception of the affective social and physical environments.
Collapse
Affiliation(s)
- Imran Khan
- Embodied Emotion, Cognition, and (Inter-)Action Lab, School of Physics, Engineering, and Computer Science, University of Hertfordshire, College Lane, Hatfield, United Kingdom
| | - Lola Cañamero
- Embodied Emotion, Cognition, and (Inter-)Action Lab, School of Physics, Engineering, and Computer Science, University of Hertfordshire, College Lane, Hatfield, United Kingdom
- ETIS Lab, CY Cergy Paris University—ENSEA—CNRS UMR8051, Cergy, France
| |
Collapse
|
5
|
Higashino K, Kimoto M, Iio T, Shimohara K, Shiomi M. Tactile stimulus is essential to increase motivation for touch interaction in virtual environment. Adv Robot 2021. [DOI: 10.1080/01691864.2021.1967780] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Kana Higashino
- ATR-ISL, Kyoto, Japan
- Faculty of Science and Engineering, Doshisha Univ., Kyoto, Japan
| | - Mitsuhiko Kimoto
- ATR-ISL, Kyoto, Japan
- Faculty of Science and Technology, Keio Univ., Kanagawa, Japan
| | - Takamasa Iio
- ATR-ISL, Kyoto, Japan
- Faculty of Culture and Information Science, Doshisha Univ., Kyoto, Japan
| | | | | |
Collapse
|
6
|
|
7
|
Zheng X, Shiomi M, Minato T, Ishiguro H. How Can Robots Make People Feel Intimacy Through Touch? JOURNAL OF ROBOTICS AND MECHATRONICS 2020. [DOI: 10.20965/jrm.2020.p0051] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This study investigates the effects of the touch characteristics that change the intimacy perceived by humans in human-robot touch interaction with an android robot having a human-like feminine appearance. Past studies on human-robot touch interaction focused on understanding which types of human touches are used to express emotions to robots. However, they less focused on how a robot’s touch characteristics can affect humans’ perceived intimacy. In this study, first, we concentrated on two types of touch characteristics (type and place) and their effects on the perceived intimacy of a commonly used emotion in human-robot interaction, namely happiness. The results showed that the touch types are useful for changing the perceived intimacy, although the touched place did not exhibit any significant effects. Based on the results of our first experiment, we investigated the effects of different touch characteristics (length and part). We concluded that the touch part is useful to change the perceived intimacy, although the touch length did not exhibit any significant effects. Finally, the results suggested that a pat (type) by the fingers (part) is a better combination to express intimacy with our robot.
Collapse
|
8
|
Nakagawa K, Matsumura R, Shiomi M. Effect of Robot’s Play-Biting in Non-Verbal Communication. JOURNAL OF ROBOTICS AND MECHATRONICS 2020. [DOI: 10.20965/jrm.2020.p0086] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper focuses on “play-biting” as a touch communication method used by robots. We investigated an appropriate play-biting behavior and its effect on interaction. The touching action has positive effects in human-robot interactions. However, as biting is a defenseless act, it may cause a negative effect as well. Therefore, we first examine biting manner and the appearance of the robot using a virtual play-biting system in Experiment 1. Next, based on the result of experiment, the play-biting system is implemented in a stuffed animal robot. We verified the impressions created by the robot and its effect on mitigating stress in Experiment 2. Consequently, the play-biting communication gave positive and lively impression, and effect of reducing the physiological index of stress, in comparison to only touching the robot.
Collapse
|
9
|
Shiomi M, Hirano T, Kimoto M, Iio T, Shimohara K. Gaze-Height and Speech-Timing Effects on Feeling Robot-Initiated Touches. JOURNAL OF ROBOTICS AND MECHATRONICS 2020. [DOI: 10.20965/jrm.2020.p0068] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper reports the effects of communication cues on robot-initiated touch interactions at close distance by focusing on two factors: gaze-height for making eye contact and speech timing before and after touches. Although both factors are essential to achieve acceptable touches in human-human touch interaction, their effectiveness remains unknown in human-robot touch interaction contexts. To investigate the effects of these factors, we conducted an experiment whose results showed that being touched with before-touch timing is preferred to being touched with after-touch timing, although gaze-height did not significantly improve the feelings of robot-initiated touch.
Collapse
|
10
|
Zheng X, Shiomi M, Minato T, Ishiguro H. What Kinds of Robot's Touch Will Match Expressed Emotions? IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2019.2947010] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|