1
|
Dubois-Sage M, Jacquet B, Jamet F, Baratgin J. People with Autism Spectrum Disorder Could Interact More Easily with a Robot than with a Human: Reasons and Limits. Behav Sci (Basel) 2024; 14:131. [PMID: 38392485 PMCID: PMC10886012 DOI: 10.3390/bs14020131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 02/02/2024] [Accepted: 02/04/2024] [Indexed: 02/24/2024] Open
Abstract
Individuals with Autism Spectrum Disorder show deficits in communication and social interaction, as well as repetitive behaviors and restricted interests. Interacting with robots could bring benefits to this population, notably by fostering communication and social interaction. Studies even suggest that people with Autism Spectrum Disorder could interact more easily with a robot partner rather than a human partner. We will be looking at the benefits of robots and the reasons put forward to explain these results. The interest regarding robots would mainly be due to three of their characteristics: they can act as motivational tools, and they are simplified agents whose behavior is more predictable than that of a human. Nevertheless, there are still many challenges to be met in specifying the optimum conditions for using robots with individuals with Autism Spectrum Disorder.
Collapse
Affiliation(s)
- Marion Dubois-Sage
- Laboratoire Cognitions Humaine et Artificielle, RNSR 200515259U, UFR de Psychologie, Université Paris 8, 93526 Saint-Denis, France
| | - Baptiste Jacquet
- Laboratoire Cognitions Humaine et Artificielle, RNSR 200515259U, UFR de Psychologie, Université Paris 8, 93526 Saint-Denis, France
- Association P-A-R-I-S, 75005 Paris, France
| | - Frank Jamet
- Laboratoire Cognitions Humaine et Artificielle, RNSR 200515259U, UFR de Psychologie, Université Paris 8, 93526 Saint-Denis, France
- Association P-A-R-I-S, 75005 Paris, France
- UFR d'Éducation, CY Cergy Paris Université, 95000 Cergy-Pontoise, France
| | - Jean Baratgin
- Laboratoire Cognitions Humaine et Artificielle, RNSR 200515259U, UFR de Psychologie, Université Paris 8, 93526 Saint-Denis, France
- Association P-A-R-I-S, 75005 Paris, France
| |
Collapse
|
2
|
Konishi S, Kuwata M, Matsumoto Y, Yoshikawa Y, Takata K, Haraguchi H, Kudo A, Ishiguro H, Kumazaki H. Self-administered questionnaires enhance emotion estimation of individuals with autism spectrum disorders in a robotic interview setting. Front Psychiatry 2024; 15:1249000. [PMID: 38380121 PMCID: PMC10877007 DOI: 10.3389/fpsyt.2024.1249000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 01/23/2024] [Indexed: 02/22/2024] Open
Abstract
Background Robots offer many unique opportunities for helping individuals with autism spectrum disorders (ASD). Determining the optimal motion of robots when interacting with individuals with ASD is important for achieving more natural human-robot interactions and for exploiting the full potential of robotic interventions. Most prior studies have used supervised machine learning (ML) of user behavioral data to enable robot perception of affective states (i.e., arousal and valence) and engagement. It has previously been suggested that including personal demographic information in the identification of individuals with ASD is important for developing an automated system to perceive individual affective states and engagement. In this study, we hypothesized that assessing self-administered questionnaire data would contribute to the development of an automated estimation of the affective state and engagement when individuals with ASD are interviewed by an Android robot, which will be linked to implementing long-term interventions and maintaining the motivation of participants. Methods Participants sat across a table from an android robot that played the role of the interviewer. Each participant underwent a mock job interview. Twenty-five participants with ASD (males 22, females 3, average chronological age = 22.8, average IQ = 94.04) completed the experiment. We collected multimodal data (i.e., audio, motion, gaze, and self-administered questionnaire data) to train a model to correctly classify the state of individuals with ASD when interviewed by an android robot. We demonstrated the technical feasibility of using ML to enable robot perception of affect and engagement of individuals with ASD based on multimodal data. Results For arousal and engagement, the area under the curve (AUC) values of the model estimates and expert coding were relatively high. Overall, the AUC values of arousal, valence, and engagement were improved by including self-administered questionnaire data in the classification. Discussion These findings support the hypothesis that assessing self-administered questionnaire data contributes to the development of an automated estimation of an individual's affective state and engagement. Given the efficacy of including self-administered questionnaire data, future studies should confirm the effectiveness of such long-term intervention with a robot to maintain participants' motivation based on the proposed method of emotion estimation.
Collapse
Affiliation(s)
- Shunta Konishi
- Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, The University of Tokyo, Chiba, Japan
| | - Masaki Kuwata
- Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, The University of Tokyo, Chiba, Japan
| | - Yoshio Matsumoto
- Department of Medical and Robotic Engineering Design, Faculty of Advanced Engineering, Tokyo University of Science, Tokyo, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Keiji Takata
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan
| | - Hideyuki Haraguchi
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan
| | - Azusa Kudo
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Hirokazu Kumazaki
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
- College of Science and Engineering, Kanazawa University, Kanazawa, Japan
| |
Collapse
|
3
|
Matsushima T, Yoshikawa Y, Matsuo K, Kurahara K, Uehara Y, Nakao T, Ishiguro H, Kumazaki H, Kato TA. Development of depression assessment tools using humanoid robots -Can tele-operated robots talk with depressive persons like humans? J Psychiatr Res 2024; 170:187-194. [PMID: 38154335 DOI: 10.1016/j.jpsychires.2023.12.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 09/26/2023] [Accepted: 12/06/2023] [Indexed: 12/30/2023]
Abstract
BACKGROUND Depression is a common mental disorder and causes significant social loss. Early intervention for depression is important. Nonetheless, depressed patients tend to conceal their symptoms from others based on shame and stigma, thus hesitate to visit psychiatrists especially during early phase. We hypothesize that application of humanoid robots would be a novel solution. Depressed patients may feel more comfortable talking with such robots than humans. METHODS We recruited 13 patients with major depressive disorder (MDD) and 27 healthy volunteers as controls. Participants took both tele-operated humanoid robot and human interviews to evaluate severity of depression using the Hamilton Depression Rating Scale (HDRS). In addition, participants completed a self-administered questionnaire asking about their impressions of the robot interview. RESULTS Confidence interval and t-test analysis have revealed that the HDRS scores are equally reliable between robot and human interviews. No significant differences were observed between the two interviews regarding "nervousness about the interview" and "hesitancy to talk about depressed moods and suicidal ideation." Compared to human interviews, robot interviews yielded significantly lower scores on shame-related factors especially among patients with MDD. LIMITATION Small sample size, and the evaluator is male only. CONCLUSIONS This is the first report to show the reliability of tele-operated humanoid robot interviews for assessment of depression. Robot interviews are potentially equally reliable as human interviews. Robot interviews are suggested to be more appropriate in assessing shame-related suppressed emotions and hidden thoughts of depressed patients in clinical practice, which may reduce the stigma associated with depression.
Collapse
Affiliation(s)
- Toshio Matsushima
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Keitaro Matsuo
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Keita Kurahara
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Youki Uehara
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Tomohiro Nakao
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Hirokazu Kumazaki
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| | - Takahiro A Kato
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan.
| |
Collapse
|
4
|
Holeva V, Nikopoulou VA, Lytridis C, Bazinas C, Kechayas P, Sidiropoulos G, Papadopoulou M, Kerasidou MD, Karatsioras C, Geronikola N, Papakostas GA, Kaburlasos VG, Evangeliou A. Effectiveness of a Robot-Assisted Psychological Intervention for Children with Autism Spectrum Disorder. J Autism Dev Disord 2024; 54:577-593. [PMID: 36331688 PMCID: PMC9638397 DOI: 10.1007/s10803-022-05796-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/12/2022] [Indexed: 11/06/2022]
Abstract
Difficulties with social interaction characterise children with Autism Spectrum Disorders and have a negative impact in their everyday life. Integrating a social-humanoid robot within the standard clinical treatment has been proven promising. The main aim of this randomised controlled study was to evaluate the effectiveness of a robot-assisted psychosocial intervention and the secondary aim was to investigate potential differences between a robot-assisted intervention group and a control group receiving intervention by humans only. The analysis of the results showed that robot-assisted intervention could be beneficial by improving children's psychosocial skills. This improvement was highlighted by neuropsychological testing and parent reporting. Group comparison only presented minimal statistically significant differences. The study underpins the potential of robot-assisted interventions to augment standard care.
Collapse
Grants
- Τ1ΕDΚ-00929 Action "RESEARCH - DEVELOP - INNOVATE", cycle A, Intervention II, Operational Programme "Competitiveness, Entrepreneurship and Innovation", NSRF (National Strategic Reference Framework) of Greece 2014-2020
- Action “RESEARCH – DEVELOP - INNOVATE”, cycle A, Intervention II, Operational Programme “Competitiveness, Entrepreneurship and Innovation”, NSRF (National Strategic Reference Framework) of Greece 2014-2020
Collapse
Affiliation(s)
- Vasiliki Holeva
- Clinical Psychology Department, Papageorgiou General Hospital, Periferiaki Odos, Ring Road, N. Efkarpia, 54603, Thessaloniki, Greece.
| | - V A Nikopoulou
- Clinical Psychology Department, Papageorgiou General Hospital, Periferiaki Odos, Ring Road, N. Efkarpia, 54603, Thessaloniki, Greece
| | - C Lytridis
- HUman-MAchines INteraction Laboratory (HUMAIN-Lab), International Hellenic University, Agios Loukas, Kavala, Greece
| | - C Bazinas
- HUman-MAchines INteraction Laboratory (HUMAIN-Lab), International Hellenic University, Agios Loukas, Kavala, Greece
| | - P Kechayas
- Clinical Psychology Department, Papageorgiou General Hospital, Periferiaki Odos, Ring Road, N. Efkarpia, 54603, Thessaloniki, Greece
| | - G Sidiropoulos
- HUman-MAchines INteraction Laboratory (HUMAIN-Lab), International Hellenic University, Agios Loukas, Kavala, Greece
| | - M Papadopoulou
- Division of Child Neurology and Metabolic Disorders, 4th Department of Paediatrics, AUTH, Papageorgiou General Hospital, Periferiaki Odos, N. Efkarpia, Thessaloniki, Greece
| | - M D Kerasidou
- Clinical Psychology Department, Papageorgiou General Hospital, Periferiaki Odos, Ring Road, N. Efkarpia, 54603, Thessaloniki, Greece
| | - C Karatsioras
- "Praxis" Novel Consulting and Therapy Centre for Children, Kavala, Greece
| | | | - G A Papakostas
- HUman-MAchines INteraction Laboratory (HUMAIN-Lab), International Hellenic University, Agios Loukas, Kavala, Greece
| | - V G Kaburlasos
- HUman-MAchines INteraction Laboratory (HUMAIN-Lab), International Hellenic University, Agios Loukas, Kavala, Greece
| | - A Evangeliou
- Division of Child Neurology and Metabolic Disorders, 4th Department of Paediatrics, AUTH, Papageorgiou General Hospital, Periferiaki Odos, N. Efkarpia, Thessaloniki, Greece
| |
Collapse
|
5
|
Yoshikawa Y, Kobayashi H, Sakai N, Ishiguro H, Kumazaki H. Therapeutic potential of robots for people who stutter: a preliminary study. Front Psychiatry 2024; 15:1298626. [PMID: 38283848 PMCID: PMC10811234 DOI: 10.3389/fpsyt.2024.1298626] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 01/03/2024] [Indexed: 01/30/2024] Open
Abstract
Introduction Growing anecdotal evidence suggests the feasibility of robotic intervention for people who suffer from disorders related to state anxiety. Few studies have been conducted on utilizing robots for persons who stutter (PWS). The present study examines the feasibility of using a robot for speech therapy for PWS. Methods We prepared four settings (i.e., interviews with unfamiliar persons, interviews with unfamiliar communication robots, reading sentences aloud with a tandem robot that can utter the same words as a user by repeating the user's voice after a short delay, and reading sentences aloud while being alone). We assessed the potential of the robots as both interlocutors and practice partners in training with delayed auditory feedback (DAF) for PWS. Moreover, we assessed the relationship between the trait of stuttering and the participants' affinity to the robots. Results Eleven PWS participated in the study. Eight (72.7%) participants had fewer stuttering-related psychological symptoms when they communicated with robots than when they communicated with humans. Spearman's rank correlation analysis revealed that there was a significant negative correlation between the Modified Erickson Communication Attitude scale (S-24) and the difference between the scores for stuttering-related psychological symptoms pertaining to the communication robot and humans (p < 0.01). Six participants (54.5%) had fewer stuttering-related psychological symptoms when they read aloud with the tandem robot than when they read aloud alone. There were significant positive correlations between S-24 and the differences between the scores for stuttering-related psychological symptoms when reading aloud with the tandem robot and those when reading aloud alone (p < 0.01). Discussion The communication robot and tandem utterance robot can sometimes be burdensome, although both robots were always easier to talk to for PWS in this preliminary study. The participants with positive speech-related attitudes were more inclined to decrease stuttering-related psychological symptoms when communicating with CommU than when communicating with humans. The participants whose speech-related attitudes were negative were more inclined to show a decrease in stuttering-related psychological symptoms when reading aloud with the tandem robot. Further studies are needed to provide more detailed information.
Collapse
Affiliation(s)
- Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Hiroaki Kobayashi
- Department of Clinical Research on Social Recognition and Memory, Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Naomi Sakai
- Hearing and Speech Functions Section, Department of Rehabilitation for Sensory Functions, National Rehabilitation Center for Persons with Disabilities, Research Institute, Saitama, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Hirokazu Kumazaki
- College of Science and Engineering, Kanazawa University, Kanazawa, Japan
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| |
Collapse
|
6
|
Jin YR, Sung YS, Koh CL, Chu SY, Yang HC, Lin LY. Efficacy of Motor Interventions on Functional Performance Among Preschool Children With Autism Spectrum Disorder: A Pilot Randomized Controlled Trial. Am J Occup Ther 2023; 77:7706205020. [PMID: 37992052 DOI: 10.5014/ajot.2023.050283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2023] Open
Abstract
IMPORTANCE Motor ability plays an important role in overall developmental profiles. Preschool children with autism spectrum disorder (ASD) are at risk of motor skills deficits and delays. However, evidence of the efficacy of different motor interventions for the identification of optimal treatment types is lacking, especially for preschool children with ASD. OBJECTIVE To examine the efficacy of the Motor Skill Occupational Therapy Intervention ON ASD (MOTION-ASD) and Cognitive Orientation Exercise (CO-EXC) programs to improve motor skills performance, self-care performance, and adaptive behaviors among preschool children with ASD. DESIGN Randomized controlled trial, two-group, triple-blinded, repeated-measures design Setting: University laboratory. PARTICIPANTS Thirteen preschool children with ASD (M age = 4.91 yr). OUTCOMES AND MEASURES The Bruininks-Oseretsky Test of Motor Proficiency-Second Edition, Brief Form, Assessment of Motor and Process Skills, and Vineland Adaptive Behavior Scales-Third Edition. RESULTS Children in the MOTION-ASD group showed significantly greater improvements in manual coordination and overall gross and fine manual skills than those in the CO-EXC group immediately after the intervention. Significant improvements in fine manual control, body coordination, overall motor skills, and self-care performance were made throughout both interventions and were retained at the posttest and the 4-wk follow-up. CONCLUSIONS AND RELEVANCE These findings provide supporting evidence that motor skills interventions involving fundamental skills and cognitive training may be a viable therapeutic option for treating children with ASD. The results also suggest that practitioners may consider providing structured and strategic motor skills interventions for preschool children with ASD. What This Article Adds: This study's rigorous tests of motor skills interventions support ways to manage motor difficulties in children with autism spectrum disorder (ASD). An intervention based on motor learning theory could benefit preschool children with ASD, especially in terms of manual coordination ability and overall gross and fine motor skills.
Collapse
Affiliation(s)
- Yu-Ru Jin
- Yu-Ru Jin, MS, is Doctoral Student, Institute of Allied Health Sciences, College of Medicine, National Cheng Kung University, Tainan, Taiwan. At the time this research was conducted, Jin was Graduate Student, Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Yi-Shan Sung
- Yi-Shan Sung, PhD, was PhD Candidate, Institute of Allied Health Sciences, College of Medicine, National Cheng Kung University, Tainan, Taiwan, at the time this research was conducted
| | - Chia-Lin Koh
- Chia-Lin Koh, PhD, is Assistant Professor, Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Shin Ying Chu
- Shin Ying Chu, PhD, is Associate Professor, Head, Speech Sciences Programme, Faculty of Health Sciences, Centre for Healthy Ageing and Wellness (H-CARE), National University of Malaysia, Kuala Lumpur, Malaysia
| | - Hsiu-Ching Yang
- Hsiu-Ching Yang, MS, is Occupational Therapist, Department of Physical Medicine and Rehabilitation, National Cheng Kung University Hospital, Tainan, Taiwan
| | - Ling-Yi Lin
- Ling-Yi Lin, ScD, is Department Chair and Professor, Department of Occupational Therapy, and Professor, Institute of Allied Health Sciences, College of Medicine, National Cheng Kung University, Tainan, Taiwan;
| |
Collapse
|
7
|
Takata K, Yoshikawa Y, Muramatsu T, Matsumoto Y, Ishiguro H, Mimura M, Kumazaki H. Social skills training using multiple humanoid robots for individuals with autism spectrum conditions. Front Psychiatry 2023; 14:1168837. [PMID: 37539327 PMCID: PMC10394831 DOI: 10.3389/fpsyt.2023.1168837] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 06/23/2023] [Indexed: 08/05/2023] Open
Abstract
Introduction Social skills training (SST) is used to help individuals with autism spectrum conditions (ASC) better understand the perspectives of others and social interactions, develop empathy skills, and learn how to engage with others socially. However, many individuals with ASC cannot easily sustain high motivation and concentration during such an intervention when it is administered by humans. We developed a social skills training program using multiple humanoid robots (STUH), including an android robot, that aimed to enable individuals with ASC to become familiar with the perspectives of others and improve their sociability and empathy skills. The objective of the present study was to investigate the effectiveness of STUH for these individuals. Methods In STUH, we prepared 50 social exercises that consisted of conversations and behavioral interactions between an android robot and a simple humanoid robot. We prepared another humanoid robot that featured a cartoon-like and mechanical design, which played the role of host. In the first half-session of STUH, participants worked on the exercise from the perspective of an outsider. In the second half-session of STUH, they simulated experience by using robots as their avatars. The intervention associated with STUH was conducted for five days in total. We conducted an analysis of variance (ANOVA) featuring the intervention time point as the independent variable to examine changes in each score on the sociability index items. Results In total, 14 individuals with ASC participated in the study. The results of multiple comparison tests using the Bonferroni method indicated that all sociability index items improved between preintervention and follow-up. Our program enabled the participants to become familiar with the perspectives of others and improve their sociability. Discussion Given the promising results of this study, future studies featuring long-term follow-up should be conducted to draw definitive conclusions about the efficacy of our training system.
Collapse
Affiliation(s)
- Keiji Takata
- Department of Psychology, Saitama Gakuen University, Saitama, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Yoshio Matsumoto
- Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Chiba, Japan
- Department of Clinical Research on Social Recognition and Memory, Research Center for Child Mental Development, Kanazawa University, Ishikawa, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Hirokazu Kumazaki
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
- Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Chiba, Japan
- College of Science and Engineering, Kanazawa University, Ishikawa, Japan
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| |
Collapse
|
8
|
Yoshikawa Y, Muramatsu T, Sakai K, Haraguchi H, Kudo A, Ishiguro H, Mimura M, Kumazaki H. A new group-based online job interview training program using computer graphics robots for individuals with autism spectrum disorders. Front Psychiatry 2023; 14:1198433. [PMID: 37465254 PMCID: PMC10350627 DOI: 10.3389/fpsyt.2023.1198433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Accepted: 06/20/2023] [Indexed: 07/20/2023] Open
Abstract
Introduction Job interviews are a major barrier to employment for individuals with autism spectrum disorders (ASD). During the coronavirus pandemic, establishing online job interview training at home was indispensable. However, many hurdles prevent individuals with ASD from concentrating on online job interview training. To facilitate the acquisition of interview skills from home for individuals with ASD, we developed a group interview training program with a virtual conferencing system (GIT-VICS Program) that uses computer graphics (CG) robots. Methods This study investigated the feasibility of the GIT-VICS Program in facilitating skill acquisition for face-to-face job interviews in pre-post measures. In the GIT-VICS Program, five participants were grouped and played the roles of interviewees (1), interviewers (2), and human resources (2). They alternately practiced each role in GIT-VICS Program sessions conducted over 8 or 9 days over three consecutive weeks. Before and after the GIT-VICS Program, the participants underwent a mock face-to-face job interview with two experienced human interviewers (MFH) to evaluate its effect. Results Fourteen participants completed the trial procedures without experiencing any technological challenges or distress that would have led to the termination of the session. The GIT-VICS Program improved their job interview skills (verbal competence, nonverbal competence, and interview performance). Discussion Given the promising results of this study and to draw clear conclusions about the efficacy of CG robots for mock online job interview training, future studies adding appropriate guidance for manner of job interview by experts are needed.
Collapse
Affiliation(s)
- Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Kazuki Sakai
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Hideyuki Haraguchi
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan
| | - Azusa Kudo
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Hirokazu Kumazaki
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan
- Department of Neuropsychiatry, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
- College of Science and Engineering, Kanazawa University, Ishikawa, Japan
| |
Collapse
|
9
|
Hong Y, Chen S, Zhou F, Chan A, Tang T. Phonetic entrainment in L2 human-robot interaction: an investigation of children with and without autism spectrum disorder. Front Psychol 2023; 14:1128976. [PMID: 37404579 PMCID: PMC10315851 DOI: 10.3389/fpsyg.2023.1128976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 05/19/2023] [Indexed: 07/06/2023] Open
Abstract
Phonetic entrainment is a phenomenon in which people adjust their phonetic features to approach those of their conversation partner. Individuals with Autism Spectrum Disorder (ASD) have been reported to show some deficits in entrainment during their interactions with human interlocutors, though deficits in terms of significant differences from typically developing (TD) controls were not always registered. One reason related to the inconsistencies of whether deficits are detected or not in autistic individuals is that the conversation partner's speech could hardly be controlled, and both the participants and the partners might be adjusting their phonetic features. The variabilities in the speech of conversation partners and various social traits exhibited might make the phonetic entrainment (if any) of the participants less detectable. In this study, we attempted to reduce the variability of the interlocutors by employing a social robot and having it do a goal-directed conversation task with children with and without ASD. Fourteen autistic children and 12 TD children participated the current study in their second language English. Results showed that autistic children showed comparable vowel formants and mean fundamental frequency (f0) entrainment as their TD peers, but they did not entrain their f0 range as the TD group did. These findings suggest that autistic children were capable of exhibiting phonetic entrainment behaviors similar to TD children in vowel formants and f0, particularly in a less complex situation where the speech features and social traits of the interlocutor were controlled. Furthermore, the utilization of a social robot may have increased the interest of these children in phonetic entrainment. On the other hand, entrainment of f0 range was more challenging for these autistic children even in a more controlled situation. This study demonstrates the viability and potential of using human-robot interactions as a novel method to evaluate abilities and deficits in phonetic entrainment in autistic children.
Collapse
Affiliation(s)
- Yitian Hong
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Si Chen
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- Department of Chinese and Bilingual Studies, Research Centre for Language, Cognition, and Neuroscience, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- The HK PolyU-PekingU Research Centre on Chinese Linguistics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Fang Zhou
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Angel Chan
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- Department of Chinese and Bilingual Studies, Research Centre for Language, Cognition, and Neuroscience, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- The HK PolyU-PekingU Research Centre on Chinese Linguistics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Tempo Tang
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| |
Collapse
|
10
|
Ghiglino D, Floris F, De Tommaso D, Kompatsiari K, Chevalier P, Priolo T, Wykowska A. Artificial scaffolding: Augmenting social cognition by means of robot technology. Autism Res 2023; 16:997-1008. [PMID: 36847354 DOI: 10.1002/aur.2906] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 02/11/2023] [Indexed: 03/01/2023]
Abstract
The concept of scaffolding refers to the support that the environment provides in the acquisition and consolidation of new abilities. Technological advancements allow for support in the acquisition of cognitive capabilities, such as second language acquisition using simple smartphone applications There is, however, one domain of cognition that has been scarcely addressed in the context of technologically assisted scaffolding: social cognition. We explored the possibility of supporting the acquisition of social competencies of a group of children with autism spectrum disorder engaged in a rehabilitation program (age = 5.8 ± 1.14, 10 females, 33 males) by designing two robot-assisted training protocols tailored to Theory of Mind competencies. One protocol was performed with a humanoid robot and the other (control) with a non-anthropomorphic robot. We analyzed changes in NEPSY-II scores before and after the training using mixed effects models. Our results showed that activities with the humanoid significantly improved NEPSY-II scores on the ToM scale. We claim that the motor repertoire of humanoids makes them ideal platforms for artificial scaffolding of social skills in individuals with autism, as they can evoke similar social mechanisms to those elicited in human-human interaction, without providing the same social pressure that another human might exert.
Collapse
Affiliation(s)
- Davide Ghiglino
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Federica Floris
- Piccolo Cottolengo Genovese di Don Orione, Don Orione Italia, Genoa, Italy.,SIDiN, Società Italiana Disturbi del Neurosviluppo, Florence, Italy
| | - Davide De Tommaso
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Kyveli Kompatsiari
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Pauline Chevalier
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Tiziana Priolo
- Piccolo Cottolengo Genovese di Don Orione, Don Orione Italia, Genoa, Italy
| | - Agnieszka Wykowska
- Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genoa, Italy
| |
Collapse
|
11
|
Pinto-Bernal MJ, Sierra M. SD, Munera M, Casas D, Villa-Moreno A, Frizera-Neto A, Stoelen MF, Belpaeme T, Cifuentes CA. Do different robot appearances change emotion recognition in children with ASD? Front Neurorobot 2023; 17:1044491. [PMID: 36937553 PMCID: PMC10017775 DOI: 10.3389/fnbot.2023.1044491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Accepted: 02/06/2023] [Indexed: 03/06/2023] Open
Abstract
Introduction Socially Assistive Robotics has emerged as a potential tool for rehabilitating cognitive and developmental disorders in children with autism. Social robots found in the literature are often able to teach critical social skills, such as emotion recognition and physical interaction. Even though there are promising results in clinical studies, there is a lack of guidelines on selecting the appropriate robot and how to design and implement the child-robot interaction. Methods This work aims to evaluate the impacts of a social robot designed with three different appearances according to the results of a participatory design (PD) process with the community. A validation study in the emotion recognition task was carried out with 21 children with autism. Results Spectrum disorder results showed that robot-like appearances reached a higher percentage of children's attention and that participants performed better when recognizing simple emotions, such as happiness and sadness. Discussion This study offers empirical support for continuing research on using SAR to promote social interaction with children with ASD. Further long-term research will help to identify the differences between high and low-functioning children.
Collapse
Affiliation(s)
| | - Sergio D. Sierra M.
- Bristol Robotics Laboratory, University of the West of England, Bristol, United Kingdom
| | - Marcela Munera
- Bristol Robotics Laboratory, University of the West of England, Bristol, United Kingdom
- Department of Biomedical Engineering, Colombian School of Engineering Julio Garavito, Bogotá, Colombia
| | - Diego Casas
- School of Engineering, Science and Technology, Universidad del Rosario, Bogotá, Colombia
| | | | - Anselmo Frizera-Neto
- Electrical Engineering Department, Federal University of Espirito Santo, Victoria, Brazil
| | - Martin F. Stoelen
- Faculty of Engineering and Science, Western Norway University of Applied Sciences, Bergen, Norway
| | | | - Carlos A. Cifuentes
- Bristol Robotics Laboratory, University of the West of England, Bristol, United Kingdom
- School of Engineering, Science and Technology, Universidad del Rosario, Bogotá, Colombia
- *Correspondence: Carlos A. Cifuentes
| |
Collapse
|
12
|
Occupational Therapy Interventions Using New Technologies in Children and Adolescents with Autism Spectrum Disorder: A Scoping Review. J Autism Dev Disord 2023; 53:332-358. [PMID: 35048236 PMCID: PMC9889430 DOI: 10.1007/s10803-022-05431-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/04/2022] [Indexed: 02/04/2023]
Abstract
New technologies (NT) are increasingly used in Occupational Therapy (OT) interventions in people with Autism Spectrum Disorder (ASD). We conducted a scoping review to describe OT interventions investigated in scientific literature which use NT in children and adolescents with ASD. Two authors independently searched the scientific databases PubMed, EMBASE, Scopus and Web of Science, carried out a peer-review screening of articles and extracted data. Twenty studies met the inclusion criteria. OT interventions lasted between 1 week and 12 months, consisted of between 1 session per day and 5 sessions per week, were carried out exclusively by an occupational therapist, and the most used NT was the computer (n = 12). The duration of the interventions and assessment measures used varied greatly between studies.
Collapse
|
13
|
Yoshida A, Kumazaki H, Muramatsu T, Yoshikawa Y, Ishiguro H, Mimura M. Intervention with a humanoid robot avatar for individuals with social anxiety disorders comorbid with autism spectrum disorders. Asian J Psychiatr 2022; 78:103315. [PMID: 36343574 DOI: 10.1016/j.ajp.2022.103315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Accepted: 11/03/2022] [Indexed: 11/06/2022]
Abstract
For some individuals with social anxiety disorders (SAD) comorbid with autism spectrum disorders (ASD), it is difficult to speak in front of others. Herein, we report the case of a patient with SAD comorbid with ASD who could not speak in front of others until she used a humanoid robot as her avatar. During the intervention, her personality changed from shy to outgoing, which is explained by the Proteus effect. These case findings suggest that interventions with a robot avatar might improve the motivation for individuals with SAD comorbid with ASD who cannot speak in front of others to communicate.
Collapse
Affiliation(s)
- Atsushi Yoshida
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Hirokazu Kumazaki
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan; Department of Future Psychiatric Medicine, Graduate school of Biomedical Sciences, Nagasaki University, Nagasaki, Japan; Colledge of Science and Engineering, Kanazawa University, Ishikawa, Japan.
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
14
|
van Dam K, Gielissen M, Reijnders R, van der Poel A, Boon B. Experiences of Persons With Executive Dysfunction in Disability Care Using a Social Robot to Execute Daily Tasks and Increase the Feeling of Independence: Multiple-Case Study. JMIR Rehabil Assist Technol 2022; 9:e41313. [PMID: 36326800 PMCID: PMC9672999 DOI: 10.2196/41313] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 09/06/2022] [Accepted: 10/04/2022] [Indexed: 11/06/2022] Open
Abstract
Background Executive functions are essential for independently navigating nearly all of our daily activities. Executive dysfunction often occurs as a result of a neurodevelopmental disorder. Persons with executive dysfunction experience challenges regarding independent execution of daily tasks. Social robots might support persons with executive dysfunction to execute daily tasks and promote their feeling of independence. Objective This study aimed to study the impact of interacting with social robot Tessa on goal attainment in the execution of daily tasks and perceived independence of persons with executive dysfunction. Methods In this multiple-case study, 18 participant–caregiver couples were followed up while using Tessa in the home environment for 3 months. Goal attainment on independently performing a self-determined goal was measured by the Goal Attainment Scale, and participant–caregiver couples were interviewed about their experience with their interaction with Tessa and how they perceived Tessa’s impact on their independence. Results In total, 11 (61%) participants reached their goal after 6 weeks and maintained their goal after 3 months. During the study period, 2 participant–caregiver couples withdrew because of mismatch with Tessa. Participants set goals in the following domains: execution of household tasks; intake of food, water, or medication; being ready in time for an appointment; going to bed or getting out of bed on time; personal care; and exercise. Participants perceived that Tessa increased the feeling of independence by generating more structure, stimulation, and self-direction. Participant–caregiver couples reported that the auditive information provided by Tessa was more effective in coping with executive dysfunction compared to their initial approaches using visual information, and the use of Tessa had a positive impact on their relationship. Conclusions This study paid ample time and attention to the implementation of a social robot in daily care practice. The encouraging findings support the use of social robot Tessa for the execution of daily tasks and increasing independence of persons with executive dysfunction in disability care.
Collapse
Affiliation(s)
| | | | | | | | - Brigitte Boon
- Academy Het Dorp, Arnhem, Netherlands
- Siza, Arnhem, Netherlands
- Tranzo, Tilburg University, Tilburg, Netherlands
| |
Collapse
|
15
|
Maggio MG, Calatozzo P, Cerasa A, Pioggia G, Quartarone A, Calabrò RS. Sex and Sexuality in Autism Spectrum Disorders: A Scoping Review on a Neglected but Fundamental Issue. Brain Sci 2022; 12:1427. [PMID: 36358354 PMCID: PMC9688284 DOI: 10.3390/brainsci12111427] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 10/16/2022] [Accepted: 10/21/2022] [Indexed: 11/19/2023] Open
Abstract
ASD consists of a set of permanent neurodevelopmental conditions, which are studded with social and communication differences, limited interests, and repetitive behaviors. Individuals with ASD have difficulty reading eye gestures and expressions, and may also have stereotyped or repetitive language, excessive adherence to routines, fixed interests, and rigid thinking. However, sexuality in adolescents and young adults with ASD is still a poorly studied and neglected issue. This review aims to evaluate sexual function and behavior in individuals with ASD to foster a greater understanding of this important, although often overlooked, issue. This review was conducted by searching peer-reviewed articles published between 01 June 2000 and 31 May 2022 using the following databases: PubMed, Embase, Cochrane Database, and Web of Science. A comprehensive search was conducted using the terms: "Autism" OR "ASD" AND "Sexuality" OR "Romantic relation" OR "sexual behavior" AND/OR "sexual awareness". After an accurate revision of 214 full manuscripts, 11 articles satisfied the inclusion/exclusion criteria. This review found that, although individuals with ASD may have sexual functioning, their sexuality is characterized by higher prevalence rates of gender dysphoria and inappropriate sexual behavior. Furthermore, sexual awareness is reduced in this patient population, and the prevalence of other variants of sexual orientation (i.e., homosexuality, asexuality, bisexuality, etc.) is higher in adolescents with ASD than in non-autistic peers. Sexual health and education should be included in the care path of patients with ASD in order to improve their quality of life and avoid/reduce inappropriate and risky behaviors.
Collapse
Affiliation(s)
- Maria Grazia Maggio
- Department of Biomedical and Biotechnological Science, University of Catania, 95123 Catania, Italy
| | - Patrizia Calatozzo
- Studio di Psicoterapia Relazionale e Riabilitazione Cognitiva, 98124 Messina, Italy
| | - Antonio Cerasa
- Institute for Biomedical Research and Innovation, National Research Council of Italy (IRIB-CNR), 98164 Messina, Italy
- Sant’Anna Institute, 88900 Crotone, Italy
- Pharmacotechnology Documention and Transfer Unit, Preclinical and Traslation Pharmacology, Department of Pharmacy, Health Science and Nutrition, University of Calabria, 87036 Calabria, Italy
| | - Giovanni Pioggia
- Institute for Biomedical Research and Innovation, National Research Council of Italy (IRIB-CNR), 98164 Messina, Italy
| | | | | |
Collapse
|
16
|
Kumazaki H, Muramatsu T, Yoshikawa Y, Matsumoto Y, Takata K, Ishiguro H, Mimura M. Android Robot Promotes Disclosure of Negative Narratives by Individuals With Autism Spectrum Disorders. Front Psychiatry 2022; 13:899664. [PMID: 35782427 PMCID: PMC9240260 DOI: 10.3389/fpsyt.2022.899664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Accepted: 05/26/2022] [Indexed: 11/13/2022] Open
Abstract
Many individuals with autism spectrum disorders (ASD) demonstrate some challenges with personal narrative writing. Sentence completion tests (SCT) is a class of semi-structured projective techniques and encourage respondents to disclose their private narratives. Even in SCT, only providing beginning of sentences is inadequate to compensate atypicalities in their creativity and imagination, and self-disclosure is difficult for many individuals with ASD. It is reported that many individuals with ASD often achieve a higher degree of task engagement through interactions with robots and that robotic systems may be useful in eliciting and promoting social communication such as self-disclosure for some individuals with ASD. There is a possibility that exemplification by android robots in place of human interviewers can result in a higher degree of task engagement for individuals with ASD. The objective of this study was to investigate whether additional exemplifications by android robots in the SCT can prompt self-disclosure for individuals with ASD. We compared the difference in disclosure statements and subjective emotion in the testing paper of the SCT in additional exemplification by an android robot and a human interviewer. In addition, we assessed the disclosure statements and subjective emotions in the SCT, for which exemplifications were written on testing paper to make the comparison. Our quantitative data suggested that exemplification by android robot promoted more self-disclosure, especially about the negative topic compared to exemplification by a human interviewer and that written on test paper. In addition, the level of participant embarrassment in response to exemplification by the android robot seemed to be lower compared to that in the human interviewer condition. In the assessment and support for individuals with ASD, eliciting self-disclosure is a pressing issue. It is hoped that the appropriate use of robots will lead to a better understanding and support for their application.
Collapse
Affiliation(s)
- Hirokazu Kumazaki
- Department of Neuropsychiatry, Unit of Translational Medicine, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan.,Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan.,College of Science and Engineering, Kanazawa University, Kanazawa, Japan.,Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan.,Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Chiba, Japan
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Yoshio Matsumoto
- Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan.,College of Science and Engineering, Kanazawa University, Kanazawa, Japan.,Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Keiji Takata
- Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
17
|
Kumazaki H, Muramatsu T, Yoshikawa Y, Matsumoto Y, Kuwata M, Takata K, Ishiguro H, Mimura M. Differences in the Optimal Motion of Android Robots for the Ease of Communications Among Individuals With Autism Spectrum Disorders. Front Psychiatry 2022; 13:883371. [PMID: 35722543 PMCID: PMC9203835 DOI: 10.3389/fpsyt.2022.883371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Accepted: 05/13/2022] [Indexed: 12/01/2022] Open
Abstract
Android robots are employed in various fields. Many individuals with autism spectrum disorders (ASD) have the motivation and aptitude for using such robots. Interactions with these robots are structured to resemble social situations in which certain social behaviors can occur and to simulate daily life. Considering that individuals with ASD have strong likes and dislikes, ensuring not only the optimal appearance but also the optimal motion of robots is important to achieve smooth interaction and to draw out the potential of robotic interventions. We investigated whether individuals with ASD found it easier to talk to an android robot with little motion (i.e., only opening and closing its mouth during speech) or an android robot with much motion (i.e., in addition to opening and closing its mouth during speech, moving its eyes from side to side and up and down, blinking, deeply breathing, and turning or moving its head or body at random). This was a crossover study in which a total of 25 participants with ASD experienced mock interviews conducted by an android robot with much spontaneous facial and bodily motion and an android robot with little motion. We compared demographic data between participants who answered that the android robot with much motion was easier to talk to than android robot with little motion and those who answered the opposite. In addition, we investigated how each type of demographic data was related to participants' feeling of comfort in an interview setting with an android robot. Fourteen participants indicated that the android robot with little motion was easier to talk to than the robot with much motion, whereas 11 participants answered the opposite. There were significant differences between these two groups in the sensory sensitivity score, which reflects the tendency to show a low neurological threshold. In addition, we found correlations between the sensation seeking score, which reflects the tendency to show a high neurological threshold, and self-report ratings of comfort in each condition. These results provide preliminary support for the importance of setting the motion of an android robot considering the sensory traits of ASD.
Collapse
Affiliation(s)
- Hirokazu Kumazaki
- Department of Future Psychiatric Medicine, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan.,National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan.,College of Science and Engineering, Kanazawa University, Kanazawa, Japan.,Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan.,Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Chiba, Japan
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Yoshio Matsumoto
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan.,Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Chiba, Japan.,Department of Clinical Research on Social Recognition and Memory, Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Masaki Kuwata
- Human Augmentation Research Center, National Institute of Advanced Industrial Science and Technology, Chiba, Japan
| | - Keiji Takata
- National Center of Neurology and Psychiatry, Department of Preventive Intervention for Psychiatric Disorders, National Institute of Mental Health, Tokyo, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
18
|
Robot-Enhanced Language Learning for Children in Norwegian Day-Care Centers. MULTIMODAL TECHNOLOGIES AND INTERACTION 2021. [DOI: 10.3390/mti5120074] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
In a case study, we transformed the existing learning program Language Shower, which is used in some Norwegian day-care centers in the Grorud district of Oslo municipality, into a digital solution using an app for smartphones or tablets with the option for further enhancement of the presentation by a NAO robot. The solution was tested in several iterations and multiple day-care centers over several weeks. Measurements of the children’s progress across learning sessions indicated a positive impact of the program using a robot as compared to the program without a robot. In situ observations and interviews with day-care center staff confirmed the solution’s many advantages, but also revealed some important areas for improvement. In particular, the speech recognition needs to be more flexible and robust, and special measures have to be in place to handle children speaking simultaneously.
Collapse
|
19
|
Brief Report: The Effectiveness of Hugging a Huggable Device Before Having a Conversation with an Unfamiliar Person for Autism Spectrum Disorders. J Autism Dev Disord 2021; 52:3294-3303. [PMID: 34292488 PMCID: PMC9213352 DOI: 10.1007/s10803-021-05173-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/25/2021] [Indexed: 11/17/2022]
Abstract
Sensory overresponsivity (SOR) emerges before anxiety and positively predicts subsequent increasing levels of anxiety in individuals with autism spectrum disorder (ASD). Sensory seeking behavior occurs as compensation for SOR, and individuals may seek sensory input in one sensory domain to compensate for SOR. Tactile seeking behavior is sufficient to decrease social anxiety in communicating with unfamiliar people. We assessed the effectiveness of hugging a huggable device before a conversation for reducing the psychological stress associated with speaking to an unfamiliar person or robot. Our analysis showed a significant effect, with Hugvie contributing to decreased stress for both interlocutors. Thus, this study demonstrated the efficacy of hugging it before conversation, which emphasizes the importance of tactile seeking for individuals with ASD.
Collapse
|
20
|
Future perspectives of robot psychiatry: can communication robots assist psychiatric evaluation in the COVID-19 pandemic era? Curr Opin Psychiatry 2021; 34:277-286. [PMID: 33560019 DOI: 10.1097/yco.0000000000000692] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
PURPOSE OF REVIEW Direct face-to-face interview between a psychiatrist and a patient is crucial in psychiatric evaluation, however, such traditional interviews are becoming difficult to conduct because of the infection risk in the COVID-19 era. As telepsychiatry, video interviews using internet are suggested to be useful to evaluate and assist individuals with mental disorders. However, some patients especially with social phobia, depression, and autism spectrum disorder (ASD) hesitate to use even such face-to-face-like tools. Communication robots have been proposed as future assistant tools for such patients. Herein, we summarize recent advancements in robot psychiatry, and propose the benefits of communication robots in psychiatric evaluation. RECENT FINDINGS Recent studies have suggested that communication robots are effective in assisting people with ASD. As a pilot trial, we herein conducted semi-structured interviews to evaluate depression and hikikomori, a form of pathological social withdrawal, using a communication robot and a psychiatrist, respectively. There was almost identical evaluation between the two. Interestingly, a person with hikikomori answered that the robot was easier to disclose. SUMMARY Robots can reduce the burden of human resources and the infection risk in the COVID-19 era. Robot interview is expected to be implemented for future evaluation system in psychiatry.
Collapse
|
21
|
Kuhn E, Fiske A, Henningsen P, Buyx A. [Psychotherapy with an Autonomous Artifical Intelligence - Ethical Benefits and Challenges]. PSYCHIATRISCHE PRAXIS 2021; 48:S26-S30. [PMID: 33652484 DOI: 10.1055/a-1369-2938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
OBJECTIVE This paper provides an overview of a range of ethical aspects involved in the use of autonomous, virtual or embodied artificial intelligence (AI) in the care of people with mental health issues. METHODOLOGY The overview is based on a thematic literature review. It is guided by the principles of biomedical ethics together with the concept of epistemic (in)justice. RESULTS In addition to a risk-benefit analysis, (digital) health literacy, equity of access, issues of under- or misuse of care, and an adaptation of informed consent need to be considered. CONCLUSION The ethical assessment of autonomous AI in psychotherapy remains open; too many clinical, ethical, legal, and practical questions remain to be addressed. Quality criteria for AI application as well as guidelines for its clinical use need to be developed before wider clinical implementation.
Collapse
Affiliation(s)
- Eva Kuhn
- Sektion Global Health, Institut für Hygiene und Öffentliche Gesundheit, Universitätsklinikum Bonn
| | - Amelia Fiske
- Institut für Geschichte und Ethik der Medizin, Technische Universität München
| | - Peter Henningsen
- Klinik für Psychosomatische Medizin und Psychotherapie, Klinikum rechts der Isar der Technischen Universität München
| | - Alena Buyx
- Institut für Geschichte und Ethik der Medizin, Technische Universität München
| |
Collapse
|
22
|
Kumazaki H, Muramatsu T, Yoshikawa Y, Kato TA, Ishiguro H, Kikuchi M, Mimura M. Use of a tele-operated robot to increase sociability in individuals with autism spectrum disorder who display Hikikomori. Asian J Psychiatr 2021; 57:102588. [PMID: 33561778 DOI: 10.1016/j.ajp.2021.102588] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Accepted: 01/25/2021] [Indexed: 10/22/2022]
Affiliation(s)
- Hirokazu Kumazaki
- Research Center for Child Mental Development, Kanazawa University, Ishikawa, Japan; Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan; Department of Preventive intervention for Psychiatric Disorders, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo, Japan
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Takahiro A Kato
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Mitsuru Kikuchi
- Research Center for Child Mental Development, Kanazawa University, Ishikawa, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
23
|
Kumazaki H, Yoshikawa Y, Muramatsu T, Haraguchi H, Fujisato H, Sakai K, Matsumoto Y, Ishiguro H, Sumiyoshi T, Mimura M. Group-Based Online Job Interview Training Program Using Virtual Robot for Individuals With Autism Spectrum Disorders. Front Psychiatry 2021; 12:704564. [PMID: 35140635 PMCID: PMC8818697 DOI: 10.3389/fpsyt.2021.704564] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Accepted: 12/29/2021] [Indexed: 12/24/2022] Open
Abstract
The rapid expansion of online job interviews during the COVID-19 pandemic is expected to continue after the pandemic has subsided. These interviews are a significant barrier for individuals with autism spectrum disorders (ASD). There is little evidence-based training for online job interviews for individuals with ASD, and the development of new trainings is expected. In an effort to facilitate online job interview skill acquisition for individuals with ASD, we developed a group-based online job interview training program using a virtual robot (GOT). In GOT, the interviewer and interviewee are projected as virtual robots on the screen. Five participants were grouped and performed the role of interviewee, interviewer, and evaluator. The participants performed all roles in a random order. Each session consisted of a first job interview session, feedback session, and second job interview session. The participants experienced 25 sessions. Before and after GOT, the participants underwent a mock online job interview with a human professional interviewer (MOH) to evaluate the effect of GOT. In total, 15 individuals with ASD took part in the study. The GOT improved self-confidence, motivation, the understanding of others' perspectives, verbal competence, non-verbal competence, and interview performance scores. There was also a significant increase in the recognition of the importance of the point of view of interviewers and evaluators after the second MOH compared to after the first MOH. Using a VR robot and learning the importance of interview skills by experiencing other perspectives (i.e., viewpoint of interviewer and evaluator) may have sustained their motivation and enabled greater self-confidence. Given the promising results of this study and to draw definitive conclusions regarding the efficacy of virtual reality (VR) robots for mock online job interview training, further studies with larger, more diverse samples of individuals with ASD using a longitudinal design are warranted.
Collapse
Affiliation(s)
- Hirokazu Kumazaki
- Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan.,Department of Clinical Research on Social Recognition and Memory, Research Center for Child Mental Development, Kanazawa University, Ishikawa, Japan.,Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Yuichiro Yoshikawa
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Taro Muramatsu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Hideyuki Haraguchi
- Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan
| | - Hiroko Fujisato
- Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan
| | - Kazuki Sakai
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Yoshio Matsumoto
- Department of Clinical Research on Social Recognition and Memory, Research Center for Child Mental Development, Kanazawa University, Ishikawa, Japan.,Service Robotics Research Group, Intelligent Systems Institute, National Institute of Advanced Industrial Science and Technology, Ibaraki, Japan
| | - Hiroshi Ishiguro
- Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Tomiki Sumiyoshi
- Department of Preventive Intervention for Psychiatric Disorders, National Center of Neurology and Psychiatry, National Institute of Mental Health, Tokyo, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|