1
|
Tanaka H, Saga T, Iwauchi K, Honda M, Morimoto T, Matsuda Y, Uratani M, Okazaki K, Nakamura S. The Validation of Automated Social Skills Training in Members of the General Population Over 4 Weeks: Comparative Study. JMIR Form Res 2023; 7:e44857. [PMID: 37103996 PMCID: PMC10176127 DOI: 10.2196/44857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 03/03/2023] [Accepted: 03/20/2023] [Indexed: 04/28/2023] Open
Abstract
BACKGROUND Social skills training by human trainers is a well-established method of teaching appropriate social and communication skills and strengthening social self-efficacy. Specifically, human social skills training is a fundamental approach to teaching and learning the rules of social interaction. However, it is cost-ineffective and offers low accessibility, since the number of professional trainers is limited. A conversational agent is a system that can communicate with a human being in a natural language. We proposed to overcome the limitations of current social skills training with conversational agents. Our system is capable of speech recognition, response selection, and speech synthesis and can also generate nonverbal behaviors. We developed a system that incorporated automated social skills training that completely adheres to the training model of Bellack et al through a conversational agent. OBJECTIVE This study aimed to validate the training effect of a conversational agent-based social skills training system in members of the general population during a 4-week training session. We compare 2 groups (with and without training) and hypothesize that the trained group's social skills will improve. Furthermore, this study sought to clarify the effect size for future larger-scale evaluations, including a much larger group of different social pathological phenomena. METHODS For the experiment, 26 healthy Japanese participants were separated into 2 groups, where we hypothesized that group 1 (system trained) will make greater improvement than group 2 (nontrained). System training was done as a 4-week intervention where the participants visit the examination room every week. Each training session included social skills training with a conversational agent for 3 basic skills. We evaluated the training effect using questionnaires in pre- and posttraining evaluations. In addition to the questionnaires, we conducted a performance test that required the social cognition and expression of participants in new role-play scenarios. Blind ratings by third-party trainers were made by watching recorded role-play videos. A nonparametric Wilcoxson Rank Sum test was performed for each variable. Improvement between pre- and posttraining evaluations was used to compare the 2 groups. Moreover, we compared the statistical significance from the questionnaires and ratings between the 2 groups. RESULTS Of the 26 recruited participants, 18 completed this experiment: 9 in group 1 and 9 in group 2. Those in group 1 achieved significant improvement in generalized self-efficacy (P=.02; effect size r=0.53). We also found a significant decrease in state anxiety presence (P=.04; r=0.49), measured by the State-Trait Anxiety Inventory (STAI). For ratings by third-party trainers, speech clarity was significantly strengthened in group 1 (P=.03; r=0.30). CONCLUSIONS Our findings reveal the usefulness of the automated social skills training after a 4-week training period. This study confirms a large effect size between groups on generalized self-efficacy, state anxiety presence, and speech clarity.
Collapse
Affiliation(s)
- Hiroki Tanaka
- Nara Institute of Science and Technology, Ikoma, Japan
| | - Takeshi Saga
- Nara Institute of Science and Technology, Ikoma, Japan
| | - Kota Iwauchi
- Nara Institute of Science and Technology, Ikoma, Japan
| | - Masato Honda
- Department of Psychiatry, Nara Medical University, Kashihara, Japan
| | - Tsubasa Morimoto
- Department of Psychiatry, Nara Medical University, Kashihara, Japan
| | | | | | - Kosuke Okazaki
- Department of Psychiatry, Nara Medical University, Kashihara, Japan
| | | |
Collapse
|
2
|
Baltariu IC, Enea V, Kaffenberger J, Duiverman LM, Aan Het Rot M. The acute effects of alcohol on social cognition: A systematic review of experimental studies. Drug Alcohol Depend 2023; 245:109830. [PMID: 36907121 DOI: 10.1016/j.drugalcdep.2023.109830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 01/27/2023] [Accepted: 02/15/2023] [Indexed: 03/14/2023]
Abstract
RATIONALE Alcohol effects on social cognition have been studied by measuring facial emotion recognition, empathy, Theory of Mind (ToM) and other forms of information processing. OBJECTIVES Using the PRISMA guidelines, we reviewed experimental studies that examined acute effects of alcohol on social cognition. METHODS Scopus, PsycInfo, PubMed, and Embase were searched between July 2020 - January 2023. The PICO strategy was used for identifying participants, interventions, comparators, and outcomes. Participants (N = 2330) were adult social alcohol users. Interventions consisted of acute alcohol administration. Comparators included placebo or the lowest alcohol dose. Outcome variables were grouped into three themes: facial processing, empathy and ToM, and perceptions of inappropriate sexual behavior. RESULTS A total of 32 studies were reviewed. Studies measuring facial processing (67%) often found no effects of alcohol on the recognition of specific emotions, facilitated emotion recognition at lower doses and worsened emotion recognition at higher doses. In studies measuring empathy or ToM (24%), lower doses were more likely to lead to improvements while higher doses were generally impairing. Within the third group of studies (9%), moderate to high alcohol doses made it more difficult to perceive sexual aggression accurately. CONCLUSIONS Lower alcohol doses might sometimes help facilitate social cognition, but most data were in line with the idea that alcohol tends to worsen social cognition, particularly at higher doses. Future studies might focus on examining other moderators of the effects of alcohol on social cognition, particularly interpersonal characteristics such as trait emotional empathy, and participant and target gender.
Collapse
Affiliation(s)
- Isabelle Cristina Baltariu
- Department of Psychology, University of Groningen, the Netherlands; Department of Psychology, Alexandru Ioan Cuza University of Iași, Romania.
| | - Violeta Enea
- Department of Psychology, Alexandru Ioan Cuza University of Iași, Romania
| | - Jan Kaffenberger
- Department of Psychology, University of Groningen, the Netherlands
| | | | | |
Collapse
|
3
|
Nijman SA, Pijnenborg GHM, Vermeer RR, Zandee CER, Zandstra DC, van der Vorm D, de Wit-de Visser AC, Meins IA, Geraets CNW, Veling W. Dynamic Interactive Social Cognition Training in Virtual Reality (DiSCoVR) versus Virtual Reality Relaxation (VRelax) for People With a Psychotic Disorder: A Single-Blind Multicenter Randomized Controlled Trial. Schizophr Bull 2023; 49:518-530. [PMID: 36413388 PMCID: PMC10016415 DOI: 10.1093/schbul/sbac166] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
BACKGROUND AND HYPOTHESIS Social cognition training (SCT), an intervention for social cognition and social functioning, might be improved by using virtual reality (VR), because VR may offer better opportunities to practice in a potentially more realistic environment. To date, no controlled studies have investigated VR-SCT. This study investigated a VR-SCT, "DiSCoVR". We hypothesized that DiSCoVR would improve social cognition and social functioning. STUDY DESIGN Participants were randomized to DiSCoVR (n = 41) or VR relaxation ('VRelax', n = 40), an active control condition, and completed 16 twice-weekly sessions. Three assessments (baseline, posttreatment, and 3-month follow-up) were performed by blinded assessors. The primary outcome was social cognition (emotion perception and theory of mind). Secondary outcomes included social functioning (measured with an interview and experience sampling), psychiatric symptoms, information processing, and self-esteem. Data were analyzed using mixed-models regression analysis. Treatment effects were evaluated by the time by condition interaction terms. STUDY RESULTS No significant time by condition interactions were found for any of the outcome variables, indicating an absence of treatment effects. Between-group effect sizes ranged from negligible to moderate (Cohen's d < |0.53|). Main effects of time were found for several outcomes. CONCLUSIONS These results suggest that DiSCoVR was not effective, possibly because of inadequate simulation of emotional expressions in VR. This lack of efficacy may indicate that current SCT protocols are relatively unsuitable for improving social functioning. Previous studies showed small to moderate effects on higher order social cognition, but the SCT approach may need critical reevaluation, as it may not sufficiently lead to functional improvement.
Collapse
Affiliation(s)
- S A Nijman
- Department of Psychotic Disorders, GGZ Drenthe, Dennenweg 9, PO Box 30007, 9404 LA, Assen, The Netherlands.,University Center of Psychiatry, University Medical Center Groningen, University of Groningen, Hanzeplein 1, PO Box 30.001, 9700 RB, Groningen, The Netherlands.,Department of Clinical and Developmental Neuropsychology, University of Groningen, Grote Kruisstraat 2/1, 9712 TS, Groningen, The Netherlands
| | - G H M Pijnenborg
- Department of Psychotic Disorders, GGZ Drenthe, Dennenweg 9, PO Box 30007, 9404 LA, Assen, The Netherlands.,Department of Clinical and Developmental Neuropsychology, University of Groningen, Grote Kruisstraat 2/1, 9712 TS, Groningen, The Netherlands
| | - R R Vermeer
- GGZ Delfland, Sint Jorisweg 2, 2612 GA, Delft, The Netherlands
| | - C E R Zandee
- GGZ Delfland, Sint Jorisweg 2, 2612 GA, Delft, The Netherlands
| | - D C Zandstra
- Zeeuwse Gronden, Axelsestraat 8/A, 4537 AJ, Terneuzen, The Netherlands
| | - D van der Vorm
- GGZ Westelijk Noord-Brabant, Hoofdlaan 8, PO Box 371, 4600AJ, Bergen op Zoom, The Netherlands
| | - A C de Wit-de Visser
- GGZ Westelijk Noord-Brabant, Hoofdlaan 8, PO Box 371, 4600AJ, Bergen op Zoom, The Netherlands.,Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Professor Cobbenhagenlaan 125, PO Box 90153, 5000LE Tilburg, The Netherlands
| | - I A Meins
- Department of Psychotic Disorders, GGZ Drenthe, Dennenweg 9, PO Box 30007, 9404 LA, Assen, The Netherlands.,University Center of Psychiatry, University Medical Center Groningen, University of Groningen, Hanzeplein 1, PO Box 30.001, 9700 RB, Groningen, The Netherlands.,Department of Clinical and Developmental Neuropsychology, University of Groningen, Grote Kruisstraat 2/1, 9712 TS, Groningen, The Netherlands
| | - C N W Geraets
- University Center of Psychiatry, University Medical Center Groningen, University of Groningen, Hanzeplein 1, PO Box 30.001, 9700 RB, Groningen, The Netherlands
| | - W Veling
- University Center of Psychiatry, University Medical Center Groningen, University of Groningen, Hanzeplein 1, PO Box 30.001, 9700 RB, Groningen, The Netherlands
| |
Collapse
|
4
|
Wiebe A, Kannen K, Selaskowski B, Mehren A, Thöne AK, Pramme L, Blumenthal N, Li M, Asché L, Jonas S, Bey K, Schulze M, Steffens M, Pensel MC, Guth M, Rohlfsen F, Ekhlas M, Lügering H, Fileccia H, Pakos J, Lux S, Philipsen A, Braun N. Virtual reality in the diagnostic and therapy for mental disorders: A systematic review. Clin Psychol Rev 2022; 98:102213. [PMID: 36356351 DOI: 10.1016/j.cpr.2022.102213] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 08/21/2022] [Accepted: 10/11/2022] [Indexed: 01/27/2023]
Abstract
BACKGROUND Virtual reality (VR) technologies are playing an increasingly important role in the diagnostics and treatment of mental disorders. OBJECTIVE To systematically review the current evidence regarding the use of VR in the diagnostics and treatment of mental disorders. DATA SOURCE Systematic literature searches via PubMed (last literature update: 9th of May 2022) were conducted for the following areas of psychopathology: Specific phobias, panic disorder and agoraphobia, social anxiety disorder, generalized anxiety disorder, posttraumatic stress disorder (PTSD), obsessive-compulsive disorder, eating disorders, dementia disorders, attention-deficit/hyperactivity disorder, depression, autism spectrum disorder, schizophrenia spectrum disorders, and addiction disorders. ELIGIBILITY CRITERIA To be eligible, studies had to be published in English, to be peer-reviewed, to report original research data, to be VR-related, and to deal with one of the above-mentioned areas of psychopathology. STUDY EVALUATION For each study included, various study characteristics (including interventions and conditions, comparators, major outcomes and study designs) were retrieved and a risk of bias score was calculated based on predefined study quality criteria. RESULTS Across all areas of psychopathology, k = 9315 studies were inspected, of which k = 721 studies met the eligibility criteria. From these studies, 43.97% were considered assessment-related, 55.48% therapy-related, and 0.55% were mixed. The highest research activity was found for VR exposure therapy in anxiety disorders, PTSD and addiction disorders, where the most convincing evidence was found, as well as for cognitive trainings in dementia and social skill trainings in autism spectrum disorder. CONCLUSION While VR exposure therapy will likely find its way successively into regular patient care, there are also many other promising approaches, but most are not yet mature enough for clinical application. REVIEW REGISTRATION PROSPERO register CRD42020188436. FUNDING The review was funded by budgets from the University of Bonn. No third party funding was involved.
Collapse
Affiliation(s)
- Annika Wiebe
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Kyra Kannen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Benjamin Selaskowski
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Aylin Mehren
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Ann-Kathrin Thöne
- School of Child and Adolescent Cognitive Behavior Therapy (AKiP), Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Lisa Pramme
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Nike Blumenthal
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Mengtong Li
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Laura Asché
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Stephan Jonas
- Institute for Digital Medicine, University Hospital Bonn, Bonn, Germany
| | - Katharina Bey
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Marcel Schulze
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Maria Steffens
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Max Christian Pensel
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Matthias Guth
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Felicia Rohlfsen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Mogda Ekhlas
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Helena Lügering
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Helena Fileccia
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Julian Pakos
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Silke Lux
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Alexandra Philipsen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Niclas Braun
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany.
| |
Collapse
|
5
|
Jung M, Sim S, Kim J, Kim K. Impact of Personalized Avatars and Motion Synchrony on Embodiment and Users’ Subjective Experience: Empirical Study. JMIR Serious Games 2022; 10:e40119. [PMID: 36346658 PMCID: PMC9682455 DOI: 10.2196/40119] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 09/07/2022] [Accepted: 10/11/2022] [Indexed: 11/09/2022] Open
Abstract
Background Embodiment through a virtual avatar is a key element for people to feel that they are in the virtual world. Objective This study aimed to elucidate the interaction between 2 methods of eliciting embodiment through a virtual avatar: motion synchronization and appearance similarity between a human and avatar, to understand embodiment (agency, body ownership, and self-location) and subjective experience (presence, simulator sickness, and emotion) in virtual reality. Methods Using a full-body motion capture system, 24 participants experienced their virtual avatars with a 3D-scanned face and size-matched body from a first-person perspective. This study used a 2 (motion; sync and async) × 2 (appearance; personalized and generic) within-subject design. Results The results indicated that agency and body ownership increased when motion and appearance were matched, whereas self-location, presence, and emotion were affected by motion only. Interestingly, if the avatar’s appearance was similar to the participants (personalized avatar), they formed an agency toward the avatar’s motion that was not performed by themselves. Conclusions Our findings would be applicable in the field of behavioral therapy, rehabilitation, and entertainment applications, by eliciting higher agency with a personalized avatar.
Collapse
Affiliation(s)
- Myeongul Jung
- Department of Computer Science, Hanyang University, Seoul, Republic of Korea
| | - Sangyong Sim
- Department of Computer Science, Hanyang University, Seoul, Republic of Korea
| | - Jejoong Kim
- Department of Psychology, Duksung Woman's University, Seoul, Republic of Korea
| | - Kwanguk Kim
- Department of Computer Science, Hanyang University, Seoul, Republic of Korea
| |
Collapse
|
6
|
Isenstein EL, Waz T, LoPrete A, Hernandez Y, Knight EJ, Busza A, Tadin D. Rapid assessment of hand reaching using virtual reality and application in cerebellar stroke. PLoS One 2022; 17:e0275220. [PMID: 36174027 PMCID: PMC9522266 DOI: 10.1371/journal.pone.0275220] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Accepted: 09/13/2022] [Indexed: 11/19/2022] Open
Abstract
The acquisition of sensory information about the world is a dynamic and interactive experience, yet the majority of sensory research focuses on perception without action and is conducted with participants who are passive observers with very limited control over their environment. This approach allows for highly controlled, repeatable experiments and has led to major advances in our understanding of basic sensory processing. Typical human perceptual experiences, however, are far more complex than conventional action-perception experiments and often involve bi-directional interactions between perception and action. Innovations in virtual reality (VR) technology offer an approach to close this notable disconnect between perceptual experiences and experiments. VR experiments can be conducted with a high level of empirical control while also allowing for movement and agency as well as controlled naturalistic environments. New VR technology also permits tracking of fine hand movements, allowing for seamless empirical integration of perception and action. Here, we used VR to assess how multisensory information and cognitive demands affect hand movements while reaching for virtual targets. First, we manipulated the visibility of the reaching hand to uncouple vision and proprioception in a task measuring accuracy while reaching toward a virtual target (n = 20, healthy young adults). The results, which as expected revealed multisensory facilitation, provided a rapid and a highly sensitive measure of isolated proprioceptive accuracy. In the second experiment, we presented the virtual target only briefly and showed that VR can be used as an efficient and robust measurement of spatial memory (n = 18, healthy young adults). Finally, to assess the feasibility of using VR to study perception and action in populations with physical disabilities, we showed that the results from the visual-proprioceptive task generalize to two patients with recent cerebellar stroke. Overall, we show that VR coupled with hand-tracking offers an efficient and adaptable way to study human perception and action.
Collapse
Affiliation(s)
- E. L. Isenstein
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, United States of America
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
- Center for Visual Science, University of Rochester, Rochester, NY, United States of America
| | - T. Waz
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, United States of America
| | - A. LoPrete
- Center for Visual Science, University of Rochester, Rochester, NY, United States of America
- Center for Neuroscience and Behavior, American University, Washington, DC, United States of America
- Bioengineering Graduate Group, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Y. Hernandez
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
- The City College of New York, CUNY, New York, NY, United States of America
| | - E. J. Knight
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
- Division of Developmental and Behavioral Pediatrics, Department of Pediatrics, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
| | - A. Busza
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, United States of America
| | - D. Tadin
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, United States of America
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
- Center for Visual Science, University of Rochester, Rochester, NY, United States of America
- Department of Ophthalmology, University of Rochester School of Medicine and Dentistry, Rochester, New York, United States of America
| |
Collapse
|
7
|
Holgersen G, Nordgreen T, Ten Velden Hegelstad W, Bircow Elgen I. Views of young people with psychosis on using virtual reality assisted therapy. A qualitative study. Early Interv Psychiatry 2022; 17:361-367. [PMID: 35708166 DOI: 10.1111/eip.13331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 03/23/2022] [Accepted: 05/29/2022] [Indexed: 11/29/2022]
Abstract
AIM Service disengagement is a challenge in young individuals struggling with psychosis. Combining cognitive behavioural therapy for psychosis (CBTp) with virtual reality (VR) has proven acceptable and potentially effective for symptoms and social functioning in adults with psychosis. However, studies focusing on young adolescents are lacking. The aim of the present study was to investigate the acceptability of VR-assisted CBTp among adolescents with psychosis. METHODS A qualitative study investigating the acceptability of VR during exposure-based social training among adolescents with early onset psychosis. Thematic analysis was used to identify, analyse, interpret and report patterns from the qualitative interviews. RESULTS A total of 27 adolescents with psychosis were invited to participate, 11 declined and 16 were enrolled (59%), and all completed the study. The participants were from 13 until 18 years old, mean age 16 years. None of them had previous experience with use of VR in therapy, but 10 out of 16 participants had prior experience with VR from playing video games. Regarding acceptability, 14 out of 16 had positive expectations towards using VR in CBTp, and they would prefer using VR during exposure-based social training to real-life training only. CONCLUSIONS VR-assisted CBTp can be an acceptable intervention for adolescents with psychosis, given their comfort with technology and the opportunity to confront their fears in less threatening virtual social settings with fewer social risks. The present study yields support to continue developing VR-assisted therapy for adolescents, and focusing on VR-interventions for early onset psychosis.
Collapse
Affiliation(s)
- Guri Holgersen
- Department of Child and Adolescent Psychiatry, Haukeland University Hospital, Bergen, Norway.,Division of Psychiatry, Haukeland University Hospital, Bergen, Norway
| | - Tine Nordgreen
- Division of Psychiatry, Haukeland University Hospital, Bergen, Norway.,Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway
| | - Wenche Ten Velden Hegelstad
- TIPS Centre for Clinical Research in Psychosis, Stavanger University Hospital, Stavanger, Norway.,Faculty of Social Science, Institute for Social Studies, University of Stavanger, Stavanger, Norway
| | - Irene Bircow Elgen
- Department of Child and Adolescent Psychiatry, Haukeland University Hospital, Bergen, Norway.,Division of Psychiatry, Haukeland University Hospital, Bergen, Norway.,Department of Clinical Medicine, University of Bergen, Bergen, Norway
| |
Collapse
|
8
|
Schuster L, Friedrich AS, Kothgassner OD, Zemp M. Virtual Reality als Trainingstool in der Klinischen und Gesundheitspsychologie. ZEITSCHRIFT FUR KLINISCHE PSYCHOLOGIE UND PSYCHOTHERAPIE 2022. [DOI: 10.1026/1616-3443/a000662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Zusammenfassung. Hintergrund: Virtual Reality (VR) wird zunehmend als Hilfsmittel für psychologische Interventionen eingesetzt. Auch für sozial-emotionale Fähigkeiten kann VR realitätsnahe Übungsszenarien kreieren. Fragestellung: Dieses systematische Review gibt einen Überblick über den aktuellen Forschungsstand zu VR-Trainings sozial-emotionaler Fähigkeiten. Methode: Die systematische Literaturrecherche erfolgte in PSYNDEX, PsycINFO, Scopus, PubMed und Web of Science und orientierte sich an den PRISMA-Richtlinien. Eingeschlossen wurden deutsch- und englischsprachige empirische Studien zu VR-basierten Trainings sozial-emotionaler Fähigkeiten für gesunde oder psychisch beeinträchtigte Personen aller Altersstufen. Ergebnisse: Elf Studien wurden eingeschlossen. Die Mehrheit untersuchte klinische Stichproben. Die methodische Qualität wurde bei zehn Studien positiv beurteilt. Schlussfolgerungen: Insgesamt spricht das Review für die Nützlichkeit VR-basierter Trainings sozial-emotionaler Fähigkeiten, aber der aktuelle Forschungsstand erlaubt noch keine eindeutigen Schlussfolgerungen bezüglich ihrer Wirksamkeit.
Collapse
Affiliation(s)
- Laura Schuster
- Institut für Klinische und Gesundheitspsychologie, Universität Wien, Österreich
| | | | - Oswald D. Kothgassner
- Universitätsklinik für Kinder- und Jugendpsychiatrie, Medizinische Universität Wien, Österreich
| | - Martina Zemp
- Institut für Klinische und Gesundheitspsychologie, Universität Wien, Österreich
| |
Collapse
|
9
|
Shen ZH, Liu MH, Wu Y, Lin QQ, Wang YG. Virtual-reality-based social cognition and interaction training for patients with schizophrenia: A preliminary efficacy study. Front Psychiatry 2022; 13:1022278. [PMID: 36465308 PMCID: PMC9714325 DOI: 10.3389/fpsyt.2022.1022278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 11/02/2022] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Social cognition and interaction training (SCIT) is a psychosocial intervention program for patients with psychosis, designed to improve their social functioning by improving social cognition. Although the feasibility and efficacy of SCIT have been verified, patients with schizophrenia tend to suffer from motivational deficits and low treatment adherence. It has been suggested that using virtual reality (VR) technology might be effective in addressing these issues. In this study, we aimed to develop a VR-based SCIT and compare its efficacy with that of traditional SCIT. MATERIALS AND METHODS We developed a novel VR-based social cognition and interaction training (VR-SCIT) that combines traditional SCIT (TR-SCIT) intervention with VR technology. Participants were randomly assigned in a 1:1:1 ratio to the VR-SCIT (n = 28), TR-SCIT (n = 30), or waiting-list groups (n = 29). All treatments were combined with treatment-as-usual. Assessments of social cognition (i.e., Chinese version of Face-Affective Identification Task, Chinese version of Social Cognition Screening Questionnaire) and social functioning (i.e., Chinese version of Personal and Social Performance Scale) were administered from baseline to post-intervention. RESULTS Patients receiving VR-SCIT and TR-SCIT showed a significantly greater improvement on the assessments of emotion perception (Cohen's d was 1.66, 0.55, and 0.10 for VR-SCIT, TR-SCIT, and Waiting-list, respectively), hostile attributional bias (Cohen's d was 0.48, 0.44, and 0.05 for VR-SCIT, TR-SCIT, and Waiting-list, respectively), metacognition (Cohen's d was 1.66, 0.76, and 0.06 for VR-SCIT, TR-SCIT, and waiting-list, respectively), and social functioning (Cohen's d was 1.09, 0.90, and 0.20 for VR-SCIT, TR-SCIT, and waiting-list, respectively) from baseline to post-intervention, compared to those in waiting-list group. Additionally, VR-SCIT showed an advantage over TR-SCIT in improving emotion perception and metacognition with higher treatment compliance. CONCLUSION These preliminary findings indicate that VR-SCIT is a feasible and promising method for improving social cognition and social functioning in patients with schizophrenia.
Collapse
Affiliation(s)
- Zhi-Hua Shen
- Affiliated Mental Health Center and Hangzhou Seventh People's Hospital, Zhejiang University School of Medicine, Hangzhou, China.,Zhejiang Provincial Institute of Drug Abuse Research, Hangzhou, China
| | | | - Yue Wu
- The Fifth Hospital of Ruian, Wenzhou, China
| | - Qian-Qian Lin
- Affiliated Mental Health Center and Hangzhou Seventh People's Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Yong-Guang Wang
- Affiliated Mental Health Center and Hangzhou Seventh People's Hospital, Zhejiang University School of Medicine, Hangzhou, China.,Zhejiang Provincial Institute of Drug Abuse Research, Hangzhou, China
| |
Collapse
|
10
|
Chung OS, Johnson AM, Dowling NL, Robinson T, Ng CH, Yücel M, Segrave RA. Are Australian Mental Health Services Ready for Therapeutic Virtual Reality? An Investigation of Knowledge, Attitudes, Implementation Barriers and Enablers. Front Psychiatry 2022; 13:792663. [PMID: 35185649 PMCID: PMC8854652 DOI: 10.3389/fpsyt.2022.792663] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/10/2021] [Accepted: 01/14/2022] [Indexed: 12/18/2022] Open
Abstract
Therapeutic virtual reality (VR) has the potential to address the challenges of equitable delivery of evidence-based psychological treatment. However, little is known about therapeutic VR regarding the perspectives and needs of real-world service providers. This exploratory study aimed to assess the acceptability, appropriateness, and feasibility of therapeutic VR among clinicians, managers, and service staff working in mental healthcare and explore potential implementation barriers and enablers. Eighty-one staff from a network of private psychiatric hospitals in Victoria, Australia (aged M + SD: 41.88 + 12.01 years, 71.6% female; 64% clinical staff) completed an online survey, which included the Acceptability of Intervention Measure (AIM), Appropriateness of Intervention Measure (IAM), and Feasibility of Intervention Measure (FIM). While 91% of participants had heard about VR technology, only 40% of participants had heard of therapeutic VR being used in mental healthcare, and none had used therapeutic VR in a clinical setting. Most participants perceived VR to be acceptable (84%), appropriate (69%), and feasible (59%) to implement within their role or service and envisioned a range of possible applications. However, participants expressed concerns regarding safety, efficacy, and logistical challenges across clinical settings. Findings suggest a strong interest for therapeutic VR among Australian mental health providers working in the private system. However, dissemination efforts should focus on addressing identified barriers to ensure mental health providers are adequately informed and empowered to make implementation decisions.
Collapse
Affiliation(s)
- Olivia S Chung
- BrainPark, Turner Institute for Brain and Mental Health and Monash Biomedical Imaging Facility, Monash University, Melbourne, VIC, Australia
| | - Alisha M Johnson
- BrainPark, Turner Institute for Brain and Mental Health and Monash Biomedical Imaging Facility, Monash University, Melbourne, VIC, Australia
| | - Nathan L Dowling
- Professorial Unit, Department of Psychiatry, The Melbourne Clinic, The University of Melbourne, Melbourne, VIC, Australia
| | - Tracy Robinson
- School of Nursing, Paramedicine and Healthcare Sciences, Charles Sturt University, Bathurst, NSW, Australia
| | - Chee H Ng
- Professorial Unit, Department of Psychiatry, The Melbourne Clinic, The University of Melbourne, Melbourne, VIC, Australia
| | - Murat Yücel
- BrainPark, Turner Institute for Brain and Mental Health and Monash Biomedical Imaging Facility, Monash University, Melbourne, VIC, Australia
| | - Rebecca A Segrave
- BrainPark, Turner Institute for Brain and Mental Health and Monash Biomedical Imaging Facility, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
11
|
Franzen M, de Jong PJ, Veling W, aan het Rot M. Victims of Bullying: Emotion Recognition and Understanding. Front Psychol 2021; 12:729835. [PMID: 34721191 PMCID: PMC8551375 DOI: 10.3389/fpsyg.2021.729835] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 09/24/2021] [Indexed: 12/15/2022] Open
Abstract
Introduction: Victims of bullying often show interpersonal problems, such as having less high-quality interpersonal relationships compared to non-involved individuals. Research suggests that interpersonal struggles are associated with diminished emotional intelligence and competence and can lead to mental health problems such as depression. Therefore, we examined emotion recognition abilities, empathic accuracy, and behavioral responses to emotions in bullying victims and non-involved individuals. Based on previous research, we expected victims to show diminished skills in all three domains. Methods: Adolescents (Mage=17years; 67% female; no "other" gender participants) with (N=24) and without (N=21) a self-reported history of bullying victimization in high school completed a Virtual Reality facial emotion recognition task (ERT-VR), an empathic accuracy task (EAT) using videos of people recounting real-life autobiographical events, and a computer task in which they indicated their likely behavioral responses to facial emotions. Results: The two groups only significantly differed in recognizing emotions when taking their depression symptoms into account. Across emotions, victims had lower recognition accuracy than non-involved individuals. When examining emotion-specific differences, victims showed lower accuracy for neutral faces which they mainly mistook for angry faces. Conclusion: In contrast to expectations, adolescents with a high-school history of bullying victimization mostly showed similar emotional intelligence and competence skills as non-involved individuals. Nonetheless, we found some subtle differences regarding emotion recognition. Victims misjudged neutral as angry faces. This suggests a hostile attribution bias which might help explain victims' interpersonal problems as well as their increased risk for mental health problems.
Collapse
Affiliation(s)
- Minita Franzen
- Department of Psychology, University of Groningen, Groningen, Netherlands
| | - Peter J. de Jong
- Department of Psychology, University of Groningen, Groningen, Netherlands
| | - Wim Veling
- Department of Psychiatry, University Medical Centre Groningen, Groningen, Netherlands
| | - Marije aan het Rot
- Department of Psychology, University of Groningen, Groningen, Netherlands
| |
Collapse
|
12
|
Virtual reality facial emotion recognition in social environments: An eye-tracking study. Internet Interv 2021; 25:100432. [PMID: 34401391 PMCID: PMC8350588 DOI: 10.1016/j.invent.2021.100432] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Revised: 06/20/2021] [Accepted: 07/14/2021] [Indexed: 11/27/2022] Open
Abstract
BACKGROUND Virtual reality (VR) enables the administration of realistic and dynamic stimuli within a social context for the assessment and training of emotion recognition. We tested a novel VR emotion recognition task by comparing emotion recognition across a VR, video and photo task, investigating covariates of recognition and exploring visual attention in VR. METHODS Healthy individuals (n = 100) completed three emotion recognition tasks; a photo, video and VR task. During the VR task, emotions of virtual characters (avatars) in a VR street environment were rated, and eye-tracking was recorded in VR. RESULTS Recognition accuracy in VR (overall 75%) was comparable to the photo and video task. However, there were some differences; disgust and happiness had lower accuracy rates in VR, and better accuracy was achieved for surprise and anger in VR compared to the video task. Participants spent more time identifying disgust, fear and sadness than surprise and happiness. In general, attention was directed longer to the eye and nose areas than the mouth. DISCUSSION Immersive VR tasks can be used for training and assessment of emotion recognition. VR enables easily controllable avatars within environments relevant for daily life. Validated emotional expressions and tasks will be of relevance for clinical applications.
Collapse
|
13
|
Sygel K, Wallinius M. Immersive Virtual Reality Simulation in Forensic Psychiatry and Adjacent Clinical Fields: A Review of Current Assessment and Treatment Methods for Practitioners. Front Psychiatry 2021; 12:673089. [PMID: 34122189 PMCID: PMC8193033 DOI: 10.3389/fpsyt.2021.673089] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Accepted: 04/30/2021] [Indexed: 01/09/2023] Open
Abstract
Background: Research has indicated that interactive, computerized case simulations using immersive virtual reality (VR) technology may be beneficial in the augmentation of conventional methods of assessment and treatment in forensic psychiatry, primarily through providing an engaging and safe environment in which the user can practice and learn skills and behaviors. However, there does not appear to be an overview of current developments available in the field, which may be an obstacle to clinicians considering the use of VR in their clinical practice. Objectives: Current, clinically relevant assessment and treatment methods applying immersive VR in forensic or adjacent clinical settings, were analyzed. Methods: This review surveyed the practical use of immersive VR in forensic psychiatry and relevant adjacent psychiatric and forensic fields from 2016 to 2020 and was performed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Results: Out of the 1,105 journal articles screened, 14 met criteria for inclusion. Four articles described VR interventions directly addressing forensic psychiatric settings (treatment of general aggression and assessment of sexual offenders against children). The majority of the remaining articles were in the clinical domain of psychosis treatment. Several interventions were designed as part of comprehensive treatment programs, and others were intended as one-off assessments or paired with pre-existing psychological treatment. The degree to which the VR simulations were individualized to the user appeared to be largely dependent upon the extent of provider input. A variety of research methodologies were used in the included articles and the majority had limitations common to small-scale, non-randomized studies. None of the studies reported serious adverse effects. Discussion: There is a lack of large randomized controlled trials of current assessments or treatments using VR simulation in forensic psychiatry, let alone those with long-term follow-up, showing clear advantages of VR over standard practice. The evidence thus far is insufficient to recommend immediate and large-scale implementation of any one VR intervention, however, several have been shown to be feasible and acceptable to the participants and to provide insights and inspiration for future research and development.
Collapse
Affiliation(s)
- Kristina Sygel
- Department of Psychiatry and Neurochemistry, Centre for Ethics, Law and Mental Health, Institute of Neuroscience and Physiology, The Sahlgrenska Academy at University of Gothenburg, Gothenburg, Sweden.,Department of Forensic Psychiatry, National Board of Forensic Medicine, Stockholm, Sweden
| | - Märta Wallinius
- Department of Psychiatry and Neurochemistry, Centre for Ethics, Law and Mental Health, Institute of Neuroscience and Physiology, The Sahlgrenska Academy at University of Gothenburg, Gothenburg, Sweden.,Research and Development Unit, Regional Forensic Psychiatric Clinic, Växjö, Sweden.,Lund Clinical Research on Externalizing and Developmental Psychopathology, Child and Adolescent Psychiatry, Department of Clinical Sciences Lund, Lund University, Lund, Sweden
| |
Collapse
|
14
|
van der Meer L, Jonker T, Wadman H, Wunderink C, van Weeghel J, Pijnenborg GHM, van Setten ERH. Targeting Personal Recovery of People With Complex Mental Health Needs: The Development of a Psychosocial Intervention Through User-Centered Design. Front Psychiatry 2021; 12:635514. [PMID: 33897494 PMCID: PMC8060492 DOI: 10.3389/fpsyt.2021.635514] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 01/25/2021] [Indexed: 12/21/2022] Open
Abstract
Long-term admissions in psychiatric facilities often result in a gradual erosion of the identity of people diagnosed with severe mental illnesses (SMIs) into merely "patient." Moreover, experiences of loss often reduced people's sense of purpose. Although regaining a multidimensional identity and a sense of purpose are essential for personal recovery, few interventions specifically address this, while at the same time take people's often considerable cognitive and communicative disabilities into consideration. This study describes the development process of a new intervention through user-centered design (UCD). UCD is an iterative process in which a product (in this case, an intervention) is developed in close cooperation with future users, such that the final product matches their needs. The design process included three phases: an analysis, design, and evaluation phase. In the analysis phase, the "problem" was defined, users' needs were identified, and design criteria were established. In the design phase, the collected information served as input to create a testable prototype using a process of design and redesign, in close collaboration with service users and other stakeholders. This resulted in an intervention entitled "This is Me" (TiM) in which service users, together with a self-chosen teammate, actively engage in new experiences on which they are prompted to reflect. Finally, in the evaluation phase, TiM was implemented and evaluated in a real-life setting. In a small feasibility pilot, we found indications that some people indeed demonstrated increased reflection on their identity during the intervention. Furthermore, TiM seemed to benefit the relationship between the service users and the mental health professionals with whom they underwent the experiences. The pilot also revealed some aspects of the (implementation of) TiM that can be improved. Overall, we conclude that UCD is a useful method for the development of a new psychosocial intervention. The method additionally increased our knowledge about necessary factors in targeting personal recovery for people with complex mental health needs. Moreover, we conclude that TiM is a promising tool for supporting people with SMI in redeveloping a multidimensional identity and a renewed sense of purpose.
Collapse
Affiliation(s)
- Lisette van der Meer
- Department of Rehabilitation, Lentis Center for Mental Health Care, Zuidlaren, Netherlands.,Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, Netherlands
| | - Tessa Jonker
- Department of Rehabilitation, Lentis Center for Mental Health Care, Zuidlaren, Netherlands
| | - Heleen Wadman
- BuurtzorgT Mental Health Institution, Groningen, Netherlands
| | - Charlotte Wunderink
- Department of Rehabilitation, Lentis Center for Mental Health Care, Zuidlaren, Netherlands.,Research and Innovation Center for Rehabilitation, Hanze University of Applied Sciences, Groningen, Netherlands
| | - Jaap van Weeghel
- Department of TRANZO, Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, Netherlands.,Parnassia Group, Parnassia Noord Holland, Castricum, Netherlands.,Phrenos Center of Expertise on Severe Mental Illness, Utrecht, Netherlands
| | - Gerdina Hendrika Maria Pijnenborg
- Department of Clinical Psychology and Experimental Psychopathology, University of Groningen, Groningen, Netherlands.,Department of Psychotic Disorders, GGZ-Drenthe, Assen, Netherlands
| | - Ellie R H van Setten
- Department of Rehabilitation, Lentis Center for Mental Health Care, Zuidlaren, Netherlands.,Rob Giel Research Center, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| |
Collapse
|
15
|
Balcombe L, De Leo D. Psychological Screening and Tracking of Athletes and Digital Mental Health Solutions in a Hybrid Model of Care: Mini Review. JMIR Form Res 2020; 4:e22755. [PMID: 33271497 PMCID: PMC7746225 DOI: 10.2196/22755] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 10/16/2020] [Accepted: 10/17/2020] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND There is a persistent need for mental ill-health prevention and intervention among at-risk and vulnerable subpopulations. Major disruptions to life, such as the COVID-19 pandemic, present an opportunity for a better understanding of the experience of stressors and vulnerability. Faster and better ways of psychological screening and tracking are more generally required in response to the increased demand upon mental health care services. The argument that mental and physical health should be considered together as part of a biopsychosocial approach is garnering acceptance in elite athlete literature. However, the sporting population are unique in that there is an existing stigma of mental health, an underrecognition of mental ill-health, and engagement difficulties that have hindered research, prevention, and intervention efforts. OBJECTIVE The aims of this paper are to summarize and evaluate the literature on athletes' increased vulnerability to mental ill-health and digital mental health solutions as a complement to prevention and intervention, and to show relationships between athlete mental health problems and resilience as well as digital mental health screening and tracking, and faster and better treatment algorithms. METHODS This mini review shapes literature in the fields of athlete mental health and digital mental health by summarizing and evaluating journal and review articles drawn from PubMed Central and the Directory of Open Access Journals. RESULTS Consensus statements and systematic reviews indicated that elite athletes have comparable rates of mental ill-health prevalence to the general population. However, peculiar subgroups require disentangling. Innovative expansion of data collection and analytics is required to respond to engagement issues and advance research and treatment programs in the process. Digital platforms, machine learning, deep learning, and artificial intelligence are useful for mental health screening and tracking in various subpopulations. It is necessary to determine appropriate conditions for algorithms for use in recommendations. Partnered with real-time automation and machine learning models, valid and reliable behavior sensing, digital mental health screening, and tracking tools have the potential to drive a consolidated, measurable, and balanced risk assessment and management strategy for the prevention and intervention of the sequelae of mental ill-health. CONCLUSIONS Athletes are an at-risk subpopulation for mental health problems. However, a subgroup of high-level athletes displayed a resilience that helped them to positively adjust after a period of overwhelming stress. Further consideration of stress and adjustments in brief screening tools is recommended to validate this finding. There is an unrealized potential for broadening the scope of mental health, especially symptom and disorder interpretation. Digital platforms for psychological screening and tracking have been widely used among general populations, but there is yet to be an eminent athlete version. Sports in combination with mental health education should address the barriers to help-seeking by increasing awareness, from mental ill-health to positive functioning. A hybrid model of care is recommended, combining traditional face-to-face approaches along with innovative and evaluated digital technologies, that may be used in prevention and early intervention strategies.
Collapse
Affiliation(s)
- Luke Balcombe
- School of Health and Sport Science, University of the Sunshine Coast, Sunshine Coast, Australia.,Australian Institute for Suicide Research and Prevention, Griffith University, Brisbane, Australia
| | - Diego De Leo
- Australian Institute for Suicide Research and Prevention, Griffith University, Brisbane, Australia
| |
Collapse
|