Queues, crowds, and angry mobs: Face identification under distraction in a virtual airport

In visual environments, selective attention must be employed to focus on task-relevant stimuli. A key question here concerns the extent to which other stimuli within the visual field influence target processing. In this study, we ask whether face identity matching is subject to similar effects from irrelevant stimuli in the visual field, specifically task-irrelevant people. Although most previous studies rely on highly controlled face and body stimuli presented in isolation, here we use a more realistic environment. Participants take the role of passport officers and must match a person's face to their photo-ID, while other people appear in the background, waiting to be processed. Presenting an interactive virtual environment on screen (Experiments 1 and 2) or in immersive VR (Experiment 3), we generally found no evidence for distraction from background people on face-matching accuracy. However, when immersed in VR, an angry crowd in the background delayed matching speed while not affecting accuracy. We discuss the theoretical implications of these results and their potential importance in practical settings.

Virtual food exposure with positive mood induction or social support to reduce food anxiety in anorexia nervosa: A feasibility study

OBJECTIVE

Aversive emotions toward food and the consequences of eating are at the core of anorexia nervosa. Exposure therapy is effective to reduce anxiety and avoidance toward feared stimuli. Based on the inhibitory learning framework, this study examined the feasibility to induce social support or positive mood to enhance the impact of a single session virtual food exposure on food-related anxiety in anorexia nervosa.

METHOD

One hundred and forty-five patients were randomized to: (1) virtual food exposure (i.e., baseline condition), (2) virtual food exposure plus positive mood induction (i.e., positive mood condition), or (3) virtual food exposure plus social support (i.e., social support condition). They completed self-report assessments of anxiety toward virtual foods, general anxiety, positive mood, social support, and hunger, before and after virtual food exposure. Number of eye gazes and touches toward foods were recorded during the virtual reality exposure.

RESULTS

Patients had lower levels of anxiety toward virtual foods in the positive mood condition, compared to the baseline condition [F(2,141)  = 4.36, p = .015; medium effect size]. They also touched food items more often in the baseline condition. No other significant changes were found.

DISCUSSION

Virtual food exposure enhanced by positive mood induction seems a feasible approach to strengthen the impact of food exposure in anorexia nervosa.

PUBLIC SIGNIFICANCE

This research contributes to the understanding of how patients with anorexia nervosa can be supported to overcome fear and anxiety around food. Virtual reality enables patients to expose themselves to difficult situations (e.g., kitchen with foods of various calorie contents) while experiencing positive stimuli, such as a loving and kind pet or a supportive avatar.

Mood induction through imitation of full-body movements with different affective intentions

Theories of human emotion, including some emotion embodiment theories, suggest that our moods and affective states are reflected in the movements of our bodies. We used the reverse process for mood regulation; modulate body movements to regulate mood. Dancing is a type of full-body movement characterized by affective expressivity and, hence, offers the possibility to express different affective states through the same movement sequences. We tested whether the repeated imitation of a dancer performing two simple full-body dance movement sequences with different affective expressivity (happy or sad) could change mood states. Computer-based systems, using avatars as dance models to imitate, offer a series of advantages such as independence from physical contact and location. Therefore, we compared mood induction effects in two conditions: participants were asked to imitate dance movements from one of the two avatars showing: (a) videos of a human dancer model or (b) videos of a robot dancer model. The mood induction was successful for both happy and sad imitations, regardless of condition (human vs. robot avatar dance model). Moreover, the magnitude of happy mood induction and how much participants liked the task predicted work-related motivation after the mood induction. We conclude that mood regulation through dance movements is possible and beneficial in the work context.

Effects of self-avatar cast shadow and foot vibration on telepresence, virtual walking experience, and cybersickness from omnidirectional movie

Human locomotion is most naturally achieved through walking, which is good for both mental and physical health. To provide a virtual walking experience to seated users, a system utilizing foot vibrations and simulated optical flow was developed. The current study sought to augment this system and examine the effect of an avatar's cast shadow and foot vibrations on the virtual walking experience and cybersickness. The omnidirectional movie and the avatar's walking animation were synchronized, with the cast shadow reflecting the avatar's movement on the ground. Twenty participants were exposed to the virtual walking in six conditions (with/without foot vibrations and no/short/long shadow) and were asked to rate their sense of telepresence, walking experience, and occurrences of cybersickness. Our findings indicate that the synchronized foot vibrations enhanced telepresence as well as self-motion, walking, and leg-action sensations, while also reducing instances of nausea and disorientation sickness. The avatar's cast shadow was found to improve telepresence and leg-action sensation, but had no impact on self-motion and walking sensation. These results suggest that observation of the self-body cast shadow does not directly improve walking sensation, but is effective in enhancing telepresence and leg-action sensation, while foot vibrations are effective in improving telepresence and walking experience and reducing instances of cybersickness.

The Effects of Virtual Reality Telemedicine With Pediatric Patients Diagnosed With Posttraumatic Stress Disorder: Exploratory Research Method Case Report

BACKGROUND

Trauma-focused cognitive behavioral therapy (TF-CBT) strategies are common interventions to treat child trauma and a posttraumatic stress disorder (PTSD) diagnosis in children with histories of sexual and physical abuse. With the advent of COVID-19, the disruption of child development combined with intense exposure to technology and screen time indicate a need for delivering other novel approaches to treat pediatric PTSD. Virtual reality (VR) has been used with evidence-based TF-CBT as an intervention in lab-based settings, but never as telehealth. Such technologies, including a VR head-mounted device (HMD) programmed with novel TheraVR software, for psychotherapy and treating trauma-related symptoms could redefine how pediatric populations respond to treatment.

OBJECTIVE

The aim of this exploratory single-case study was to reflect symptom improvement and patient engagement using VR as telehealth.

METHODS

The patient was a 10-year-old girl of Middle Eastern descent diagnosed with trauma and comorbid medical conditions. The patient was in divorced joint parental custody and a Child Protective Services report was made with referral for therapy. Night terrors, hallucinations, depression, anxiety, isolation, and encopresis symptoms were assessed at the beginning of treatment. Clinical analysis met the criteria for a diagnosis of early onset PTSD, which was treated over the course of 7 months using TF-CBT. A cross-analysis design was used to compare improved effectiveness in treatment and patient outcomes when moving from delivery of care with telehealth using desktop and tablet synchronous technology to 2D VR desktop telehealth with TheraVR software and subsequently HMD VR telehealth with TheraVR software. Sessions were conducted in private practice providing psychotherapy for remote patient care, collateral care with the family, and coordination of clinical care with the patient's pediatrician. Safety and protocols for reducing triggers were clinically monitored by the provider.

RESULTS

Over the course of treatment, and moving from standard telehealth to 2D VR to TheraVR with a standalone HMD, there was a significant reduction in PTSD symptoms. The transfer from using the standard video conferencing with face-to-face video to using customizable avatar technology with an assigned scene environment presented an increase in patient retention and follow-through with the treatment goals. The continuous use of delivery of care using VR with the TheraVR software demonstrated breakthrough clinical observations where the patient devised her own interventions for coping with mood, emotional regulation, and negative cognitive processes using the 10 different VR environments.

CONCLUSIONS

This study shows the potential efficacy in using VR specifically for younger populations as a better modality of pediatrics care, while improving engagement with the provider through telehealth. These findings suggest the value of further research through larger clinical trials including pediatric patients diagnosed with severe trauma or trauma-related symptoms to assess the effectiveness of TheraVR software.

Deep learning(s) in gaming disorder through the user-avatar bond: A longitudinal study using machine learning

Background and aims

Gaming disorder [GD] risk has been associated with the way gamers bond with their visual representation (i.e., avatar) in the game-world. More specifically, a gamer's relationship with their avatar has been shown to provide reliable mental health information about the user in their offline life, such as their current and prospective GD risk, if appropriately decoded.

Methods

To contribute to the paucity of knowledge in this area, 565 gamers (Mage = 29.3 years; SD =10.6) were assessed twice, six months apart, using the User-Avatar-Bond Scale (UABS) and the Gaming Disorder Test. A series of tuned and untuned artificial intelligence [AI] classifiers analysed concurrently and prospectively their responses.

Results

Findings showed that AI models learned to accurately and automatically identify GD risk cases, based on gamers' reported UABS score, age, and length of gaming involvement, both concurrently and longitudinally (i.e., six months later). Random forests outperformed all other AIs, while avatar immersion was shown to be the strongest training predictor.

Conclusion

Study outcomes demonstrated that the user-avatar bond can be translated into accurate, concurrent and future GD risk predictions using trained AI classifiers. Assessment, prevention, and practice implications are discussed in the light of these findings.

Extended Reality Telemedicine Collaboration System Using Patient Avatar Based on 3D Body Pose Estimation

Recent advances in extended reality (XR) technology have opened the possibility of significantly improving telemedicine systems. This is primarily achieved by transferring 3D information about patient state, which is utilized to create more immersive experiences on VR/AR headsets. In this paper, we propose an XR-based telemedicine collaboration system in which the patient is represented as a 3D avatar in an XR space shared by local and remote clinicians. The proposed system consists of an AR client application running on Microsoft HoloLens 2 used by a local clinician, a VR client application running on the HTC vive Pro used by a remote clinician, and a backend part running on the server. The patient is captured by a camera on the AR side, and the 3D body pose estimation is performed on frames from this camera stream to form a 3D patient avatar. Additionally, the AR and VR sides can interact with the patient avatar via virtual hands, and annotations can be performed on a 3D model. The main contribution of our work is the use of 3D body pose estimation for the creation of a 3D patient avatar. In this way, 3D body reconstruction using depth cameras is avoided, which reduces system complexity and hardware and network resources. Another contribution is the novel architecture of the proposed system, where audio and video streaming are realized using WebRTC protocol. The performance evaluation showed that the proposed system ensures high frame rates for both AR and VR client applications, while the processing latency remains at an acceptable level.

Examining the Impact of Digital Human Gaze Expressions on Engagement Induction

With advancements in technology, digital humans are becoming increasingly sophisticated, with their application scope widening to include interactions with real people. However, research on expressions that facilitate natural engagement in interactions between real people and digital humans is scarce. With this study, we aimed to examine the differences in user engagement as measured by subjective evaluations, eye tracking, and electroencephalogram (EEG) responses relative to different gaze expressions in various conversational contexts. Conversational situations were categorized as face-to-face, face-to-video, and digital human interactions, with gaze expressions segmented into eye contact and gaze avoidance. Story stimuli incorporating twelve sentences verified to elicit positive and negative emotional responses were employed in the experiments after validation. A total of 45 participants (31 females and 14 males) underwent stimulation through positive and negative stories while exhibiting eye contact or gaze avoidance under each of the three conversational conditions. Engagement was assessed using subjective evaluation metrics in conjunction with measures of the subjects' gaze and brainwave activity. The findings revealed engagement disparities between the face-to-face and digital-human conversation conditions. Notably, only positive stimuli elicited variations in engagement based on gaze expression across different conversation conditions. Gaze analysis corroborated the engagement differences, aligning with prior research on social sensitivity, but only in response to positive stimuli. This research departs from traditional studies of un-natural interactions with digital humans, focusing instead on interactions with digital humans designed to mimic the appearance of real humans. This study demonstrates the potential for gaze expression to induce engagement, regardless of the human or digital nature of the conversational dyads.

Improving capacity to identify, assess, and manage adolescents engaging in non-suicidal self-injury using patient avatars

PURPOSE

We developed and evaluated a training comprising a didactic and virtual practice session with human-guided patient avatars to increase pediatric residents' competence to identify and assess non-suicidal self-injury (NSSI) and suicide risk.

METHODS

Thirty pediatric residents at three children's hospitals in Florida participated in the training and completed pre-, one-month post-, and three-months post-training surveys. One-way repeated measures ANOVA with post-hoc comparisons determined changes in confidence, comfort, behavioral intentions, attitudes, knowledge, and behavior over time. Qualitative responses provided feedback on the training, especially the novel practice session with adolescent patient avatars.

RESULTS

Three-months post-training residents expressed significantly greater confidence in talking to adolescents who self-injure, applying the SOARS method to assess self-injury, and assessing functions/reasons for self-injury; reported feeling significantly more comfortable asking about self-injury, well-equipped to handle the emotional aspects of self-injury, and comfortable treating adolescents who self-injure; reported greater behavioral intentions to talk to adolescents about self-injury, assess an adolescent's stage of change for stopping self-injury, and provide brief interventions for adolescents who self-injure; and used SOARS to evaluate current NSSI with a greater proportion of adolescent patients. Qualitative feedback expressed positive perceptions, especially related to the virtual-reality role-play session.

CONCLUSIONS

Incorporating an interactive, human-guided virtual experience using role-playing and feedback with patient avatars represents a viable option comparable to using typical standardized patients to expand the scalability of NSSI trainings for pediatric residents, especially when they occur virtually.

Using Visual Patient to Show Vital Sign Predictions, a Computer-Based Mixed Quantitative and Qualitative Simulation Study

BACKGROUND

Machine learning can analyze vast amounts of data and make predictions for events in the future. Our group created machine learning models for vital sign predictions. To transport the information of these predictions without numbers and numerical values and make them easily usable for human caregivers, we aimed to integrate them into the Philips Visual-Patient-avatar, an avatar-based visualization of patient monitoring.

METHODS

We conducted a computer-based simulation study with 70 participants in 3 European university hospitals. We validated the vital sign prediction visualizations by testing their identification by anesthesiologists and intensivists. Each prediction visualization consisted of a condition (e.g., low blood pressure) and an urgency (a visual indication of the timespan in which the condition is expected to occur). To obtain qualitative user feedback, we also conducted standardized interviews and derived statements that participants later rated in an online survey.

RESULTS

The mixed logistic regression model showed 77.9% (95% CI 73.2-82.0%) correct identification of prediction visualizations (i.e., condition and urgency both correctly identified) and 93.8% (95% CI 93.7-93.8%) for conditions only (i.e., without considering urgencies). A total of 49 out of 70 participants completed the online survey. The online survey participants agreed that the prediction visualizations were fun to use (32/49, 65.3%), and that they could imagine working with them in the future (30/49, 61.2%). They also agreed that identifying the urgencies was difficult (32/49, 65.3%).

CONCLUSIONS

This study found that care providers correctly identified >90% of the conditions (i.e., without considering urgencies). The accuracy of identification decreased when considering urgencies in addition to conditions. Therefore, in future development of the technology, we will focus on either only displaying conditions (without urgencies) or improving the visualizations of urgency to enhance usability for human users.

Patient Derived Xenografts (PDX) Models as an Avatar to Assess Personalized Therapy Options in Uveal Melanoma: A Feasibility Study

Uveal melanoma is the most common primary intraocular malignancy in adults. Up to 50% of UM patients develop metastatic disease, usually in the liver. When metastatic, the prognosis is poor, and few treatment options exist. Here, we investigated the feasibility of establishing patient-derived xenografts (PDXs) from a patient's tumor in order to screen for therapies that the patient could benefit from. Samples obtained from 29 primary tumors and liver metastases of uveal melanoma were grafted into SCID mice. PDX models were successfully established for 35% of primary patient tumors and 67% of liver metastases. The tumor take rate was proportional to the risk of metastases. PDXs showed the same morphology, the same GNAQ/11, BAP1, and SF3B1 mutations, and the same chromosome 3 and 8q status as the corresponding patient samples. Six PDX models were challenged with two compounds for 4 weeks. We show that, for 31% of patients with high or intermediate risk of metastasis, the timing to obtain efficacy results on PDX models derived from their primary tumors was compatible with the selection of the therapy to treat the patient after relapse. PDXs could thus be a valid tool ("avatar") to select the best personalized therapy for one third of patients that are most at risk of relapse.

Effects of avatar shape and motion on mirror neuron system activity

Humanness is an important characteristic for facilitating interpersonal communication, particularly through avatars in the metaverse. In this study, we explored the mirror neuron system (MNS) as a potential neural basis for perceiving humanness in avatars. Although previous research suggests that the MNS may be influenced by human-like shape and motion, the results have been inconsistent due to the diversity and complexity of the MNS investigation. Therefore, this study aims to investigate the effects of shape and motion humanness in avatars on MNS activity. Participants viewed videos of avatars with four different shapes (HumanShape, AngularShape, AbbreviatedShape, and ScatteredShape) and two types of motion (HumanMotion and LinearMotion), and their μ-wave attenuation in the electroencephalogram was evaluated. Results from a questionnaire indicated that HumanMotion was perceived as human-like, while AbbreviatedShape and ScatteredShape were seen as non-human-like. AngularShape's humanity was indefinite. The MNS was activated as expected for avatars with human-like shapes and/or motions. However, for non-human-like motions, there were differences in activity trends depending on the avatar shape. Specifically, avatars with HumanShape and ScatteredShape in LinearMotion activated the MNS, but the MNS was indifferent to AngularShape and AbbreviatedShape. These findings suggest that when avatars make non-human-like motions, the MNS is activated not only for human-like appearance but also for the scattered and exaggerated appearance of the human body in the avatar shape. These findings could enhance inter-avatar communication by considering brain activity.

Design and Usability of an Avatar-Based Learning Program to Support Diabetes Education: Quality Improvement Study in Colombia

BACKGROUND

This quality improvement study, entitled Avatar-Based LEarning for Diabetes Optimal Control (ABLEDOC), explored the feasibility of delivering an educational program to people with diabetes in Colombia. The aim was to discover how this approach could be used to improve awareness and understanding of the condition, the effects of treatment, and strategies for effective management of blood-glucose control.

METHODS

Individuals with diabetes were recruited by Colombian endocrinologists to a human-centered study to codesign the educational program, using the Double Diamond model. Participants contributed to two phases. The first phase focused on gathering unmet educational needs and choice of curriculum. Three prototypes were developed as a result. During phase 2, a different group of participants engaged with the program for several weeks, before reporting back.

RESULTS

Thirty-six participants completed a Web survey during phase 1, and five were also interviewed by telephone. The majority (33 of 36; 91%) were receptive to the prospect of educational interventions and ranked the chosen topic of hypoglycemia highly. In phase 2, the three prototypes were tested by 17 participants, 10 of whom also gave feedback in focus groups. The response was overwhelmingly positive, with 16 of 17 (94%) stating they would use a program like this again. The 3D version was the most highly rated.

CONCLUSIONS

Immersive, avatar-based programs, delivered through smartphone, have the potential to deliver educational information that is trusted, engaging, and useful. Future work includes expansion of the curriculum, evaluation with a larger group, and exploration of the prospective role of artificial intelligence in personalizing this form of educational intervention.

A new door to a different world: opportunities from the metaverse and the raise of meta-medical laboratories

OBJECTIVES

In the digital age, the metaverse has emerged with impressive potential for many segments of society. The metaverse could be presented as a parallel dimension able to enhance the physical world as well as our actions and decisions in it with the objective to use a coalition between the natural and virtual worlds for value creation. Our aim was to elaborate on the impact of the metaverse on laboratory medicine.

METHODS

Based on the available evidence, literature and reports, we analyzed the different perspectives of the metaverse on laboratory medicine and the needs for an efficient transition.

RESULTS

The convergence and integration of technologies in the metaverse will participate to the reimagination of laboratory medicine services with augmented services, users' experiences, efficiency, and personalized care. The revolution around the metaverse offers different opportunities for laboratory medicine but also open multiple related challenges that are presented in this article.

CONCLUSIONS

Scientific societies, multidisciplinary teams and specialists in laboratory medicine must prepare the integration metaverse and meta-medical laboratories, raise the awareness, educate, set guidance to obtain a maximum of value and mitigate potential adverse consequences.

Avatar-Based Strategies for Breast Cancer Patients: A Systematic Review

There is a lack of studies to determine if avatar-based protocols could be considered an efficient and accurate strategy to improve psychological well-being in oncology patients, even though it represents a growing field of research. To the best of our knowledge, this is the first systematic review addressing the effectiveness of avatar-based treatments to enhance quality of life (QoL) and psychological well-being in breast cancer patients. The purpose of this study was to review the scientific literature of those studies involving avatar-based technology and breast cancer patients in order to answer the following questions. (1) Are avatar-based strategies useful to im-prove QoL and psychological well-being (anxiety and depression symptoms) in breast cancer patients? (2) Which is the best way to develop avatar-based protocols for breast cancer patients? We conducted a systematic review of the peer-reviewed literature from EBSCO, Ovid, PubMed, Scopus, and Web of Science (WOS), following the PRISMA statements and using "avatar + breast cancer" or "avatar + cancer" as keywords. Studies which were published in either English or Spanish and which addressed QoL and psychological well-being in breast cancer patients were reviewed. The results will contribute to developing innovative avatar-based strategies focused on breast cancer patients.

Boosting Creativity through Users' Avatars and Contexts in Virtual Environments-A Systematic Review of Recent Research

As an artificial space extended from the physical environment, the virtual environment (VE) provides more possibilities for humans to work and be entertained with less physical restrictions. Benefiting from anonymity, one of the important features of VEs, users are able to receive visual stimuli that might differ from the physical environment through digital representations presented in VEs. Avatars and contextual cues in VEs can be considered as digital representations of users and contexts. In this article, we analyzed 21 articles that examined the creativity-boosting effects of different digital user and contextual representations. We summarized the main effects induced by these two digital representations, notably the effect induced by the self-similar avatar, Proteus effect, avatar with Social Identity Cues, priming effect induced by contextual representation, and embodied metaphorical effect. In addition, we examined the influence of immersion on creativity by comparing non-immersive and immersive VEs (i.e., desktop VE and headset VE, respectively). Last, we discussed the roles of embodiment and presence in the creativity in VEs, which were overlooked in the past research.

Avatar and virtual agent-assisted telecare for patients in their homes: A scoping review

INTRODUCTION

Telecare can be an effective way to deliver healthcare to patients' homes. Avatar or virtual agent-equipped technologies have the potential to increase user engagement and adherence to telecare. This study aimed to identify telecare interventions assisted by avatars/virtual agents, reflect the concepts of telecare and give an overview on its outcomes.

METHODS

A scoping review guided by the PRISMA-ScR checklist was conducted. MEDLINE, CINAHL, PsycINFO and grey literature were searched through 12 July 2022. Studies were included if patients were remotely cared for by healthcare professionals and received telecare interventions assisted by avatars/virtual agents in their homes. Studies underwent quality appraisal, and were synthesized along the dimensions 'study characteristics', 'intervention' and 'outcomes'.

RESULTS

Out of 535 records screened, 14 studies were included, reporting the effects of avatar/virtual agent-assisted telecare interventions, tailored to specific patient groups. Telecare interventions mainly focused on teletherapy and telemonitoring. Telecare services were rehabilitative, preventive, palliative, promotive and curative. Modes of communication were asynchronous, synchronous or a mix of both. Tasks of the implemented avatars/virtual agents comprised delivering health interventions, monitoring, assessment, guidance and strengthening agency. Telecare interventions led to improved clinical outcomes and higher adherence. Most studies reported sufficient system usability and high satisfaction among participants.

CONCLUSIONS

Telecare interventions were overall target group related and integrated in a service model. This combined with the use of avatars and virtual agents leads to improved adherence to telecare in the home setting. Further studies could account for relatives' experiences with telecare.

Modeling the Tumor Microenvironment and Cancer Immunotherapy in Next-Generation Humanized Mice

Cancer immunotherapy has brought significant clinical benefits to numerous patients with malignant disease. However, only a fraction of patients experiences complete and durable responses to currently available immunotherapies. This highlights the need for more effective immunotherapies, combination treatments and predictive biomarkers. The molecular properties of a tumor, intratumor heterogeneity and the tumor immune microenvironment decisively shape tumor evolution, metastasis and therapy resistance and are therefore key targets for precision cancer medicine. Humanized mice that support the engraftment of patient-derived tumors and recapitulate the human tumor immune microenvironment of patients represent a promising preclinical model to address fundamental questions in precision immuno-oncology and cancer immunotherapy. In this review, we provide an overview of next-generation humanized mouse models suitable for the establishment and study of patient-derived tumors. Furthermore, we discuss the opportunities and challenges of modeling the tumor immune microenvironment and testing a variety of immunotherapeutic approaches using human immune system mouse models.

A Serious Game for the Assessment of Visuomotor Adaptation Capabilities during Locomotion Tasks Employing an Embodied Avatar in Virtual Reality

The study of visuomotor adaptation (VMA) capabilities has been encompassed in various experimental protocols aimed at investigating human motor control strategies and/or cognitive functions. VMA-oriented frameworks can have clinical applications, primarily in the investigation and assessment of neuromotor impairments caused by conditions such as Parkinson's disease or post-stroke, which affect the lives of tens of thousands of people worldwide. Therefore, they can enhance the understanding of the specific mechanisms of such neuromotor disorders, thus being a potential biomarker for recovery, with the aim of being integrated with conventional rehabilitative programs. Virtual Reality (VR) can be entailed in a framework targeting VMA since it allows the development of visual perturbations in a more customizable and realistic way. Moreover, as has been demonstrated in previous works, a serious game (SG) can further increase engagement thanks to the use of full-body embodied avatars. Most studies implementing VMA frameworks have focused on upper limb tasks and have utilized a cursor as visual feedback for the user. Hence, there is a paucity in the literature about VMA-oriented frameworks targeting locomotion tasks. In this article, the authors present the design, development, and testing of an SG-based framework that addresses VMA in a locomotion activity by controlling a full-body moving avatar in a custom VR environment. This workflow includes a set of metrics to quantitatively assess the participants' performance. Thirteen healthy children were recruited to evaluate the framework. Several quantitative comparisons and analyses were run to validate the different types of introduced visuomotor perturbations and to evaluate the ability of the proposed metrics to describe the difficulty caused by such perturbations. During the experimental sessions, it emerged that the system is safe, easy to use, and practical in a clinical setting. Despite the limited sample size, which represents the main limitation of the study and can be compensated for with future recruitment, the authors claim the potential of this framework as a useful instrument for quantitatively assessing either motor or cognitive impairments. The proposed feature-based approach gives several objective parameters as additional biomarkers that can integrate the conventional clinical scores. Future studies might investigate the relation between the proposed biomarkers and the clinical scores for specific disorders such as Parkinson's disease and cerebral palsy.

Evaluating the Feasibility of Emotion Expressions in Avatars Created From Real Person Photos: Pilot Web-Based Survey of Virtual Reality Software

BACKGROUND

The availability and potential of virtual reality (VR) has led to an increase of its application. VR is suggested to be helpful in training elements of social competence but with an emphasis on interventions being tailored. Recognizing facial expressions is an important social skill and thus a target for training. Using VR in training these skills could have advantages over desktop alternatives. Children with autism, for instance, appear to prefer avatars over real images when assessing facial expressions. Available software provides the opportunity to transform profile pictures into avatars, thereby giving the possibility of tailoring according to an individual's own environment. However, the emotions provided by such software should be validated before application.

OBJECTIVE

Our aim was to investigate whether available software is a quick, easy, and viable way of providing emotion expressions in avatars transformed from real images.

METHODS

A total of 401 participants from a general population completed a survey on the web containing 27 different images of avatars transformed, using a software, from real images. We calculated the reliability of each image and their level of difficulty using a structural equation modeling approach. We used Bayesian confirmatory factor analysis testing under a multidimensional first-order correlated factor structure where faces showing the same emotions represented a latent variable.

RESULTS

Few emotions were correctly perceived and rated as higher than other emotions. The factor loadings indicating the discrimination of the image were around 0.7, which means 49% shared variance with the latent factor that the face is linked with. The standardized thresholds indicating the difficulty level of the images are mostly around average, and the highest correlation is between faces showing happiness and anger.

CONCLUSIONS

Only using a software to transform profile pictures to avatars is not sufficient to provide valid emotion expressions. Adjustments are needed to increase faces' discrimination (eg, increasing reliabilities). The faces showed average levels of difficulty, meaning that they are neither very difficult nor very easy to perceive, which fits a general population. Adjustments should be made for specific populations and when applying this technology in clinical practice.

Combatting ageism through virtual embodiment? Using explicit and implicit measures

OBJECTIVES

Ageism is defined as stereotypes, prejudice, and discrimination towards people because of their age. Although ageism can be directed towards people of any age group, most research has focused on ageism towards older people. Ageism towards older people is known to have a significant impact on their health and wellbeing and to even result in higher healthcare costs. The present study evaluated the use of virtual embodiment (VE) to reduce self- and other-directed ageism.

DESIGN, SETTING, AND PARTICIPANTS

We randomized 80 individuals between the ages of 18 and 35 years to one of two conditions: VE as an older or a younger avatar.

RESULTS

No differences were found on explicit measures of ageism. Once multiple comparisons were accounted for, a nonsignificant reduction in implicit age bias following exposure to the older avatar (Cohen's d = .75, p = .02) also was found.

CONCLUSIONS

Past research has established the effectiveness of VE in relation to implicit measures. However, once both explicit and implicit measures are included and multiple comparisons are accounted for, neither explicit nor implicit measures of ageism show a significant effect. Given the multidimensional nature of ageism, further research is needed to establish the effectiveness of VE once multiple measures of ageism are considered.

Playfully Assessing Lower Extremity Selective Voluntary Motor Control in Children With Cerebral Palsy: Psychometric Study

BACKGROUND

Objective measures specifically assessing selective voluntary motor control are scarce. Therefore, we have developed an interval-scaled assessment based on accelerometers.

OBJECTIVE

This study provided a preliminary evaluation of the validity and reliability of this novel gamelike assessment measuring lower limb selective voluntary motor control in children with cerebral palsy (CP).

METHODS

Children with CP and their neurologically intact peers were recruited for this psychometric evaluation of the assessgame. The participants played the assessgame and steered an avatar by selective hip, knee, or ankle joint movements captured with accelerometers. The assessgame's scores provide information about the accuracy of the selective movement of the target joint and the amplitude and frequency of involuntary movements occurring in uninvolved joints. We established discriminative validity by comparing the assessgame scores of the children with CP with those of the neurologically intact children, concurrent validity by correlations with clinical scores and therapists' opinions, and relative and absolute test-retest reliability.

RESULTS

We included 20 children with CP (mean age 12 years and 5 months, SD 3 years and 4 months; Gross Motor Function Classification System levels I to IV) and 31 neurologically intact children (mean age 11 years and 1 month, SD 3 years and 6 months). The assessgame could distinguish between the children with CP and neurologically intact children. The correlations between the assessgame's involuntary movement score and the therapist's rating of the occurrence of involuntary movements during the game were moderate (Spearman ρ=0.56; P=.01), whereas the correlations of the assessgame outcomes with the Selective Control Assessment of the Lower Extremity and Gross Motor Function Classification System were low and not significant (|ρ|≤0.39). The intraclass correlation coefficients were >0.85 and indicated good relative test-retest reliability. Minimal detectable changes amounted to 25% (accuracy) and 44% (involuntary movement score) of the mean total scores. The percentage of children able to improve by the minimal detectable change without reaching the maximum score was 100% (17/17) for the accuracy score and 94% (16/17) for the involuntary movement score.

CONCLUSIONS

The assessgame proved reliable and showed discriminative validity in this preliminary evaluation. Concurrent validity was moderate with the therapist's opinion but relatively poor with the Selective Control Assessment of the Lower Extremity. We assume that the assessment's gamelike character demanded various other motor control aspects that are less considered in current clinical assessments.

Immersive Virtual Reality Avatars for Embodiment Illusions in People With Mild to Borderline Intellectual Disability: User-Centered Development and Feasibility Study

BACKGROUND

Immersive virtual reality (IVR) has been investigated as a tool for treating psychiatric conditions. In particular, the practical nature of IVR, by offering a doing instead of talking approach, could support people who do not benefit from existing treatments. Hence, people with mild to borderline intellectual disability (MBID; IQ=50-85) might profit particularly from IVR therapies, for instance, to circumvent issues in understanding relevant concepts and interrelations. In this context, immersing the user into a virtual body (ie, avatar) appears promising for enhancing learning (eg, by changing perspectives) and usability (eg, natural interactions). However, design requirements, immersion procedures, and proof of concept of such embodiment illusion (ie, substituting the real body with a virtual one) have not been explored in this group.

OBJECTIVE

Our study aimed to establish design guidelines for IVR embodiment illusions in people with MBID. We explored 3 factors to induce the illusion, by testing the avatar's appearance, locomotion using IVR controllers, and virtual object manipulation. Furthermore, we report on the feasibility to induce the embodiment illusion and provide procedural guidance.

METHODS

We conducted a user-centered study with 29 end users in care facilities, to investigate the avatar's appearance, controller-based locomotion (ie, teleport, joystick, or hybrid), and object manipulation. Overall, 3 iterations were conducted using semistructured interviews to explore design factors to induce embodiment illusions in our group. To further understand the influence of interactions on the illusion, we measured the sense of embodiment (SoE) during 5 interaction tasks.

RESULTS

IVR embodiment illusions can be induced in adults with MBID. To induce the illusion, having a high degree of control over the body outweighed avatar customization, despite the participants' desire to replicate their own body image. Similarly, the highest SoE was measured during object manipulation tasks, which required a combination of (virtual) locomotion and object manipulation behavior. Notably, interactions that are implausible (eg, teleport and occlusions when grabbing) showed a negative influence on SoE. In contrast, implementing artificial interaction aids into the IVR avatar's hands (ie, for user interfaces) did not diminish the illusion, presuming that the control was unimpaired. Nonetheless, embodiment illusions showed a tedious and complex need for (control) habituation (eg, motion sickness), possibly hindering uptake in practice.

CONCLUSIONS

Balancing the embodiment immersion by focusing on interaction habituation (eg, controller-based locomotion) and lowering customization effort seems crucial to achieve both high SoE and usability for people with MBID. Hence, future studies should investigate the requirements for natural IVR avatar interactions by using multisensory integrations for the virtual body (eg, animations, physics-based collision, and touch) and other interaction techniques (eg, hand tracking and redirected walking). In addition, procedures and use for learning should be explored for tailored mental health therapies in people with MBID.

Acceptability and feasibility of using avatar-based virtual world software as an adjunct to clinical interventions, training, and reflective practice in a medium secure setting: A qualitative interview study

BACKGROUND

Relationships are at the core of recovery, particularly in secure services where patients have usually had difficulties with authority figures and can have mentalisation deficits. Early indications are that avatar-based virtual world software may help facilitate communication and emotional expression.

AIMS

To establish the feasibility of using avatar-based virtual world software in a medium secure hospital, adjunctive to standard staff-patient interactions during clinical interventions and staff activities including reflective practice and training; to explore patient, staff participant and facilitator experiences using it.

METHODS

Use of the software was offered across an 89-bedded unit as an optional adjunct to clinical interventions, reflective practice and training sessions. Qualitative data were collected using semi-structured interviews and analysed using thematic analysis. Volunteer sampling was used. Five patients volunteered and were matched with an equal number of staff facilitators and participants.

RESULTS

Eighty four sessions were completed using the avatar software with between 1 and 11 participant(s) per session, totalling 347 participant sessions. No adverse events occurred relatable to the sessions. An overarching theme of 'adding value' emerged, encompassing subthemes such as 'concrete visual presence and imagery', 'mentalisation processes' and 'enhanced focus, depth and problem solving'. Experiences of added value were affected by moderators which were 'power and relationship dynamics', the 'ability to use software', 'practical processes' and 'literacy'.

CONCLUSIONS

Avatar software is feasible to implement, acceptable to patients and staff and may offer an opportunity to aid mentalisation and reflection. By definition, everyone engaging in this study was a volunteer, even an enthusiast, so it would now be useful to extend evaluation to those who need some encouragement to use avatar software. Research to quantify benefits and establish the cost impact is now indicated, as our findings show it may offer a novel way of connecting with hard-to-reach patient groups.

Licensing Effect of Pro-Environmental Behavior in Metaverse

The Metaverse is an important virtual venue in people's daily lives. This study examined whether pro-environmental behaviors in the Metaverse with a self-customized avatar lead to licensing effects, thereby reducing pro-environmental intention in reality. In addition, the study examined the mediating effect of self-presence on the relationship between avatar customization and pro-environmental behavior. A laboratory experiment was conducted using ZEPETO, a Metaverse platform. A total of 60 participants were randomly assigned to the self-customized avatar condition or the assigned avatar condition, and they engaged in pro-environmental behaviors on the Metaverse platform. Participants with self-customized avatars had less intention to engage in pro-environmental behavior in reality after engaging in pro-environmental behavior in the Metaverse than those with assigned avatars. Furthermore, self-presence partially mediated the relationship between avatar customization and pro-environmental intention.

Avatar Mice Underscore the Role of the T Cell-Dendritic Cell Crosstalk in Ebola Virus Disease and Reveal Mechanisms of Protection in Survivors

Ebola virus disease (EVD) is a complex infectious disease characterized by high inflammation, multiorgan failure, the dysregulation of innate and adaptive immune responses, and coagulation abnormalities. Evidence accumulated over the last 2 decades indicates that, during fatal EVD, the infection of antigen-presenting cells (APC) and the dysregulation of T cell immunity preclude a successful transition between innate and adaptive immunity, which constitutes a key disease checkpoint. In order to better understand the contribution of the APC-T cell crosstalk to EVD pathophysiology, we have developed avatar mice transplanted with human, donor-specific APCs and T cells. Here, we show that the transplantation of T cells and APCs from Ebola virus (EBOV)-naive individuals into avatar mice results in severe disease and death and that this phenotype is dependent on T cell receptor (TCR)-major histocompatibility complex (MCH) recognition. Conversely, avatar mice were rescued from death induced by EBOV infection after the transplantation of both T cells and plasma from EVD survivors. These results strongly suggest that protection from EBOV reinfection requires both cellular and humoral immune memory responses. IMPORTANCE The crosstalk between dendritic cells and T cells marks the transition between innate and adaptive immune responses, and it constitutes an important checkpoint in EVD. In this study, we present a mouse avatar model in which T cell and dendritic cell interactions from a specific donor can be studied during EVD. Our findings indicate that T cell receptor-major histocompatibility complex-mediated T cell-dendritic cell interactions are associated with disease severity, which mimics the main features of severe EVD in these mice. Resistance to an EBOV challenge in the model was achieved via the transplantation of both survivor T cells and plasma.

The Effectiveness of Virtual Reality Interventions on Smoking, Nutrition, Alcohol, Physical Activity and/or Obesity Risk Factors: A Systematic Review

To our knowledge, no systematic reviews have examined the effectiveness of virtual reality (VR) interventions across all smoking, nutrition, alcohol, physical activity, and/or obesity (SNAPO) risk factors. This systematic review assessed the effectiveness of VR interventions on reducing SNAPO risks compared to control groups or other interventions. MEDLINE, EMBASE, Scopus, PsycINFO, and CENTRAL were searched to identify eligible studies published to 7 October 2021. Two reviewers independently completed screening, data extraction and quality assessment. Twenty-six studies were included, five on smoking, twelve on physical activity (PA), six on obesity, one on PA and obesity, one on obesity and nutrition, and one on obesity, nutrition and PA. VR was effective for smoking cessation in three studies and for smoking reduction in four studies. Seven studies had significantly higher PA in the VR group, and one study found significantly higher PA in a comparator group. Two studies showed VR was more effective at reducing BMI or weight than comparators. Three multiple health risks studies showed mixed results. The remaining studies found no significant difference between VR and control/comparators. VR appears promising for the treatment of smoking, nutrition, PA, and obesity risks; however, further randomised trials are needed.

The Effect of a Future-Self Avatar Mobile Health Intervention (FutureMe) on Physical Activity and Food Purchases: Randomized Controlled Trial

BACKGROUND

Insufficient physical activity and unhealthy diets are contributing to the rise in noncommunicable diseases. Preventative mobile health (mHealth) interventions may help reverse this trend, but present bias might reduce their effectiveness. Future-self avatar interventions have resulted in behavior change in related fields, yet evidence of whether such interventions can change health behavior is lacking.

OBJECTIVE

We aimed to investigate the impact of a future-self avatar mHealth intervention on physical activity and food purchasing behavior and examine the feasibility of a novel automated nutrition tracking system. We also aimed to understand how this intervention impacts related attitudinal and motivational constructs.

METHODS

We conducted a 12-week parallel randomized controlled trial (RCT), followed by semistructured interviews. German-speaking smartphone users aged ≥18 years living in Switzerland and using at least one of the two leading Swiss grocery loyalty cards, were recruited for the trial. Data were collected from November 2020 to April 2021. The intervention group received the FutureMe intervention, a physical activity and food purchase tracking mobile phone app that uses a future-self avatar as the primary interface and provides participants with personalized food basket analysis and shopping tips. The control group received a conventional text- and graphic-based primary interface intervention. We pioneered a novel system to track nutrition by leveraging digital receipts from loyalty card data and analyzing food purchases in a fully automated way. Data were consolidated in 4-week intervals, and nonparametric tests were conducted to test for within- and between-group differences.

RESULTS

We recruited 167 participants, and 95 eligible participants were randomized into either the intervention (n=42) or control group (n=53). The median age was 44 years (IQR 19), and the gender ratio was balanced (female 52/95, 55%). Attrition was unexpectedly high with only 30 participants completing the intervention, negatively impacting the statistical power. The FutureMe intervention led to small statistically insignificant increases in physical activity (median +242 steps/day) and small insignificant improvements in the nutritional quality of food purchases (median -1.28 British Food Standards Agency Nutrient Profiling System Dietary Index points) at the end of the intervention. Intrinsic motivation significantly increased (P=.03) in the FutureMe group, but decreased in the control group. Outcome expectancy directionally increased in the FutureMe group, but decreased in the control group. Leveraging loyalty card data to track the nutritional quality of food purchases was found to be a feasible and accepted fully automated nutrition tracking system.

CONCLUSIONS

Preventative future-self avatar mHealth interventions promise to encourage improvements in physical activity and food purchasing behavior in healthy population groups. A full-powered RCT is needed to confirm this preliminary evidence and to investigate how future-self avatars might be modified to reduce attrition, overcome present bias, and promote sustainable behavior change.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04505124; https://clinicaltrials.gov/ct2/show/NCT04505124.

Faster Time to Treatment Decision of Viscoelastic Coagulation Test Results through Improved Perception with the Animated Visual Clot: A Multicenter Comparative Eye-Tracking Study

As the interpretation of viscoelastic coagulation test results remains challenging, we created Visual Clot, an animated blood clot aiming to facilitate raw rotational thromboelastometry (ROTEM) parameters. This study investigated anesthesia personnel’s cognitive processing in managing simulated bleeding scenarios using eye-tracking technology. This multicenter, international, computer-based study across five large, central European hospitals included 35 participants with minimal to no prior experience interpreting viscoelastic test results. Using eye-tracking technology and an iPad tagged with quick response codes, we defined the time to treatment decision and the time on screen surface in seconds of correctly solved scenarios as our outcomes. The median time to treatment decision was 52 s for Visual Clot and 205 s for ROTEM (p < 0.0001). The probability of solving the scenario correctly was more than 8 times higher when using Visual Clot than when using ROTEM (Hazard ratio [HR] 8.54, 95% CI from 6.5 to 11.21; p < 0.0001). Out of 194 correctly answered scenarios of participants with the eye-tracker, 154 (79.4%) were solved with Visual Clot and 40 (20.6%) with ROTEM. Participants spent on average 30 s less looking at the screen surface with Visual Clot compared to ROTEM (Coefficient −30.74 s, 95% CI from −39.27 to −22.27; p < 0.0001). For a comparison of the two modalities in terms of information transfer, we calculated the percentage of time on the screen surface of the overall time to treatment decision, which with Visual Clot was 14 percentage points shorter than with ROTEM (Coefficient −14.55, 95% CI from −20.05 to −9.12; p < 0.0001). Visual Clot seems to improve perception and detection of coagulopathies and leads to earlier initiation of the appropriate treatment. In a high-pressure working environment such as the operating and the resuscitation room, correct and timely decisions regarding bleeding management may have a relevant impact on patients’ outcomes.

No Cameras, No Problem: Creating an Inclusive Research-Driven Classroom Environment Using Student-Generated Avatars

Student involvement in distance education has continued to increase over the last decade and has been accelerated by the unplanned transition to remote instruction caused by the COVID-19 pandemic. Empirical data demonstrate variable levels of student learning and engagement in such environments, including limited use of technologies (e.g., laptop cameras) to interact with peers and course instructors. Consequently, creating accessible and inclusive virtual learning contexts that best promote collaboration and success - whether in lecture or laboratory spaces - can be a challenge. To address these concerns, we developed and evaluated the Researcher Avatar (RA) activity, a brief exercise designed to provide students with the opportunity to depict and describe their identity as a scientific researcher through creation of an avatar. Students then made use of their avatars as their profile pictures on the course videoconferencing platform throughout the duration of the term. Participants (N = 24) who completed the RA activity as part of an online Research Foundations Course at our institution developed avatars that included both stereotypical imagery of scientists (e.g., lab coat) and personal attributes intended to reflect their dedication to science, collegiality, and future career interests. Collectively, participants reported that the activity was valuable in allowing them to "see" and get to know their classmates while likewise offering them the chance to reflect on their own goals as a researcher.

Virtual Hand Illusion in younger and older adults

Introduction

Embodiment involves experiencing ownership over our body and localizing it in space and is informed by multiple senses (visual, proprioceptive and tactile). Evidence suggests that embodiment and multisensory integration may change with older age. The Virtual Hand Illusion (VHI) has been used to investigate multisensory contributions to embodiment, but has never been evaluated in older adults. Spatio-temporal factors unique to virtual environments may differentially affect the embodied perceptions of older and younger adults.

Methods

Twenty-one younger (18–35 years) and 19 older (65+ years) adults completed the VHI paradigm. Body localization was measured at baseline and again, with subjective ownership ratings, following synchronous and asynchronous visual-tactile interactions.

Results

Higher ownership ratings were observed in the synchronous relative to the asynchronous condition, but no effects on localization/drift were found. No age differences were observed. Localization accuracy was biased in both age groups when the virtual hand was aligned with the real hand, indicating a visual mislocalization of the virtual hand.

Conclusions

No age-related differences in the VHI were observed. Mislocalization of the hand in VR occurred for both groups, even when congruent and aligned; however, tactile feedback reduced localization biases. Our results expand the current understanding of age-related changes in multisensory embodiment within virtual environments.

Local vs. Avatar Robot: Performance and Perceived Workload of Service Encounters in Public Space

In recent years, the demand for remote services has increased with concerns regarding the spread of infectious diseases and employees' quality of life. Many attempts have been made to enable store staff to provide various services remotely via avatars displayed to on-site customers. However, the workload required on the part of service staff by the emerging new work style of operating avatar robots remains a concern. No study has compared the performance and perceived workload of the same staff working locally versus remotely via an avatar. In this study, we conducted an experiment to identify differences between the performance of in-person services and remote work through an avatar robot in an actual public space. The results showed that there were significant differences in the partial performance between working via an avatar and working locally, and we could not find significant difference in the overall performance. On the other hand, the perceived workload was significantly lower when the avatar robot was used. We also found that customers reacted differently to the robots and to the in-person participants. In addition, the workload perceived by operators in the robotic task was correlated with their personality and experience. To the best of our knowledge, this study is the first investigation of both performance and workload in remote customer service through robotic avatars, and it has important implications for the implementation of avatar robots in service settings.

Exercising With Embodied Young Avatars: How Young vs. Older Avatars in Virtual Reality Affect Perceived Exertion and Physical Activity Among Male and Female Elderly Individuals

This study demonstrated that implementation of the Proteus effect via manipulation of avatar age in VR is effective among elderly individuals in the context of exercise. One hundred and four elderly adults aged 60 years and older who did not engage in vigorous physical activities participated in this experiment with a 2 (avatar age: young vs. older) × 2 (sex: male vs. female) design. The results showed that the embodiment of younger avatars (age approximately 20 years) in VR leads to greater perceived exercise exertion regardless of sex after controlling for age and emotion. Older adults with young avatars perceived a greater contribution of efforts to exercise. This study also found that among those who did not engage in vigorous exercise, female older adults who embodied young avatars reported greater self-efficacy for future exercise and greater physical activity during the exercise phase than those who embodied older avatars. This study suggests that females are more likely to be motivated to continue exercising through young avatar embodiment. In contrast, female elderly who embodied old avatars reported significant fewer physical activity than male elderly who embodied old avatars. This indicated that the Proteus effect had stronger effects among females than among older males. Although we found the Proteus effect through VR avatar manipulation, the effect was temporary and limited to the experimental phase. This study is the first to examine the Proteus effect among elderly individuals in the context of exercise. It also contributes to the literature by indicating that avatar age manipulation is an effective means of promoting exercise among elderly individuals and helping them achieve exercise outcomes. This study further demonstrates that female elderly individuals respond to young avatars differently than male elderly individuals, with female elderly individuals showing more positive effects of young avatar embodiment than males. Implications and theoretical contributions are discussed.

An Avatar-Led Digital Smoking Cessation Program for Sexual and Gender Minority Young Adults: Intervention Development and Results of a Single-Arm Pilot Trial

BACKGROUND

Sexual and gender minority young adults have a high prevalence of smoking and unique barriers to accessing tobacco treatment.

OBJECTIVE

To address these challenges as well as their preferences for sexual and gender minority-targeted interventions and digital programs, we developed and evaluated the acceptability, preliminary efficacy, and impact on theory-based change processes of an acceptance and commitment therapy-based digital program called Empowered, Queer, Quitting, and Living (EQQUAL).

METHODS

Participants (n=22) of a single-arm trial conducted to evaluate the program were young adults, age 18 to 30 years, who self-identified as sexual and gender minority individuals and smoked at least one cigarette per day. All participants received access to the EQQUAL program. Participants completed web-based surveys at baseline and at a follow-up 2 months after enrollment. We verified self-reported smoking abstinence with biochemical testing; missing data were counted as smoking or using tobacco.

RESULTS

For young adults who logged in at least once (n=18), the mean number of log-ins was 5.5 (SD 3.6), mean number of sessions completed was 3.1 (SD 2.6), and 39% (7/18) completed all 6 sessions. Overall, 93% of participants (14/15) were satisfied with the EQQUAL program, 100% (15/15) found it easy to use, and 100% (15/15) said it helped them be clearer about how to quit. Abstinence from smoking or using tobacco was confirmed with biochemical testing for 23% of participants (5/22). Both quantitative and qualitative results suggested a positive overall response to the avatar guide, with areas for future improvement largely centered on the avatar's appearance and movements.

CONCLUSIONS

Treatment acceptability of EQQUAL was very promising. The rate of abstinence, which was biochemically confirmed, was 3 times higher than that of the only other digital program to date that has targeted sexual and gender minority young adults and 6 to 13 times higher than those of nontargeted digital smoking interventions among sexual and gender minority young adults. Planned improvements for the next iteration of the program include making the avatar's movements more natural; offering multiple avatar guides with different on characteristics such as race, ethnicity, and gender identity from which to choose; and providing a support forum for users to connect anonymously with peers.

The Perceived Match Between Observed and Own Bodies, but Not Its Accuracy, Is Influenced by Movement Dynamics and Clothing Cues

Own-perceived body matching - the ability to match one's own body with an observed body - is a difficult task for both general and clinical populations. Thus far, however, own-perceived body matching has been investigated in situations that are incongruent with how we are used to experience and perceive our body in daily life. In the current study, we aimed to examine own-perceived body matching in a context that more closely resembles real life. More specifically, we investigated the effects of body movement dynamics and clothing cues on own-perceived body matching. We asked participants to match their own body with an externally perceived body that was a 3D-generated avatar based on participants' real bodies, fitted with a computer-generated dress. This perceived body was (1) either static (non-walking avatar) or dynamic (walking avatar), (2) either bigger, smaller, or the same size as participants' own body size, and (3) fitted with a dress with a size either bigger, smaller, or the same as participants' own dress size. Our results suggest that movement dynamics cues did not improve the accuracy of own-perceived body matching, but that confidence about dress fit was higher for dynamic avatars, and that the difference between dynamic and static avatars was dependent on participants' self-esteem. Furthermore, when participants were asked to rate the observed body in reference to how they wanted to represent themselves to others, dynamic avatars were rated lower than static avatars for the biggest-sized bodies only, possibly reflecting the influence of movement cues on amplifying socio-cultural stereotypes. Finally, while smaller body/dress sizes were systematically rated higher than bigger body/dress sizes for several self-report items, the interplay between body and dress size played an important role in participants' self-report as well. Thus, while our research suggests that movement and garment dynamics, allowing for realistic, concrete situations that are reminiscent of daily life, influence own-body perception, these cues did not lead to an improvement in accuracy. These findings provide important insights for research exploring (own-) body perception and bodily self-awareness, with practical (e.g., development of online avatars) and clinical (e.g., anorexia nervosa and body dysmorphic disorder) implications.

Player-avatar interactions in habitual and problematic gaming: A qualitative investigation

BACKGROUND AND AIMS

Previous studies have reported that stronger avatar identification and negative self-concept are associated with gaming disorder (GD). This study aimed to examine the value and significance of avatars based on firsthand accounts from regular and problematic gamers, and to identify any potential links between avatar-related experiences and excessive gaming.

METHODS

An online survey of 993 adult gamers yielded 3,972 text responses. Qualitative analysis of 59,059 words extracted 10 categories of avatar-related perspectives.

RESULTS

Some problem and non-problem gamers employed sentimental language (e.g., 'dear friend', 'like a child', 'part of my soul') to refer to their avatar. However, most participants perceived avatars as a means of achieving in-game goals and enabling greater interactivity (e.g., socializing). When asked to reflect on hypothetically losing their avatar, participants generally anticipated feeling temporary frustration or annoyance due to lost time and effort invested into the avatar. Although some participants reported that their avatar 'mattered', avatars were often considered as superficial ('just pixels') and peripheral to the primary reinforcement of achieving in-game rewards and objectives. Some broader psychological and identity issues such as gender dysphoria, rather than 'addiction', were cited as motivating persistent avatar-related interactions and attachment.

DISCUSSION AND CONCLUSIONS

Participants reported diverse views on the psychological value and function of avatars, but the relationship between avatars and problematic gaming or GD was largely unclear or inconsistent, and refuted by some participants. Future research with clinical samples may lead to a better understanding of player-avatar processes, including whether avatar-stimuli facilitate the development of maladaptive gaming habits, particularly among psychologically vulnerable players. Future investigations should be mindful of 'overpathologizing' avatar-related phenomena and recognize their important role in socializing, storytelling, and creative expression among gamers.

Embodied storytelling and meaning-making at the end of life: VoicingHan avatar life-review for palliative care in cancer patients

This article presents VoicingHan project as a new form of life-review mediated by digital avatars promoting the reconstruction of self and identity through performativity. Whereas traditional life-review uses interview as primary means of the therapeutic process, VoicingHan is mediated by virtual bodies with self-guided participation in one's own life stories through embodied storytelling performance. VoicingHan enrolled 12-patients receiving outpatient palliative care at VCU Massey cancer center. The storytelling performances were recorded via avatar video format and distributed to participants for review and/or sharing. The present study considered the avatar videos as qualitative data emerging from these individually constructed life review narratives. In this article, the benefits of VoicngHan life-review were demonstrated by analyzing the avatar video narratives, based on theoretical and developmental frameworks. Through the lens of Social Constructivism, this qualitative study deepens our understanding of human-avatar interactions to engage life review process, within the liminal space of life-threatening illnesses.

Shape-invariant encoding of dynamic primate facial expressions in human perception

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

Temporal lobe epilepsy alters neural responses to human and avatar facial expressions in the face perception network

BACKGROUND AND OBJECTIVE

Although avatars are now widely used in advertisement, entertainment, and business today, no study has investigated whether brain lesions in neurological patients interfere with brain activation in response to dynamic avatar facial expressions. The aim of our event-related fMRI study was to compare brain activation differences in people with epilepsy and controls during the processing of fearful and neutral dynamic expressions displayed by human or avatar faces.

METHODS

Using functional magnetic resonance imaging (fMRI), we examined brain responses to dynamic facial expressions of trained actors and their avatar look-alikes in 16 people with temporal lobe epilepsy (TLE) and 26 controls. The actors' fearful and neutral expressions were recorded on video and conveyed onto their avatar look-alikes by face tracking.

RESULTS

Our fMRI results show that people with TLE exhibited reduced response differences between fearful and neutral expressions displayed by humans in the right amygdala and the left superior temporal sulcus (STS). Further, TLE was associated with reduced response differences between human and avatar fearful expressions in the dorsal pathway of the face perception network (STS and inferior frontal gyrus) as well as in the medial prefrontal cortex.

CONCLUSIONS

Taken together, these findings suggest that brain responses to dynamic facial expressions are altered in people with TLE compared to neurologically healthy individuals-regardless of whether the face is human or computer-generated. In TLE, areas sensitive to dynamic facial features and associated with processes relating to the self and others are particularly affected when processing dynamic human and avatar expressions. Our findings highlight that the impact of TLE on facial emotion processing must be extended to artificial faces and should be considered when applying dynamic avatars in the context of neurological conditions.

Dynamic human and avatar facial expressions elicit differential brain responses

Computer-generated characters, so-called avatars, are widely used in advertising, entertainment, human–computer interaction or as research tools to investigate human emotion perception. However, brain responses to avatar and human faces have scarcely been studied to date. As such, it remains unclear whether dynamic facial expressions of avatars evoke different brain responses than dynamic facial expressions of humans. In this study, we designed anthropomorphic avatars animated with motion tracking and tested whether the human brain processes fearful and neutral expressions in human and avatar faces differently. Our fMRI results showed that fearful human expressions evoked stronger responses than fearful avatar expressions in the ventral anterior and posterior cingulate gyrus, the anterior insula, the anterior and posterior superior temporal sulcus, and the inferior frontal gyrus. Fearful expressions in human and avatar faces evoked similar responses in the amygdala. We did not find different responses to neutral human and avatar expressions. Our results highlight differences, but also similarities in the processing of fearful human expressions and fearful avatar expressions even if they are designed to be highly anthropomorphic and animated with motion tracking. This has important consequences for research using dynamic avatars, especially when processes are investigated that involve cortical and subcortical regions.

The Effects of Dynamic and Static Emotional Facial Expressions of Humans and Their Avatars on the EEG: An ERP and ERD/ERS Study

This study aimed to examine whether the cortical processing of emotional faces is modulated by the computerization of face stimuli ("avatars") in a group of 25 healthy participants. Subjects were passively viewing 128 static and dynamic facial expressions of female and male actors and their respective avatars in neutral or fearful conditions. Event-related potentials (ERPs), as well as alpha and theta event-related synchronization and desynchronization (ERD/ERS), were derived from the EEG that was recorded during the task. All ERP features, except for the very early N100, differed in their response to avatar and actor faces. Whereas the N170 showed differences only for the neutral avatar condition, later potentials (N300 and LPP) differed in both emotional conditions (neutral and fear) and the presented agents (actor and avatar). In addition, we found that the avatar faces elicited significantly stronger reactions than the actor face for theta and alpha oscillations. Especially theta EEG frequencies responded specifically to visual emotional stimulation and were revealed to be sensitive to the emotional content of the face, whereas alpha frequency was modulated by all the stimulus types. We can conclude that the computerized avatar faces affect both, ERP components and ERD/ERS and evoke neural effects that are different from the ones elicited by real faces. This was true, although the avatars were replicas of the human faces and contained similar characteristics in their expression.

Avatar-based patient monitoring in critical anaesthesia events: a randomised high-fidelity simulation study

BACKGROUND

Failures in situation awareness cause two-thirds of anaesthesia complications. Avatar-based patient monitoring may promote situation awareness in critical situations.

METHODS

We conducted a prospective, randomised, high-fidelity simulation study powered for non-inferiority. We used video analysis to grade anaesthesia teams managing three 10 min emergency scenarios using three randomly assigned monitoring modalities: only conventional, only avatar, and split-screen showing both modalities side by side. The primary outcome was time to performance of critical tasks. Secondary outcomes were time to verbalisation of vital sign deviations and the correct cause of the emergency, perceived workload, and usability. We used mixed Cox and linear regression models adjusted for various potential confounders. The non-inferiority margin was 10%, or hazard ratio (HR) 0.9.

RESULTS

We analysed 52 teams performing 154 simulations. For performance of critical tasks during a scenario, split-screen was non-inferior to conventional (HR=1.13; 95% confidence interval [CI], 0.96-1.33; not significant in test for superiority); the result for avatar was inconclusive (HR=0.98; 95% CI, 0.83-1.15). Avatar was associated with a higher probability for verbalisation of the cause of the emergency (HR=1.78; 95% CI, 1.13-2.81; P=0.012). We found no evidence for a monitor effect on perceived workload. Perceived usability was lower for avatar (coefficient=-23.0; 95% CI, -27.2 to -18.8; P<0.0001) and split-screen (-6.7; 95% CI, -10.9 to -2.4; P=0.002) compared with conventional.

CONCLUSIONS

This study showed non-inferiority of split-screen compared with conventional monitoring for performance of critical tasks during anaesthesia crisis situations. The patient avatar improved verbalisation of the correct cause of the emergency. These results should be interpreted considering participants' minimal avatar but extensive conventional monitoring experience.

Face the Uncanny: The Effects of Doppelganger Talking Head Avatars on Affect-Based Trust Toward Artificial Intelligence Technology are Mediated by Uncanny Valley Perceptions

This experiment (N = 228) examined how exposure to a talking head doppelganger created by an artificial intelligence (AI) program influenced affect-based trust toward AIs. Using a 3 (talking head featuring the participant's or a stranger's face, audio-only condition) by 2 (pro-AI pitch and anti-AI pitch playback) design, we uncovered that exposure to a talking head featuring the participant's face instead of a stranger's face increased uncanny valley perceptions. Furthermore, uncanny valley perceptions mediated the link between exposure to a talking head with the participant's face on affect-based trust. Overall, exposure to a doppelganger talking head, who delivered a persuasive pitch, triggered discomfort on the participant whose features were sourced to craft a synthetic talking head, which in turn decreased affect-based trust attributed to AIs. This phenomenon is rooted in basic psychological mechanisms that underpin the uncanny valley hypothesis. Future studies may test for these findings across different platforms and also provide evidence regarding user mental processing.

The Untapped Potential of Virtual Reality in Rehabilitation of Balance and Gait in Neurological Disorders

Dynamic systems theory transformed our understanding of motor control by recognizing the continual interaction between the organism and the environment. Movement could no longer be visualized simply as a response to a pattern of stimuli or as a demonstration of prior intent; movement is context dependent and is continuously reshaped by the ongoing dynamics of the world around us. Virtual reality is one methodological variable that allows us to control and manipulate that environmental context. A large body of literature exists to support the impact of visual flow, visual conditions, and visual perception on the planning and execution of movement. In rehabilitative practice, however, this technology has been employed mostly as a tool for motivation and enjoyment of physical exercise. The opportunity to modulate motor behavior through the parameters of the virtual world is often ignored in practice. In this article we present the results of experiments from our laboratories and from others demonstrating that presenting particular characteristics of the virtual world through different sensory modalities will modify balance and locomotor behavior. We will discuss how movement in the virtual world opens a window into the motor planning processes and informs us about the relative weighting of visual and somatosensory signals. Finally, we discuss how these findings should influence future treatment design.

Virtual Avatar Coaching With Community Context for Adult-Child Dyads with Low Income

OBJECTIVE

Examine the acceptability of an evidence-based, contextually tailored, virtual avatar coaching approach for nutrition education among adult-child dyads with low income.

DESIGN

Structured observations and semistructured interviews.

SETTING

Low-income communities in 2 midsized urban areas.

PARTICIPANTS

Fifteen African American adult and child (aged 5-10 years old) dyads recruited from community agencies.

PHENOMENON OF INTEREST

Structured observation during the use of the virtual avatar coaching program and qualitative feedback on program experience after using the program.

ANALYSIS

Transcripts were independently coded by 2 trained coders. Content analysis was conducted to determine trends and patterns in responses, and salient quotes were extracted from the manuscripts.

RESULTS

The program generated dialogue between the children and adults around preferences and dietary habits. Adults and children described the program as being helpful, informative, motivational, and fun. Adults and children liked that the avatar acknowledged them at a personal level, provided accountability, and was tailored to them and their environment. Children wanted the ability to customize the avatar, more gamification, and avatar demonstration of healthy behaviors. Children felt the program would improve their health behaviors and were interested in using it again.

CONCLUSIONS AND IMPLICATIONS

This study highlights information that can be used to improve avatar-based programs for nutrition education with children and their adult caregivers who have low income. Future work should assess the impact of user customization experience, program impact on dietary behaviors, and resources required to scale and maintain the program with community agencies.

Decoding of facial expressions of pain in avatars: does sex matter?

OBJECTIVES

The decoding of facial expressions of pain plays a crucial role in pain diagnostic and clinical decision making. For decoding studies, it is necessary to present facial expressions of pain in a flexible and controllable fashion. Computer models (avatars) of human facial expressions of pain allow for systematically manipulating specific facial features. The aim of the present study was to investigate whether avatars can show realistic facial expressions of pain and how the sex of the avatars influence the decoding of pain by human observers.

METHODS

For that purpose, 40 female (mean age: 23.9 years) and 40 male (mean age: 24.6 years) observers watched 80 short videos showing computer-generated avatars, who presented the five clusters of facial expressions of pain (four active and one stoic cluster) identified by Kunz and Lautenbacher (2014). After each clip, observers were asked to provide ratings for the intensity of pain the avatars seem to experience and the certainty of judgement, i.e. if the shown expression truly represents pain.

RESULTS

Results show that three of the four active facial clusters were similarly accepted as valid expressions of pain by the observers whereas only one cluster ("raised eyebrows") was disregarded. The sex of the observed avatars influenced the decoding of pain as indicated by increased intensity and elevated certainty ratings for female avatars.

CONCLUSIONS

The assumption of different valid facial expressions of pain could be corroborated in avatars, which contradicts the idea of only one uniform pain face. The observers' rating of the avatars' pain was influenced by the avatars' sex, which resembles known observer biases for humans. The use of avatars appeared to be a suitable method in research on the decoding of the facial expression of pain, mirroring closely the known forms of human facial expressions.

Physicians' Perceptions of a Situation Awareness-Oriented Visualization Technology for Viscoelastic Blood Coagulation Management (Visual Clot): Mixed Methods Study

Background

Viscoelastic tests enable a time-efficient analysis of coagulation properties. An important limitation of viscoelastic tests is the complicated presentation of their results in the form of abstract graphs with a multitude of numbers. We developed Visual Clot to simplify the interpretation of presented clotting information. This visualization technology applies user-centered design principles to create an animated model of a blood clot during the hemostatic cascade. In a previous simulation study, we found Visual Clot to double diagnostic accuracy, reduce time to decision making and perceived workload, and improve care providers’ confidence.

Objective

This study aimed to investigate the opinions of physicians on Visual Clot technology. It further aimed to assess its strengths, limitations, and clinical applicability as a support tool for coagulation management.

Methods

This was a researcher-initiated, international, double-center, mixed qualitative-quantitative study that included the anesthesiologists and intensive care physicians who participated in the previous Visual Clot study. After the participants solved six coagulation scenarios using Visual Clot, we questioned them about the perceived pros and cons of this new tool. Employing qualitative research methods, we identified recurring answer patterns, and derived major topics and subthemes through inductive coding. Based on them, we defined six statements. The study participants later rated their agreement to these statements on five-point Likert scales in an online survey, which represented the quantitative part of this study.

Results

A total of 60 physicians participated in the primary Visual Clot study. Among these, 36 gave an interview and 42 completed the online survey. In total, eight different major topics were derived from the interview field note responses. The three most common topics were “positive design features” (29/36, 81%), “facilitates decision making” (17/36, 47%), and “quantification not made” (17/36, 47%). In the online survey, 93% (39/42) agreed to the statement that Visual Clot is intuitive and easy to learn. Moreover, 90% (38/42) of the participants agreed that they would like the standard result and Visual Clot displayed on the screen side by side. Furthermore, 86% (36/42) indicated that Visual Clot allows them to deal with complex coagulation situations more quickly.

Conclusions

A group of anesthesia and intensive care physicians from two university hospitals in central Europe considered Visual Clot technology to be intuitive, easy to learn, and useful for decision making in situations of active bleeding. From the responses of these possible future users, Visual Clot appears to constitute an efficient and well-accepted way to streamline the decision-making process in viscoelastic test–based coagulation management.

Customizing Your Demons: Anxiety Reduction via Anthropomorphizing and Destroying an "Anxiety Avatar"

Character customization is a prominent feature in digital games, affording users the ability to tailor one’s virtual self-representation (avatar) to match aspects of their actual or ideal self, influencing psychological well-being. The mental health implications of character customization can be partially explained by self-discrepancy theory, which argues that achieving congruence with one’s avatar reduces cognitive dissonance. However, the role of undesirable self-concepts such as mental health ailments have largely been overlooked in this context despite forming part of one’s identity. In theory, customization of an avatar representing undesirable self-concepts presents a self-regulatory paradox: individuals desire to reduce discrepancies with a self-representation, yet they also desire to enlarge discrepancies with a disliked-self. To reconcile this, two experiments explored the psychological implications of imbuing avatars with undesirable self-concepts. In Study 1 (N = 90), participants customized an avatar to represent anxiety within themselves (i.e., an anxiety avatar). Customization significantly reduced state anxiety compared to a control group, supporting the proposed discrepancy-reduction mechanism. Study 2 (N = 122) employed a 2 (customization: yes, no) × 2 (destruction: yes, no) between-subjects design, with participants either destroying or observing an anxiety avatar. Destruction of customized anxiety avatars resulted in the largest reduction in anxiety among all conditions, supporting the proposed discrepancy-enlargement mechanism. Theoretical and practical implications for the use of avatar-based e-mental health interventions are discussed.