Computer-Controlled Virtual Humans in Patient-Facing Systems: Systematic Review and Meta-Analysis

An Exploratory Study of the Potential of Online Counseling for University Students by a Human-Operated Avatar Counselor

Recently, the use of digital technologies, such as avatars and virtual reality, has been increasingly explored to address university students' mental health issues. However, there is limited research on the advantages and disadvantages of counselors using avatars in online video counseling. Herein, 25 university students were enrolled in a pilot online counseling session with a human counselor-controlled avatar, and asked about their emotional experiences and impressions of the avatar and to provide qualitative feedback on their communication experience. Positive emotions during the session were associated with impressions of the avatar's intelligence and likeability. The anthropomorphism, animacy, likeability, and intelligent impressions of the avatar were interrelated, indicating that the avatar's smile and the counselor's expertise in empathy and approval may have contributed to these impressions. However, no associations were observed between participant experiences and their prior communication with avatars, or between participant experiences and their gender or the perceived gender of the avatar. Accordingly, recommendations for future practice and research are provided. Accumulating practical and empirical findings on the effectiveness of human-operated avatar counselors is crucial for addressing university students' mental health issues.

Designing and Evaluating an Emotionally Responsive Virtual Patient Simulation

INTRODUCTION

Virtual patient (VP) simulations have been widely used for healthcare training, education, and assessment. However, few VP systems have integrated emotion sensing and analyzed how a user's emotions may influence the overall training experience. This article presents a VP that can recognize and respond to 5 human emotions (anger, disgust, fear, joy, and sadness), as well as 2 facial expressions (smiling and eye contact).

METHODS

The VP was developed by combining the capabilities of a facial recognition system, a tone analyzer, a cloud-based artificial intelligence chatbot, and interactive 3-dimensional avatars created in a high-fidelity game engine (Unity). The system was tested with healthcare professionals at Changzhou Traditional Chinese Medicine Hospital.

RESULTS

A total of 65 participants (38 females and 27 males) aged between 23 and 57 years (mean = 38.35, SD = 11.48) completed the survey, and 19 participants were interviewed. Most participants perceived that the VP was useful in improving their communication skills, particularly their nonverbal communication skills. They also reported that adding users' affective states as an additional interaction increased engagement of the VP and helped them build connections with the VP.

CONCLUSIONS

The emotionally responsive VP seemed to be functionally complete and usable. However, some technical limitations need to be addressed before the system's official implementation in real-world clinical practice. Future development will include improving the accuracy of the speech recognition system, using more sophisticated emotion sensing software, and developing a natural user interface.

Dialogue agents for artificial intelligence-based conversational systems for cognitively disabled: a systematic review

PURPOSE

We present a systematic literature review of dialogue agents for Artificial Intelligence (AI) and agent-based conversational systems dealing with cognitive disability of aged and impaired people including dementia and Parkinson's disease. We analyze current applications, gaps, and challenges in the existing research body, and provide guidelines and recommendations for their future development and use.

MATERIALS AND METHODS

We perform this study by applying Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. We performed a systematic search using relevant databases (ACM Digital Library, Google Scholar, IEEE Xplore, PubMed, and Scopus).

RESULTS

This study identified 468 articles on the use of conversational agents in healthcare. We finally selected 124 articles based on their objectives and content as directly related to our main topic.

CONCLUSION

We identified the main challenges in the field and analyzed the typical examples of the application of conversational agents in the healthcare domain, the desired characteristics of conversational agents, and chatbot support for aged people and people with cognitive disabilities. Our results contribute to a discussion on conversational health agents and emphasize current knowledge gaps and challenges for future research.IMPLICATIONS FOR REHABILITATIONA systematic literature review of dialogue agents for artificial intelligence and agent-based conversational systems dealing with cognitive disability of aged and impaired people.Main challenges and desired characteristics of the conversational agents, and chatbot support for aged people and people with cognitive disability.Current knowledge gaps and challenges for remote healthcare and rehabilitation.Guidelines and recommendations for future development and use of conversational systems.

Evaluation framework for conversational agents with artificial intelligence in health interventions: a systematic scoping review

OBJECTIVES

Conversational agents (CAs) with emerging artificial intelligence present new opportunities to assist in health interventions but are difficult to evaluate, deterring their applications in the real world. We aimed to synthesize existing evidence and knowledge and outline an evaluation framework for CA interventions.

MATERIALS AND METHODS

We conducted a systematic scoping review to investigate designs and outcome measures used in the studies that evaluated CAs for health interventions. We then nested the results into an overarching digital health framework proposed by the World Health Organization (WHO).

RESULTS

The review included 81 studies evaluating CAs in experimental (n = 59), observational (n = 15) trials, and other research designs (n = 7). Most studies (n = 72, 89%) were published in the past 5 years. The proposed CA-evaluation framework includes 4 evaluation stages: (1) feasibility/usability, (2) efficacy, (3) effectiveness, and (4) implementation, aligning with WHO's stepwise evaluation strategy. Across these stages, this article presents the essential evidence of different study designs (n = 8), sample sizes, and main evaluation categories (n = 7) with subcategories (n = 40). The main evaluation categories included (1) functionality, (2) safety and information quality, (3) user experience, (4) clinical and health outcomes, (5) costs and cost benefits, (6) usage, adherence, and uptake, and (7) user characteristics for implementation research. Furthermore, the framework highlighted the essential evaluation areas (potential primary outcomes) and gaps across the evaluation stages.

DISCUSSION AND CONCLUSION

This review presents a new framework with practical design details to support the evaluation of CA interventions in healthcare research.

PROTOCOL REGISTRATION

The Open Science Framework (https://osf.io/9hq2v) on March 22, 2021.

Improving counseling effectiveness with virtual counselors through nonverbal compassion involving eye contact, facial mimicry, and head-nodding

An effective way to reduce emotional distress is by sharing negative emotions with others. This is why counseling with a virtual counselor is an emerging methodology, where the sharer can consult freely anytime and anywhere without having to fear being judged. To improve counseling effectiveness, most studies so far have focused on designing verbal compassion for virtual counselors. However, recent studies showed that virtual counselors' nonverbal compassion through eye contact, facial mimicry, and head-nodding also have significant impact on the overall counseling experience. To verify this, we designed the virtual counselor's nonverbal compassion and examined its effects on counseling effectiveness (i.e., reduce the intensity of anger and improve general affect). A total of 40 participants were recruited from the university community. Participants were then randomly assigned to one of two virtual counselor conditions: a neutral virtual counselor condition without nonverbal compassion and a compassionate virtual counselor condition with nonverbal compassion (i.e., eye contact, facial mimicry, and head-nodding). Participants shared their anger-inducing episodes with the virtual counselor for an average of 16.30 min. Note that the virtual counselor was operated by the Wizard-of-Oz method without actually being technically implemented. Results showed that counseling with a compassionate virtual counselor reduced the intensity of anger significantly more than counseling with a neutral virtual counselor (F(1, 37) = 30.822, p < 0.001, ηp2 = 0.454). In addition, participants who counseled with a compassionate virtual counselor responded that they experienced higher empathy than those who counseled with a neutral virtual counselor (p < 0.001). These findings suggest that nonverbal compassion through eye contact, facial mimicry, and head-nodding of the virtual counselor makes the participants feel more empathy, which contributes to improving the counseling effectiveness by reducing the intensity of anger.

Doctors' perceptions of using their digital twins in patient care

Recent Artificial Intelligence (AI) advancements have facilitated tools capable of generating digital twins of real human faces and voices for interactive communication. In this research, we explore utilizing Digital Twins of Doctors (DTDs) in healthcare because using a doctor's identity can provide benefits like enhancing the credibility of the health information delivered using computers. DTDs are computer-controlled AI-generated digital replicas of doctors that closely resemble their characteristics. However, there exist limitations, including the social implications of using a doctor's identity, potential negative impacts on doctor-patient communication, and liability concerns. To ensure a comprehensive understanding of DTD usage in healthcare before widespread adoption, systematic research is essential. As a step towards this direction, in this qualitative research, we report findings from 13 semi-structured interviews with doctors. Our findings indicate that doctors believe DTDs offer benefits by saving doctors' time through the efficient delivery of repetitive information and personalizing patient care. Moreover, while using a doctor's identity can enhance credibility, it also raises concerns about using a doctor's identity to spread potential misinformation. These findings contribute by informing future researchers about doctors' perspectives on utilizing DTDs in healthcare, guiding the development of effective implementation strategies for responsible DTD integration into healthcare.

Development of a Virtual Human for Supporting Tobacco Cessation During the COVID-19 Pandemic

People who consume tobacco are at greater risk of developing severe COVID-19. Unfortunately, the COVID-19 pandemic reduced the accessibility of tobacco cessation services as a result of necessary social restrictions. Innovations were urgently needed to support tobacco cessation during the pandemic. Virtual humans are artificially intelligent computer agents with a realistic, humanlike appearance. Virtual humans could be a scalable and engaging way to deliver tobacco cessation information and support. Florence, a virtual human health worker, was developed in collaboration with the World Health Organization to remotely support people toward tobacco cessation during the COVID-19 pandemic. Florence delivers evidence-based information, assists with making quit plans, and directs people to World Health Organization-recommended cessation services in their country. In this viewpoint, we describe the process of developing Florence. The development was influenced by a formative evaluation of data from 115 early users of Florence from 49 countries. In general, Florence was positively perceived; however, changes were requested to aspects of her design and content. In addition, areas for new content were identified (eg, for nonsmoker support persons). Virtual health workers could expand the reach of evidence-based tobacco cessation information and personalized support. However, as they are a new innovation in tobacco cessation, their efficacy, feasibility, and acceptability in this application needs to be evaluated, including in diverse populations.

The Impact of Virtual Humans on Psychosomatic Medicine

OBJECTIVE

Virtual humans are likely to enhance the delivery of health care over the next decade. Virtual humans are artificially intelligent computer agents with hyperrealistic, autonomously animated embodiments based on affective computing techniques. Virtual humans could be programmed to screen for health conditions, triage patients, and deliver health interventions, with appropriate facial expressions and body gestures, functioning as a supplement to human care. This article provides a perspective on the implications of virtual humans for behavioral and psychosomatic medicine, and health psychology.

METHODS

A narrative review was conducted to integrate observations and findings from research on virtual humans from 91 articles in this multidisciplinary area.

RESULTS

Virtual humans can be used for multimodal behavior analysis of patients, individualized tailoring of interventions, and detection of changes of psychological and behavioral measures over time. Virtual humans can also pair the scalability of a website with the interactivity and relational skills of a human tele-therapist. Research is beginning to show the acceptability, feasibility, and preliminary effectiveness of virtual humans in a range of populations. Virtual humans can be easily tailored in terms of their appearance, voice, and language, and may be adapted to fit the characteristics of a patient population or hard-to-reach groups. If co-designed with these communities, virtual humans may help to promote health care engagement and improve outcomes.

CONCLUSIONS

Virtual humans can engage and motivate patients, and deliver personalized psychological and behavioral health care. This article provides an overview of the potential impact of virtual humans on psychosomatic medicine and discusses ethical implications.

Insights of Parents and Parents-To-Be in Using Chatbots to Improve Their Preconception, Pregnancy, and Postpartum Health: A Mixed Studies Review

INTRODUCTION

Chatbots, which are also known as conversational or virtual agents, are digital programs that can interact with humans using voice, text, or animation. They have shown promise in providing preconception, pregnancy, and postpartum care. This review aims to consolidate the insights of parents and parents-to-be in using chatbots to improve their preconception, pregnancy, and postpartum health.

METHODS

Seven electronic databases were searched from their inception dates until April 2022 (PubMed, Embase, CINAHL, PsycINFO, Web of Science, Scopus, and ProQuest Dissertations and Theses Global) for relevant studies. English language primary studies that were conducted on parents or parents-to-be aged ≥18 years old who had undergone interventions involving the use of any type of chatbot were included in this review. The quality of included studies was appraised using the Mixed Methods Appraisal Tool. A convergent qualitative synthesis design for mixed studies reviews was used to synthesize the findings, and results were thematically analyzed.

RESULTS

Fifteen studies met the inclusion criteria: quantitative (n = 11), qualitative (n = 1), and mixed method (n = 3). Three main themes were identified: (1) welcoming a new health resource, (2) obstacles blocking the way, and (3) moving toward a digital health era.

DISCUSSION

Parents and parents-to-be appreciated the informational, socioemotional, and psychological support provided by chatbots. Recommendations for technological improvements in the functionality of the chatbots were made that include training sessions for health care providers to familiarize them with this new digital technology. Multidisciplinary chatbot development teams could also be established to develop more comprehensive chatbot-delivered health programs for more diverse populations.

The Chatbots Are Invading Us: A Map Point on the Evolution, Applications, Opportunities, and Emerging Problems in the Health Domain

The inclusion of chatbots is potentially disruptive in society, introducing opportunities, but also important implications that need to be addressed on different domains. The aim of this study is to examine chatbots in-depth, by mapping out their technological evolution, current usage, and potential applications, opportunities, and emerging problems within the health domain. The study examined three points of view. The first point of view traces the technological evolution of chatbots. The second point of view reports the fields of application of the chatbots, giving space to the expectations of use and the expected benefits from a cross-domain point of view, also affecting the health domain. The third and main point of view is that of the analysis of the state of use of chatbots in the health domain based on the scientific literature represented by systematic reviews. The overview identified the topics of greatest interest with the opportunities. The analysis revealed the need for initiatives that simultaneously evaluate multiple domains all together in a synergistic way. Concerted efforts to achieve this are recommended. It is also believed to monitor both the process of osmosis between other sectors and the health domain, as well as the chatbots that can create psychological and behavioural problems with an impact on the health domain.

Artificial intelligence for secondary prevention of myocardial infarction: A qualitative study of patient and health professional perspectives

BACKGROUND

Artificial intelligence (AI) has potential to improve self-management of several chronic conditions. However, the perspective of patients and healthcare professionals regarding AI-enabled health management programs, which are key to successful implementation, remains poorly understood.

PURPOSE

To explore the opinions of people with a history of myocardial infarction (PHMI) and health professionals on the use of AI for secondary prevention of MI.

PROCEDURE

Three rounds of focus groups were conducted via videoconferencing with 38 participants: 22 PHMI and 16 health professionals.

FINDINGS

We identified 21 concepts stemming from participants' views, which we classified into five categories: Trust; Expected Functions; Adoption; Concerns; and Perceived Benefits. Trust covered the credibility of information and safety to believe health advice. Expected Functions covered tailored feedback and personalised advice. Adoption included usability features and overall interest in AI. Concerns originated from previous negative experience with AI. Perceived Benefits included the usefulness of AI to provide advice when regular contact with healthcare services is not feasible. Health professionals were more optimistic than PHMI about the usefulness of AI for improving health behaviour.

CONCLUSIONS

Altogether, our findings provide key insights from end-users to improve the likelihood of successful implementation and adoption of AI-enabled systems in the context of MI, as an exemplar of broader applications in chronic disease management.

Comparing the Feasibility and Acceptability of a Virtual Human, Teletherapy, and an e-Manual in Delivering a Stress Management Intervention to Distressed Adult Women: Pilot Study

BACKGROUND

Virtual humans (VHs), teletherapy, and self-guided e-manuals may increase the accessibility of psychological interventions. However, there is limited research on how these technologies compare in terms of their feasibility and acceptability in delivering stress management interventions.

OBJECTIVE

We conducted a preliminary comparison of the feasibility and acceptability of a VH, teletherapy, and an e-manual at delivering 1 module of cognitive behavioral stress management (CBSM) to evaluate the feasibility of the trial methodology in preparation for a future randomized controlled trial (RCT).

METHODS

A pilot RCT was conducted with a parallel, mixed design. A community sample of distressed adult women were randomly allocated to receive 1 session of CBSM involving training in cognitive and behavioral techniques by a VH, teletherapy, or an e-manual plus homework over 2 weeks. Data were collected on the feasibility of the intervention technologies (technical support and homework access), trial methods (recruitment methods, questionnaire completion, and methodological difficulty observations), intervention acceptability (intervention completion, self-report ratings, therapist rapport, and trust), and acceptability of the trial methods (self-report ratings and observations). Qualitative data in the form of written responses to open-ended questions were collected to enrich and clarify the findings on intervention acceptability.

RESULTS

Overall, 38 participants' data were analyzed. A VH (n=12), teletherapy (n=12), and an e-manual (n=14) were found to be feasible and acceptable for delivering 1 session of CBSM to distressed adult women based on the overall quantitative and qualitative findings. Technical difficulties were minimal and did not affect intervention completion, and no significant differences were found between the conditions (P=.31). The methodology was feasible, although improvements were identified for a future trial. All conditions achieved good satisfaction and perceived engagement ratings, and no significant group differences were found (P>.40). Participants had similar willingness to recommend each technology (P=.64). There was a nonsignificant trend toward participants feeling more open to using the VH and e-manual from home than teletherapy (P=.10). Rapport (P<.001) and trust (P=.048) were greater with the human teletherapist than with the VH. The qualitative findings enriched the quantitative results by revealing the unique strengths and limitations of each technology that may have influenced acceptability.

CONCLUSIONS

A VH, teletherapy, and a self-guided e-manual were found to be feasible and acceptable methods of delivering 1 session of a stress management intervention to a community sample of adult women. The technologies were found to have unique strengths and limitations that may affect which works best for whom and in what circumstances. Future research should test additional CBSM modules for delivery by these technologies and conduct a larger RCT to compare their feasibility, acceptability, and effectiveness when delivering a longer home-based stress management program.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12620000859987; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=380114&isReview=true.

Electronic Health Record-Integrated Clinical Decision Support for Clinicians Serving Populations Facing Health Care Disparities: Literature Review

OBJECTIVES

To review current studies about designing and implementing clinician-facing clinical decision support (CDS) integrated or interoperable with an electronic health record (EHR) to improve health care for populations facing disparities.

METHODS

We searched PubMed to identify studies published between January 1, 2011 and October 22, 2021 about clinician-facing CDS integrated or interoperable with an EHR. We screened abstracts and titles and extracted study data from articles using a protocol developed by team consensus. Extracted data included patient population characteristics, clinical specialty, setting, EHR, clinical problem, CDS type, reported user-centered design, implementation strategies, and outcomes.

RESULTS

There were 28 studies (36 articles) included. Most studies were performed at safety net institutions (14 studies) or Indian Health Service sites (6 studies). CDS tools were implemented in primary care outpatient settings in 24 studies (86%) for screening or treatment. CDS included point-of-care alerts (93%), order facilitators (46%), workflow support (39%), relevant information display (36%), expert systems (11%), and medication dosing support (7%). Successful outcomes were reported in 19 of 26 studies that reported outcomes (73%). User-centered design was reported during CDS planning (39%), development (32%), and implementation phase (25%). Most frequent implementation strategies were education (89%) and consensus facilitation (50%).

CONCLUSIONS

CDS tools may improve health equity and outcomes for patients who face disparities. The present review underscores the need for high-quality analyses of CDS-associated health outcomes, reporting of user-centered design and implementation strategies used in low-resource settings, and methods to disseminate CDS created to improve health equity.

Effects of Cognitive Behavioral Stress Management Delivered by a Virtual Human, Teletherapy, and an E-Manual on Psychological and Physiological Outcomes in Adult Women: An Experimental Test

Technology may expand the reach of stress management to broader populations. However, issues with engagement can reduce intervention effectiveness. Technologies with highly social interfaces, such as virtual humans (VH), may offer advantages in this space. However, it is unclear how VH compare to telehealth and e-manuals at delivering psychological interventions. This experiment compared the effects of single laboratory session of Cognitive Behavioral Stress Management (CBSM) delivered by a VH (VH-CBSM), human telehealth (T-CBSM), and an e-manual (E-CBSM) on psychological and physiological outcomes in a community sample of stressed adult women. A pilot randomized controlled trial (RCT) with a parallel, mixed design was conducted. Adult women (M age =43.21, SD = 10.70) who self-identified as stressed were randomly allocated to VH-CBSM, T-CBSM, or E-CBSM involving one 90 min session and homework. Perceived stress, stress management skills, negative affect, optimism, relaxation, and physiological stress were measured. Mixed factorial ANOVAs and pairwise comparisons with Bonferroni correction investigated main and interaction effects of time and condition. Participants’ data (N = 38) were analysed (12 = VH-CBSM; 12 = T-CBSM; 14 = E-CBSM). Each condition significantly improved stress, negative affect, optimism, relaxation, and physiological stress over time with large effect sizes. No significant differences were found between conditions on outcomes. Overall, all three technologies showed promise for remotely delivering CBSM in a controlled setting. The findings suggest feasibility of the VH-CBSM delivery approach and support conducting a fully powered RCT to examine its effectiveness when delivering a full 10-week CBSM intervention.

Promoting Physical Activity in Older Adults With Type 2 Diabetes via an Anthropomorphic Conversational Agent: Development of an Evidence and Theory-Based Multi-Behavior Intervention

Introduction

Anthropomorphic conversational agents (ACA) are a promising digital tool to support self-management of type 2 diabetes (T2D), albeit little explored. There is a dearth of literature on the detailed content of these interventions, which may limit effectiveness and replication. Our aim is to describe the development of an evidence and theory-based intervention to improve physical activity in older adults with T2D, subsumed in a multi-behavior intervention via a mobile application with an ACA.

Methods

Overall decisions on the multi-behavior intervention design, such as the use of standardized behavior change techniques (BCTTv1), guided the development of the physical activity component. Firstly, recommendations on ambulatory activity were used to select the target behavior (walking). Meta-research on effective behavior change techniques (BCTs) was then identified. One meta-analysis linked effective BCTs with the three basic psychological needs of the self-determination theory (SDT). This meta-analysis, taken together with additional evidence on SDT, led to the selection of this theory to inform the design. BCTs were extracted from meta-research; we selected the most appropriate to be operationalized via the conversational agent through multidisciplinary discussions. Rules governing the dialogue flow and BCTs tailoring, taking the form "if some conditions hold then execute some action," were derived based on the Basic Psychological in Exercise Scale (competence, autonomy, and relatedness scores), in conjunction with published evidence and multidisciplinary discussions.

Results

Thirteen BCTs were implemented in the prototype via the ACA (e.g., goal setting behavior 1.1). Six if-then rules were derived and depicted in the dialogue steps through process flow diagrams, which map how the system functions. An example of a rule is "If competence score ≤ 10 then, apply BCT 1.1 with 500 steps increments as options for the daily walking goal; If competence score > 10 then, apply BCT 1.1 with 1,000 steps increments as options for the daily walking goal."

Conclusion

Evidence and SDT were translated into a mobile application prototype using an ACA to promote physical activity in older adults with T2D. This approach, which includes 13 BCTs and six if-then rules for their tailoring, may leverage the efforts of others in developing similar interventions.

A Digital Human for Delivering a Remote Loneliness and Stress Intervention to At-Risk Younger and Older Adults During the COVID-19 Pandemic: Randomized Pilot Trial

BACKGROUND

Loneliness is a growing public health issue that has been exacerbated in vulnerable groups during the COVID-19 pandemic. Computer agents are capable of delivering psychological therapies through the internet; however, there is limited research on their acceptability to date.

OBJECTIVE

The objectives of this study were to evaluate (1) the feasibility and acceptability of a remote loneliness and stress intervention with digital human delivery to at-risk adults and (2) the feasibility of the study methods in preparation for a randomized controlled trial.

METHODS

A parallel randomized pilot trial with a mixed design was conducted. Participants were adults aged 18 to 69 years with an underlying medical condition or aged 70 years or older with a Mini-Mental State Examination score of >24 (ie, at greater risk of developing severe COVID-19). Participants took part from their place of residence (independent living retirement village, 20; community dwelling, 7; nursing home, 3). Participants were randomly allocated to the intervention or waitlist control group that received the intervention 1 week later. The intervention involved completing cognitive behavioral and positive psychology exercises with a digital human facilitator on a website for at least 15 minutes per day over 1 week. The exercises targeted loneliness, stress, and psychological well-being. Feasibility was evaluated using dropout rates and behavioral observation data. Acceptability was evaluated from behavioral engagement data, the Friendship Questionnaire (adapted), self-report items, and qualitative questions. Psychological measures were administered to evaluate the feasibility of the trial methods and included the UCLA Loneliness Scale, the 4-item Perceived Stress Scale, a 1-item COVID-19 distress measure, the Flourishing Scale, and the Scale of Positive and Negative Experiences.

RESULTS

The study recruited 30 participants (15 per group). Participants were 22 older adults and 8 younger adults with a health condition. Six participants dropped out of the study. Thus, the data of 24 participants were analyzed (intervention group, 12; waitlist group, 12). The digital human intervention and trial methods were generally found to be feasible and acceptable in younger and older adults living independently, based on intervention completion, and behavioral, qualitative, and some self-report data. The intervention and trial methods were less feasible to nursing home residents who required caregiver assistance. Acceptability could be improved with additional content, tailoring to the population, and changes to the digital human's design.

CONCLUSIONS

Digital humans are a promising and novel technological solution for providing at-risk adults with access to remote psychological support during the COVID-19 pandemic. Research should further examine design techniques to improve their acceptability in this application and investigate intervention effectiveness in a randomized controlled trial.

TRIAL REGISTRATION

Australia New Zealand Clinical Trials Registry ACTRN12620000786998; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=380113.

Perspectives fondamentale, clinique et sociétale de l’utilisation des personnages virtuels en santé mentale

Avec l’attrait engendré par les avancées en informatique et en intelligence artificielle, les personnages virtuels (c.-à-d. personnages représentés numériquement d’apparence humaine ou non) sont pressentis comme de futurs prestataires de soins en santé mentale. À ce jour, l’utilisation principale de tels personnages est toutefois marginale et se limite à une aide complémentaire à la pratique des cliniciens. Des préoccupations liées à la sécurité et l’efficacité, ainsi qu’un manque de connaissances et de compétences peuvent expliquer cette discordance entre ce que certains s’imaginent être l’utilisation future (voire futuriste) des personnages virtuels et leur utilisation actuelle. Un aperçu des récentes données probantes contribuerait à réduire cette divergence et à mieux saisir les enjeux associés à leur utilisation plus répandue en santé mentale.

Objectif Cet article vise à informer tous les acteurs impliqués, dont les cliniciens, quant au potentiel des personnages virtuels en santé mentale, et de les sensibiliser aux enjeux associés à leur usage.

Méthode Une recension narrative de la littérature a été réalisée afin de synthétiser les informations obtenues de la recherche fondamentale et clinique, et de discuter des considérations sociétales.

Résultats Plusieurs caractéristiques des personnages virtuels provenant de la recherche fondamentale ont le potentiel d’influencer les interactions entre un patient et un clinicien. Elles peuvent être regroupées en deux grandes catégories : les caractéristiques liées à la perception (p. ex. réalisme) et celles liées à l’attribution spontanée d’une catégorie sociale au personnage virtuel par un observateur (p. ex. genre). Selon la recherche clinique, plusieurs interventions ou évaluations utilisant des personnages virtuels ont montré divers degrés d’efficacité en santé mentale, et certains éléments de la relation thérapeutique (p. ex. alliance et empathie) peuvent d’ailleurs être présents lors d’une relation avec un personnage virtuel. De multiples enjeux socioéconomiques et éthiques doivent aussi être discutés en vue d’un développement et d’une utilisation plus accrue qui soient responsables et éthiques. Bien que l’accessibilité et la disponibilité des personnages virtuels constituent un avantage indéniable pour l’offre de services en santé mentale, certaines iniquités demeurent. L’accumulation de données biométriques (p. ex. rythme cardiaque) a également le potentiel d’enrichir le travail des cliniciens, mais aussi de mener au développement de personnages virtuels autonomes à l’aide de l’intelligence artificielle, ce qui pourrait conduire à certains dérapages (p. ex. erreurs de décision clinique). Quelques pistes de recommandations visant à éviter ces effets indésirables sont présentées.

Conclusion L’emploi des personnages virtuels sera de plus en plus répandu en santé mentale en raison de leurs avantages prometteurs. Ainsi, il est souhaitable que tous les acteurs impliqués s’informent sur leur usage dans ce contexte, se sensibilisent aux enjeux spécifiques, participent activement aux discussions quant à leur développement et adoptent des recommandations uniformes en vue d’un usage sécuritaire et éthique en santé mentale.

Conversational Agents for Health and Well-being Across the Life Course: Protocol for an Evidence Map

BACKGROUND

Conversational agents, which we defined as computer programs that are designed to simulate two-way human conversation by using language and are potentially supplemented with nonlanguage modalities, offer promising avenues for health interventions for different populations across the life course. There is a lack of open-access and user-friendly resources for identifying research trends and gaps and pinpointing expertise across international centers.

OBJECTIVE

Our aim is to provide an overview of all relevant evidence on conversational agents for health and well-being across the life course. Specifically, our objectives are to identify, categorize, and synthesize-through visual formats and a searchable database-primary studies and reviews in this research field.

METHODS

An evidence map was selected as the type of literature review to be conducted, as it optimally corresponded to our aim. We systematically searched 8 databases (MEDLINE; CINAHL; Web of Science; Scopus; the Cochrane, ACM, IEEE, and Joanna Briggs Institute databases; and Google Scholar). We will perform backward citation searching on all included studies. The first stage of a double-stage screening procedure, which was based on abstracts and titles only, was conducted by using predetermined eligibility criteria for primary studies and reviews. An operational screening procedure was developed for streamlined and consistent screening across the team. Double data extraction will be performed with previously piloted data collection forms. We will appraise systematic reviews by using A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2. Primary studies and reviews will be assessed separately in the analysis. Data will be synthesized through descriptive statistics, bivariate statistics, and subgroup analysis (if appropriate) and through high-level maps such as scatter and bubble charts. The development of the searchable database will be informed by the research questions and data extraction forms.

RESULTS

As of April 2021, the literature search in the eight databases was concluded, yielding a total of 16,351 records. The first stage of screening, which was based on abstracts and titles only, resulted in the selection of 1282 records of primary studies and 151 records of reviews. These will be subjected to second-stage screening. A glossary with operational definitions for supporting the study selection and data extraction stages was drafted. The anticipated completion date is October 2021.

CONCLUSIONS

Our wider definition of a conversational agent and the broad scope of our evidence map will explicate trends and gaps in this field of research. Additionally, our evidence map and searchable database of studies will help researchers to avoid fragmented research efforts and wasteful redundancies. Finally, as part of the Harnessing the Power of Conversational e-Coaches for Health and Well-being Through Swiss-Portuguese Collaboration project, our work will also inform the development of an international taxonomy on conversational agents for health and well-being, thereby contributing to terminology standardization and categorization.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/26680.

Copresence With Virtual Humans in Mixed Reality: The Impact of Contextual Responsiveness on Social Perceptions

Virtual humans (VHs)—automated, three-dimensional agents—can serve as realistic embodiments for social interactions with human users. Extant literature suggests that a user’s cognitive and affective responses toward a VH depend on the extent to which the interaction elicits a sense of copresence, or the subjective “sense of being together.” Furthermore, prior research has linked copresence to important social outcomes (e.g., likeability and trust), emphasizing the need to understand which factors contribute to this psychological state. Although there is some understanding of the determinants of copresence in virtual reality (VR) (cf. Oh et al., 2018), it is less known what determines copresence in mixed reality (MR), a modality wherein VHs have unique access to social cues in a “real-world” setting. In the current study, we examined the extent to which a VH’s responsiveness to events occurring in the user’s physical environment increased a sense of copresence and heightened affective connections to the VH. Participants (N = 65) engaged in two collaborative tasks with a (nonspeaking) VH using an MR headset. In the first task, no event in the participant’s physical environment would occur, which served as the control condition. In the second task, an event in the participants’ physical environment occurred, to which the VH either responded or ignored depending on the experimental condition. Copresence and interpersonal evaluations of the VHs were measured after each collaborative task via self-reported measures. Results show that when the VH responded to the physical event, participants experienced a significant stronger sense of copresence than when the VH did not respond. However, responsiveness did not elicit more positive evaluations toward the VH (likeability and emotional connectedness). This study is an integral first step in establishing how and when affective and cognitive components of evaluations during social interactions diverge. Importantly, the findings suggest that feeling copresence with VH in MR is partially determined by the VHs’ response to events in the actual physical environment shared by both interactants.