Perceived organizational affiliation and its effects on patient trust: Role modeling with embodied conversational agents

Improving User Experience of Virtual Health Assistants: Scoping Review

Background

Virtual assistants can be used to deliver innovative health programs that provide appealing, personalized, and convenient health advice and support at scale and low cost. Design characteristics that influence the look and feel of the virtual assistant, such as visual appearance or language features, may significantly influence users’ experience and engagement with the assistant.

Objective

This scoping review aims to provide an overview of the experimental research examining how design characteristics of virtual health assistants affect user experience, summarize research findings of experimental research examining how design characteristics of virtual health assistants affect user experience, and provide recommendations for the design of virtual health assistants if sufficient evidence exists.

Methods

We searched 5 electronic databases (Web of Science, MEDLINE, Embase, PsycINFO, and ACM Digital Library) to identify the studies that used an experimental design to compare the effects of design characteristics between 2 or more versions of an interactive virtual health assistant on user experience among adults. Data were synthesized descriptively. Health domains, design characteristics, and outcomes were categorized, and descriptive statistics were used to summarize the body of research. Results for each study were categorized as positive, negative, or no effect, and a matrix of the design characteristics and outcome categories was constructed to summarize the findings.

Results

The database searches identified 6879 articles after the removal of duplicates. We included 48 articles representing 45 unique studies in the review. The most common health domains were mental health and physical activity. Studies most commonly examined design characteristics in the categories of visual design or conversational style and relational behavior and assessed outcomes in the categories of personality, satisfaction, relationship, or use intention. Over half of the design characteristics were examined by only 1 study. Results suggest that empathy and relational behavior and self-disclosure are related to more positive user experience. Results also suggest that if a human-like avatar is used, realistic rendering and medical attire may potentially be related to more positive user experience; however, more research is needed to confirm this.

Conclusions

There is a growing body of scientific evidence examining the impact of virtual health assistants’ design characteristics on user experience. Taken together, data suggest that the look and feel of a virtual health assistant does affect user experience. Virtual health assistants that show empathy, display nonverbal relational behaviors, and disclose personal information about themselves achieve better user experience. At present, the evidence base is broad, and the studies are typically small in scale and highly heterogeneous. Further research, particularly using longitudinal research designs with repeated user interactions, is needed to inform the optimal design of virtual health assistants.

Adaptation Mechanisms in Human–Agent Interaction: Effects on User’s Impressions and Engagement

Adaptation is a key mechanism in human–human interaction. In our work, we aim at endowing embodied conversational agents with the ability to adapt their behavior when interacting with a human interlocutor. With the goal to better understand what the main challenges concerning adaptive agents are, we investigated the effects on the user’s experience of three adaptation models for a virtual agent. The adaptation mechanisms performed by the agent take into account the user’s reaction and learn how to adapt on the fly during the interaction. The agent’s adaptation is realized at several levels (i.e., at the behavioral, conversational, and signal levels) and focuses on improving the user’s experience along different dimensions (i.e., the user’s impressions and engagement). In our first two studies, we aim to learn the agent’s multimodal behaviors and conversational strategies to dynamically optimize the user’s engagement and impressions of the agent, by taking them as input during the learning process. In our third study, our model takes both the user’s and the agent’s past behavior as input and predicts the agent’s next behavior. Our adaptation models have been evaluated through experimental studies sharing the same interacting scenario, with the agent playing the role of a virtual museum guide. These studies showed the impact of the adaptation mechanisms on the user’s experience of the interaction and their perception of the agent. Interacting with an adaptive agent vs. a nonadaptive agent tended to be more positively perceived. Finally, the effects of people’s a priori about virtual agents found in our studies highlight the importance of taking into account the user’s expectancies in human–agent interaction.

A Mixed Methods Examination of Health Care Provider Behaviors That Build Patients' Trust

OBJECTIVE

Patient trust in health care providers is associated with better health behaviors and utilization, yet provider trust has not been consistently conceptualized. This study uses qualitative methods to identify the key health provider behaviors that patients report build their trust, and data from a national U.S. survey of adults to test the robustness of the qualitative findings.

METHODS

In this mixed methods study, we conducted 40 semi-structured interviews with a diverse sample to identify the provider behaviors that build trust. We then analyzed a nationally representative survey (n = 6,517) to examine the relationship between respondents' trust in their usual provider and the key trust-related behaviors identified in the qualitative interviews.

RESULTS

Interviewees reported that health providers build trust by communicating effectively (listening and providing detailed explanations), caring about their patients (treating them as individuals, valuing their experience, and showing commitment to solving their health issues), and demonstrating competence (being knowledgeable, thorough, and solving their health issues). Trust in one's provider was highly correlated with all eight survey items measuring communication, caring, and competence.

CONCLUSIONS

To build trust with patients, health providers should actively listen, provide detailed explanations, show caring for patients, and demonstrate their knowledge.

Does an interactive trust-enhanced electronic consent improve patient experiences when asked to share their health records for research? A randomized trial

OBJECTIVE

In the context of patient broad consent for future research uses of their identifiable health record data, we compare the effectiveness of interactive trust-enhanced e-consent, interactive-only e-consent, and standard e-consent (no interactivity, no trust enhancement).

MATERIALS AND METHODS

A randomized trial was conducted involving adult participants making a scheduled primary care visit. Participants were randomized into 1 of the 3 e-consent conditions. Primary outcomes were patient-reported satisfaction with and subjective understanding of the e-consent. Secondary outcomes were objective knowledge, perceived voluntariness, trust in medical researchers, consent decision, and time spent using the application. Outcomes were assessed immediately after use of the e-consent and at 1-week follow-up.

RESULTS

Across all conditions, participants (N = 734) reported moderate-to-high satisfaction with consent (mean 4.3 of 5) and subjective understanding (79.1 of 100). Over 94% agreed to share their health record data. No statistically significant differences in outcomes were observed between conditions. Irrespective of condition, black participants and those with lower education reported lower satisfaction, subjective understanding, knowledge, perceived voluntariness, and trust in medical researchers, as well as spent more time consenting.

CONCLUSIONS

A large majority of patients were willing to share their identifiable health records for research, and they reported positive consent experiences. However, incorporating optional additional information and messages designed to enhance trust in the research process did not improve consent experiences. To improve poorer consent experiences of racial and ethnic minority participants and those with lower education, other novel consent technologies and processes may be valuable. (An Interactive Patient-Centered Consent for Research Using Medical Records; NCT03063268).

The Atrial Fibrillation Health Literacy Information Technology Trial: Pilot Trial of a Mobile Health App for Atrial Fibrillation

Background

Atrial fibrillation (AF) is a common arrhythmia that adversely affects health-related quality of life (HRQoL). We conducted a pilot trial of individuals with AF using a smartphone to provide a relational agent as well as rhythm monitoring. We employed our pilot to measure acceptability and adherence and to assess its effectiveness in improving HRQoL and adherence.

Objective

This study aims to measure acceptability and adherence and to assess its effectiveness to improve HRQoL and adherence.

Methods

Participants were recruited from ambulatory clinics and randomized to a 30-day intervention or usual care. We collected baseline characteristics and conducted baseline and 30-day assessments of HRQoL using the Atrial Fibrillation Effect on Quality of Life (AFEQT) measure and self-reported adherence to anticoagulation. The intervention consisted of a smartphone-based relational agent, which simulates face-to-face counseling and delivered content on AF education, adherence, and symptom monitoring with prompted rhythm monitoring. We compared differences in AFEQT and adherence at 30 days, adjusted for baseline values. We quantified participants’ use and acceptability of the intervention.

Results

A total of 120 participants were recruited and randomized (59 to control and 61 to intervention) to the pilot trial (mean age 72.1 years, SD 9.10; 62/120, 51.7% women). The control group had a 95% follow-up, and the intervention group had a 93% follow-up. The intervention group demonstrated significantly higher improvement in total AFEQT scores (adjusted mean difference 4.5; 95% CI 0.6-8.3; P=.03) and in daily activity (adjusted mean difference 7.1; 95% CI 1.8-12.4; P=.009) compared with the control between baseline and 30 days. The intervention group showed significantly improved self-reported adherence to anticoagulation therapy at 30 days (intervention 3.5%; control 23.2%; adjusted difference 16.6%; 95% CI 2.8%-30.4%; P<.001). Qualitative assessments of acceptability identified that participants found the relational agent useful, informative, and trustworthy.

Conclusions

Individuals randomized to a 30-day smartphone intervention with a relational agent and rhythm monitoring showed significant improvement in HRQoL and adherence. Participants had favorable acceptability of the intervention with both objective use and qualitative assessments of acceptability.

Computer-Controlled Virtual Humans in Patient-Facing Systems: Systematic Review and Meta-Analysis

BACKGROUND

Virtual humans (VH) are computer-generated characters that appear humanlike and simulate face-to-face conversations using verbal and nonverbal cues. Unlike formless conversational agents, like smart speakers or chatbots, VH bring together the capabilities of both a conversational agent and an interactive avatar (computer-represented digital characters). Although their use in patient-facing systems has garnered substantial interest, it is unknown to what extent VH are effective in health applications.

OBJECTIVE

The purpose of this review was to examine the effectiveness of VH in patient-facing systems. The design and implementation characteristics of these systems were also examined.

METHODS

Electronic bibliographic databases were searched for peer-reviewed articles with relevant key terms. Studies were included in the systematic review if they designed or evaluated VH in patient-facing systems. Of the included studies, studies that used a randomized controlled trial to evaluate VH were included in the meta-analysis; they were then summarized using the PICOTS framework (population, intervention, comparison group, outcomes, time frame, setting). Summary effect sizes, using random-effects models, were calculated, and the risk of bias was assessed.

RESULTS

Among the 8,125 unique records identified, 53 articles describing 33 unique systems, were qualitatively, systematically reviewed. Two distinct design categories emerged - simple VH and VH augmented with health sensors and trackers. Of the 53 articles, 16 (26 studies) with 44 primary and 22 secondary outcomes were included in the meta-analysis. Meta-analysis of the 44 primary outcome measures revealed a significant difference between intervention and control conditions, favoring the VH intervention (SMD = .166, 95% CI .039-.292, P=.012), but with evidence of some heterogeneity, I2=49.3%. There were more cross-sectional (k=15) than longitudinal studies (k=11). The intervention was delivered using a personal computer in most studies (k=18), followed by a tablet (k=4), mobile kiosk (k=2), head-mounted display (k=1), and a desktop computer in a community center (k=1).

CONCLUSIONS

We offer evidence for the efficacy of VH in patient-facing systems. Considering that studies included different population and outcome types, more focused analysis is needed in the future. Future studies also need to identify what features of virtual human interventions contribute toward their effectiveness.

Clinical Virtual Reality tools to advance the prevention, assessment, and treatment of PTSD

Numerous reports indicate that the incidence of posttraumatic stress disorder (PTSD) in Operation Enduring Freedom/Operation Iraqi Freedom/Operation New Dawn (OEF/OIF/OND) military personnel has created a significant behavioural healthcare challenge. These findings have served to motivate research on how to better develop and disseminate evidence-based treatments for PTSD. The current article presents the use of Virtual Reality (VR) as a clinical tool to address the assessment, prevention, and treatment of PTSD, based on the VR projects that were evolved at the University of Southern California Institute for Creative Technologies since 2004. A brief discussion of the definition and rationale for the clinical use of VR is followed by a description of a VR application designed for the delivery of prolonged exposure (PE) for treating Service Members (SMs) and Veterans with combat- and sexual assault-related PTSD. The expansion of the virtual treatment simulations of Iraq and Afghanistan for PTSD assessment and prevention is then presented. This is followed by a forward-looking discussion that details early efforts to develop virtual human agent systems that serve the role of virtual patients for training the next generation of clinical providers, as healthcare guides that can be used to support anonymous access to trauma-relevant behavioural healthcare information, and as clinical interviewers capable of automated behaviour analysis of users to infer psychological state. The paper will conclude with a discussion of VR as a tool for breaking down barriers to care in addition to its direct application in assessment and intervention.