Trust and acceptance of a virtual psychiatric interview between embodied conversational agents and outpatients

A systematic review of consumers' and healthcare professionals' trust in digital healthcare

Despite the well-documented importance of trust in digital healthcare, its domains are not well-understood, preventing theoretically robust instruments for standardised measurements. We identified instruments measuring trust in digital healthcare, explored definitions, associated factors, and outcomes. We systematically reviewed the literature using tailored searches and 49 studies measuring trust in digital healthcare from either consumers', healthcare professionals', or both perspectives were included. Trust in digital healthcare is complex and, from a consumers' perspective, can influence digital healthcare use, adoption, acceptance, and usefulness. Consumers' trust can be affected by the degree of human interaction in automated interventions, perceived risks, privacy concerns, data accuracy, digital literacy, quality of the digital healthcare intervention, satisfaction, education, and income. Healthcare professionals' trust is enhanced by education and observing good digital health performance. While studies can benefit from rigorous trust measurements, future efforts should address the need for a theoretical framework for trust in digital healthcare.

Determinants of Dropout From a Virtual Agent-Based App for Insomnia Management in a Self-Selected Sample of Users With Insomnia Symptoms: Longitudinal Study

Background

Fully automated digital interventions delivered via smartphone apps have proven efficacious for a wide variety of mental health outcomes. An important aspect is that they are accessible at a low cost, thereby increasing their potential public impact and reducing disparities. However, a major challenge to their successful implementation is the phenomenon of users dropping out early.

Objective

The purpose of this study was to pinpoint the factors influencing early dropout in a sample of self-selected users of a virtual agent (VA)-based behavioral intervention for managing insomnia, named KANOPEE, which is freely available in France.

Methods

From January 2021 to December 2022, of the 9657 individuals, aged 18 years or older, who downloaded and completed the KANOPEE screening interview and had either subclinical or clinical insomnia symptoms, 4295 (44.5%) dropped out (ie, did not return to the app to continue filling in subsequent assessments). The primary outcome was a binary variable: having dropped out after completing the screening assessment (early dropout) or having completed all the treatment phases (n=551). Multivariable logistic regression analysis was used to identify predictors of dropout among a set of sociodemographic, clinical, and sleep diary variables, and users' perceptions of the treatment program, collected during the screening interview.

Results

The users' mean age was 47.95 (SD 15.21) years. Of those who dropped out early and those who completed the treatment, 65.1% (3153/4846) were women and 34.9% (1693/4846) were men. Younger age (adjusted odds ratio [AOR] 0.98, 95% CI 0.97-0.99), lower education level (compared to middle school; high school: AOR 0.56, 95% CI 0.35-0.90; bachelor's degree: AOR 0.35, 95% CI 0.23-0.52; master's degree or higher: AOR 0.35, 95% CI 0.22-0.55), poorer nocturnal sleep (sleep efficiency: AOR 0.64, 95% CI 0.42-0.96; number of nocturnal awakenings: AOR 1.13, 95% CI 1.04-1.23), and more severe depression symptoms (AOR 1.12, 95% CI 1.04-1.21) were significant predictors of dropping out. When measures of perceptions of the app were included in the model, perceived benevolence and credibility of the VA decreased the odds of dropout (AOR 0.91, 95% CI 0.85-0.97).

Conclusions

As in traditional face-to-face cognitive behavioral therapy for insomnia, the presence of significant depression symptoms plays an important role in treatment dropout. This variable represents an important target to address to increase early engagement with fully automated insomnia management programs. Furthermore, our results support the contention that a VA can provide relevant user stimulation that will eventually pay out in terms of user engagement.

Depiction of conversational agents as health professionals: a scoping review

OBJECTIVE

The purpose of this scoping review was to examine the depiction of conversational agents as health professionals. We identified the professional characteristics that are used with these depictions and determined the prevalence of these characteristics among conversational agents that are used for health care.

INTRODUCTION

The depiction of conversational agents as health professionals has implications for both the users and the developers of these programs. For this reason, it is important to know more about these depictions and how they are implemented in practical settings.

INCLUSION CRITERIA

This review included scholarly literature on conversational agents that are used for health care. It focused on conversational agents designed for patients and health seekers, not health professionals or trainees. Conversational agents that address physical and/or mental health care were considered, as were programs that promote healthy behaviors.

METHODS

This review was conducted in accordance with JBI methodology for scoping reviews. The databases searched included MEDLINE (PubMed), Embase, CINAHL with Full Text (EBSCOhost), Scopus, Web of Science, ACM Guide to Computing Literature (Association for Computing Machinery Digital Library), and IEEE Xplore (IEEE). The main database search was conducted in June 2021, and an updated search was conducted in January 2022. Extracted data included characteristics of the report, basic characteristics of the conversational agent, and professional characteristics of the conversational agent. Extracted data were summarized using descriptive statistics. Results are presented in a narrative summary and accompanying tables.

RESULTS

A total of 38 health-related conversational agents were identified across 41 reports. Six of these conversational agents (15.8%) had professional characteristics. Four conversational agents (10.5%) had a professional appearance in which they displayed the clothing and accessories of health professionals and appeared in professional settings. One conversational agent (2.6%) had a professional title (Dr), and 4 conversational agents (10.5%) were described as having professional roles. Professional characteristics were more common among embodied vs disembodied conversational agents.

CONCLUSIONS

The results of this review show that the depiction of conversational agents as health professionals is not particularly common, although it does occur. More discussion is needed on the potential ethical and legal issues surrounding the depiction of conversational agents as health professionals. Future research should examine the impact of these depictions, as well as people's attitudes toward them, to better inform recommendations for practice.

Stigmatization of people with addiction by health professionals: Current knowledge. A scoping review

Background

Stigma of people with substance and non-substance use disorders (SNSUD) is a long-known phenomenon. The aim of this review was to assess the stigmatization, by health professionals, of people with SNSUD, its characteristics and change over time.

Methods

A scoping review of literature reviews was conducted with systematic search of PubMed, Scopus and PsycINFO databases.

Results

From the 19 selected reviews, all focused on people with SUD (PWSUD) only and 20 % to 51 % of health professionals had negative attitudes/beliefs about SUD. Addiction training and clinical experience with PWSUD were associated with a less negative attitude. Health professionals' negative beliefs, lack of time or support were associated with less involvement in addiction care. Tobacco use disorder, SUDs other than alcohol and tobacco, relapse, psychiatric comorbidity or criminal records were associated with a more negative attitude. The influence of several variables potentially related to stigmatization was inconsistent across selected reviews. The evolution of stigmatization over time was not systematically assessed and showed mixed results.

Conclusions

The stigmatization of PWSUD has an impact on their care, and a change in some variables could reduce its importance: moral model of addiction, health professionals' negative beliefs, lack of training, time, and role support. Teaching what addiction is according to the medical chronic disease model, and developing stigma-focused training could improve caregivers' attitudes and further reduce stigma. Further studies are needed to determine whether stigma of PWSUD by health professionals has changed over time and to characterize stigma for people with non-substance use disorders.

How Can Digital Mental Health Enhance Psychiatry?

The use of digital technologies is constantly growing around the world. The wider-spread adoption of digital technologies and solutions in the daily clinical practice in psychiatry seems to be a question of when, not if. We propose a synthesis of the scientific literature on digital technologies in psychiatry and discuss the main aspects of its possible uses and interests in psychiatry according to three domains of influence that appeared to us: 1) assist and improve current care: digital psychiatry allows for more people to have access to care by simply being more accessible but also by being less stigmatized and more convenient; 2) develop new treatments: digital psychiatry allows for new treatments to be distributed via apps, and practical guidelines can reduce ethical challenges and increase the efficacy of digital tools; and 3) produce scientific and medical knowledge: digital technologies offer larger and more objective data collection, allowing for more detection and prevention of symptoms. Finally, ethical and efficacy issues remain, and some guidelines have been put forth on how to safely use these solutions and prepare for the future.

Predictors of users' adherence to a fully automated digital intervention to manage insomnia complaints

OBJECTIVE

Fully automated digital interventions show promise for disseminating evidence-based strategies to manage insomnia complaints. However, an important concept often overlooked concerns the extent to which users adopt the recommendations provided in these programs into their daily lives. Our objectives were evaluating users' adherence to the behavioral recommendations provided by an app, and exploring whether users' perceptions of the app had an impact on their adherence behavior.

MATERIAL AND METHODS

Case series study of individuals completing a fully automated insomnia management program, conducted by a virtual agent, during December 2020 to September 2022. Primary outcome was self-reported adherence to the behavioral recommendations provided. Perceptions of the app and of the virtual agent were measured with the Acceptability E-Scale and ECA-Trust Questionnaire. Insomnia was evaluated with the Insomnia Severity Index at baseline (phase 1), after 7 days of sleep monitoring (phase 2) and post-intervention (phase 3).

RESULTS

A total of 824 users were included, 62.7% female, mean age 51.85 (±12.55) years. Of them, 32.7% reported having followed at least one recommendation. Users' trust in the virtual agent and acceptance of the app were related to a pre-intervention effect in insomnia severity (phase 2). In turn, larger pre-intervention improvements predicted better adherence. Mediational analyses showed that higher levels of trust in the virtual agent and better acceptance of the app exerted statistically significant positive effects on adherence (β = 0.007, 95% CI, 0.001-0.017 and β = 0.003, 95% CI 0.0004-0.008, respectively).

DISCUSSION

Users' adherence is motivated by positive perceptions of the app's features and pre-intervention improvements.

CONCLUSIONS

Determinants of adherence should be assessed, and targeted, to increase the impact of fully automated digital interventions.

Factors Influencing the Acceptability, Acceptance, and Adoption of Conversational Agents in Health Care: Integrative Review

BACKGROUND

Conversational agents (CAs), also known as chatbots, are digital dialog systems that enable people to have a text-based, speech-based, or nonverbal conversation with a computer or another machine based on natural language via an interface. The use of CAs offers new opportunities and various benefits for health care. However, they are not yet ubiquitous in daily practice. Nevertheless, research regarding the implementation of CAs in health care has grown tremendously in recent years.

OBJECTIVE

This review aims to present a synthesis of the factors that facilitate or hinder the implementation of CAs from the perspectives of patients and health care professionals. Specifically, it focuses on the early implementation outcomes of acceptability, acceptance, and adoption as cornerstones of later implementation success.

METHODS

We performed an integrative review. To identify relevant literature, a broad literature search was conducted in June 2021 with no date limits and using all fields in PubMed, Cochrane Library, Web of Science, LIVIVO, and PsycINFO. To keep the review current, another search was conducted in March 2022. To identify as many eligible primary sources as possible, we used a snowballing approach by searching reference lists and conducted a hand search. Factors influencing the acceptability, acceptance, and adoption of CAs in health care were coded through parallel deductive and inductive approaches, which were informed by current technology acceptance and adoption models. Finally, the factors were synthesized in a thematic map.

RESULTS

Overall, 76 studies were included in this review. We identified influencing factors related to 4 core Unified Theory of Acceptance and Use of Technology (UTAUT) and Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) factors (performance expectancy, effort expectancy, facilitating conditions, and hedonic motivation), with most studies underlining the relevance of performance and effort expectancy. To meet the particularities of the health care context, we redefined the UTAUT2 factors social influence, habit, and price value. We identified 6 other influencing factors: perceived risk, trust, anthropomorphism, health issue, working alliance, and user characteristics. Overall, we identified 10 factors influencing acceptability, acceptance, and adoption among health care professionals (performance expectancy, effort expectancy, facilitating conditions, social influence, price value, perceived risk, trust, anthropomorphism, working alliance, and user characteristics) and 13 factors influencing acceptability, acceptance, and adoption among patients (additionally hedonic motivation, habit, and health issue).

CONCLUSIONS

This review shows manifold factors influencing the acceptability, acceptance, and adoption of CAs in health care. Knowledge of these factors is fundamental for implementation planning. Therefore, the findings of this review can serve as a basis for future studies to develop appropriate implementation strategies. Furthermore, this review provides an empirical test of current technology acceptance and adoption models and identifies areas where additional research is necessary.

TRIAL REGISTRATION

PROSPERO CRD42022343690; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=343690.

From improved sleep regularity to reduced sleep complaints and mental health conditions: a population-based interventional study using a smartphone-based virtual agent

STUDY OBJECTIVES

To explore the effect of sleep regularity on sleep complaints and mental health conditions (i.e. insomnia, fatigue, anxiety, and depressive symptoms) in a population-based interventional study using a smartphone-based virtual agent.

METHODS

A populational cohort based on the Kanopée application, which provided interactions with a virtual companion to collect data on sleep and make personalized recommendations to improve sleep over 17 days. A pre-intervention sleep diary and interview were used for cross-sectional analysis (n = 2142), and a post-intervention sleep diary and interview were used for longitudinal analysis (n = 732). The intra-individual mean (IIM) and standard deviation (ISD) of total sleep time (TST) were calculated to measure sleep quantity and sleep regularity.

RESULTS

The mean age at baseline was 49 years, 65% were female, 72% reported insomnia, 58% fatigue, 36% anxiety, and 17% depressive symptoms. Before the intervention, irregular and short sleep was associated with a higher likelihood of insomnia (Relative risk [RR] = 1.26 [1.21-1.30] for irregular TST and RR = 1.19 [1.15-1.23] for short TST), fatigue, anxiety, and depressive symptoms. After the intervention, the IIM of the TST increased while the ISD of the TST and sleep complaints and mental health conditions decreased. More regular TST was associated with reduced insomnia and depressive symptoms (RR = 1.33 [1.10-1.52] and RR = 1.55 [1.13-1.98], respectively).

CONCLUSIONS

Our results reveal a longitudinal association between sleep regularity and sleep complaints and mental health conditions. Policymakers, health professionals, and the general population should be aware that, beyond its positive effect on sleep health, regular sleep could promote mental health.

Optimizing appreciation and persuasion of embodied conversational agents for health behavior change: A design experiment and focus group study

Embodied Conversational Agents (ECAs) can increase user engagement and involvement and can strengthen the effect of an intervention on health outcomes that is provided via an ECA. However, evidence regarding the effectiveness of ECAs on health outcomes is still limited. In this article, we report on a study that has the goal to identify the effect of a match between a health topic and the ECAs' appearance on ratings of personality characteristics, persuasiveness and intention to use. We report on an online experiment with three different ECAs and three different health topics, conducted among 732 older adults. We triangulated the quantitative results with qualitative insights from a focus group. The results reveal that older adults prefer an ECA that has an appearance matching a certain health topic, resulting in higher ratings on persuasiveness and intention to use. Personality characteristics should be measured embedded within a health topic, but are not rated higher because of a match. We furthermore provide guidelines for designing the content of the ECA.

Factors influencing acceptance and trust of chatbots in juvenile offenders' risk assessment training

Introduction

Research has identified simulation-based training with chatbots and virtual avatars as an effective educational strategy in some domains, such as medicine and mental health disciplines. Several studies on interactive systems have also suggested that user experience is decisive for adoption. As interest increases, it becomes important to examine the factors influencing user acceptance and trust in simulation-based training systems, and to validate applicability to specific learning tasks. The aim of this research is twofold: (1) to examine the perceived acceptance and trust in a risk assessment training chatbot developed to help students assess risk and needs of juvenile offenders, and (2) to examine the factors influencing students' perceptions of acceptance and trust.

Methods

Participants were 112 criminology students in an undergraduate course in a Canadian university. Participants were directed to use a custom-designed chatbot with a virtual 3D avatar for juvenile offenders' risk assessment training, to complete online questionnaires and a risk assessment exercise.

Results

Results show satisfactory levels of acceptance and trust in the chatbot. Concerning acceptance, more than half appeared to be satisfied or very satisfied with the chatbot, while most participants appeared to be neutral or satisfied with the benevolence and credibility of the chatbot.

Discussion

Results suggest that acceptance and trust do not only depend on the design of the chatbot software, but also on the characteristics of the user, and most prominently on self-efficacy, state anxiety, learning styles and neuroticism personality traits. As trust and acceptance play a vital role in determining technology success, these results are encouraging.

The Craving-Manager smartphone app designed to diagnose substance use/addictive disorders, and manage craving and individual predictors of relapse: a study protocol for a multicenter randomized controlled trial

Background

The rate of individuals with addiction who are currently treated are low, and this can be explained by barriers such as stigma, desire to cope alone, and difficulty to access treatment. These barriers could be overcome by mobile technologies. EMI (Ecological Momentary Intervention) is a treatment procedure characterized by the delivery of interventions (messages on smartphones) to people in their daily lives. EMI presents opportunities for treatments to be available to people during times and in situations when they are most needed. Craving is a strong predictor of relapse and a key target for addiction treatment. Studies using Ecological Momentary Assessment (EMA) method have revealed that, in daily life, person-specific cues could precipitate craving, that in turn, is associated with a higher probability to report substance use and relapse in the following hours. Assessment and management of these specific situations in daily life could help to decrease addictive use and avoid relapse. The Craving-Manager smartphone app has been designed to diagnose addictive disorders, and assess and manage craving as well as individual predictors of use/relapse. It delivers specific and individualized interventions (counseling messages) composed of evidence-based addiction treatments approaches (cognitive behavioral therapy and mindfulness). The Craving-Manager app can be used for any addiction (substance or behavior). The objective of this protocol is to evaluate the efficacy of the Craving-Manager app in decreasing use (of primary substance(s)/addictive behavior(s)) over 4 weeks, among individuals on a waiting list for outpatient addiction treatment.

Methods/design

This multicenter double-blind randomized controlled trial (RCT) will compare two parallel groups: experimental group (full interventional version of the app, 4 weeks, EMA + EMI), versus control group (restricted version of the app, 4 weeks, only EMA). Two hundred and seventy-four participants will be recruited in 6 addiction treatment centers in France.

Discussion

This RCT will provide indication on how the Craving-Manager app will reduce addictive use (e.g., better craving management, better stimulus control) in both substance and behavioral addictions. If its efficacy is confirmed, the app could offer the possibility of an easy to use and personalized intervention accessible to the greatest number of individuals with addiction.

Clinical Trial Registration

ClinicalTrials.gov: NCT04732676.

Capturing Conversational Gestures for Embodied Conversational Agents Using an Optimized Kaneda-Lucas-Tomasi Tracker and Denavit-Hartenberg-Based Kinematic Model

In order to recreate viable and human-like conversational responses, the artificial entity, i.e., an embodied conversational agent, must express correlated speech (verbal) and gestures (non-verbal) responses in spoken social interaction. Most of the existing frameworks focus on intent planning and behavior planning. The realization, however, is left to a limited set of static 3D representations of conversational expressions. In addition to functional and semantic synchrony between verbal and non-verbal signals, the final believability of the displayed expression is sculpted by the physical realization of non-verbal expressions. A major challenge of most conversational systems capable of reproducing gestures is the diversity in expressiveness. In this paper, we propose a method for capturing gestures automatically from videos and transforming them into 3D representations stored as part of the conversational agent's repository of motor skills. The main advantage of the proposed method is ensuring the naturalness of the embodied conversational agent's gestures, which results in a higher quality of human-computer interaction. The method is based on a Kanade-Lucas-Tomasi tracker, a Savitzky-Golay filter, a Denavit-Hartenberg-based kinematic model and the EVA framework. Furthermore, we designed an objective method based on cosine similarity instead of a subjective evaluation of synthesized movement. The proposed method resulted in a 96% similarity.

Developing, Implementing, and Evaluating an Artificial Intelligence-Guided Mental Health Resource Navigation Chatbot for Health Care Workers and Their Families During and Following the COVID-19 Pandemic: Protocol for a Cross-sectional Study

Background

Approximately 1 in 3 Canadians will experience an addiction or mental health challenge at some point in their lifetime. Unfortunately, there are multiple barriers to accessing mental health care, including system fragmentation, episodic care, long wait times, and insufficient support for health system navigation. In addition, stigma may further reduce an individual’s likelihood of seeking support. Digital technologies present new and exciting opportunities to bridge significant gaps in mental health care service provision, reduce barriers pertaining to stigma, and improve health outcomes for patients and mental health system integration and efficiency. Chatbots (ie, software systems that use artificial intelligence to carry out conversations with people) may be explored to support those in need of information or access to services and present the opportunity to address gaps in traditional, fragmented, or episodic mental health system structures on demand with personalized attention. The recent COVID-19 pandemic has exacerbated even further the need for mental health support among Canadians and called attention to the inefficiencies of our system. As health care workers and their families are at an even greater risk of mental illness and psychological distress during the COVID-19 pandemic, this technology will be first piloted with the goal of supporting this vulnerable group.

Objective

This pilot study seeks to evaluate the effectiveness of the Mental Health Intelligent Information Resource Assistant in supporting health care workers and their families in the Canadian provinces of Alberta and Nova Scotia with the provision of appropriate information on mental health issues, services, and programs based on personalized needs.

Methods

The effectiveness of the technology will be assessed via voluntary follow-up surveys and an analysis of client interactions and engagement with the chatbot. Client satisfaction with the chatbot will also be assessed.

Results

This project was initiated on April 1, 2021. Ethics approval was granted on August 12, 2021, by the University of Alberta Health Research Board (PRO00109148) and on April 21, 2022, by the Nova Scotia Health Authority Research Ethics Board (1027474). Data collection is anticipated to take place from May 2, 2022, to May 2, 2023. Publication of preliminary results will be sought in spring or summer 2022, with a more comprehensive evaluation completed by spring 2023 following the collection of a larger data set.

Conclusions

Our findings can be incorporated into public policy and planning around mental health system navigation by Canadian mental health care providers—from large public health authorities to small community-based, not-for-profit organizations. This may serve to support the development of an additional touch point, or point of entry, for individuals to access the appropriate services or care when they need them, wherever they are.

International Registered Report Identifier (IRRID)

PRR1-10.2196/33717

Digital tools for the assessment of pharmacological treatment for depressive disorder: State of the art

Depression is an invalidating disorder, marked by phenotypic heterogeneity. Clinical assessments for treatment adjustments and data-collection for pharmacological research often rely on subjective representations of functioning. Better phenotyping through digital applications may add unseen information and facilitate disentangling the clinical characteristics and impact of depression and its pharmacological treatment in everyday life. Researchers, physicians, and patients benefit from well-understood digital phenotyping approaches to assess the treatment efficacy and side-effects. This review discusses the current possibilities and pitfalls of wearables and technology for the assessment of the pharmacological treatment of depression. Their applications in the whole spectrum of treatment for depression, including diagnosis, treatment of an episode, and monitoring of relapse risk and prevention are discussed. Multiple aspects are to be considered, including concerns that come with collecting sensitive data and health recordings. Also, privacy and trust are addressed. Available applications range from questionnaire-like apps to objective assessment of behavioural patterns and promises in handling suicidality. Nonetheless, interpretation and integration of this high-resolution information with other phenotyping levels, remains challenging. This review provides a state-of-the-art description of wearables and technology in digital phenotyping for monitoring pharmacological treatment in depression, focusing on the challenges and opportunities of its application in clinical trials and research.

Chatbots to Support Young Adults’ Mental Health: an Exploratory Study of Acceptability

Despite the prevalence of mental health conditions, stigma, lack of awareness and limited resources impede access to care, creating a need to improve mental health support. The recent surge in scientific and commercial interest in conversational agents and their potential to improve diagnosis and treatment seems a potentially fruitful area in this respect, particularly for young adults who widely use such systems in other contexts. Yet, there is little research that considers the acceptability of conversational agents in mental health. This study, therefore, presents three research activities that explore whether conversational agents and, in particular, chatbots can be an acceptable solution in mental healthcare for young adults. First, a survey of young adults (in a university setting) provides an understanding of the landscape of mental health in this age group and of their views around mental health technology, including chatbots. Second, a literature review synthesises current evidence relating to the acceptability of mental health conversational agents and points to future research priorities. Third, interviews with counsellors who work with young adults, supported by a chatbot prototype and user-centred design techniques, reveal the perceived benefits and potential roles of mental health chatbots from the perspective of mental health professionals, while suggesting preconditions for the acceptability of the technology. Taken together, these research activities: provide evidence that chatbots are an acceptable solution to offering mental health support for young adults; identify specific challenges relating to both the technology and environment; and argue for the application of user-centred approaches during development of mental health chatbots and more systematic and rigorous evaluations of the resulting solutions.

How to Design a Relevant Corpus for Sleepiness Detection Through Voice?

This article presents research on the detection of pathologies affecting speech through automatic analysis. Voice processing has indeed been used for evaluating several diseases such as Parkinson, Alzheimer, or depression. If some studies present results that seem sufficient for clinical applications, this is not the case for the detection of sleepiness. Even two international challenges and the recent advent of deep learning techniques have still not managed to change this situation. This article explores the hypothesis that the observed average performances of automatic processing find their cause in the design of the corpora. To this aim, we first discuss and refine the concept of sleepiness related to the ground-truth labels. Second, we present an in-depth study of four corpora, bringing to light the methodological choices that have been made and the underlying biases they may have induced. Finally, in light of this information, we propose guidelines for the design of new corpora.

Changes to the Psychiatric Chatbot Landscape: A Systematic Review of Conversational Agents in Serious Mental Illness: Changements du paysage psychiatrique des chatbots: une revue systématique des agents conversationnels dans la maladie mentale sérieuse

OBJECTIVE

The need for digital tools in mental health is clear, with insufficient access to mental health services. Conversational agents, also known as chatbots or voice assistants, are digital tools capable of holding natural language conversations. Since our last review in 2018, many new conversational agents and research have emerged, and we aimed to reassess the conversational agent landscape in this updated systematic review.

METHODS

A systematic literature search was conducted in January 2020 using the PubMed, Embase, PsychINFO, and Cochrane databases. Studies included were those that involved a conversational agent assessing serious mental illness: major depressive disorder, schizophrenia spectrum disorders, bipolar disorder, or anxiety disorder.

RESULTS

Of the 247 references identified from selected databases, 7 studies met inclusion criteria. Overall, there were generally positive experiences with conversational agents in regard to diagnostic quality, therapeutic efficacy, or acceptability. There continues to be, however, a lack of standard measures that allow ease of comparison of studies in this space. There were several populations that lacked representation such as the pediatric population and those with schizophrenia or bipolar disorder. While comparing 2018 to 2020 research offers useful insight into changes and growth, the high degree of heterogeneity between all studies in this space makes direct comparison challenging.

CONCLUSIONS

This review revealed few but generally positive outcomes regarding conversational agents' diagnostic quality, therapeutic efficacy, and acceptability, which may augment mental health care. Despite this increase in research activity, there continues to be a lack of standard measures for evaluating conversational agents as well as several neglected populations. We recommend that the standardization of conversational agent studies should include patient adherence and engagement, therapeutic efficacy, and clinician perspectives.

Effectiveness and Acceptance of a Smartphone-Based Virtual Agent Screening for Alcohol and Tobacco Problems and Associated Risk Factors During COVID-19 Pandemic in the General Population

Background: During the current COVID-19 pandemic, alcohol, and tobacco are the most available substances for managing stress and can induce a risk of addiction. KANOPEE is a smartphone application available to the general population using an embodied conversational agent (ECA) to screen for experiences of problems with alcohol/tobacco use and to provide follow-up tools for brief intervention. Objectives: This study aimed to determine if the smartphone KANOPEE application could identify people at risk for alcohol and/or tobacco use disorders in the context of the current COVID-19 pandemic, to assess adherence to a 7-day follow-up use diary, and to evaluate trust and acceptance of the application. Methods: The conversational agent, named Jeanne, interviewed participants about perceived problems with the use of alcohol and tobacco since the pandemic and explored risk for tobacco and alcohol use disorder with the five-item Cigarette Dependence Scale (CDS-5) and "Cut Down, Annoyed, Guilty, Eye-opener" (CAGE) questionnaire and experience of craving for each substance. Descriptive, univariate, and multivariate analyses were performed to specify personalized associations with reporting a problem with alcohol/tobacco use; descriptive analysis reported the experience with the intervention and acceptance and trust in the application. Results: From April 22 to October 26, 2020, 1,588 French participants completed the KANOPEE interview, and 318 answered the acceptance and trust scales. Forty-two percent of tobacco users and 27% of alcohol users reported problem use since the pandemic. Positive screening with CDS-5 and CAGE and craving were associated with reported problem use (p < 0.0001). Lockdown period influenced alcohol (p < 0.0005) but not tobacco use (p > 0.05). Eighty-eight percent of users reported that KANOPEE was easy to use, and 82% found Jeanne to be trustworthy and credible. Conclusion: KANOPEE was able to screen for risk factors for substance use disorder (SUD) and was acceptable to users. Reporting craving and being at risk for SUD seem to be early markers to be identified. Alcohol problem use seems to be more reliant on contextual conditions such as confinement. This method is able to offer acceptable, brief, and early intervention with minimal delay for vulnerable people.

Computer-Assisted Avatar-Based Treatment for Dysfunctional Beliefs in Depressive Inpatients: A Pilot Study

Dysfunctional cognitions are a crucial part of depression. Cognitive therapy aims to modify dysfunctional beliefs. Typically, dysfunctional beliefs are questioned, and patients are trained to think of alternative functional beliefs. We developed a computer-assisted, avatar-based adjunct for cognitive therapy that aims to reduce dysfunctional beliefs and symptom severity. Besides, it aims to promote alternative functional beliefs. In a randomized controlled trial with 34 patients diagnosed with major depression currently undergoing inpatient treatment at the university psychiatric hospital in Regensburg, Germany, participants were randomly assigned to receive either treatment as usual (TAU) or computer-assisted avatar-based treatment for dysfunctional beliefs (CAT-DB) in addition to TAU. In CAT-DB participants are faced with a virtual avatar expressing their personal dysfunctional beliefs. Participants are asked to contradict these and express alternative functional beliefs. Assessments of conviction of dysfunctional beliefs, functional beliefs and symptom severity were done shortly before the intervention (pre-treatment), right after the intervention (post-treatment) and 14 days later (follow-up). The reduction in conviction of dysfunctional beliefs and symptom severity, and the increase in conviction of alternative functional beliefs at post-treatment and follow-up were significantly greater for the group receiving CAT-DB. Our study provides an indication in favor of the effectiveness of CAT-DB for depressive patients. It is a simple tool that could support classical cognitive therapy. Further studies at different centres, with larger sample sizes and varying therapeutic contexts are required to prove the effectiveness of our intervention.

Smartphone-Based Virtual Agents to Help Individuals With Sleep Concerns During COVID-19 Confinement: Feasibility Study

BACKGROUND

The COVID-19 crisis and consequent confinement restrictions have caused significant psychosocial stress and reports of sleep complaints, which require early management, have increased during recent months. To help individuals concerned about their sleep, we developed a smartphone-based app called KANOPEE that allows users to interact with a virtual agent dedicated to autonomous screening and delivering digital behavioral interventions.

OBJECTIVE

Our objective was to assess the feasibility of this app, in terms of inclusion rate, follow-up rate, perceived trust and acceptance of the virtual agent, and effects of the intervention program, in the context of COVID-19 confinement in France.

METHODS

The virtual agent is an artificial intelligence program using decision tree architecture and interacting through natural body motion and natural voice. A total of 2069 users aged 18 years and above downloaded the free app during the study period (April 22 to May 5, 2020). These users first completed a screening interview based on the Insomnia Severity Index (ISI) conducted by the virtual agent. If the users were positive for insomnia complaints (ISI score >14), they were eligible to join the 2-stage intervention program: (1) complete an electronic sleep diary for 1 week and (2) follow personalized sleep recommendations for 10 days. We collected and analyzed the following measures: sociodemographic information, ISI scores and sleep/wake schedules, and acceptance and trust of the agent.

RESULTS

Approximately 76% (1574/2069) of the app users completed the screening interview with the virtual agent. The virtual agent was well accepted by 27.4% (431/1574) of the users who answered the acceptance and trust questionnaires on its usability, satisfaction, benevolence, and credibility. Of the 773 screened users who reported sleep complaints (ISI score >14), 166 (21.5%) followed Step 1 of the intervention, and only 47 of those (28.3%) followed Step 2. Users who completed Step 1 found that their insomnia complaints (baseline mean ISI score 18.56, mean ISI score after Step 1 15.99; P<.001) and nocturnal sleep quality improved significantly after 1 week. Users who completed Step 2 also showed an improvement compared to the initial measures (baseline mean ISI score 18.87, mean ISI score after Step 2 14.68; P<.001). Users that were most severely affected (ISI score >21) did not respond to either intervention.

CONCLUSIONS

These preliminary results suggest that the KANOPEE app is a promising solution to screen populations for sleep complaints and that it provides acceptable and practical behavioral advice for individuals reporting moderately severe insomnia.

Perceived Usefulness, Satisfaction, Ease of Use and Potential of a Virtual Companion to Support the Care Provision for Older Adults

This article reports a study aiming to determine the perceptions of older adults needing formal care about the usefulness, satisfaction, and ease of use of CaMeLi, a virtual companion based on an embodied conversational agent, and the perceptions of formal caregivers about the potential of virtual companions to support care provision. An observational study involving older adults needing formal care was conducted to assess CaMeLi using a multi-method approach (i.e., an auto-reported questionnaire—the Usefulness, Satisfaction, and Ease of use questionnaire; a scale for the usability assessment based on the opinion of observers—the International Classification of Functioning Disability and Health-based Usability Scale; and critical incident registration). Moreover, a focus group was conducted to collect data regarding the perceived utility of virtual companions to support care provision. The observational study was conducted with 46 participants with an average age of 63.6 years, and the results were associated with a high level of usefulness, satisfaction, and ease of use of CaMeLi. Furthermore, the focus group composed of four care providers considered virtual companions a promising solution to support care provision and to prevent loneliness and social isolation. The results of both the observational study and the focus group revealed good perceptions regarding the role of virtual companions to support the care provision for older adults.

The Effect of Multimodal Emotional Expression on Responses to a Digital Human during a Self-Disclosure Conversation: a Computational Analysis of User Language

Digital humans show promise for use in healthcare as virtual therapists to deliver psychotherapy or companions for social support. For digital humans to be effective and engaging in these roles, it is important they can build close relationships with people. Emotional expressiveness can improve social closeness in human relationships, especially for females. However, it is unknown whether multimodal emotional expression improves relationships with digital humans. Participants were 185 adults aged 18 years or older with English fluency. Participants were block-randomized by gender to complete the Relationship Closeness Induction Task with one of six versions of a digital human. The digital humans varied in modality richness (face, no face) and emotional expression (emotional voice, neutral voice; emotional face, neutral face). Participants' language was analysed for emotional content using Linguistic Inquiry and Word Count software. A series of three-way ANOVA and ANCOVA were conducted to evaluate the effect of digital human face type, voice type, and participant gender on emotional content in participant language. A digital human with no face was associated with more first-person singular pronoun use than a neutral face and an emotional face digital human. A digital human with no face and a neutral voice received more general negative emotion language than a digital human with no face and an emotional voice. Findings suggest the presence of a face and emotion in the voice may improve emotional responses to digital humans. Results provide evidence for aspects of the theoretical framework of embodied agent-patient communication.

Acceptance of virtual agents in a homecare context: Evaluation of excessive daytime sleepiness in apneic patients during interventions by continuous positive airway pressure (CPAP) providers

Sleep apnea syndrome treatment relies primarily on continuous positive airway pressure, which requires a homecare follow-up. Excessive daytime sleepiness is a key symptom to be measured during follow-up, and there is a need for more easy-to-administer, ecological and engaging tools to assess it. Virtual agents have shown their effectiveness in performing clinical evaluation in a medical environment. A virtual agent assessing excessive daytime sleepiness via the Epworth Sleepiness Scale has been tested at home by 102 patients treated by continuous positive airway pressure (CPAP) and their homecare providers. Acceptance and trustworthiness of the agent, as well as the influence of demographics and clinical characteristics of patients, were investigated. Results showed that both patients and homecare providers reported a positive attitude towards the virtual agent, which was found to be usable, satisfactory, credible and benevolent. Homecare providers reported that it was not a burden to their working routine. Positive regression coefficients were found between patients' and homecare providers' attitudes towards the virtual agent. We found no influence of patients' demographics and clinical characteristics on their acceptance of the virtual agent. This shows that virtual agents are well accepted by patients and homecare providers, independently of their demographics and clinical characteristics. Positive regression coefficients observed between patients' and homecare providers' perceptions of the agent indicate that the opinions of both influence acceptance of the virtual agent in a homecare context. Virtual agents are new innovative digital solutions to be considered in homecare follow-up of apneic patients treated by CPAP.