Development, Feasibility, Acceptability, and Utility of an Expressive Speech-Enabled Digital Health Agent to Deliver Online, Brief Motivational Interviewing for Alcohol Misuse: Descriptive Study

A systematic review of chatbot-assisted interventions for substance use

Objectives

This study systematically reviewed research on the utilization of chatbot-related technologies for the prevention, assessment, and treatment of various substance uses, including alcohol, nicotine, and other drugs.

Methods

Following PRISMA guidelines, 28 articles were selected for final analysis from an initial screening of 998 references. Data were coded for multiple components, including study characteristics, intervention types, intervention contents, sample characteristics, substance use details, measurement tools, and main findings, particularly emphasizing the effectiveness of chatbot-assisted interventions on substance use and the facilitators and barriers affecting program effectiveness.

Results

Half of the studies specifically targeted smoking. Furthermore, over 85% of interventions were designed to treat substance use, with 7.14% focusing on prevention and 3.57% on assessment. Perceptions of effectiveness in quitting substance use varied, ranging from 25% to 50%, while for reduced substance use, percentages ranged from 66.67% to 83.33%. Among the studies assessing statistical effectiveness (46.43%), all experimental studies, including quasi-experiments, demonstrated significant and valid effects. Notably, 30% of studies emphasized personalization and providing relevant tips or information as key facilitators.

Conclusion

This study offers valuable insights into the development and validation of chatbot-assisted interventions, thereby establishing a robust foundation for their efficacy.

Exploring the characteristics of conversational agents in chronic disease management interventions: A scoping review

Objective

With the increasing global burden of chronic diseases, there is the potential for conversational agents (CAs) to assist people in actively managing their conditions. This paper reviews different types of CAs used for chronic condition management, delving into their characteristics and the chosen study designs. This paper also discusses the potential of these CAs to enhance the health and well-being of people with chronic conditions.

Methods

A search was performed in February 2023 on PubMed, ACM Digital Library, Scopus, and IEEE Xplore. Studies were included if they focused on chronic disease management or prevention and if systems were evaluated on target user groups.

Results

The 42 selected studies explored diverse types of CAs across 11 health conditions. Personalization varied, with 25 CAs not adapting message content, while others incorporated user characteristics and real-time context. Only 12 studies used medical records in conjunction with CAs for conditions like diabetes, mental health, cardiovascular issues, and cancer. Despite measurement method variations, the studies predominantly emphasized improved health outcomes and positive user attitudes toward CAs.

Conclusions

The results underscore the need for CAs to adapt to evolving patient needs, customize interventions, and incorporate human support and medical records for more effective care. It also highlights the potential of CAs to play a more active role in helping individuals manage their conditions and notes the value of linguistic data generated during user interactions. The analysis acknowledges its limitations and encourages further research into the use and potential of CAs in disease-specific contexts.

Embodied Conversational Agents Providing Motivational Interviewing to Improve Health-Related Behaviors: Scoping Review

BACKGROUND

Embodied conversational agents (ECAs) are advanced human-like interfaces that engage users in natural face-to-face conversations and interactions. These traits position ECAs as innovative tools for delivering interventions for promoting health-related behavior adoption. This includes motivational interviewing (MI), a therapeutic approach that combines brief interventions with motivational techniques to encourage the adoption of healthier behaviors.

OBJECTIVE

This study aims to identify the health issues addressed by ECAs delivering MI interventions, explore the key characteristics of these ECAs (eg, appearance, dialogue mechanism, emotional model), analyze the implementation of MI principles and techniques within ECAs, and examine the evaluation methods and primary outcomes of studies that use ECAs providing MI interventions.

METHODS

We conducted a scoping review following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) methodology. Our systematic search covered the PubMed, Scopus, IEEE Xplore, ACM Digital, and PsycINFO databases for papers published between January 2008 and December 2022. We included papers describing ECAs developed for delivering MI interventions targeting health-related behaviors and excluded articles that did not describe ECAs with human appearances and without the necessary evaluation or MI explanation. In a multistage process, 3 independent reviewers performed screening and data extraction, and the collected data were synthesized using a narrative approach.

RESULTS

The initial search identified 404 articles, of which 3.5% (n=14) were included in the review. ECAs primarily focused on reducing alcohol use (n=5, 36%), took on female representations (n=9, 64%), and gave limited consideration to user ethnicity (n=9, 64%). Most of them used rules-driven dialogue mechanisms (n=13, 93%), include emotional behavior to convey empathy (n=8, 57%) but without an automatic recognition of user emotions (n=12, 86%). Regarding MI implementation, of 14 studies, 3 (21%) covered all MI principles, 4 (29%) included all processes, and none covered all techniques. Most studies (8/14, 57%) conducted acceptability, usability, and user experience assessments, whereas a smaller proportion (4/14, 29%) used randomized controlled trials to evaluate behavior changes. Overall, the studies reported positive results regarding acceptability, usability, and user experience and showed promising outcomes in changes in attitudes, beliefs, motivation, and behavior.

CONCLUSIONS

This study revealed significant advancements in the use of ECAs for delivering MI interventions aimed at promoting healthier behaviors over the past 15 years. However, this review emphasizes the need for a more in-depth exploration of ECA characteristics. In addition, there is a need for the enhanced integration of MI principles, processes, and techniques into ECAs. Although acceptability and usability have received considerable attention, there is a compelling argument for placing a stronger emphasis on assessing changes in attitudes, beliefs, motivation, and behavior. Consequently, inclusion of more randomized controlled trials is essential for comprehensive intervention evaluations.

Factors Influencing the Acceptability, Acceptance, and Adoption of Conversational Agents in Health Care: Integrative Review

BACKGROUND

Conversational agents (CAs), also known as chatbots, are digital dialog systems that enable people to have a text-based, speech-based, or nonverbal conversation with a computer or another machine based on natural language via an interface. The use of CAs offers new opportunities and various benefits for health care. However, they are not yet ubiquitous in daily practice. Nevertheless, research regarding the implementation of CAs in health care has grown tremendously in recent years.

OBJECTIVE

This review aims to present a synthesis of the factors that facilitate or hinder the implementation of CAs from the perspectives of patients and health care professionals. Specifically, it focuses on the early implementation outcomes of acceptability, acceptance, and adoption as cornerstones of later implementation success.

METHODS

We performed an integrative review. To identify relevant literature, a broad literature search was conducted in June 2021 with no date limits and using all fields in PubMed, Cochrane Library, Web of Science, LIVIVO, and PsycINFO. To keep the review current, another search was conducted in March 2022. To identify as many eligible primary sources as possible, we used a snowballing approach by searching reference lists and conducted a hand search. Factors influencing the acceptability, acceptance, and adoption of CAs in health care were coded through parallel deductive and inductive approaches, which were informed by current technology acceptance and adoption models. Finally, the factors were synthesized in a thematic map.

RESULTS

Overall, 76 studies were included in this review. We identified influencing factors related to 4 core Unified Theory of Acceptance and Use of Technology (UTAUT) and Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) factors (performance expectancy, effort expectancy, facilitating conditions, and hedonic motivation), with most studies underlining the relevance of performance and effort expectancy. To meet the particularities of the health care context, we redefined the UTAUT2 factors social influence, habit, and price value. We identified 6 other influencing factors: perceived risk, trust, anthropomorphism, health issue, working alliance, and user characteristics. Overall, we identified 10 factors influencing acceptability, acceptance, and adoption among health care professionals (performance expectancy, effort expectancy, facilitating conditions, social influence, price value, perceived risk, trust, anthropomorphism, working alliance, and user characteristics) and 13 factors influencing acceptability, acceptance, and adoption among patients (additionally hedonic motivation, habit, and health issue).

CONCLUSIONS

This review shows manifold factors influencing the acceptability, acceptance, and adoption of CAs in health care. Knowledge of these factors is fundamental for implementation planning. Therefore, the findings of this review can serve as a basis for future studies to develop appropriate implementation strategies. Furthermore, this review provides an empirical test of current technology acceptance and adoption models and identifies areas where additional research is necessary.

TRIAL REGISTRATION

PROSPERO CRD42022343690; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=343690.

A Digital Counselor-Delivered Intervention for Substance Use Among People With HIV: Development and Usability Study

BACKGROUND

Substance use disorders are prevalent and undertreated among people with HIV. Computer-delivered interventions (CDIs) show promise in expanding reach, delivering evidence-based care, and offering anonymity. Use in HIV clinic settings may overcome access barriers. Incorporating digital counselors may increase CDI engagement, and thereby improve health outcomes.

OBJECTIVE

We aim to develop and pilot a digital counselor-delivered brief intervention for people with HIV who use drugs, called "C-Raven," which is theory grounded and uses evidence-based practices for behavior change.

METHODS

Intervention mapping was used to develop the CDI including a review of the behavior change research in substance use, HIV, and digital counselors. We conducted in-depth interviews applying the situated-information, motivation, and behavior skills model and culturally adapting the content for local use with people with HIV. With a user interaction designer, we created various digital counselors and CDI interfaces. Finally, a mixed methods approach using in-depth interviews and quantitative assessments was used to assess the usability, acceptability, and cultural relevance of the intervention content and the digital counselor.

RESULTS

Participants found CDI easy to use, useful, relevant, and motivating. A consistent suggestion was to provide more information about the negative impacts of drug use and the interaction of drug use with HIV. Participants also reported that they learned new information about drug use and its health effects. The CDI was delivered by a "Raven," digital counselor, programmed to interact in a motivational interviewing style. The Raven was perceived to be nonjudgmental, understanding, and emotionally responsive. The appearance and images in the intervention were perceived as relevant and acceptable. Participants noted that they could be more truthful with a digital counselor, however, it was not unanimously endorsed as a replacement for a human counselor. The C-Raven Satisfaction Scale showed that all participants rated their satisfaction at either a 4 (n=2) or a 5 (n=8) on a 5-point Likert scale and all endorsed using the C-Raven program again.

CONCLUSIONS

CDIs show promise in extending access to care and improving health outcomes but their development necessarily requires integration from multiple disciplines including behavioral medicine and computer science. We developed a cross-platform compatible CDI led by a digital counselor that interacts in a motivational interviewing style and (1) uses evidence-based behavioral change methods, (2) is culturally adapted to people with HIV who use drugs, (3) has an engaging and interactive user interface, and (4) presents personalized content based on participants' ongoing responses to a series of menu-driven conversations. To advance the continued development of this and other CDIs, we recommend expanded testing, standardized measures to evaluate user experience, integration with clinician-delivered substance use treatment, and if effective, implementation into HIV clinical care.

The Cultural Adaption of a Sobriety Support App for Alaska Native and American Indian People: Qualitative Feasibility and Acceptability Study

BACKGROUND

Despite high rates of alcohol abstinence, Alaska Native and American Indian (ANAI) people experience a disproportionate burden of alcohol-related morbidity and mortality. Multiple barriers to treatment exist for this population, including a lack of culturally relevant resources; limited access to or delays in receiving treatment; and privacy concerns. Many ANAI people in the state of Alaska, United States, live in sparsely populated rural areas, where treatment access and privacy concerns regarding peer-support programs may be particularly challenging. In addition, prior research demonstrates that many ANAI people prefer a self-management approach to sobriety, rather than formal treatment. Taken together, these factors suggest a potential role for a culturally adapted smartphone app to support ANAI people interested in changing their behavior regarding alcohol use.

OBJECTIVE

This study was the first phase of a feasibility and acceptability study of a culturally tailored version of an off-the-shelf smartphone app to aid ANAI people in managing or reducing their use of alcohol. The aim of this qualitative needs assessment was to gather insights and preferences from ANAI people and health care providers serving ANAI people to guide feature development, content selection, and cultural adaptation before a pilot test of the smartphone app with ANAI people.

METHODS

From October 2018 to September 2019, we conducted semistructured interviews with 24 ANAI patients aged ≥21 years and 8 providers in a tribal health care organization in south-central Alaska.

RESULTS

Participants generally endorsed the usefulness of a smartphone app for alcohol self-management. They cited anonymity, 24/7 access, peer support, and patient choice as key attributes of an app. The desired cultural adaptations included ANAI- and land-themed design elements, cultural content (eg, stories from elders), and spiritual resources. Participants considered an app especially useful for rural-dwelling ANAI people, as well as those who lack timely access to treatment services or prefer to work toward managing their alcohol use outside the clinical setting.

CONCLUSIONS

This needs assessment identified key features, content, and cultural adaptations that are being implemented in the next phase of the study. In future work, we will determine the extent to which these changes can be accommodated in a commercially available app, the feasibility of implementation, and the acceptability of the culturally adapted version of the app among ANAI users.

Language Use in Conversational Agent-Based Health Communication: Systematic Review

Background

Given the growing significance of conversational agents (CAs), researchers have conducted a plethora of relevant studies on various technology- and usability-oriented issues. However, few investigations focus on language use in CA-based health communication to examine its influence on the user perception of CAs and their role in delivering health care services.

Objective

This review aims to present the language use of CAs in health care to identify the achievements made and breakthroughs to be realized to inform researchers and more specifically CA designers.

Methods

This review was conducted by following the protocols of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 statement. We first designed the search strategy according to the research aim and then performed the keyword searches in PubMed and ProQuest databases for retrieving relevant publications (n=179). Subsequently, 3 researchers screened and reviewed the publications independently to select studies meeting the predefined selection criteria. Finally, we synthesized and analyzed the eligible articles (N=11) through thematic synthesis.

Results

Among the 11 included publications, 6 deal exclusively with the language use of the CAs studied, and the remaining 5 are only partly related to this topic. The language use of the CAs in these studies can be roughly classified into six themes: (1) personal pronouns, (2) responses to health and lifestyle prompts, (3) strategic wording and rich linguistic resources, (4) a 3-staged conversation framework, (5) human-like well-manipulated conversations, and (6) symbols and images coupled with phrases. These derived themes effectively engaged users in health communication. Meanwhile, we identified substantial room for improvement based on the inconsistent responses of some CAs and their inability to present large volumes of information on safety-critical health and lifestyle prompts.

Conclusions

This is the first systematic review of language use in CA-based health communication. The results and limitations identified in the 11 included papers can give fresh insights into the design and development, popularization, and research of CA applications. This review can provide practical implications for incorporating positive language use into the design of health CAs and improving their effective language output in health communication. In this way, upgraded CAs will be more capable of handling various health problems particularly in the context of nationwide and even worldwide public health crises.