End-user views of an electronic encounter decision aid linked to routine depression screening

Examining Challenges to Co-Design Digital Health Interventions With End Users: Systematic Review

BACKGROUND

Digital health interventions (DHIs) are changing the dynamic of health care by providing personalized, private, and instantaneous solutions to end users. However, the explosion of digital health has been fraught with challenges. The approach to co-design with end users varies across a diverse domain of stakeholders, often resulting in siloed approaches with no clear consensus. The concept of validating user experiences contrasts greatly between digital stakeholders (ie, user experience and retention) and health stakeholders (ie, safety and efficacy). Several methodologies and frameworks are being implemented to address this challenge to varying degrees of success.

OBJECTIVE

We aimed to broadly examine the advancements and challenges to co-design DHIs with end users over the last decade. This task was undertaken to identify the key problem areas at the domain level, with the ultimate goal of creating recommendations for better approaches to co-design DHIs with end users.

METHODS

We conducted a systematic search of key databases for co-design studies involving end users in DHIs. Searches were divided into 3 relevant streams: health behavior, user experience, and digital methodologies and frameworks. The eligibility criteria were guided by the PerSPEcTiF framework and the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. In line with this framework, studies were included in this review that (1) address research on DHIs; (2) focus on interaction and co-design with end users; (3) explain results such that uptake, effectiveness, satisfaction, and health outcomes are discernible, positively or negatively; and (4) describe actionable procedures for better DHI design. The search was conducted in a diverse group of 6 bibliographical databases from January 2015 to May 2024: PsycINFO, PubMed (MEDLINE), Web of Science, CINAHL, Institute of Electrical and Electronics Engineers Xplore, and Scopus. From the 13,961 studies initially screened for titles and abstracts, 489 (3.6%) were eligible for a full-text screening, of which 171 (1.2%) studies matched the inclusion criteria and were included in a qualitative synthesis.

RESULTS

Of the 171 studies analyzed across 52 journals, we found 5 different research approaches, spanning 8 different digital health solution types and 5 different design methodologies. These studies identified several core themes when co-designing with end users: advancements, which included participatory co-design; challenges, which included participatory co-design, environment and context, testing, and cost and scale; and gaps, which included a pragmatic hybridized framework and industry implementability.

CONCLUSIONS

This research supports a pragmatic shift toward using mixed methods approaches at scale, methods that are primed to take advantage of the emerging big data era of digital health co-design. This organic outlook should blend the vision of digital health co-designers with the pragmatism of Agile design methodology and the rigor of health care metrics.

TRIAL REGISTRATION

PROSPERO CRD42021238164; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021238164.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/28083.

Comparison of analog and digital patient decision aids for the treatment of depression: a scoping review

Introduction

Patient decision aids (PDAs) are important tools to empower patients and integrate their preferences and values in the decision-making process. Even though patients with mental health problems have a strong interest in being more involved in decision making about their treatment, research has mainly focused on PDAs for somatic conditions. In this scoping review, we focus on patients suffering from depression and the role of PDAs for this patient group. The review offers an overview of digital and analog PDAs, their advantages and disadvantages as well as recommendations for further research and development.

Methods

A systematic search of the existing literature guided by the Cochrane Handbook for Systematic Reviews and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses - extension for scoping reviews (PRISMA-ScR) was conducted. Three electronic literature databases with the appropriate thematic focus were searched (PubMed, PsycInfo, and Web of Science). The search strategy used controlled and natural language to search for the key concepts decision aids and depression. The articles were selected in a two-step process guided by predefined inclusion and exclusion criteria. We narratively synthetized information extracted from 40 research articles.

Results

We included 40 articles in our review. Our review revealed that there is more focus on digital PDAs in research than in clinical practice. Digitalization can enhance the benefits of PDAs by developing tools that are more efficient, interactive, and personalized. The main disadvantages of both types of PDAs for the treatment of depression are related to time, dissemination, and capacity building for the health care providers. Digital PDAs need to be regularly updated, effective strategies for their dissemination and acceptance need to be identified, and clinicians need sufficient training on how to use digital PDAs. There is more research needed to study which forms of PDAs are most appropriate for various patient groups (e.g., older adults, or patients with comorbidities), and to identify the most effective ways of PDAs' integration in the clinical workflow. The findings from our review could be well aligned with the International Patient Decision Aids Standards.

Discussion

More research is needed regarding effective strategies for the implementation of digital PDAs into the clinical workflow, ethical issues raised by the digital format, and opportunities of tailoring PDAs for diverse patient groups.

Digitally filling the access gap in mental health care: An investigation of the association between rurality and online engagement with validated self-report screens across the United States

Mental health disorders are highly prevalent, yet few persons receive access to treatment; this is compounded in rural areas where mental health services are limited. The proliferation of online mental health screening tools are considered a key strategy to increase identification, diagnosis, and treatment of mental illness. However, research on real-world effectiveness, especially in hard to reach rural communities, is limited. Accordingly, the current work seeks to test the hypothesis that online screening use is greater in rural communities with limited mental health resources. The study utilized a national, online, population-based cohort consisting of Microsoft Bing search engine users across 18 months in the United States (representing approximately one-third of all internet searches), in conjunction with user-matched data of completed online mental health screens for anxiety, bipolar, depression, and psychosis (N = 4354) through Mental Health America, a leading non-profit mental health organization in the United States. Rank regression modeling was leveraged to characterize U.S. county-level screen completion rates as a function of rurality, health-care availability, and sociodemographic variables. County-level rurality and mental health care availability alone explained 42% of the variance in MHA screen completion rate (R2 = 0.42, p < 5.0 × 10-6). The results suggested that online screening was more prominent in underserved rural communities, therefore presenting as important tools with which to bridge mental health-care gaps in rural, resource-deficient areas.

Digital Interventions to Enhance Readiness for Psychological Therapy: Scoping Review

BACKGROUND

Psychological therapy is an effective treatment method for mental illness; however, many people with mental illness do not seek treatment or drop out of treatment early. Increasing client uptake and engagement in therapy is key to addressing the escalating global problem of mental illness. Attitudinal barriers, such as a lack of motivation, are a leading cause of low engagement in therapy. Digital interventions to increase motivation and readiness for change hold promise as accessible and scalable solutions; however, little is known about the range of interventions being used and their feasibility as a means to increase engagement with therapy.

OBJECTIVE

This review aimed to define the emerging field of digital interventions to enhance readiness for psychological therapy and detect gaps in the literature.

METHODS

A literature search was conducted in PubMed, PsycINFO, PsycARTICLES, Scopus, Embase, ACM Guide to Computing Literature, and IEEE Xplore Digital Library from January 1, 2006, to November 30, 2021. The PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) methodology was applied. Publications were included when they concerned a digitally delivered intervention, a specific target of which was enhancing engagement with further psychological treatment, and when this intervention occurred before the target psychological treatment.

RESULTS

A total of 45 publications met the inclusion criteria. The conditions included depression, unspecified general mental health, comorbid anxiety and depression, smoking, eating disorders, suicide, social anxiety, substance use, gambling, and psychosis. Almost half of the interventions (22/48, 46%) were web-based programs; the other formats included screening tools, videos, apps, and websites. The components of the interventions included psychoeducation, symptom assessment and feedback, information on treatment options and referrals, client testimonials, expectation management, and pro-con lists. Regarding feasibility, of the 16 controlled studies, 7 (44%) measuring actual behavior or action showed evidence of intervention effectiveness compared with controls, 7 (44%) found no differences, and 2 (12%) indicated worse behavioral outcomes. In general, the outcomes were mixed and inconclusive owing to variations in trial designs, control types, and outcome measures.

CONCLUSIONS

Digital interventions to enhance readiness for psychological therapy are broad and varied. Although these easily accessible digital approaches show potential as a means of preparing people for therapy, they are not without risks. The complex nature of stigma, motivation, and individual emotional responses toward engaging in treatment for mental health difficulties suggests that a careful approach is needed when developing and evaluating digital readiness interventions. Further qualitative, naturalistic, and longitudinal research is needed to deepen our knowledge in this area.

Human-Computer Interaction, Ethics, and Biomedical Informatics

Objectives : To provide an overview of recent work at the intersection of Biomedical Informatics, Human-Computer Interaction, and Ethics.

Methods : Search terms for Human-Computer Interaction, Biomedical Informatics, and Ethics were used to identify relevant papers published between 2017 and 2019.Relevant papers were identified through multiple methods, including database searches, manual reviews of citations, recent publications, and special collections, as well as through peer recommendations. Identified articles were reviewed and organized into broad themes.

Results : We identified relevant papers at the intersection of Biomedical Informatics, Human-Computer Interactions, and Ethics in over a dozen journals. The content of these papers was organized into three broad themes: ethical issues associated with systems in use, systems design, and responsible conduct of research.

Conclusions : The results of this overview demonstrate an active interest in exploring the ethical implications of Human-Computer Interaction concerns in Biomedical Informatics. Papers emphasizing ethical concerns associated with patient-facing tools, mobile devices, social media, privacy, inclusivity, and e-consent reflect the growing prominence of these topics in biomedical informatics research. New questions in these areas will likely continue to arise with the growth of precision medicine and citizen science.

Electronic clinical decision support to facilitate a change in clinical practice: Small details can make or break success

BACKGROUND

The use of electronic clinical decision support (CDS) is becoming common to change historically common clinical practices considered outdated by current guidelines. Preimplementation design of CDS tools is key to their success in changing clinical behaviors. Unfortunately, there are no established protocols for CDS tool development, and CDS failure can result from even small design flaws. This paper describes an example of a design oversight and how correction resulted in CDS success.

STUDY DESIGN AND METHODS

We performed a retrospective review of compliance with a CDS tool to encourage the use of prothrombin complex concentrate over plasma transfusion for the emergent reversal of warfarin. We identified a potential design flaw, made the necessary modifications, and repeated the compliance review.

RESULTS

After CDS, plasma orders declined by 150 units/mo; however, 48% of orders placed for non-warfarin coagulopathy were still for warfarin reversal. Hospital-wide, this noncompliance was 36% and was 80% in the emergency department. By simply relocating the qualifier "NOT on warfarin" from the end to the beginning of the order, noncompliance for warfarin reversal was reduced to 5% (P < .0001 by chi-square).

CONCLUSIONS

The successful use of electronic clinical decision support in the electronic medical record can depend on optimal design. Missing even small design elements such as the positioning of key terms within the tool can result in an ineffective CDS. Important design strategies to avoid poor performance are discussed as they relate to the CDS tool we describe.

Healthcare Options for People Experiencing Depression (HOPE*D): the development and pilot testing of an encounter-based decision aid for use in primary care

OBJECTIVE

To develop and pilot an encounter-based decision aid (eDA) for people with depression for use in primary care.

DESIGN

We developed an eDA for depression through cognitive interviews and pilot tested it using a one-group pretest, post-test design in primary care. Feasibility, fidelity of eDA use and acceptability were assessed using recruitment rates and semistructured interviews with patients, medical assistants and clinicians. Treatment choice and shared decision-making (SDM) were also assessed.

SETTING

Interviews with adult patients and the public were conducted in a mall and library in Grafton County, New Hampshire, while clinician interviews took place by phone or at the clinician's office. Pilot testing occurred in a New Hampshire primary care practice.

PARTICIPANTS

Cognitive interviews were conducted with adults, ≥18 years, who could read English from the following stakeholder groups: history of depression, the public and clinicians. Patients with a Patient Health Questionnaire-9 score of ≥5 were recruited for piloting.

RESULTS

Three stages of cognitive interviews were conducted (n=28). Changes to eDA included moving the combination therapy information and access to treatment information, adding colour, modifying pictograms and editing the talk-therapy description. Clinician concerns about patient health literacy were not reflected in patient interviews. Of 59 patients who reviewed study information, 56 were eligible and agreed to participate in pilot testing; however, only 29 could be reached for follow-up. The eDA was widely accepted, though clinicians did not always use it as intended. We found no impact of eDA use on SDM, though patients chose a wider range of treatment options.

CONCLUSIONS

We demonstrated the feasibility of the use of an eDA for depression in primary care that was widely accepted. Further research is needed to improve the fidelity with which the eDA is used and to assess its impact on SDM and related health outcomes.