Generating value with mental health apps

Governance of research and product improvement studies in consumer mental health apps. Interviews with researchers and app developers

Consumer mental health apps (MHAs) collect and generate mental health-related data on their users, which can be leveraged for research and product improvement studies. Such studies are associated with ethical issues that may be difficult for researchers and app developers to assess. To improve ethical study conduct, governance through rules, agreements and customs could be relied upon, but their translation into practice is subject to barriers. This qualitative interview study with 17 researchers and app developers looked into the role and impact of governance standards on consumer MHA studies. Interviewees experienced a significant number of rules, agreements and customs, although not all of the governance standards that can potentially be applicable. Standards did have an impact on the interests of researchers and app developers, app users and society, but this impact was mediated by several barriers related to their conceptualization and implementation. Conceptualization barriers impacted the development of a standard, the inclusion of relevant concepts and the coordination between standards. Implementation barriers concerned the resource cost of understanding a standard, as well as suboptimal enforcement. The framework developed in this study can support more effective efforts to improve the governance of future consumer MHA studies.

Assessing Patient Adherence to and Engagement With Digital Interventions for Depression in Clinical Trials: Systematic Literature Review

BACKGROUND

New approaches to the treatment of depression are necessary for patients who do not respond to current treatments or lack access to them because of barriers such as cost, stigma, and provider shortage. Digital interventions for depression are promising; however, low patient engagement could limit their effectiveness.

OBJECTIVE

This systematic literature review (SLR) assessed how participant adherence to and engagement with digital interventions for depression have been measured in the published literature, what levels of adherence and engagement have been reported, and whether higher adherence and increased engagement are linked to increased efficacy.

METHODS

We focused on a participant population of adults (aged ≥18 years) with depression or major depressive disorder as the primary diagnosis and included clinical trials, feasibility studies, and pilot studies of digital interventions for treating depression, such as digital therapeutics. We screened 756 unique records from Ovid MEDLINE, Embase, and Cochrane published between January 1, 2000, and April 15, 2022; extracted data from and appraised the 94 studies meeting the inclusion criteria; and performed a primarily descriptive analysis. Otsuka Pharmaceutical Development & Commercialization, Inc (Princeton, New Jersey, United States) funded this study.

RESULTS

This SLR encompassed results from 20,111 participants in studies using 47 unique web-based interventions (an additional 10 web-based interventions were not described by name), 15 mobile app interventions, 5 app-based interventions that are also accessible via the web, and 1 CD-ROM. Adherence was most often measured as the percentage of participants who completed all available modules. Less than half (44.2%) of the participants completed all the modules; however, the average dose received was 60.7% of the available modules. Although engagement with digital interventions was measured differently in different studies, it was most commonly measured as the number of modules completed, the mean of which was 6.4 (means ranged from 1.0 to 19.7) modules. The mean amount of time participants engaged with the interventions was 3.9 (means ranged from 0.7 to 8.4) hours. Most studies of web-based (34/45, 76%) and app-based (8/9, 89%) interventions found that the intervention group had substantially greater improvement for at least 1 outcome than the control group (eg, care as usual, waitlist, or active control). Of the 14 studies that investigated the relationship between engagement and efficacy, 9 (64%) found that increased engagement with digital interventions was significantly associated with improved participant outcomes. The limitations of this SLR include publication bias, which may overstate engagement and efficacy, and low participant diversity, which reduces the generalizability.

CONCLUSIONS

Patient adherence to and engagement with digital interventions for depression have been reported in the literature using various metrics. Arriving at more standardized ways of reporting adherence and engagement would enable more effective comparisons across different digital interventions, studies, and populations.

Unlock digital health promotion in LMICs to benefit the youth

As digital technologies such as smartphones and fitness bands become more ubiquitous, individuals can engage in self-monitoring and self-care, gaining greater control over their health trajectories along the life-course. These technologies appeal particularly to young people, who are more familiar with digital devices. How this digital transformation facilitates health promotion is therefore a topic of animated debate. However, most research to date focuses on the promise and peril of digital health promotion (DHP) in high-income settings, while DHP in low- and middle-income countries (LMICs) remain largely unexplored. This narrative review aims to fill this gap by critically examining key ethical challenges of implementing DHP in LMICs, with a focus on young people. In the existing literature, we identified potential impediments as well as enabling conditions. Aspects to consider in unlocking the potential of DHP include (1) addressing the digital divide and structural injustice in data-related practices; (2) engaging the target population and responding to their specific needs given their economic, cultural, and social contexts; (3) monitoring the quality and impact of DHP over time; and (4) improving responsible technology governance and its implementation. Addressing these concerns could result in meaningful health benefits for populations lacking access to more conventional healthcare resources.

Mapping Factors That Affect the Uptake of Digital Therapeutics Within Health Systems: Scoping Review

BACKGROUND

Digital therapeutics are patient-facing digital health interventions that can significantly alter the health care landscape. Despite digital therapeutics being used to successfully treat a range of conditions, their uptake in health systems remains limited. Understanding the full spectrum of uptake factors is essential to identify ways in which policy makers and providers can facilitate the adoption of effective digital therapeutics within a health system, as well as the steps developers can take to assist in the deployment of products.

OBJECTIVE

In this review, we aimed to map the most frequently discussed factors that determine the integration of digital therapeutics into health systems and practical use of digital therapeutics by patients and professionals.

METHODS

A scoping review was conducted in MEDLINE, Web of Science, Cochrane Database of Systematic Reviews, and Google Scholar. Relevant data were extracted and synthesized using a thematic analysis.

RESULTS

We identified 35,541 academic and 221 gray literature reports, with 244 (0.69%) included in the review, covering 35 countries. Overall, 85 factors that can impact the uptake of digital therapeutics were extracted and pooled into 5 categories: policy and system, patient characteristics, properties of digital therapeutics, characteristics of health professionals, and outcomes. The need for a regulatory framework for digital therapeutics was the most stated factor at the policy level. Demographic characteristics formed the most iterated patient-related factor, whereas digital literacy was considered the most important factor for health professionals. Among the properties of digital therapeutics, their interoperability across the broader health system was most emphasized. Finally, the ability to expand access to health care was the most frequently stated outcome measure.

CONCLUSIONS

The map of factors developed in this review offers a multistakeholder approach to recognizing the uptake factors of digital therapeutics in the health care pathway and provides an analytical tool for policy makers to assess their health system's readiness for digital therapeutics.

Technology Use During the COVID-19 Pandemic and the Ways in Which Technology Can Support Adolescent Well-being: Qualitative Exploratory Study

BACKGROUND

Most adolescents in the United States engage with technology. Social isolation and disruptions in activities owing to the COVID-19 pandemic have been linked to worsening mood and overall decreased well-being in adolescents. Although studies on the direct impacts of technology on adolescent well-being and mental health are inconclusive, there are both positive and negative associations depending on various factors, such as how the technology is used and by whom under certain settings.

OBJECTIVE

This study applied a strengths-based approach and focused on the potential to leverage technology to benefit adolescent well-being during a public health emergency. This study aimed to gain an initial and nuanced understanding of how adolescents have used technology to support their wellness throughout the pandemic. In addition, this study aimed to further motivate future large-scale research on how technology can be leveraged to benefit adolescent well-being.

METHODS

This study used an exploratory qualitative approach and was conducted in 2 phases. Phase 1 consisted of interviewing subject matter experts who work with adolescents to inform the creation of a semistructured interview for phase 2. Subject matter experts were recruited from existing connections with the Hemera Foundation and National Mental Health Innovation Center's (NMHIC) networks. In phase 2, adolescents (aged 14-18 years) were recruited nationally through social media (eg, Facebook, Twitter, LinkedIn, and Instagram) and via email to institutions (eg, high schools, hospitals, and health technology companies). High school and early college interns at NMHIC led the interviews via Zoom (Zoom Video Communications) with an NMHIC staff member on the call in an observational role. A total of 50 adolescents completed interviews regarding their technology use and its role during the COVID-19 pandemic.

RESULTS

The overarching themes identified from the data were COVID-19's impact on adolescent lives, positive role of technology, negative role of technology, and resiliency. Adolescents engaged with technology as a way to foster and maintain connection in a time of extended isolation. However, they also demonstrated an awareness of when technology was negatively affecting their well-being, prompting them to turn to other fulfilling activities that do not involve technology.

CONCLUSIONS

This study highlights how adolescents have used technology for well-being throughout the COVID-19 pandemic. Guidelines based on insights from the results of this study were created for adolescents, parents, caregivers, and teachers to provide recommendations for how adolescents can use technology to bolster overall well-being. Adolescents' ability to recognize when they need to engage in nontechnology-related activities and their ability to use technology to reach a larger community indicate that technology can be facilitated in positive ways to benefit their overall well-being. Future research should focus on increasing the generalizability of recommendations and identifying additional ways to leverage mental health technologies.

Healthcare Workers' Perspectives of mHealth Adoption Factors in the Developing World: Scoping Review

BACKGROUND

mHealth applications provide health practitioners with platforms that enable disease management, facilitate drug adherence, facilitate drug adherence, speed up diagnosis, monitor outbreaks, take and transfer medical images, and provide advice. Many developing economies are investing more in mobile telecommunication infrastructure than in road transport and electric power generation. Despite this, mHealth has not seen widespread adoption by healthcare workers in the developing world. This study reports a scoping review of factors that impact the adoption of mHealth by healthcare workers in the developing world, and based on these findings, a framework is developed for enhancing mHealth adoption by healthcare workers in the developing world.

METHODS

A structured literature search was performed using PubMed and Scopus, supplemented by hand searching. The searches were restricted to articles in English during the period January 2009 to December 2019 and relevant to the developing world that addressed: mobile phone use by healthcare workers and identified factors impacting the adoption of mHealth implementations. All authors reviewed selected papers, with final inclusion by consensus. Data abstraction was performed by all authors. The results were used to develop the conceptual framework using inductive iterative content analysis.

RESULTS AND DISCUSSION

Of 919 articles, 181 met the inclusion criteria and, following a review of full papers, 85 reported factors that impact (promote or impede) healthcare worker adoption of mHealth applications. These factors were categorised into 18 themes and, after continued iterative review and discussion were reduced to 7 primary categories (engagement/funding, infrastructure, training/technical support, healthcare workers' mobile-cost/ownership, system utility, motivation/staffing, patients' mobile-cost/ownership), with 17 sub-categories. These were used to design the proposed framework.

CONCLUSIONS

Successful adoption of mHealth by healthcare workers in the developing world will depend on addressing the factors identified in the proposed framework. They must be assessed in each specific setting prior to mHealth implementation. Application of the proposed framework will help shape future policy and practice of mHealth implementation in the developing world and increase adoption by health workers.

Thinking Aloud or Screaming Inside: Exploratory Study of Sentiment Around Work

Background

Millions of workers experience work-related ill health every year. The loss of working days often accounts for poor well-being because of discomfort and stress caused by the workplace. The ongoing pandemic and postpandemic shift in socioeconomic and work culture can continue to contribute to adverse work-related sentiments. Critically investigating state-of-the-art technologies, this study identifies the research gaps in recognizing workers’ need for well-being support, and we aspire to understand how such evidence can be collected to transform the workforce and workplace.

Objective

Building on recent advances in sentiment analysis, this study aims to closely examine the potential of social media as a tool to assess workers’ emotions toward the workplace.

Methods

This study collected a large Twitter data set comprising both pandemic and prepandemic tweets facilitated through a human-in-the-loop approach in combination with unsupervised learning and meta-heuristic optimization algorithms. The raw data preprocessed through natural language processing techniques were assessed using a generative statistical model and a lexicon-assisted rule-based model, mapping lexical features to emotion intensities. This study also assigned human annotations and performed work-related sentiment analysis.

Results

A mixed methods approach, including topic modeling using latent Dirichlet allocation, identified the top topics from the corpus to understand how Twitter users engage with discussions on work-related sentiments. The sorted aspects were portrayed through overlapped clusters and low intertopic distances. However, further analysis comprising the Valence Aware Dictionary for Sentiment Reasoner suggested a smaller number of negative polarities among diverse subjects. By contrast, the human-annotated data set created for this study contained more negative sentiments. In this study, sentimental juxtaposition revealed through the labeled data set was supported by the n-gram analysis as well.

Conclusions

The developed data set demonstrates that work-related sentiments are projected onto social media, which offers an opportunity to better support workers. The infrastructure of the workplace, the nature of the work, the culture within the industry and the particular organization, employers, colleagues, person-specific habits, and upbringing all play a part in the health and well-being of any working adult who contributes to the productivity of the organization. Therefore, understanding the origin and influence of the complex underlying factors both qualitatively and quantitatively can inform the next generation of workplaces to drive positive change by relying on empirically grounded evidence. Therefore, this study outlines a comprehensive approach to capture deeper insights into work-related health.

Success Factors for Scaling Up the Adoption of Digital Therapeutics Towards the Realization of P5 Medicine

Introduction

Digital therapeutics (DTx) can be a valuable contribution to the successful scale up of P5 Medicine (personalized, participatory, predictive, preventive, precision medicine) as they offer powerful means of delivering personalization and active patient participation in disease self-management. We investigated how the approval and adoption of DTx within health systems have been approached in five selected European countries and regions, with a view to proposing success factors scaling up their adoption.

Methodology

Preliminary research established best countries or region candidates as being Germany, UK, France, Belgium, and the Spanish Region of Catalonia. The research was informed by a literature review, interviews with public bodies and industry, and a multi-stakeholder workshop to validate the findings and fill in existing gaps.

Results

To authorize the use of digital technologies, the countries and regions passed legislation and developed policy instruments, appointed bodies to assess and certify the products and formalized mechanisms for permitting reimbursement. While DTx is not a commonly used nomenclature, there are digital health technology types defined that have similar requirements as DTx. Assessment and certification frameworks are usually built around the Medical Device Regulation with additional criteria. Reimbursement considerations often observe reimbursement of therapeutic devices and/or medicines. To be integrated into reimbursement systems, countries require manufacturers to demonstrate clinical value and cost-effectiveness. As there are currently very few DTx approved in practice, there is resistance toward clinical acceptance and organizational change, and change management is highly needed to integrate DTx into healthcare systems. The integration and secondary use of DTx data is not encountered in daily practice. Although some enablers exist, there remain technical and legal barriers.

Discussion

DTx strategies should be considered as an integral part of digital health strategies and legislation, and specific DTx pathways with clear and transparent assessment and guidelines that balance regulation and innovation should be defined. To help manufacturers, countries should recommend and list methods that are widely accepted and ensure scientific robustness, aligned to the MDR requirements to support transfer of relevant and comparable data across countries. To facilitate rapid uptake of innovation, countries should add flexibility to the framework by allowing temporary market authorization to enable data collection that can support the clinical and socio-economic evaluation and data gathering phase. Certification should trigger rapid price setting and reimbursement mechanisms, and dynamic ways to adjust price and reimbursement levels in time should be established. Relevant stakeholders should be approached on the potential impacts of DTx through transparent communication and change management strategies should be considered. These findings should be validated with a wider range of stakeholders.

The Impact of Digital Therapeutics on Current Health Technology Assessment Frameworks

Historically healthcare has been delivered offline (e.g., physician consultations, mental health counseling services). It is widely understood that healthcare lags behind other industries (e.g., financial, transportation) whom have already incorporated digital technologies in their workflow. However, this is changing with the recent emergence of digital therapeutics (DTx) helping to bring healthcare services online. To promote adoption, healthcare providers need to be educated regarding the digital therapy to allow for proper prescribing. But of equal importance is affordability and many countries rely on reimbursement support from the government and insurance agencies. Here we briefly explore how national reimbursement agencies or non-profits across six countries (Canada, United States of America, United Kingdom, Germany, France, Australia) handle DTx submissions and describe the potential impact of digital therapeutics on current health technology assessment (HTA) frameworks. A targeted review to identify HTA submissions and guidelines from national reimbursement agencies or non-profits was conducted. We reviewed guidelines from the Institute for Clinical and Economic Review (ICER) in the USA, the Canadian Agency for Drugs and Technologies in Health (CADTH) in Canada, the National Institute for Health and Care Excellence (NICE) in the United Kingdom (UK), the Institute for Quality and Efficiency in Health Care (IQWIG) in Germany, Haute Autorité de Santé (HAS) in France, and the Pharmaceutical Benefits Advisory Committee (PBAC) in Australia. Our review identified one set of guidelines developed by NICE in the UK. The guidelines by NICE outlined an evidence standards framework for digital health technologies (DHT). Depending on the organizational impact, financial commitment, and economic risk for the payer, different economic analyses are required. Economic analyses levels are separated into 3 categories, basic, low financial commitment, and high financial commitment. All economic analyses levels require a budget impact analysis. A cost-utility analysis is recommended for DHTs categorized in the high financial commitment category. Whereas, for DHTs that are in the low financial commitment category, a cost-consequence analysis is typically recommended. No HTA guidelines for DTx submissions were identified for the remaining countries (Canada, USA, Germany, France, and Australia)

A Patient-Centered Framework for Measuring the Economic Value of the Clinical Benefits of Digital Health Apps: Theoretical Modeling

BACKGROUND

As digital health tools such as smartphone apps evolve and enter clinical use, questions regarding their value must be addressed. Although there are scarce generalizable data on the value of health apps given their nascency and diverse use cases, it is possible to estimate the economic value of the clinical improvement they bring to patients using a quality-adjusted life-year (QALY)-based approach and generalized values from existing literature.

OBJECTIVE

This paper aims to provide a patient-centered framework for assessing the economic value of the clinical benefits delivered by digital health apps.

METHODS

We proposed a model based upon 5 levers: country-specific monetary value of a QALY, QALYs lost due to the condition, engagement rate of app users, average effect size of the app's health impact, and duration of the app's impact before remission.

RESULTS

Using 2 digital health apps from the United States and United Kingdom as examples, we explored how this model could generate country-specific estimates of the economic value of the clinical benefits of health apps.

CONCLUSIONS

This new framework can help drive research priorities for digital health by elucidating the factors that influence the economic value.

Health Information Technology Resources to Support Measurement-Based Care

To increase utilization and convert health information technology into measurement-based care, this article highlights 4 criteria and actions that help distinguish successful mobile mental health interventions: first, interest: draw on pervading interest in mobile mental health; second, engagement: offer personalized design features and recommendations; third, specificity and simplicity: provide simple, specific, and timely feedback; fourth, support: incorporate support from peers, family and friends, and caregivers.

Leveraging Implementation Science to Understand Factors Influencing Sustained Use of Mental Health Apps: a Narrative Review

Mental health (MH) smartphone applications (apps), which can aid in self-management of conditions such as depression and anxiety, have demonstrated dramatic growth over the past decade. However, their effectiveness and potential for sustained use remain uncertain. This narrative review leverages implementation science theory to explore factors influencing MH app uptake. The review is guided by the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and discusses the role of the innovation, its recipients, context, and facilitation in influencing successful implementation of MH apps. The review highlights critical literature published between 2015 and 2020 with a focus on depression and anxiety apps. Sources were identified via PubMed, Google Scholar, and Twitter using a range of keywords pertaining to MH apps. Findings suggest that for apps to be successful, they must be advantageous over alternative tools, relatively easy to navigate, and aligned with users’ needs, skills, and resources. Significantly more attention must be paid to the complex contexts in which MH app implementation is occurring in order to refine facilitation strategies. The evidence base is still uncertain regarding the effectiveness and usability of MH apps, and much can be learned from the apps we use daily; namely, simpler is better and plans to integrate full behavioral treatments into smartphone form may be misguided. Non-traditional funding mechanisms that are nimble, responsive, and encouraging of industry partnerships will be necessary to move the course of MH app development in the right direction.

The digital clinic: Implementing technology and augmenting care for mental health

Increasing both access to and quality of mental healthcare is a global priority. One solution is to integrate technologies such as smartphone apps and sensors directly into care. Acknowledging many prior attempts and barriers, we introduce the Digital Clinic which is an already functioning clinic using smartphone apps to augment and extend care today at Beth Israel Deaconess Medical Center (BIDMC) in Boston, Massachusetts. In this piece, we outline the theoretical foundation of the Digital Clinic and its emphasis on the therapeutic alliance, measurement-based care, and shared decision making. We explore both workflow and engagement challenges as well as solutions including a new care team member, the Digital Navigator, and the customization of technology. Acknowledging that the Digital Clinic is an evolving program, we offer details on our implementation in order to allow others to replicate, expand on, and improve these initial efforts.

Acceptability and Utility of an Open-Access, Online Single-Session Intervention Platform for Adolescent Mental Health

BACKGROUND

Many youths with mental health needs are unable to access care. Single-session interventions (SSIs) have helped reduce youth psychopathology across multiple trials, promising to broaden access to effective, low-intensity supports. Online, self-guided SSIs may be uniquely scalable, particularly if they are freely available for as-needed use. However, the acceptability of online SSI and their efficacy have remained unexamined outside of controlled trials, and their practical utility is poorly understood.

OBJECTIVE

We evaluated the perceived acceptability and proximal effects of Project YES (Youth Empowerment & Support), an open-access platform offering three online SSIs for youth internalizing distress.

METHODS

After selecting one of three SSIs to complete, participants (ages 11-17 years) reported pre- and post-SSI levels of clinically relevant outcomes that SSIs may target (eg, hopelessness, self-hate) and perceived SSI acceptability. User-pattern variables, demographics, and depressive symptoms were collected to characterize youths engaging with YES.

RESULTS

From September 2019 through March 2020, 694 youths accessed YES, 539 began, and 187 completed a 30-minute, self-guided SSI. SSI completers reported clinically elevated depressive symptoms, on average, and were diverse on several dimensions (53.75% non-white; 78.10% female; 43.23% sexual minorities). Regardless of SSI selection, completers reported pre- to post-program reductions in hopelessness (dav=0.53; dz=0.71), self-hate (dav=0.32; dz=0.61), perceived control (dav=0.60; dz=0.72) and agency (dav=0.39; dz=0.50). Youths rated all SSIs as acceptable (eg, enjoyable, likely to help peers).

CONCLUSIONS

Results support the perceived acceptability and utility of open-access, free-of-charge SSIs for youth experiencing internalizing distress.

TRIAL REGISTRATION

Open Science Framework; osf.io/e52p3.