The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality

As the COVID-19 pandemic has largely increased the utilization of telehealth, mobile mental health technologies - such as smartphone apps, vir-tual reality, chatbots, and social media - have also gained attention. These digital health technologies offer the potential of accessible and scalable interventions that can augment traditional care. In this paper, we provide a comprehensive update on the overall field of digital psychiatry, covering three areas. First, we outline the relevance of recent technological advances to mental health research and care, by detailing how smartphones, social media, artificial intelligence and virtual reality present new opportunities for "digital phenotyping" and remote intervention. Second, we review the current evidence for the use of these new technological approaches across different mental health contexts, covering their emerging efficacy in self-management of psychological well-being and early intervention, along with more nascent research supporting their use in clinical management of long-term psychiatric conditions - including major depression; anxiety, bipolar and psychotic disorders; and eating and substance use disorders - as well as in child and adolescent mental health care. Third, we discuss the most pressing challenges and opportunities towards real-world implementation, using the Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework to explain how the innovations themselves, the recipients of these innovations, and the context surrounding innovations all must be considered to facilitate their adoption and use in mental health care systems. We conclude that the new technological capabilities of smartphones, artificial intelligence, social media and virtual reality are already changing mental health care in unforeseen and exciting ways, each accompanied by an early but promising evidence base. We point out that further efforts towards strengthening implementation are needed, and detail the key issues at the patient, provider and policy levels which must now be addressed for digital health technologies to truly improve mental health research and treatment in the future.

Interest and readiness for digital mental health in coordinate specialty care for early course psychosis: A survey study of 42 programs in 30 states

AIM

As in-person healthcare services become suspended due to the COVID-19 pandemic, the need for digital technologies to augment early course psychosis care has risen. Although technology offers many benefits including increasing access to care, the advantages of such tools are restricted by their implementation into the program. The goal of this study is to better understand the current usage of technology, clinical needs, and digital literacy in Coordinated Specialty Care (CSC) programs.

METHODS

An online survey of CSC staff and clinicians assessed their attitudes, preparedness, and comfort with technology implementation into care.

RESULTS

In total, 42 programs from 30 states responded to the web-based survey. Of the six key roles of CSC, the role believed to be most capable for technology to augment was Family Education and Support by 90% (38/42) of participants. Eighty-two per cent (34/42) of clinicians and staff felt that they would benefit from and have interest in receiving digital skills training (41% [17/42] strongly agree, 41% [17/42] agreed). Evaluation of respondent sentiments towards technology revealed that 70 per cent (29/42) ("agree", or "strongly agree") believe that technology can integrate into care easily.

CONCLUSIONS

Survey responses show overall positive sentiments towards technology implementation in early psychosis care. Findings also reveal that the digital tool would be better sustained if CSC staff and clinicians received digital skills education. This survey demonstrates that technology can augment early psychosis care while improving quality of care and expanding access to care.

Use of smartphones, mobile apps and wearables for health promotion by people with anxiety or depression: An analysis of a nationally representative survey data

People with mental illness have increased cardiovascular risk factors, which contributes significantly to mortality in this population. Digital interventions have emerged as promising models to promote physical health, although their potential for use in mental health populations is relatively unexplored. We examined the potential for using digital tools for health promotion by people with common mental disorders like anxiety or depression. Using data from the 2019 edition of the Health Information National Trends Survey (HINTS 5), we evaluated differences between individuals with self-reported history of diagnosed depression/anxiety and the general population with respect to ownership, usage, and perceived usefulness of digital tools for managing their health. Overall, individuals with anxiety or depression were as likely as the general population to use digital devices for their care. Those with anxiety or depression who had health apps were more likely to report intentions to lose weight than those without health apps. Significant sociodemographic predictors of digital tools usage included gender, age, income, and education level. People with anxiety or depression own and use digital health tools at similarly high rates to the general population, suggesting that these tools present a novel opportunity for health promotion among people with these disorders.

Using objective clinical metrics to understand the relationship between the electronic health record and physician well-being: observational pilot study

BACKGROUND

Electronic health records (EHRs) are a significant contributor to physicians' low satisfaction, reduced engagement and increased burnout. Yet the majority of evidence around EHR and physician harms is based on self-reported screen time, which may both over- and underreport actual exposure.

AIMS

The purpose of this study was to examine how objective EHR use correlates with physician well-being and to develop preliminary recommendations for well-being-based EHR interventions.

METHOD

Prior to the onset of COVID-19, psychiatry residents and attending physicians working in an out-patient clinic at an academic medical centre provided consent for access to EHR-usage logs and completed a well-being assessment made up of three scales: the Maslach Burnout Inventory, the Urecht Work Engagement Scale and the Professional Quality of Life Measure. Survey responses and objective EHR data were analysed with descriptive statistics.

RESULTS

Responses were obtained from 20 psychiatry residents (total eligible residents n = 27; 74% participation) and 16 clinical faculty members (total eligible faculty n = 24; 67% participation) with an overall response rate of 71% (total eligible residents and faculty n = 51 and total residents and faculty who completed survey n = 36). Moderate correlations for multiple well-being domains emerged in analysis for all participants, especially around the time spent per note and patient visits closed the same day.

CONCLUSIONS

EHR-usage logs represent an objective tool in the evaluation and enhancement of physician well-being. Results from our pilot study suggest that metrics for note writing efficiency and closing patient visits the same day are associated with physician well-being. These metrics will be important to study in ongoing efforts involving well-being-based EHR interventions.

PERSPECTIVE: The Digital Health App Policy Landscape: Regulatory Gaps and Choices Through the Lens of Mental Health

BACKGROUND

Interest in and use of mental health apps have grown over the past decade, and now further with the COVID-19 pandemic. Digital mental health offers potential to increase access to care, but tangible risks around safety and poor efficacy remain common.

METHODS

We conduct a select analysis of U.S. and international published evidence, government websites, grey literature, and media outlets. We present the marked discordance around digital mental health policy, as these frameworks grapple with the challenges of regulating in this sphere.

RESULTS

Across the world, there is no consensus around evaluation with countries piloting or proposing different models. Common barriers include the defining the scope and risk of health apps, creating processes able to update evaluation with software updates, lacking better data to inform evaluation, and educating users to the risks and benefits.

DISCUSSION

We propose four next steps for guiding any future policy: (i) clear clarification of the categorical status of mental health apps; (ii) objective methodology for assessing apps on a premarket basis which does not solely rely on self-reporting; (iii) well-designed, detailed procedures for iterative post-market app review; (iv) clinician and patient education which empowers users to make smart mental health app choices.

Mental Health App Evaluation: Updating the American Psychiatric Association's Framework Through a Stakeholder-Engaged Workshop

The app evaluation framework of the American Psychiatric Association (APA) has emerged as an adaptable tool for those seeking to navigate the ever-growing space of mental health apps. The authors describe a meeting convened in December 2019 to refine the APA framework. The expert panel comprised 16 individuals across health care fields, with representation from psychiatry, psychology, social work, nursing, clinical informatics, peer support specialists, and individuals with lived mental health experience. This meeting resulted in an update to the APA framework with the addition of clearer question descriptions and the release of an eight-question screener that may be useful in clinical settings.

Cross cultural and global uses of a digital mental health app: results of focus groups with clinicians, patients and family members in India and the United States

BACKGROUND

Despite significant advancements in healthcare technology, digital health solutions - especially those for serious mental illnesses - continue to fall short of their potential across both clinical practice and efficacy. The utility and impact of medicine, including digital medicine, hinges on relationships, trust, and engagement, particularly in the field of mental health. This paper details results from Phase 1 of a two-part study that seeks to engage people with schizophrenia, their family members, and clinicians in co-designing a digital mental health platform for use across different cultures and contexts in the United States and India.

METHODS

Each site interviewed a mix of clinicians, patients, and their family members in focus groups (n = 20) of two to six participants. Open-ended questions and discussions inquired about their own smartphone use and, after a demonstration of the mindLAMP platform, specific feedback on the app's utility, design, and functionality.

RESULTS

Our results based on thematic analysis indicate three common themes: increased use and interest in technology during coronavirus disease 2019 (COVID-19), concerns over how data are used and shared, and a desire for concurrent human interaction to support app engagement.

CONCLUSION

People with schizophrenia, their family members, and clinicians are open to integrating technology into treatment to better understand their condition and help inform treatment. However, app engagement is dependent on technology that is complementary - not substitutive - of therapeutic care from a clinician.

Consensus Statement on Ethical & Safety Practices for Conducting Digital Monitoring Studies with People at Risk of Suicide and Related Behaviors

Objective

Digital monitoring technologies (e.g., smart-phones and wearable devices) provide unprecedented opportunities to study potentially harmful behaviors such as suicide, violence, and alcohol/substance use in real-time. The use of these new technologies has the potential to significantly advance the understanding, prediction, and prevention of these behaviors. However, such technologies also introduce myriad ethical and safety concerns, such as deciding when and how to intervene if a participant's responses indicate elevated risk during the study?

Methods

We used a modified Delphi process to develop a consensus among a diverse panel of experts on the ethical and safety practices for conducting digital monitoring studies with those at risk for suicide and related behaviors. Twenty-four experts including scientists, clinicians, ethicists, legal experts, and those with lived experience provided input into an iterative, multi-stage survey, and discussion process.

Results

Consensus was reached on multiple aspects of such studies, including: inclusion criteria, informed consent elements, technical and safety procedures, data review practices during the study, responding to various levels of participant risk in real-time, and data and safety monitoring.

Conclusions

This consensus statement provides guidance for researchers, funding agencies, and institutional review boards regarding expert views on current best practices for conducting digital monitoring studies with those at risk for suicide-with relevance to the study of a range of other potentially harmful behaviors (e.g., alcohol/substance use and violence). This statement also highlights areas in which more data are needed before consensus can be reached regarding best ethical and safety practices for digital monitoring studies.

Digital mHealth Interventions for Employees: Systematic Review and Meta-Analysis of Their Effects on Workplace Outcomes

OBJECTIVES

To justify the capital investment, employers require proof of benefit of digital mHealth beyond symptomatic improvement.

METHODS

A systematic review and meta-analysis were conducted to identify studies investigating digital mHealth interventions for employees and their effects on workplace outcomes.

RESULTS

We identified 28 eligible studies, (8023 employees) comparing digital mHealth interventions to controls. Small significant effects at postintervention in engagement (g = 0.19), and productivity (g = 0.16) were found. Sustained effects were observed, engagement (g = 0.24) and productivity (g = 0.20). There was a wide range of study heterogeneity (I2 = 16% to 94%).

CONCLUSION

In RCTs digital mHealth interventions demonstrate small, potentially sustained efficacy on employee's engagement and productivity. Similar small yet non-significant effect sizes were seen for absenteeism and presenteeism. This supports the need to find ways of enabling employers to deliver these low-cost digital mHealth interventions that can help improve employee's mental health.

Assessing mental health apps marketplaces with objective metrics from 29,190 data points from 278 apps

OBJECTIVE

Utilizing a standard framework that may help clinicians and patients to identify relevant mental health apps, we sought to gain a comprehensive picture of the space by searching for, downloading, and reviewing 278 mental health apps from both the iOS and Android stores.

METHODS

278 mental health apps from the Apple iOS store and Google Play store were downloaded and reviewed in a standardized manner by trained app raters using a validated framework. Apps were evaluated with this framework comprising 105 questions and covering app origin and accessibility, privacy and security, inputs and outputs, clinical foundation, features and engagement style, and interoperability.

RESULTS

Our results confirm that app stars and downloads-even for the most popular apps by these metrics-did not correlate with more clinically relevant metrics related to privacy/security, effectiveness, and engagement. Most mental health apps offer similar functionality, with 16.5% offering both mood tracking and journaling and 7% offering psychoeducation, deep breathing, mindfulness, journaling, and mood tracking. Only 36.4% of apps were updated with a 100-day window, and 7.5% of apps had not been updated in four years.

CONCLUSION

Current app marketplace metrics commonly used to evaluate apps do not offer an accurate representation of individual apps or a comprehensive overview of the entire space. The majority of apps overlap in terms of features offered, with many domains and other features not well represented. Selecting an appropriate app continues to require personal matching given no clear trends or guidance offered by quantitative metrics alone.

Evolution of Telehealth in Ambulatory Psychiatry: A One Year Perspective

Under the direction of the leadership at our medical center, beginning March 16, 2020, all non-urgent in-person ambulatory visits were to be limited, either rescheduled or performed virtually, as the hospital braced for the surge of COVID-19 patients. The outpatient psychiatry department quickly transitioned to a telehealth model. This paper details our actions taken to implement this plan, reflections on our experience one year later, and areas for future study. On the one-year anniversary of our department implementing remote care practices around COVID-19, we reflect on lessons learned in the transition and maintenance phases of the last 12 months. Reflecting on next steps as a face-to-face care becomes more possible, we share three core factors in our decision making and research opportunities to better quantify the impact of telehealth in 2021 and beyond.

Banbury Forum Consensus Statement on the Path Forward for Digital Mental Health Treatment

A major obstacle to mental health treatment for many Americans is accessibility: the United States faces a shortage of mental health providers, resulting in federally designated shortage areas. Although digital mental health treatments (DMHTs) are effective interventions for common mental disorders, they have not been widely adopted by the U.S. health care system. National and international expert stakeholders representing health care organizations, insurance companies and payers, employers, patients, researchers, policy makers, health economists, and DMHT companies and the investment community attended two Banbury Forum meetings. The Banbury Forum reviewed the evidence for DMHTs, identified the challenges to successful and sustainable implementation, investigated the factors that contributed to more successful implementation internationally, and developed the following recommendations: guided DMHTs should be offered to all patients experiencing common mental disorders, DMHT products and services should be reimbursable to support integration into the U.S. health care landscape, and an evidence standards framework should be developed to support decision makers in evaluating DMHTs.

Case studies from the digital clinic: integrating digital phenotyping and clinical practice into today's world

The following case series provides several examples from the Digital Clinic, an outpatient mental health program which uses smartphone technology to augment traditional mental health care. The themes highlighted in this piece, expanding emotional-awareness, symptom tracking, and medication management, provide real-clinical examples of how the Digital Clinic offered remote mental health care to a diverse group of people. Furthermore, the following piece demonstrates to practicing clinicians how digital technologies, like smartphone apps, can diversify methods of clinical engagement, assist with collecting health metrics in a safe and ethical manner, and promote person centred care. With the COVID-19 pandemic forcing re-evaluation of how mental health services are provided, it is critical to ensure that digitally infused systems of care, like the Digital Clinic, are effective, accessible, and scalable.

Are Mental Health Apps Adequately Equipped to Handle Users in Crisis?

Background: Mental health (MH) apps are growing in popularity. While MH apps may be helpful, less is known about how crises such as suicidal ideation are addressed in apps. Aims: We examined the proportion of MH apps that contained language mentioning suicide or suicidal ideation and how apps communicated these policies and directed users to MH resources through app content, terms of services, and privacy policies. Method: We chose apps using an Internet search of "top mental health apps," similar to how a user might find an app, and extracted information about how crisis language was presented in these apps. Results: We found that crisis language was inconsistent among apps. Overall, 35% of apps provided crisis-specific resources in their app interface and 10.5% contained crisis language in terms of service or privacy policies. Limitations: This study employed a nonsystematic approach to sampling apps, and therefore the findings may not broadly represent apps for MH. Conclusion: To address the inconsistency of crisis resources, crisis language should be included as part of app evaluation frameworks, and internationally accessible, vetted resources should be provided to app users.

Digital Clinics and Mobile Technology Implementation for Mental Health Care

PURPOSE OF REVIEW

Interest in digital mental health, especially smartphone apps, has expanded in light of limited access to mental health services and the need for remote care during COVID-19. Digital clinics, in which apps are blended into routine care, offer a potential solution to common implementation challenges including low user engagement and lack of clinical integration of apps.

RECENT FINDINGS

While the number of mental health apps available in commercial marketplaces continues to rise, there are few examples of successful implementation of these apps into care settings. We review one example of a digital clinic created within an academic medical center and another within the Department of Veterans Affairs. We then discuss how implementation science can inform new efforts to effectively integrate mental health technologies across diverse use cases. Integrating mental health apps into care settings is feasible but requires careful attention to multiple domains that will influence implementation success, including characteristics of the innovation (e.g., utility and complexity of the app), the recipients of the technology (e.g., patients and clinicians), and context (e.g., healthcare system buy-in, reimbursement, and regulatory policies). Examples of effective facilitation strategies that can be utilized to improve implementation efforts include co-production of technology involving all end users, specialized trainings for staff and patients, creation of new team members to aid in app usage (e.g., digital navigators), and re-design of clinical workflows.

Using apps for bipolar disorder - An online survey of healthcare provider perspectives and practices

BACKGROUND

Smartphone apps have recognized potential for improving access to evidence-based care in the treatment of bipolar disorder (BD). Healthcare providers are well-positioned to play a role in guiding patients to access safe, evidence-supported, and trustworthy apps. However, little is known about whether and how clinicians use apps with people with BD: understanding practices and attitudes of healthcare providers is essential to support the implementation of mHealth interventions in a real-world context.

METHODS

A web-based survey was used to explore clinicians' attitudes towards, and use of apps when working with people with BD. Descriptive statistics were used to summarize quantitative findings. Free text responses were investigated using qualitative content analysis.

RESULTS

Eighty healthcare providers completed the survey. Approximately half of the respondents reported discussing or recommending apps in clinical practice with BD populations. Recommended apps were most commonly related to mood, sleep, and exercise. Barriers to discussing apps included a lack of healthcare provider knowledge/confidence, concerns about patients' ability to access apps, and beliefs that patients lacked interest in apps.

CONCLUSION

Although research suggests that people with BD are interested in using apps, uptake of such technology among clinicians is more limited. A lack of clinician knowledge regarding apps, combined with concerns about the digital divide and patient interest, may account for this relatively limited integration of apps into the management of BD. These findings emphasise the importance of considering the information needs of healthcare providers when planning dissemination strategies for app-based interventions for BD.

Smartphone ownership and use of mental health applications by psychiatric inpatients

Little is known about the use of mental health smartphone applications during the greatest period of vulnerability - immediately following discharge from a psychiatric inpatient unit. Currently, no data are available regarding smartphone ownership or technology literacy of individuals who receive inpatient psychiatric treatment. The goal of this study was to determine psychiatric inpatients' smartphone ownership, current uses of, and interest in utilizing apps to aid in mental health treatment after discharge. A single time point self-report survey was given to patients prior to discharge from a psychiatric inpatient unit at a major academic hospital in a metropolitan area of the United States. Of the 101 survey respondents, 82.8% indicated that they own a smartphone, and over 70% indicated that they use smartphone apps, can access the internet from their phones, and use social media. While only 25.3% reported that they currently use a mental health app, a majority of respondents (53.2%) expressed interest in using such apps in the future, and almost 60% would use those apps to track their mental health. Our data suggest that there is significant untapped potential for utilizing smartphone applications for psychiatric monitoring and treatment following discharge from an inpatient psychiatric unit.

Preparing Patients and Clinicians for Open Notes in Mental Health: Qualitative Inquiry of International Experts

BACKGROUND

In a growing number of countries worldwide, clinicians are sharing mental health notes, including psychiatry and psychotherapy notes, with patients.

OBJECTIVE

The aim of this study is to solicit the views of experts on provider policies and patient and clinician training or guidance in relation to open notes in mental health care.

METHODS

In August 2020, we conducted a web-based survey of international experts on the practice of sharing mental health notes. Experts were identified as informaticians, clinicians, chief medical information officers, patients, and patient advocates who have extensive research knowledge about or experience of providing access to or having access to mental health notes. This study undertook a qualitative descriptive analysis of experts' written responses and opinions (comments) to open-ended questions on training clinicians, patient guidance, and suggested policy regulations.

RESULTS

A total of 70 of 92 (76%) experts from 6 countries responded. We identified four major themes related to opening mental health notes to patients: the need for clarity about provider policies on exemptions, providing patients with basic information about open notes, clinician training in writing mental health notes, and managing patient-clinician disagreement about mental health notes.

CONCLUSIONS

This study provides timely information on policy and training recommendations derived from a wide range of international experts on how to prepare clinicians and patients for open notes in mental health. The results of this study point to the need for further refinement of exemption policies in relation to sharing mental health notes, guidance for patients, and curricular changes for students and clinicians as well as improvements aimed at enhancing patient and clinician-friendly portal design.

Determining sample size and length of follow-up for smartphone-based digital phenotyping studies

OBJECTIVE

Studies that use patient smartphones to collect ecological momentary assessment and sensor data, an approach frequently referred to as digital phenotyping, have increased in popularity in recent years. There is a lack of formal guidelines for the design of new digital phenotyping studies so that they are powered to detect both population-level longitudinal associations as well as individual-level change points in multivariate time series. In particular, determining the appropriate balance of sample size relative to the targeted duration of follow-up is a challenge.

MATERIALS AND METHODS

We used data from 2 prior smartphone-based digital phenotyping studies to provide reasonable ranges of effect size and parameters. We considered likelihood ratio tests for generalized linear mixed models as well as for change point detection of individual-level multivariate time series.

RESULTS

We propose a joint procedure for sequentially calculating first an appropriate length of follow-up and then a necessary minimum sample size required to provide adequate power. In addition, we developed an accompanying accessible sample size and power calculator.

DISCUSSION

The 2-parameter problem of identifying both an appropriate sample size and duration of follow-up for a longitudinal study requires the simultaneous consideration of 2 analysis methods during study design.

CONCLUSION

The temporally dense longitudinal data collected by digital phenotyping studies may warrant a variety of applicable analysis choices. Our use of generalized linear mixed models as well as change point detection to guide sample size and study duration calculations provide a tool to effectively power new digital phenotyping studies.

Patient Access to Mental Health Notes: Motivating Evidence-Informed Ethical Guidelines

ABSTRACT

In the last decade, many health organizations have embarked on a revolution in clinical communication. Using electronic devices, patients can now gain rapid access to their online clinical records. Legally, patients in many countries already have the right to obtain copies of their health records; however, the practice known as "open notes" is different. Via secure online health portals, patients are now able to access their test results, lists of medications, and the very words that clinicians write about them. Open notes are growing with most patients in the Nordic countries already offered access to their full electronic record. From April 2021, a new federal ruling in the United States mandates-with few exemptions-that providers offer patients access to their online notes (Office of the National Coordinator for Health Information Technology, Department of Health and Human Services, Available at: https://www.govinfo.gov/content/pkg/FR-2019-03-04/pdf/2019-02224.pdf#page=99). Against these policy changes, only limited attention has been paid to the ethical question about whether patients with mental health conditions should access their notes, as mentioned in the articles by Strudwick, Yeung, and Gratzer (Front Psychiatry 10:917, 2019) and Blease, O'Neill, Walker, Hägglund, and Torous (Lancet Psychiatry 7:924-925, 2020). In this article, our goal is to motivate further inquiry into opening mental health notes to patients, particularly among persons with serious mental illness and those accessing psychological treatments. Using biomedical ethical principles to frame our discussion, we identify key empirical questions that must be pursued to inform ethical practice guidelines.

Changes to the Psychiatric Chatbot Landscape: A Systematic Review of Conversational Agents in Serious Mental Illness: Changements du paysage psychiatrique des chatbots: une revue systématique des agents conversationnels dans la maladie mentale sérieuse

OBJECTIVE

The need for digital tools in mental health is clear, with insufficient access to mental health services. Conversational agents, also known as chatbots or voice assistants, are digital tools capable of holding natural language conversations. Since our last review in 2018, many new conversational agents and research have emerged, and we aimed to reassess the conversational agent landscape in this updated systematic review.

METHODS

A systematic literature search was conducted in January 2020 using the PubMed, Embase, PsychINFO, and Cochrane databases. Studies included were those that involved a conversational agent assessing serious mental illness: major depressive disorder, schizophrenia spectrum disorders, bipolar disorder, or anxiety disorder.

RESULTS

Of the 247 references identified from selected databases, 7 studies met inclusion criteria. Overall, there were generally positive experiences with conversational agents in regard to diagnostic quality, therapeutic efficacy, or acceptability. There continues to be, however, a lack of standard measures that allow ease of comparison of studies in this space. There were several populations that lacked representation such as the pediatric population and those with schizophrenia or bipolar disorder. While comparing 2018 to 2020 research offers useful insight into changes and growth, the high degree of heterogeneity between all studies in this space makes direct comparison challenging.

CONCLUSIONS

This review revealed few but generally positive outcomes regarding conversational agents' diagnostic quality, therapeutic efficacy, and acceptability, which may augment mental health care. Despite this increase in research activity, there continues to be a lack of standard measures for evaluating conversational agents as well as several neglected populations. We recommend that the standardization of conversational agent studies should include patient adherence and engagement, therapeutic efficacy, and clinician perspectives.