Perceived Drivers and Barriers to the Adoption of eMental Health by Psychologists: The Construction of the Levels of Adoption of eMental Health Model

Opportunities and challenges in leveraging digital technology for mental health system strengthening: a systematic review to inform interventions in the United Arab Emirates

Digital technology offers scalable, real-time interventions for mental health promotion and treatment. This systematic review explores the opportunities and challenges associated with the use of digital technology in mental health, with a focus on informing mental health system strengthening interventions in the United Arab Emirates (UAE). Following PRISMA guidelines, a systematic search of databases was conducted up to August 2023 and identified a total of 8479 citations of which 114 studies were included in the qualitative analysis. The included studies encompass diverse digital interventions, platforms, and modalities used across various mental health conditions. The review identifies feasible, acceptable, and efficacious interventions, ranging from telehealth and mobile apps to virtual reality and machine learning models. Opportunities for improving access to care, reducing patients' transfers, and utilizing real-world interaction data for symptom monitoring are highlighted. However, challenges such as digital exclusion, privacy concerns, and potential service replacement caution policymakers. This study serves as a valuable evidence base for policymakers and mental health stakeholders in the UAE to navigate the integration of digital technology in mental health services effectively.

Remote mental health services during the COVID-19 pandemic in Finland and the Netherlands: a qualitative study

BACKGROUND

The COVID-19 pandemic has increased worldwide mental health conditions, substantially affecting the demand and provision of mental health services. To continue services and safeguard the health and well-being of mental health service users, service providers have responded to the pandemic with the adoption of remote services. The objective of our study was to identify and compare the promoters and challenges of the adoption of remote mental health services experienced by service users in Finland and the Netherlands during the COVID-19 pandemic with help of the FITTE framework.

METHODS

The study adopted a qualitative descriptive approach, consisting of in-depth semi-structured interviews with mental health service users in Finland (n = 12) and the Netherlands (n = 13) during the COVID-19 pandemic. Qualitative content analysis with both inductive and deductive approach was utilized, and the extended FITTE framework was applied to identify the factors related to the fit between individual, task, technology, and environment that influenced the adoption of remote services.

RESULTS

Overall, the adoption of remote mental health services during the COVID-19 pandemic involved several promoters related to easy access to mental health services, support for mental health and well-being, and benefits of the home environment such as not having to leave outside for services and having less risk of getting the corona virus. Most of the challenges were related to lack of non-verbal communication, difficulties with expressing oneself and interpreting others, technological issues, the organization of remote services, usability and suitability of services, affinity of the health professional with the provision of remote services, and the safety and security of remote services.

CONCLUSIONS

While remote services are accessible, support our well-being and mental health and protect us against the coronavirus, our findings also show that face-to-face contact was often indispensable when adopting mental health services. Therefore, the design of future mental health services should include both remote and face-to-face delivery. Further research should be done on blended approaches and on ways in which the challenges and development needs which emerged from this study can be tackled to improve remote mental health services.

Needs, expectations, facilitators, and barriers among insurance physicians related to the use of eHealth in their work: results of a survey

PURPOSE

To determine needs, expectations, facilitators, and barriers of insurance physicians (IPs) for using eHealth in their work. Also, we investigated differences between age groups.

MATERIALS AND METHODS

All insurance physicians employed at the Dutch Social Security Institute (SSI) received an online anonymous survey in July 2020.

RESULTS

Three hundred and fifteen IPs (31%) responded. According to these IPs, the most important need for using eHealth was to collect medical information more effectively and efficiently (71%).Main facilitators were that eHealth could make IPs' work more effectively and efficiently (61%) and more future-proof (60%). Main barriers were losing human interaction (54%) and security issues (51%). Younger IPs saw more options for using eHealth, compared to older IPs.

CONCLUSIONS

The majority of IPs (in particular younger IPs) had a positive view towards using eHealth in their daily work. Nevertheless, differences in needs, expectations, facilitators and barriers between the age groups should be taken into account for the successful development and implementation of interventions using eHealth in insurance medicine.

The experiences and perceptions of health-care professionals regarding assistive technology training: A systematic review

Worldwide, there is an increasing demand for assistive technologies (ATs) that can support people to live independently for longer. Health-care professionals (HCPs) often recommend AT devices, however there exists a lack of availability of devices and appropriate training in the field. This systematic review aimed to synthesize the available evidence into the experiences and training needs of HCPs in relation to AT. Six electronic databases were searched without date restrictions: MEDLINE, PsycINFO, SPP, SSCI, CINAHL, and ASSIA. Journal handsearching, searching reference lists of included studies and relevant reviews, and contacting experts in the field of AT were also conducted. Findings were analyzed using narrative synthesis. Data from 7846 participants from 62 studies were synthesized, eliciting perceived challenges in access to and provision of training, resulting in knowledge gaps across disciplines and geographic locations. Mechanisms to mitigate these issues included ongoing support following training and tailoring education to meet individual needs since comprehensive training is essential to maintain and improve competence, knowledge, and confidence. Further research is required to explore the impact and effectiveness of AT training for HCPs to ensure that users of devices are supported to live independent and healthy lives.

Barriers and facilitators to the implementation of digital technologies in mental health systems: a qualitative systematic review to inform a policy framework

BACKGROUND

Despite the potential for improved population mental health and wellbeing, the integration of mental health digital interventions has been difficult to achieve. In this qualitative systematic review, we aimed to identify barriers and facilitators to the implementation of digital technologies in mental healthcare systems, and map these to an implementation framework to inform policy development.

METHODS

We searched Medline, Embase, Scopus, PsycInfo, Web of Science, and Google Scholar for primary research articles published between January 2010 and 2022. Studies were considered eligible if they reported barriers and/or facilitators to the integration of any digital mental healthcare technologies. Data were extracted using EPPI-Reviewer Web and analysed thematically via inductive and deductive cycles.

RESULTS

Of 12,525 references identified initially, 81 studies were included in the final analysis. Barriers and facilitators were grouped within an implementation (evidence-practice gap) framework across six domains, organised by four levels of mental healthcare systems. Broadly, implementation was hindered by the perception of digital technologies as impersonal tools that add additional burden of care onto both providers and patients, and change relational power asymmetries; an absence of resources; and regulatory complexities that impede access to universal coverage. Facilitators included person-cantered approaches that consider patients' intersectional features e.g., gender, class, disability, illness severity; evidence-based training for providers; collaboration among colleagues; appropriate investment in human and financial resources; and policy reforms that tackle universal access to digital health.

CONCLUSION

It is important to consider the complex and interrelated nature of barriers across different domains and levels of the mental health system. To facilitate the equitable, sustainable, and long-term digital transition of mental health systems, policymakers should consider a systemic approach to collaboration between public and private sectors to inform evidence-based planning and strengthen mental health systems.

PROTOCOL REGISTRATION

The protocol is registered on PROSPERO, CRD42021276838.

Evaluation of Online Counseling through the Working Experiences of Mental Health Therapists Amidst the COVID-19 Pandemic

This study aimed to reflect on mental health professionals' experiences with online counseling during the COVID-19 pandemic, as well as their perceptions and recommendations for the future. The method of qualitative research with semi-structured interviews was used. The sample consisted of 17 mental health professionals working in the public or private sectors. A framework analysis revealed four main themes, namely (a) the evaluation of online counseling; (b) comparing in-person and online counseling; (c) factors influencing the effectiveness of online counseling; and (d) suggestions for the future use of online counseling. Most therapists reported that their overall experience with online counseling was positive. The main advantages cited were the accessibility for everyone and the reductions in time, money, and distance. Its primary drawbacks included less nonverbal communication, the inability to employ certain therapeutic tools, problems with confidentiality, lack of experience, and technical difficulties during online sessions. Its effectiveness depends on contextual factors and factors related to the therapeutic process itself. Organizational planning, training, and a solid implementation strategy may help ensure that this communication medium is used to its fullest potential. In addition, the possible utilization of remote counseling combined with in-person psychotherapeutic intervention methods will provide solutions for the future, especially in crisis situations.

Therapeutic alliance in two forms of guided self-help for binge eating

The role of therapeutic alliance within psychological treatments for eating disorders (EDs), including those delivered remotely, is well established. However, few studies have investigated alliance in guided self-help, a widely recommended first-line treatment for EDs characterised by regular binge eating. Using data from a randomised controlled trial, the current study examined both facilitator and patient assessments of alliance within e-mail-assisted and face-to-face guided self-help and looked at associations between alliance, ED symptoms and ED-related impairment. One hundred thirteen patients and 11 facilitators completed measures of alliance during and following a course of guided self-help. Whilst ratings were reliable across patients and facilitators, alliance scores were higher both in the patient sample and in the face-to-face condition. Ratings of alliance showed no correlations with ED symptoms at post-treatment, and early alliance was not significantly associated with outcome, which could inform how early symptom change is encouraged in guided self-help.

E-therapists' views on the acceptability and feasibility of an internet-administered, guided, low-intensity cognitive behavioural therapy intervention for parents of children treated for cancer: A qualitative study

Background

Childhood cancer treatment completion can be a period of vulnerability for parents and is associated with mental health difficulties such as depression and anxiety. We developed an internet-administered, guided, low-intensity cognitive behavioural therapy-based self-help intervention (EJDeR) for parents delivered on the U-CARE-portal (Portal). The acceptability and feasibility of EJDeR and study procedures were examined using a single-arm feasibility trial (ENGAGE). Results indicated that EJDeR and ENGAGE study procedures are acceptable and feasible, however, a need for clinical and technical modifications to EJDeR and refinements to ENGAGE study procedures was identified.

Objectives

This study aimed to explore the acceptability and feasibility of EJDeR and ENGAGE study procedures from the perspective of e-therapists to inform clinical and technical modifications to EJDeR and refinements to study procedures prior to progression to a superiority randomised controlled trial.

Methods

We conducted semi-structured interviews with 10 e-therapists. Data were analysed using manifest content analysis.

Results

We identified three categories relating to the acceptability and feasibility of EJDeR: (a) Support to e-therapists (subcategories: Clinical supervision and Technical difficulties); (b) Guidance to parents (subcategories: Support protocols and Synchronous communication); and (c) Content (subcategories: Relevancy of the intervention and Pacing of the intervention). We identified four categories relating to the acceptability and feasibility of study procedures: (a) Recruitment and training of e-therapists (subcategories: Definition of the role and Training program); (b) Retention of parents (subcategories: Parent suitability and screening and Frequency of weekly Portal assessments); (c) Retention of e-therapists (subcategories: Administrative requirements and Communication with the research team); and (d) The Portal.

Conclusions

EJDeR and study procedures were considered acceptable and feasible, however, clinical and technical modifications and refinements to study procedures were suggested to enhance acceptability and feasibility. Results may also inform implementation considerations for both EJDeR and other similar digital psychological interventions.

Trial registration number

ISRCTN 57233429.

Virtual reality (VR) treatments for anxiety disorders are unambiguously successful, so why are so few therapists using it? Barriers to adoption and potential solutions

Anxiety disorders are a significant cause of disability globally, yet only one in ten sufferers receives adequate quality treatment. Exposure-based therapies are effective in reducing symptoms associated with a number of anxiety disorders. However, few therapists use exposure techniques to treat these conditions, even when they are adequately trained in them, often because of concerns about provoking distress, drop out, logistical barriers, and other concerns. Virtual reality exposure therapy (VRET) can address many of these concerns, and a large body of research decisively shows that VRET is as efficacious for treating these conditions as in vivo exposures. Yet, use of VRET remains low. In this article, we discuss several factors we believe are contributing to low VRET adoption among therapists and raise potential solutions to address them. We consider steps that VR experience developers and researchers might take, such as leading studies of VRET's real-world effectiveness and treatment optimization trials and continuing to improve the fit of platforms with clinicians' workflows. We also discuss steps to address therapist reservations using aligned implementation strategies, as well as barriers for clinics, and the roles that professional organizations and payers could have in improving care by encouraging adoption of VRET.

Digital intervention for public health: searching for implementing characteristics, concepts and recommendations: scoping review

Studying the impact of digital interventions on public health can help ensure that the offered services produce the desired results. In order to address these factors, the subsequent study uses a scope review to evaluate the state of the field while concentrating on ideas and suggestions that represent factors that have been crucial in the management of digital intervention for public health. To shed light on the traits, ideas and suggestions related to public health digital intervention, a scoping review was carried out. Five electronic databases were used to locate pertinent research that were published before February 2022. All texts were examined, and study abstracts were scrutinized to determine their eligibility. The last analysis of this study included fifteen publications; five reviews, four qualitative studies, two quantitative studies, one viewpoint study, one mixed-method study, one perspective study, and one interventional study. The key ideas for digital interventions in population management and health studies are presented in this overview. Many concepts, implementation characteristics and recommendations have been raised which highlight the future role of these interventions to enhance public engagement and health equity.

Factors Affecting Digital Tool Use in Client Interaction According to Mental Health Professionals: Interview Study

BACKGROUND

Digital tools and interventions are being increasingly developed in response to the growing mental health crisis, and mental health professionals (MHPs) considerably influence their adoption in client practice. However, how MHPs use digital tools in client interaction is yet to be sufficiently understood, which poses challenges to their design, development, and implementation.

OBJECTIVE

This study aimed to create a contextual understanding of how MHPs use different digital tools in clinical client practice and what characterizes the use across tools.

METHODS

A total of 19 Finnish MHPs participated in semistructured interviews, and the data were transcribed, coded, and inductively analyzed.

RESULTS

We found that MHP digital tool use was characterized by 3 distinct functions: communication, diagnosis and evaluation, and facilitating therapeutic change. The functions were addressed using analog tools, digitized tools that mimic their analog counterparts, and digital tools that use the possibilities native to digital. The MHP-client communication included various media alongside face-to-face meetings, the MHPs increasingly used digitized tools in client evaluation, and the MHPs actively used digitized materials to facilitate therapeutic change. MHP tool use was generally characterized by adaptability-it was negotiated in client interactions. However, there was considerable variance in the breadth of MHPs' digital toolbox. The existing clinical practices emphasized MHP-client interaction and invited incremental rather than radical developments, which challenged the achievement of the scalability benefits expected from digital tools.

CONCLUSIONS

MHPs use digitized and digital tools in client practice. Our results contribute to the user-centered research, development, and implementation of new digital solutions in mental health care by classifying them according to their function and medium and describing how MHPs use and do not use them.

An external facilitation intervention to increase uptake of an adverse drug event reporting intervention

Background

Adverse drug events (ADEs) are a leading cause of emergency department visits and hospital admissions in Canada. ActionADE prevents repeat ADEs by enabling clinicians to document and communicate standardized ADE information across care settings. We used an external facilitation intervention to promote the uptake of ActionADE in four hospitals in British Columbia, Canada. This study examined whether, how and in what context external facilitation influenced the uptake of ActionADE.

Methods

In this convergent-parallel mixed-methods study, an external facilitator used a four-step iterative process to support site champions using context-specific implementation strategies to increase the ADE reporting rate at their sites. We extracted archival data to assess implementation determinants before and after the implementation of the external facilitation and implementation strategies. We also retrieved data on the mean monthly counts of reported ADEs for each user from the ActionADE server. Zero-inflated Poisson models were used to examine changes in mean monthly counts of reported ADEs per user between pre-intervention (June 2021 to October 2021) and intervention (November 2021 to March 2022) periods.

Results

The external facilitator and site champions co-created three functions: (1) educate pharmacists about what and how to report in ActionADE, (2) educate pharmacists about the impact of ActionADE on patient outcomes, and (3) provide social support for pharmacists to integrate ADE reporting into clinical workflows. Site champions used eight forms to address the three functions. Peer support and reporting competition were the two common strategies used by all sites. Sites' responses to external facilitation varied. The rate of mean monthly counts of reported ADEs per user significantly increased during the intervention period compared to the pre-intervention period at LGH (RR: 3.74, 95% CI 2.78 to 5.01) and RH (RR: 1.43, 95% CI 1.23 to 1.94), but did not change at SPH (RR: 0.68, 95% CI: 0.43 to 1.09) and VGH (RR: 1.17, 95% CI 0.92 to 1.49). Leave of absence of the clinical pharmacist champion and failure to address all identified functions were implementation determinants that influenced the effectiveness of external facilitation.

Conclusion

External facilitation effectively supported researchers and stakeholders to co-create context-specific implementation strategies. It increased ADE reporting at sites where clinical pharmacist champions were available, and where all functions were addressed.

The development of a smartphone app to enhance post-traumatic stress disorder treatment in high-risk workers

Objective

Post-traumatic stress disorder (PTSD) is highly prevalent in certain populations. However, evidence indicates that many individuals do not respond to treatment. Digital supports hold promise for increasing service provision and engagement but there is a lack of evidence on blended care options and still less research guiding the development of such tools. This study details the development and overarching framework used to build a smartphone app to support PTSD treatment.

Methods

The app was developed in line with the Integrate, Design, Assess, and Share (IDEAS) framework for the development of digital health interventions and involved clinicians (n=3), frontline worker clients (n=5) and trauma-exposed frontline workers (n=19). Integrated iterative rounds of testing were conducted via in-depth interviews, surveys, prototype testing and workshops, alongside app and content development.

Results

Clinicians and frontline workers both expressed a clear preference for the app to augment but not replace face-to-face therapy, with the aim of increasing between-session support, and facilitating homework completion. Content was adapted for app delivery from manualised therapy (trauma-focused cognitive behavioural therapy (CBT). Prototype versions of the app were well received, with both clinicians and clients reporting the app was easy to use, understandable, appropriate and highly recommendable. System Usability Scale (SUS) scores were on average in the excellent range (82/100).

Conclusions

This is one of the first studies to document the development of a blended care app designed specifically to augment clinical care for PTSD, and the first within a frontline worker population. Through a systematic framework with active end user consultation, a highly usable app was built to undergo subsequent evaluation.

Forensic Psychiatric Outpatients' and Therapists' Perspectives on a Wearable Biocueing App (Sense-IT) as an Addition to Aggression Regulation Therapy: Qualitative Focus Group and Interview Study

BACKGROUND

Given the increased use of smart devices and the advantages of individual behavioral monitoring and assessment over time, wearable sensor-based mobile health apps are expected to become an important part of future (forensic) mental health care. For successful implementation in clinical practice, consideration of barriers and facilitators is of utmost importance.

OBJECTIVE

The aim of this study was to provide insight into the perspectives of both psychiatric outpatients and therapists in a forensic setting on the use and implementation of the Sense-IT biocueing app in aggression regulation therapy.

METHODS

A combination of qualitative methods was used. First, we assessed the perspectives of forensic outpatients on the use of the Sense-IT biocueing app using semistructured interviews. Next, 2 focus groups with forensic therapists were conducted to gain a more in-depth understanding of their perspectives on facilitators of and barriers to implementation.

RESULTS

Forensic outpatients (n=21) and therapists (n=15) showed a primarily positive attitude toward the addition of the biocueing intervention to therapy, with increased interoceptive and emotional awareness as the most frequently mentioned advantage in both groups. In the semistructured interviews, patients mainly reported barriers related to technical or innovation problems (ie, connection and notification issues, perceived inaccuracy of the feedback, and limitations in the ability to personalize settings). In the focus groups with therapists, 92 facilitator and barrier codes were identified and categorized into technical or innovation level (n=13, 14%), individual therapist level (n=28, 30%), individual patient level (n=33, 36%), and environmental and organizational level (n=18, 20%). The predominant barriers were limitations in usability of the app, patients' motivation, and both therapists' and patients' knowledge and skills. Integration into treatment, expertise within the therapists' team, and provision of time and materials were identified as facilitators.

CONCLUSIONS

The chances of successful implementation and continued use of sensor-based mobile health interventions such as the Sense-IT biocueing app can be increased by considering the barriers and facilitators from patients' and therapists' perspectives. Technical or innovation-related barriers such as usability issues should be addressed first. At the therapist level, increasing integration into daily routines and enhancing affinity with the intervention are highly recommended for successful implementation. Future research is expected to be focused on further development and personalization of biocueing interventions considering what works for whom at what time in line with the trend toward personalizing treatment interventions in mental health care.

Investigating information needs and preferences regarding digital mental health services among medical and psychology students in Germany: A qualitative study

Background

Since 2020, physicians and psychotherapists in Germany can prescribe digital mental health services (dMHSs). However, even future healthcare professionals (HCPs), such as medical and psychology students, remain reluctant to use dMHSs, although they are a risk group for mental health issues themselves. Reasons include scepticism and lacking awareness of dMHSs, which can be addressed by acceptance-facilitating interventions (AFIs) such as information strategies. To date, though, little is known about their information needs.

Methods

Semi-structured interviews with n = 21 students were conducted between August and September 2021. Students of legal age studying psychology or medicine at a German university could participate. Interview recordings were transcribed verbatim and content-analyzed according to Mayring, using deductive and inductive coding.

Results

Most students reported having little experience with dMHSs. Digital health has barely been raised in their study, even though it was perceived as crucial for personal needs as well as in preparation for their work as HCPs. Students favoured receiving information on and recommendations for dMHSs from their university via, e.g. social media or seminars. Among others, information about data safety, scientific evidence base and application scope were preferred. Additionally, information on costs as well as user reviews seemed to be essential components of information strategies because students were concerned that high costs or low usability would hinder uptake.

Conclusions

The results give first insights on how future HCPs would like to be informed on dMHSs. Future research should focus on systematic variations of AFIs' components mimicking real-world decision scenarios to increase the adoption of dMHSs.

Factors Associated With Intention and Use of e-Mental Health by Mental Health Counselors in General Practices: Web-Based Survey

BACKGROUND

Mental health care counselors have a high intention to use e-mental health (EMH), whereas actual use is limited. Facilitating future use requires insight into underlying factors as well as eligibility criteria that mental health care counselors use in their decision to apply EMH.

OBJECTIVE

The aim of this study was to unfold the intention and underlying reasons for mental health counselors to use EMH and to unveil the criteria they use to estimate patient eligibility for EMH. The theoretical framework was based on the reasoned action approach model, the Unified Theory of Acceptance and Use of Technology, and the Measurement Instrument for Determinants of Innovation model.

METHODS

To empirically validate our theoretical model, a web-based survey was conducted among mental health care counselors (n=132). To unveil the eligibility criteria, participants were asked to rank their reasons for considering EMH suitable or unsuitable for a patient.

RESULTS

The mean intention to use EMH was positive (mean 4.04, SD 0.64). The mean use of EMH before the COVID-19 pandemic was 38% (mean 0.38, SD 0.22), and it was 49% (mean 0.49, SD 0.25) during the pandemic. In total, 57% of the patient population was considered eligible for EMH. Usefulness and benefits (β=.440; P<.001), Task perception (β=.306; P=.001), and Accessibility (β=.140; P=.02) explained the intention to use EMH (F_3,131=54.151; P<.001; R²=0.559). In turn, intention explained patient eligibility (F_1,130=34.716; P<.001; R²=0.211), whereas intention and patient eligibility explained EMH use (F_2,129=41.047; P<.001; R²=0.389). Patient eligibility partially mediated the relationship between intention to use EMH and EMH use, with a larger direct effect (c'=0.116; P<.001) than indirect effect (c=0.065, 95% CI 0.035-0.099; P<.001). Mental health counselors assessed patients' eligibility for EMH mainly through the availability of computers and the internet and patient motivation.

CONCLUSIONS

To stimulate the use of EMH, intention and patient eligibility need to be influenced. Intention, in turn, can be enhanced by addressing the perceived usefulness and benefits of EMH, perceived accessibility, and task perception. Access to a computer and patients' motivation to use EMH are important in facilitating patient eligibility. To cause an impact with EMH in general practice, mental health counselors need to be convinced of the benefits of EMH and transfer this enthusiasm to the patient. It is recommended to involve mental health counselors in the development of EMH to increase the (perceived) added value and use.

A randomized controlled trial to pilot the efficacy of a computer-based intervention with elements of virtual reality and limited therapist assistance for the treatment of post-traumatic stress disorder

Although well-established therapies exist for post-traumatic stress disorder (PTSD), barriers to seek mental health care are high. Technology-based interventions may play a role in improving the reach of efforts to treat, especially when therapist availability is low. The goal of the current randomized controlled trial was to pilot the efficacy of a computer-based trauma intervention with elements of virtual reality (VR; 3MR system) and limited therapist involvement for the treatment of PTSD in a childhood sexual abuse (CSA) and war veteran sample and to compare this to "treatment as usual" (TAU). TAU consisted of evidence-based approaches such as imaginal exposure, EMDR, or narrative exposure therapy. A total of 44 patients with PTSD were included and randomly assigned to 12 sessions of 3MR intervention or TAU (completer n 3MR = 12, TAU = 18). Several measures (PCL-5, BDI-II, OQ-45-2, and the M.I.N.I. 5.0.0.) were administered to measure symptoms of PTSD and depression and scores of overall well-being at pre, post, and a three-month follow-up measurement. Analyses suggest that symptoms of PTSD and depression in the 3MR condition decreased, and overall well-being increased between pre and post measurements. Results did not indicate any clear differences between the treatment conditions over time which suggests that treatment gains of the 3MR intervention seem no less than those of TAU. Finally, both treatment conditions produced similar remission rates of PTSD and depression. Therefore, the 3MR intervention could possibly constitute an appropriate treatment alternative. The small sample size as well as evident drop-out rates in the 3MR condition (45%) do warrant further research. The procedures of this study were approved by the Medical Ethical Research Committee (MERC) of the Erasmus Medical Center in Rotterdam (MEC-NL46279.078.13) and pre-registered via ClinicalTrials.gov (Protocol Record CI1-12-S028-1).

Prioritising a culturally safe e-Mental Health research agenda in Aotearoa New Zealand: A sector survey report

OBJECTIVE

To collect mental health and addiction service providers' opinions about priorities for an e-Mental Health (eMH) research agenda focused on delivering culturally safe eMH in Aotearoa New Zealand.

METHOD

Service providers were recruited to participate in an anonymous online survey, which asked participants to rate the importance of potential research domains and items on a continuous scale from 1 to 10. The mean values of each item were normalised to develop a priority index.

RESULTS

48 participants rated at least one of the listed research items. The highest-rated items were (i) identifying strategies to improve access; co-developing eMH with the community (ii) a set of competencies required for delivering culturally safe care, (iii) a set of meaningful clinical outcomes that can be achieved via eMH, (iv) guidelines for the delivery of eMH services and (v) investigating the extent to which eMH could meet the mental health needs of these communities. 'Standards and guidelines' was the domain with the highest priority index.

CONCLUSIONS

Mental health and addiction service providers in Aotearoa New Zealand prioritised an eMH research agenda that is focused on pro-equity outcomes and incorporating the voices and experiences of the communities they seek to serve.

Compassionate Technology: A Systematic Scoping Review of Compassion as Foundation for Blended and Digital Mental Health Interventions (Preprint)

BACKGROUND

An essential value in mental health care is compassion: awareness of suffering, tolerating difficult feelings in the face of suffering, and acting or being motivated to alleviate suffering. Currently, technologies for mental health care are on the rise and could offer several advantages, such as more options for self-management by clients and more accessible and economically viable care. However, digital mental health interventions (DMHIs) have not been widely implemented in daily practice. Developing and evaluating DMHIs around important mental health care values, such as compassion, could be key for a better integration of technology in the mental health care context.

OBJECTIVE

This systematic scoping review explored the literature for previous instances where technology for mental health care has been linked to compassion or empathy to investigate how DMHIs can support compassion in mental health care.

METHODS

Searches were conducted in the PsycINFO, PubMed, Scopus, and Web of Science databases, and screening by 2 reviewers resulted in 33 included articles. From these articles, we extracted the following data: technology types, goals, target groups, and roles of the technologies in the intervention; study designs; outcome measures; and the extent to which the technologies met a 5-step proposed definition of compassion.

RESULTS

We found 3 main ways in which technology can contribute to compassion in mental health care: by showing compassion to people, by enhancing self-compassion in people, or by facilitating compassion between people. However, none of the included technologies met all 5 elements of compassion nor were they evaluated in terms of compassion.

CONCLUSIONS

We discuss the potential of compassionate technology, its challenges, and the need to evaluate technology for mental health care on compassion. Our findings could contribute to the development of compassionate technology, in which elements of compassion are explicitly embedded in its design, use, and evaluation.

Australian Psychologists Experiences with Digital Mental Health: a Qualitative Investigation

Digital mental health is changing the landscape of service delivery by addressing challenges associated with traditional therapy. However, practitioners' use of these resources remains underexamined. This study explored psychologists' attitudes and experiences with digital mental health intervention. Taking a qualitative exploratory approach via thematic analysis, the study sought to answer the following research questions: (i) How do psychologists perceive digital mental health? and (ii) What is their experience using digital mental health as part of routine practice? Ten practising psychologists participated in online semi-structured interviews (approximately 50 min), with interviews then transcribed verbatim. Interview data were analysed according to the six-phase approach to thematic analysis proposed by Braun and Clarke. Three themes were identified: (1) attitudes towards digital mental health; (2) use within routine practice; and (3) perspectives on an effective model for implementation. Practitioners play a major role in the design and delivery of digital mental health services. Barriers and facilitators at the practitioner-level (e.g. knowledge and competence with tools, perceptions on the utility of digital interventions) and the service-level (e.g. government support for digital health) should be considered in the future design of digital mental health resources and service delivery.

Supplementary Information

The online version contains supplementary material available at 10.1007/s41347-022-00271-5.

Adhoc Setup of an Online Mental Health Self-Help Program During the COVID-19 Pandemic: Description of the Development and Implementation Processes and Analysis of Its Users’ and Usage Profiles

Background

The COVID-19 pandemic hit Austria in March 2020. This led to a considerable reduction in outpatient psychiatric therapies. People with mental disorders as well as with newly emerging mental health issues found themselves with very limited treatment options. Within only a few days our hospital set up an online mental health self-help program which went online in its first version on the first day of the lockdown in Austria. The process of this development and implementation process alongside with the user’s and usage data for the program are presented here.

Methods

A small core team initiated the development of the program on a low-budget basis and using mostly freely available digital resources. The program had to be free of costs for its users and easy to navigate. Each self-help module contains a text description of the topic, a self-rating questionnaire and several psychoeducational 2–5 min videos. These videos explain, e.g., interactions of mental stress and the immune system or the vicious circle of anxiety. Additional videos provide easy to learn techniques like breathing and relaxation exercises.

Results

We illustrate the implementation of this program following the replicating effective program (REP) model. We provide a detailed description of the implementation process starting from a simple website to a smartphone-based application with registered user area and instantaneous reporting of self-rating questionnaire results to users. The described process could be used as a model for the setup of similar programs in a very short time. As an indicator of acceptance, we report 46,100 unique video views and 3,937 completed questionnaires in the first year of use. The most accessed videos were those on anxiety, relaxation and resilience. Analysis of the sociodemographic user data indicate that they were mostly young (&lt; 45 years; 59.7%), females (77.5%) and previously mentally healthy individuals (74.5%). An example of the collected psychometric questionnaire data over time is given.

Conclusion

We show that it is possible to set up an online mental health self-help program ad hoc and without extensive prior planning, which enabled us to dynamically respond to a new situation. We are now planning on keeping the program active for a longer period of time to supplement and expand traditional treatment settings also outside the COVID-19 pandemic.

The reality of E-counseling services in the light of Digital learning from the point of View of Teachers in Jordan

This study aims to investigate the reality of e-counseling services in the light of digital learning from the perspective of teachers in Jordan. The sample of the study consisted of (348) male and female teachers at Rusaifa Education Directorate in 2021. The scale of the counseling services for this study was created by the researchers, where the validity and reliability of the scale were approved, and the appropriate statistical procedures were used. The study reached some statistical results regarding e-counseling services in the light of digital learning from the perspective of teachers in Jordan. Results revealed that the arithmetic averages of the reality of e-counseling services have an intermediate degree at the overall level, and each dimension has an intermediate degree, too. The prevention dimension took the first place, followed by the social dimension, the moral dimension, the professional dimension, the educational dimension, and lastly, the technical dimension, respectively. The results revealed that there are no statistically significant differences at the level of significance (α ≤ 0.05) at the overall level. The level of each dimension of the scale is attributed to the variables of gender and one's years of experience.

Exploring Surgeons', Nurses', and Patients' Information Seeking Behavior on Medical Innovations: The Case of 3D Printed Biodegradable Implants in Breast Reconstruction

Objectives

To explore information seeking behavior on medical innovations.

Background

While autologous and alloplastic options for breast reconstruction are well established, it is the advent of the combination of 3D printing technology and the biocompatible nature of a highly porous biodegradable implants that offers new treatment options for the future. While this type of prosthesis is not yet clinically available understanding how patients, surgeons, and nurses take up new medical innovations is of critical importance for efficient healthcare provision.

Materials and Methods

Using the largest ever combined sample of breast cancer patients (n = 689), specialist surgeons (n = 53), and breast care nurses (n = 101), we explore participants preference for a new surgical treatment concept rooted in 3D printed and biodegradable implant technologies in the context of breast reconstruction.

Results

We find that patients overwhelmingly favor information from a successful patient of the proposed new technology when considering transitioning. Surgeons and nurses instead favor regulatory body advice, peer-reviewed journals, and witnessing the procedure performed (either in person or online). But while 1 in 4 nurses nominated talking to a successful patient as an information source, not a single surgeon chose the same. Our multinomial logit analysis exploring patient preference (controlling for individual differences) showed statistically significant results for both the type of surgical treatment and choice to undergo reconstruction. Women who underwent a type of mastectomy procedure (compared with lumpectomy patients) were more likely to choose a former patient than a surgeon for seeking information relating to a new breast implant technology. Further, women who chose to undergo a reconstruction procedure, compared with those who did not, where more likely to prefer a surgeon for information relating to a new breast implant technology, rather than a successful patient. For medical professionals, we find no statistically significant relationship between medical professionals' preference and their age, nor the number of other medical professionals they work with daily, nor the average number of breast procedures performed in their practice on a weekly basis.

Conclusions

As our findings show large variation exists (both within our patient group and compared with medical professionals) in where individuals favor information on new medical innovations, future behavioral research is warranted.

Organisational implementation climate in implementing internet-based cognitive behaviour therapy for depression

Background

Internet-based Cognitive Behaviour Therapy (iCBT) for depression have been implemented in routine care across Europe in varying ways, at various scales and with varying success. This study aimed to advance our understanding of organisational implementation climate from the perspectives of implementers and mental health service deliverers.

Methods

Qualitative and quantitative methods were combined to study the concept of organisational implementation climate in mental health care settings. Based on concept mapping, a qualitative workshop with implementers was used to conceptualise organisational implementation climate for optimizing iCBT use in routine practice. Service deliverers involved in the provision of iCBT were invited to participate in an explorative cross-sectional survey assessing levels of satisfaction and usability of iCBT, and organisational implementation climate in implementing iCBT. The two methods were applied independently to study viewpoints of implementers as well as service deliverers. Corresponding to the explorative nature of the study, inductive reasoning was applied to identify patterns and develop a reasonable explanation of the observations made. Correlative associations between satisfaction, usability and implementation climate were explored.

Results

Sixteen implementers representing fourteen service delivery organisations across Europe participated in the workshop. The top-three characteristics of a supportive organisational implementation climate included: (1) clear roles and skills of implementers, (2) feasible implementation targets, and (3) a dedicated implementation team. The top-three tools for creating a supportive implementation climate included: (1) feedback on job performance, (2) progress monitoring in achieving implementation targets, and (3) guidelines for assessing the impact of iCBT. The survey (n=111) indicated that service providers generally regarded their organisational implementation climate as supportive in implementing iCBT services. Organisational implementation climate was weakly associated with perceived usability and moderately with satisfaction with iCBT services.

Conclusions

Organisational implementation climate is a relevant factor to implementers and service deliverers in implementing iCBT in routine care. It is not only an inherent characteristic of the context in which implementation takes place, it can also be shaped to improve implementation of iCBT services. Future research should further theorise organisational implementation climate and empirically validate the measurement instruments such as used in this study.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08041-y.

Usability, Feasibility, and Effect of a Biocueing Intervention in Addition to a Moderated Digital Social Therapy-Platform in Young People With Emerging Mental Health Problems: A Mixed-Method Approach

Introduction

To optimize treatment, it is of utmost importance to take into account the myriad of biological, social, and psychological changes that young people go through during adolescence which make them more vulnerable for developing mental health problems. Biocueing, a non-invasive method to transform physiological parameters into an observable signal, could strengthen stress- and emotion regulation by cueing physiologically unusual values in daily life. The aim of this study is to investigate the usability, feasibility, and exploratory effect of biocueing in addition to ENgage YOung people earlY (ENYOY), a moderated digital social therapy-platform, in young people with emerging mental health complaints.

Methods

A user-centered mixed-method design was used. A focus group was conducted to optimize the ENYOY-platform and biocueing intervention. Biocueing was operationalized by a smartwatch and the Sense-IT app. A within-subjects design was used; 10 days for all participants 'biofeedback off' (control), followed by 10 days 'biofeedback on' (experimental). Emotional awareness and perceived stress were measured using ecological momentary assessment. Eight individuals participated. User-friendliness, usability, and acceptance were assessed using a qualitative design.

Results

Findings from the focus group resulted in several adaptations of the biocueing intervention to the ENYOY-platform and vice versa. The average measurement compliance rate was 78.8%. Level-one findings showed different individual effects on perceived stress and emotional awareness. Level-two analyses showed no overall effects on perceived stress (B = -0.020, p = 0.562) and overall positive effects on emotional awareness (B = 0.030, p = 0.048) with small effect sizes (Improvement Rate Difference = 0.05-0.35). The intervention was found to be acceptable and showed moderate usability. Participants indicated they experienced improvements in reflection on feelings and changes in behavior, such as pausing and evaluating the situation.

Conclusion

These preliminary results show that biocueing could be a promising addition to digital treatment platforms and help young people become more emotionally aware. Improvements should be made regarding the usability and acceptability of the smartwatch, as well as more extensive integration of the biocueing intervention with a digital treatment platform. It would be relevant to gain a better understanding of which individuals would benefit most from an additional biocueing intervention.

Understanding Mental Health Professionals' Perspectives and Practices Regarding the Implementation of Digital Mental Health: Qualitative Study

BACKGROUND

Despite the potential of digital mental health to provide cost-effective mental health care, its adoption in clinical settings is limited, and little is known about the perspectives and practices of mental health professionals regarding its implementation or the factors influencing these perspectives and practices.

OBJECTIVE

This study aims to characterize in depth the perspectives and practices of mental health professionals regarding the implementation of digital mental health and explore the factors affecting such perspectives and practices.

METHODS

A qualitative study using in-depth semistructured interviews with Portuguese mental health professionals (N=13)-psychologists and psychiatrists-was conducted. The transcribed interviews were thematically analyzed.

RESULTS

Mental health professionals deemed important or engaged in the following practices during the implementation of digital mental health: indication evaluation, therapeutic contract negotiation, digital psychological assessment, technology setup and management, and intervention delivery and follow-up. Low-threshold accessibility and professionals' perceived duty to provide support to their clients facilitated the implementation of digital mental health. Conversely, the lack of structured intervention frameworks; the unavailability of usable, validated, and affordable technology; and the absence of structured training programs inhibited digital mental health implementation by mental health professionals.

CONCLUSIONS

The publication of practice frameworks, development of evidence-based technology, and delivery of structured training seem key to expediting implementation and encouraging the sustained adoption of digital mental health by mental health professionals.

Acceptance of E-Mental Health Services for Different Application Purposes Among Psychotherapists in Clinical Training in Germany and Switzerland: Secondary Analysis of a Cross-Sectional Survey

Background

Despite solid evidence supporting the efficacy of electronic mental health (EMH) services, their acceptance among psychotherapists is limited and uptake rates remain low. However, the acceptance of different EMH services has yet barely been examined in future generations of psychotherapists in a differentiated manner. The aims of this study were (1) to elaborate the intention to use various EMH services for different application purposes and (2) to determine predictors of EMH service acceptance among psychotherapists in clinical training (PiT).

Materials and Methods

Our paper is based on a secondary data analysis of a cross-sectional survey. Respondents were recruited via recognized educational institutions for psychotherapy within Germany and the German-speaking part of Switzerland between June and July of 2020. The survey contained items on the intention to use different EMH services (i.e., guided and unguided programs, virtual reality, psychotherapy by telephone and videoconference) for various application purposes (i.e., prevention, treatment addition, treatment substitute, aftercare). Potential predictors of EMH service acceptance (e.g., barriers and advantages) were examined based on an extension of the Unified Theory of Acceptance and Use of Technology (UTAUT).

Results

Most of the n = 216 respondents were female (88.4%) and located in Germany (72.2%). General acceptance of EMH was moderate (M = 3.4, SD = 1.12, range 1-5), while acceptance of psychotherapy via videoconference was highest (M = 3.7, SD = 1.15) and acceptance of unguided programs was lowest (M = 2.55, SD = 1.14). There was an interaction effect of EMH service and application purpose (η2 = 0.21). Barriers and advantages both had a uniform influence on EMH service acceptance (Pr > 0.999), while impersonality, legal concerns, concerns about therapeutic alliance, simplified information provision, simplified contact maintenance, time flexibility, and geographic flexibility were significant predictors (all p < 0.05). Results showed that the extended UTAUT model was the best fitting model to predict EMH service acceptance (Pr > 0.999).

Conclusions

The intention to use different EMH services varied between application purposes among PiT. To increase acceptance of EMH services and reduce misconceptions, we identified predictors that should be addressed in future acceptance-facilitating interventions when educating PiT.

Integrating technology in mental healthcare practice: A repeated cross-sectional survey study on professionals' adoption of Digital Mental Health before and during COVID-19

As a consequence of the outbreak of the COVID-19 global pandemic in the spring of 2020, large-scale social distancing measures were implemented, resulting in the forced adoption of online or digital forms of psychological treatment. This sudden transition to digital care offered a unique opportunity to investigate if and how this experience impacted mental healthcare professionals' perceptions and use of Digital Mental Health tools. The current paper presents findings of a repeated cross-sectional study consisting of three iterations of a national online survey in the Netherlands. This survey contained open and closed questions on professionals' adoption readiness, frequency of use, perceived competency, and perceived value of Digital Mental Health collected in 2019 (before the pandemic), in 2020 (after the first wave), and in 2021 (after the second wave). The inclusion of data gathered prior to the COVID-19 pandemic offers a unique window to assess how professionals' adoption has developed through this transition from voluntary to mandatory use of Digital Mental Health tools. Our study also re-assesses the drivers, barriers, and needs of mental healthcare professionals after having gained experience with Digital Mental Health. In total, 1,039 practitioners completed the surveys (Survey 1: n = 432, Survey 2: n = 363, and Survey 3: n = 244). Results indicate that compared to the period before the pandemic, there was a particularly large increase in use, competency, and perceived value regarding videoconferencing. Small differences were also found for some other basic tools that were crucial to ensure the continuation of care, such as e-mail, text messaging, and online screening, but not for more innovative technologies, such as virtual reality and biofeedback. Many practitioners reported to have gained skills regarding Digital Mental Health and experienced several benefits of it. They expressed the intention to continue with a blended approach, using Digital Mental Health tools in combination with face-to-face care, focused on situations in which they found it to have specific added value, such as when clients are unable to travel. Others were less satisfied with the technology-mediated interactions and remained more reluctant to future use of DMH. Implications for broader implementation of Digital Mental Health and future research are discussed.

Artificially intelligent chatbots in digital mental health interventions: a review

INTRODUCTION

Increasing demand for mental health services and the expanding capabilities of artificial intelligence (AI) in recent years has driven the development of digital mental health interventions (DMHIs). To date, AI-based chatbots have been integrated into DMHIs to support diagnostics and screening, symptom management and behavior change, and content delivery.

AREAS COVERED

We summarize the current landscape of DMHIs, with a focus on AI-based chatbots. Happify Health's AI chatbot, Anna, serves as a case study for discussion of potential challenges and how these might be addressed, and demonstrates the promise of chatbots as effective, usable, and adoptable within DMHIs. Finally, we discuss ways in which future research can advance the field, addressing topics including perceptions of AI, the impact of individual differences, and implications for privacy and ethics.

EXPERT OPINION

Our discussion concludes with a speculative viewpoint on the future of AI in DMHIs, including the use of chatbots, the evolution of AI, dynamic mental health systems, hyper-personalization, and human-like intervention delivery.

Development of a Wearable Biocueing App (Sense-IT) Among Forensic Psychiatric Outpatients With Aggressive Behavior: Design and Evaluation Study

Background

The ability to regulate anger is often impaired in forensic psychiatric patients, frequently resulting in aggressive behavior. Although some treatment programs are partially successful in enhancing aggression regulation and reducing recidivism among specific subgroups, generalizable conclusions on the effectiveness of these interventions cannot be drawn to date. In forensic outpatient care, low treatment adherence and a predominant focus on cognitive control in most treatment programs may entail some of the factors impeding treatment. Technology-based interventions may address some of these treatment challenges.

Objective

The aim of this study is to explore whether a new technology-based biocueing intervention, the Sense-IT app, can be a valuable addition to aggression regulation treatment programs in forensic outpatient care. The Sense-IT app, which provides the user with real-time physiological feedback and behavioral support, is developed to strengthen emotional awareness and facilitate real-life practice. In this study, we aim to develop and evaluate an updated version of the Sense-IT app that is suitable for forensic outpatients with aggressive behavior.

Methods

First, we conducted a design study to assess the attitudes of forensic professionals and patients toward biocueing and to collect requirements for a biocueing app for this specific population. On the basis of this information, we developed an updated version of the Sense-IT app. In an evaluation study, 10 forensic outpatients used the app for 2 weeks. The app’s acceptability, usability, and clinical outcomes (aggression, anger, and recognition of bodily signals related to anger) were measured before and after the intervention using both quantitative and qualitative measures.

Results

The design study revealed a cautiously positive attitude toward the use of biocueing as an addition to aggression regulation therapy. The evaluation study among forensic outpatients demonstrated moderate acceptability and adequate usability for the new version of the Sense-IT app. Exploratory analysis revealed a significant decrease in trait aggression postintervention; no significant changes were found in other anger-related clinical outcomes. To further increase acceptability and usability, a stable functioning app with self-adjustable settings, the use of smartwatches with a longer battery life, and the use of the patient’s own smartphone devices were recommended.

Conclusions

This study, which is one of the first attempts to enroll and evaluate the real-life use of a biocueing intervention among forensic outpatients, emphasized the importance of involving both patients and therapists throughout the development and implementation process. In the future, experimental studies, including single-case experimental designs using ecological momentary assessment, should be performed to evaluate the effectiveness of the Sense-IT intervention on clinical outcomes. An open attitude toward new technology, allowing exploration of the potential benefits of the Sense-IT app case-by-case, and training of therapists in using the app are expected to facilitate its integration in therapy.

TourHeart—An Online Stratified Stepped Care Mental Health Platform: Qualitative Evaluation from Multiple Stakeholders’ Perspectives (Preprint)

Background

TourHeart, a web-based stratified stepped care mental health platform, is a one-stop solution that integrates psychoeducation and other well-being promotional tools for mental health promotion and mental illness prevention and evidence-based, low-intensity psychological interventions for the treatment of people with anxiety and depressive symptoms. Instead of focusing only on symptom reduction, the platform aims to be person-centered and recovery-oriented, and continual feedback from stakeholders is sought. Understanding the perspectives of users and service providers enables platform developers to fine-tune both the design and content of the services for enhanced service personalization and personal recovery.

Objective

This qualitative study evaluated a web-based mental health platform by incorporating the perspectives of both users and service providers who administered the platform and provided coaching services. The platform included both web-based and offline services targeting adults along the mental health spectrum based on the two-continua model of mental health and mental illness.

Methods

Interview questions were designed based on the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework (RE-AIM). Views on offline services, the design of the web-based platform, user experience, and the contents of the platform were explored using semistructured interviews. A total of 27 service users and 22 service providers were recruited using purposive criterion sampling. A hybrid thematic analysis was performed to identify salient aspects of users’ and providers’ experiences with and views of the platform.

Results

Totally, 3 broad themes (namely, the quality of the platform, drivers for platform use, and coaching services) emerged from the interview data that highlighted users’ views of and experiences with the web-based platform. The platform’s general esthetics, operations, and contents were found to be critical features and drivers for continued use. Although coaching services were indispensable, participants preferred the autonomy and anonymity associated with web-based mental health services.

Conclusions

This study highlights the importance of web-based mental health services being easy to navigate and understand, being user-centric, and providing adequate guidance in self-help. It also confirms existing design standards and recommendations and suggests that more rigorous, iterative user experience research and robust evaluation should be conducted in the future adaptation of web-based stratified stepped care services, so that they can be more personalized and better promote personal recovery.

eSano - An eHealth Platform for Internet- and Mobile-based Interventions

The prevention and treatment of mental disorders and chronic somatic diseases is a core challenge for health care systems of the 21th century. Mental- and behavioral health interventions provide the means for lowering the public health burden. However, structural deficits, reluctance to use existing services, perceived stigma and further personal and environmental reasons restrict the uptake of these evidence-based approaches. Internet- and mobile-based interventions (IMIs) might overcome some of the limitations of on-site interventions by providing an anonymous, scalable, time- and location-independent, yet evidence-based approach. In order to implement digital mental and behavioral health concepts across the life-span into practice, a technical solution to support the design, creation, and execution of IMIs is needed. However, there are various conceptual, technical as well as legal challenges to implementing a corresponding software solution in the healthcare domain. Therefore, the work at hand (1) identifies these challenges and derives a number of respective requirements, (2) introduces the eHealth platform eSano, a software project developed by an interdisciplinary team of computer scientists, psychologists, therapists, and other domain experts, with the aim to serve as a flexible basis for mental and behavioral research and health care, and (3) provides technical insights into the developed platform and its approach to address the aforementioned requirements.

Responsible Relations: A Systematic Scoping Review of the Therapeutic Alliance in Text-Based Digital Psychotherapy

Introduction: Developing a good therapeutic alliance is considered essential for the responsible delivery of psychotherapy. Text-based digital psychotherapy has become increasingly common, yet much remains unclear about the alliance and its importance for delivering mental health care via a digital format. To employ text-based digital therapies responsibly, more insight is needed into the type and strength of the therapeutic alliance online. Methods: A systematic scoping review was performed searching four databases: Scopus, PsycINFO, Web of Science, and Wiley Online Library. A total of 23 studies were selected and data was extracted and tabulated to explore the characteristics of studies on text-based psychotherapy, measurements of the therapeutic alliance and associations of the alliance with treatment outcome. Results: The therapeutic alliance in text-based digital interventions was studied with a variety of client groups, though mostly for clients diagnosed with anxiety and/or depression issues. Treatment modalities were predominantly internet-based cognitive behavioral therapy (ICBT) and tailored platforms for distinct client groups (e.g., PTSD). Almost all treatments used asynchronous text-based communication, such as e-mails and integrated messaging functions, which were mainly used to give feedback on tasks. For measurements, a version of the Working Alliance Inventory (WAI) was used in most studies. Measurements with the WAI or WAI- short form indicated a good therapeutic alliance with a weighted mean score of 5.66 (on a scale of 1 to 7) and a weighted standard deviation of 0.84. Relations between the therapeutic alliance and treatment outcomes were mostly positive, with many studies reporting significant associations (n = 8 out of 10) or significant effects of the therapeutic alliance on treatment outcomes (n = 5 out of 6). Discussion: Our scoping review suggests that a good therapeutic alliance can be established in digital psychotherapy through text-based communication, and shows support for a positive relationship between the alliance and treatment outcomes. These findings illustrate that text-based online psychotherapy can be a responsible treatment option as far as the establishment of the therapeutic alliance is concerned. However, current measures of the therapeutic alliance might miss important aspects of the alliance in digital treatment, such as the presence of empathy or compassion.

Integrating eHealth within a Transforming Mental Healthcare Setting: A Qualitative Study into Values, Challenges, and Prerequisites

Mental health care is shifting towards more person-centered and community-based health care. Although integrating eHealth within a transforming healthcare setting may help accomplishing the shift, research studying this is lacking. This study aims to improve our understanding of the value of eHealth within a transforming mental healthcare setting and to define the challenges and prerequisites for implementing eHealth in particular within this transforming context. In this article, we present the results of 29 interviews with clients, social network members, and professionals of an ambulatory team in transition within a Dutch mental health care institute. The main finding is that eHealth can support a transforming practice shifting towards more recovery-oriented, person-centered, and community-based service in which shared-decision making is self-evident. The main challenge revealed is how to deal with clients' voices, when professionals see the value of eHealth but clients do not want to start using eHealth. The shift towards client-centered and network-oriented care models and towards blended care models are both high-impact changes in themselves. Acknowledging the complexity of combining these high-impact changes might be the first step towards creating blended client-centered and network-oriented care. Future research should examine whether and how these substantial shifts could be mutually supportive.

Assessing Professionals' Adoption Readiness for eMental Health: Development and Validation of the eMental Health Adoption Readiness Scale

BACKGROUND

The last few decades have witnessed significant advances in the development of digital tools and applications for mental health care. Despite growing evidence for their effectiveness, acceptance and use of these tools in clinical practice remain low. Hence, a validated and easy-to-use instrument for assessing professionals' readiness to adopt eMental health (EMH) is necessary to gain further insights into the process of EMH adoption and facilitate future research on this topic.

OBJECTIVE

The aim of this study is to develop and validate an instrument for assessing mental health care professionals' readiness to adopt EMH.

METHODS

Item generation was guided by literature and inputs from mental health care professionals and experts in survey development. Exploratory factor analyses were conducted on an initial set of 29 items completed by a sample of mental health care professionals (N=432); thereafter, the scale was reduced to 15 items in an iterative process. The factor structure thus obtained was subsequently tested using a confirmatory factor analysis with a second sample of mental health care professionals (N=363). The internal consistency, convergent validity, and predictive validity of the eMental Health Adoption Readiness (eMHAR) Scale were assessed.

RESULTS

Exploratory factor analysis resulted in a 3-factor solution with 15 items. The factors were analyzed and labeled as perceived benefits and applicability of EMH, EMH proactive innovation, and EMH self-efficacy. These factors were confirmed through a confirmatory factor analysis. The total scale and subscales showed a good internal consistency (Cronbach α=.73-.88) along with acceptable convergent and predictive relationships with related constructs.

CONCLUSIONS

The constructed eMHAR Scale showed a conceptually interpretable 3-factor structure having satisfactory characteristics and relationships with relevant concepts. Its ease of use allows for quick acquisition of data that can contribute to understanding and facilitating the process of adoption of EMH by clinical professionals.

Understanding Mental Health App Use Among Community College Students: Web-Based Survey Study

Background

Mental health concerns are a significant issue among community college students, who often have less access to resources than traditional university college students. Mobile apps have the potential to increase access to mental health care, but there has been little research investigating factors associated with mental health app use within the community college population.

Objective

This study aimed to understand facilitators of and barriers to mental health app use among community college students.

Methods

A web-based survey was administered to a randomly selected sample of 500 community college students from April 16 to June 30, 2020. Structural equation modeling was used to test the relationships between the use of mental health apps, perceived stress, perceived need to seek help for mental health concerns, perceived stigma, past use of professional mental health services, privacy concerns, and social influence of other people in using mental health apps.

Results

Of the 500 participants, 106 (21.2%) reported use of mental health apps. Perceived stress, perceived need to seek help, past use of professional services, and social influence were positively associated with mental health app use. Furthermore, the effect of stress was mediated by a perceived need to seek help. Privacy concerns were negatively associated with mental health app use. Stigma, age, and gender did not have a statistically significant effect.

Conclusions

These findings can inform development of new digital interventions and appropriate outreach strategies to engage community college students in using mental health apps.

Experiences of therapists conducting psychological assessments and video conferencing therapy sessions with people with mild intellectual disabilities during the COVID-19 pandemic

Background. Due to the restrictive measures introduced to tackle the COVID-19 pandemic, therapists working with people with mild intellectual disabilities have had to use video conferencing to continue to conduct their psychological assessments and therapy sessions. This qualitative study explored therapists' experiences of using video conferencing during the initial lockdown period in the Netherlands. Method. In total, seven therapists working at a service organisation supporting people with intellectual disabilities participated in this qualitative study (M = 34.4 years; SD = 6.0, range: 26-42). The therapists documented their experiences via audio recordings, which were subsequently analysed using thematic analysis. Results. Five themes emerged: 1) An immediate transition to virtual working; 2) Developing virtual ways to support service users in both coping with COVID-19 related stress and with continuing therapy; 3) Lacking the appropriate equipment; 4) Limitations in virtually attuning to people with mild intellectual disabilities; and 5) Unforeseen opportunities for distance-based psychological assessments and therapy. Conclusions. This study provides valuable insights into the experiences of therapists using video conferencing to support people with mild intellectual disabilities during the COVID-19 pandemic. These insights can help inform clinical practice with respect to the use of video conferencing for psychological assessment and therapy with people with mild intellectual disabilities.

Video-consulting to address mental health needs after traumatic brain injury: evaluation of a training workshop to build capacity among psychologists

BACKGROUND

Traumatic brain injury (TBI) can lead to significant psychological distress, but few psychologists in Australia are trained in working with this complex clinical group. Despite government funding to provide video-consulting (VC) services in Australia, uptake before COVID-19 was limited.

OBJECTIVE

This mixed methods study evaluated whether training in eHealth and evidence based TBI psychological therapies increased provider uptake of VC in clinical practice, and delivery of mental health services to individuals with TBI.

METHODS

Mental health professionals completed a range of self-report measures before (n = 50), after (n = 48), and four months following (n = 30) a one-day workshop. Participants' TBI knowledge, client-base and levels of access, confidence, motivation and attitudes toward VC were assessed. Knowledge did not increase after training but participants had significant increases in their confidence and motivation to using VC at follow up. Significant reductions in pragmatic barriers to using VC were reported post training and at follow up, all barrier categories indicated significant reductions. There was no significant change in clinical practice of the participants.

CONCLUSIONS

Training to increase TBI knowledge requires specific assessment tools and although training appears to reduce barriers to using VC, uptake in clinical practice may require additional supervision and warrants further research.

Stakeholder consultation to facilitate implementation of interventions for prevention and promotion in mental health in Europe: introducing the design of the ICare Stakeholder Survey

BACKGROUND

Online interventions to prevent mental health problems have proven to be effective. However, knowledge about their implementation in real-world practice as well as for dissemination to the target groups in different settings is scarce. The goal of the 'ICare' network is to establish a comprehensive model of eMental-health service delivery in and across different European countries. Since implementation and dissemination are influenced by many contextual factors, in the first phase of ICare a stakeholder survey was conducted. The survey aim was to explore stakeholders' experiences, needs and attitudes regarding Internet-based prevention of mental health problems and hindering and fostering factors for implementation and dissemination. This article is part of a supplement and describes the design of the stakeholder survey. Survey results are published in separate articles in the same supplement.

METHODS

Based on a literature review and the individual characteristics of the ICare interventions, stakeholder groups were identified in different settings across six European countries. The RE-AIM framework guided the development of the research questions and survey instruments. A concurrent mixed methods design was applied comprising focus groups with the intended target groups of ICare interventions, an online questionnaire with potential facilitators/delivery staff and semi-structured interviews with policy makers.

CONCLUSION

The challenge was to develop a design that allowed flexibility but at the same did not jeopardize the validity of the study. Implications drawn from this survey are not restricted to specific preventive interventions but will provide general information on how online mental illness prevention can be best implemented in various settings.

If There's Something Strange in Your Neighbourhood, Who You Gonna Call? Perceived Mental Health Service User Suitability for Video Consultations

COVID-19 has placed additional challenges on mental health services. Video consultations (VCs) have provided a short-term solution to lockdown restrictions but could also increase long-term capacity to meet the anticipated rising demand. A total of 7752 VCs were conducted over six weeks. Thematic analysis of 474 online survey responses identified twenty patient attributes that influenced staffs’ decisions to offer VCs. Their opinions were diverse, at times contradictory, and not always evidence based. There was reasonable consensus (and published evidence to support) of the probable suitability of VC for patients who: are IT savvy and suitably equipped; are teenagers; live in remote/rural locations; have caring responsibilities; have anxiety disorders or express a preference. No consensus was reached regarding eight attributes and there was a corresponding paucity of evidence, indicating the need for further research. Conversely, old age; paranoia, sensory impairment/communication difficulties; high risk and trauma/PTSD (posttraumatic stress disorder) were generally seen as contraindicated by staff, despite published evidence of success elsewhere. It may be possible to overcome staff’s reticence to offer these groups VCs. As staff are effectively the gatekeepers to VC interventions, it is important to understand and support them to overcome reservations that are contrary to the empirical evidence base. This will ensure that their initial anxieties do not become unnecessary barriers to services for those most in need. As with all mental healthcare, such decisions should be made collaboratively, and on an individual basis.

Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review

Background

Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user’s uptake and sustained interactions with these interventions.

Objective

This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs.

Methods

A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included.

Results

A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one’s own health.

Conclusions

Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions.

Organizational and Policy Barriers to the Use of Digital Mental Health by Mental Health Professionals

Background: Digital mental health (DMH) provides effective methods of overcoming issues of time constraints, accessibility, and availability of mental health care. They can provide a valuable means to deliver mental health care in the present pandemic. However, adoption of these methods has been slow. Mental health professional (MHP) concerns at the organizational and policy level that influence this slow adoption need to be examined. Materials and Methods: A narrative review was conducted to identify the barriers. Searches using the databases Scopus, Embase, and PubMed were conducted to identify research focused on barriers reported by MHPs to use DMH. Results: The search resulted in 356 unique citations, and 21 papers met the inclusion and exclusion criteria. Forward and backward sampling resulted in identifying an additional 19 relevant papers. Discussion: Unmet needs for information, training, and infrastructure, challenges to the workflow and excessive workloads, and ambiguous policies serve as barriers to DMH use. This article recommends strategies for researchers, organizations, DMH designers, and governmental institutions to ensure efficient utilization of DMH. Conclusion: Concerted efforts at individual, organizational, and governmental levels are essential to ensure efficient utilization of DMH.

Design of a Game-Based Training Environment to Enhance Health Care Professionals' E-Mental Health Skills: Protocol for a User Requirements Analysis

BACKGROUND

E-mental health (EMH) offers various possibilities for mental health care delivery, with many studies demonstrating its clinical efficacy. However, the uptake of EMH technologies by mental health care professionals remains to be low. One of the reasons for this is the lack of knowledge and skills in using these technologies. Skill enhancement by means of serious gaming has been shown to be effective in other areas but has not yet been applied to the development of EMH skills of mental health care professionals.

OBJECTIVE

The aim of this paper is to describe a study protocol for the user requirements analysis for the design of a game-based training environment for mental health care professionals to enhance their skills in EMH.

METHODS

The user requirements are formulated using three complementary outputs: personas (lively descriptions of potential users), scenarios (situations that require EMH skills), and prerequisites (required technical and organizational conditions). We collected the data using a questionnaire, co-design sessions, and interviews. The questionnaire was used to determine mental health care professionals' characteristics, attitudes, and skill levels regarding EMH and was distributed among mental health care professionals in the Netherlands. This led to a number of recognizable subuser groups as the basis for personas. Co-design sessions with mental health care professionals resulted in further specification of the personas and an identification of different user scenarios for the game-based training environment. Interviews with mental health care professionals helped to determine the preferences of mental health care professionals regarding training in EMH and the technical and organizational conditions required for the prospective game-based training environment to be used in practice. This combination of requirement elicitation methods allows for a good representation of the target population in terms of both a broad view of user needs (through the large N questionnaire) and an in-depth understanding of specific design requirements (through interviews and co-design).

RESULTS

The questionnaire was filled by 432 respondents; three co-design sessions with mental health care professionals and 17 interviews were conducted. The data have been analyzed, and a full paper on the results is expected to be submitted in the first half of 2021.

CONCLUSIONS

To develop an environment that can effectively support professionals' EMH skill development, it is important to offer training possibilities that address the specific needs of mental health care professionals. The approach described in this protocol incorporates elements that enable the design of a playful training environment that is user driven and flexible and considers the technical and organizational prerequisites that influence its implementation in practice. It describes a protocol that is replicable and provides a methodology for user requirements analyses in other projects and health care areas.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR1-10.2196/18815.

A Perspective on the Integration of eHealth in Treatment of Offenders: Combining Technology and the Risk-Need-Responsivity Model

While there are multiple ways in which eHealth interventions such as online modules, apps and virtual reality can improve forensic psychiatry, uptake in practice is low. To overcome this problem, better integration of eHealth in treatment is necessary. In this perspective paper, we describe how the possibilities of eHealth can be connected to the risk-need-responsivity (RNR) model. To account for the risk-principle, stand-alone eHealth interventions might be used to offer more intensive treatment to high-risk offenders. The need-principle can be addressed by connecting novel experience-based interventions such as VR and apps to stable and acute dynamic risk factors. Finally, using and combining personalized interventions is in line with the responsivity-principle. Based on research inside and outside of forensic psychiatry, we conclude that there are many possibilities for eHealth to improve treatment-not just based on RNR, but also on other models. However, there is a pressing need for more development, implementation and evaluation research.

Health Personnel's Perceived Usefulness of Internet-Based Interventions for Parents of Children Younger Than 5 Years: Cross-Sectional Web-Based Survey Study

BACKGROUND

Approximately 10%-15% of children struggle with different socioemotional and psychological difficulties in infancy and early childhood. Thus, health service providers should have access to mental health interventions that can reach more parents than traditional face-to-face interventions. However, despite increasing evidence on the efficacy of internet-based mental health interventions, the pace in transferring such interventions to health care has been slow. One of the major suggested barriers to this may be the health personnel's attitudes to perceived usefulness of internet-based interventions.

OBJECTIVE

The purpose of this study was to examine health professionals' perceived usefulness of internet-based mental health interventions and to identify the key areas that they consider new internet-based services to be useful.

METHODS

Between May and September 2018, 2884 leaders and practitioners of infant and child health services were recruited to a cross-sectional web-based survey through the following channels: (1) existing email addresses from the Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, course database, (2) an official mailing list to infant and child health services, (3) social media, or (4) other recruitment channels. Respondents filled in background information and were asked to rate the usefulness of internet-based interventions for 12 different infant and child mental health problem areas based on the broad categories from the Diagnostic Classification of Mental Health and Developmental Disorders of Infancy and Early Childhood (DC:0-5). Perceived usefulness was assessed with 1 global item: "How often do you think internet-based self-help programs can be useful for following infant and child mental health problems in your line of work?" The answers were scored on a 4-point scale ranging from 0 (never) to 3 (often).

RESULTS

The participants reported that they sometimes or often perceived internet-based interventions as useful for different infant and child mental health problems (scale of 0-3, all means>1.61). Usefulness of internet-based interventions was rated acceptable for sleep problems (mean 2.22), anxiety (mean 2.09), and social withdrawal and shyness (mean 2.07), whereas internet-based interventions were rated as less useful for psychiatric problems such as obsessive behaviors (mean 1.89), developmental disorders (mean 1.91), or trauma (mean 1.61). Further, there were a few but small differences in perceived usefulness between service leaders and practitioners (all effect sizes<0.32, all P<.02) and small-to-moderate differences among daycare centers, well-baby clinics, municipal child welfare services, and child and adolescent mental health clinics (all effect sizes<0.69, all P<.006).

CONCLUSIONS

Internet-based interventions for different infant and child mental health problems within services such as daycare centers, well-baby clinics, municipal child welfare services, and child and adolescent mental health clinics are sometimes or often perceived as useful. These encouraging findings can support the continued exploration of internet-based mental health interventions as a way to improve parental support.

Shaping Blended Care: Adapting an Instrument to Support Therapists in Using eMental Health

BACKGROUND

Although eMental health interventions, especially when delivered in a blended way, have great potential to improve the quality and efficiency of mental health care, their use in practice lags behind expectations. The Fit for Blended Care (FfBC) instrument was developed to support therapists and clients in shaping blended care in a way that optimally fits their needs. However, this existing version cannot be directly applied to specific branches of mental health care as it is too broad and generic.

OBJECTIVE

The goal of this study is to adapt the existing FfBC instrument to fit a specific, complex setting-forensic mental health care-by means of participatory development with therapists.

METHODS

The participatory process was divided into 4 phases and was executed by a project team consisting of 1 manager, 3-5 therapists, and 1 researcher. In phase 1, general requirements for the adaptation of the existing instrument were discussed in 2 focus groups with the project team. In phase 2, patient-related factors that influence the use of an existing web-based intervention were elicited through semistructured interviews with all 18 therapists working at an outpatient clinic. In phase 3, multiple focus groups with the project teams were held to create the first version of the adapted FfBC instrument. In phase 4, a digital prototype of the instrument was used with 8 patients, and the experiences of the 4 therapists were discussed in a focus group.

RESULTS

In phase 1, it became clear that the therapists' main requirement was to develop a much shorter instrument with a few items, in which the content was specifically tailored to the characteristics of forensic psychiatric outpatients. The interviews showed a broad range of patient-related factors, of which 5 were used in the instrument: motivation for blended treatment; writing about thoughts, feelings, and behavior; conscientiousness; psychosocial problems; and social support. In addition, a part of the instrument was focused on the practical necessary preconditions that patients should fill by themselves before the treatment was developed. The use of the web-based prototype of the instrument in treatment resulted in overall positive experiences with the content; however, therapists indicated that the items should be formulated in a more patient-centered way to encourage their involvement in discussing the factors.

CONCLUSIONS

The participatory, iterative process of this study resulted in an adapted version of the FfBC instrument that fits the specific forensic context and supports shared decision making. In general, the adaptiveness of the instrument is important: its content and implementation should fit the type of care, the organization, and eHealth intervention. To adapt the instrument to other contexts, the guidelines described in this paper can be followed.

The Use of New Digital Information and Communication Technologies in Psychological Counseling during the COVID-19 Pandemic

The use of digital information and communication technologies (ICTs) has enabled many professionals to continue to provide their services during the COVID-19 pandemic. However, little is known about the adoption of ICTs by psychologists and the impact of such technologies on their practice. This study aimed to explore psychologists’ practices related with the use of ICTs before and during the COVID-19 lockdown, to identify the main changes that the pandemic has brought and the impact that such changes have had on their practice with clients, and also identify the factors that potentially have affected such changes. The Portuguese Psychologists Association announced the study, and 108 psychologists responded to an online survey during the mandatory lockdown. The results showed that these professionals continued to provide their services due to having adopted ICTs. Comparing with face-to-face interventions, psychologists recognized that additional precautions/knowledge were needed to use such technologies. Despite the challenges identified, they described the experience with the use of ICTs as positive, meeting clients’ adherence, and yielding positive results. Psychologists with the most years of professional experience maintained their services the most, but those with average experience showed the most favorable attitudes toward the use of technologies and web-based interventions.

Integration of Online Treatment Into the "New Normal" in Mental Health Care in Post-COVID-19 Times: Exploratory Qualitative Study

BACKGROUND

The COVID-19 pandemic has necessitated an immediate and large-scale uptake of online treatment for mental health care. However, there is uncertainty about what the "new normal" in mental health care will be like in post-COVID-19 times. To what extent will the experiences gained during the pandemic influence a sustainable adoption and implementation of online mental health care treatment in the future?

OBJECTIVE

In this paper, we aim to formulate expectations with regard to the sustainability of online mental health care after COVID-19.

METHODS

In an interview study, 11 mental health care professionals were asked about their experiences and expectations for the future. Participants were recruited from a mental health care organization in the Netherlands. The interviews took place between April 7-30, 2020, at the peak of the COVID-19 crisis in the Netherlands. The data were analyzed using a thematic coding method.

RESULTS

From the interviews, we learn that the new normal in mental health care will most likely consist of more blended treatments. Due to skill enhancement and (unexpected) positive experiences with online treatment, an increase in adoption is likely to take place. However, not all experiences promise a successful and sustainable upscaling of online treatment in the future. Mental health care professionals are learning that not all clients are able to benefit from this type of treatment.

CONCLUSIONS

Sustainable upscaling of online mental health care requires customized solutions, investments in technology, and flexibility of mental health care providers. Online treatment could work for those who are open to it, but many factors influence whether it will work in specific situations. There is work to be done before online treatment is inherently part of mental health care.

Technology Evaluation and Assessment Criteria for Health Apps (TEACH-Apps): Pilot Study

BACKGROUND

Despite the emergence of app evaluation tools, there remains no well-defined process receptive to diverse local needs, rigorous standards, and current content. The need for such a process to assist in the implementation of app evaluation across all medical fields is evident. Such a process has the potential to increase stakeholder engagement and catalyze interest and engagement with present-day app evaluation models.

OBJECTIVE

This study aimed to develop and pilot test the Technology Evaluation and Assessment Criteria for Health apps (TEACH-apps).

METHODS

Tailoring a well-known implementation framework, Replicating Effective Programs, we present a new process to approach the challenges faced in implementing app evaluation tools today. As a culmination of our experience implementing this process and feedback from stakeholders, we present the four-part process to aid the implementation of mobile health technology. This paper outlines the theory, evidence, and initial versions of the process.

RESULTS

The TEACH-apps process is designed to be broadly usable and widely applicable across all fields of health. The process comprises four parts: (1) preconditions (eg, gathering apps and considering local needs), (2) preimplementation (eg, customizing criteria and offering digital skills training), (3) implementation (eg, evaluating apps and creating educational handouts), and (4) maintenance and evolution (eg, repeating the process every 90 days and updating content). TEACH-apps has been tested internally at our hospital, and there is growing interest in partnering health care facilities to test the system at their sites.

CONCLUSIONS

This implementation framework introduces a process that equips stakeholders, clinicians, and users with the foundational tools to make informed decisions around app use and increase app evaluation engagement. The application of this process may lead to the selection of more culturally appropriate and clinically relevant tools in health care.