Psychometric performance of the Mental Health Implementation Science Tools (mhIST) across six low- and middle-income countries

Scaling up a brief alcohol intervention to prevent HIV infection in Vietnam: a cluster randomized, implementation trial

BACKGROUND

Evidence-based interventions (EBIs) often address normative behaviors. If a behavior is also common among clinicians, they may be skeptical about the necessity or effectiveness of an EBI. Alternatively, clinicians' attitudes and behaviors may be misaligned, or they may lack the knowledge and self-efficacy to deliver the EBI. Several EBIs address unhealthy alcohol use, a common and often culturally acceptable behavior. But unhealthy alcohol use may be particularly harmful to people with HIV (PWH). Here, we present an implementation trial using an experiential implementation strategy to address clinicians' knowledge, attitudes, and behaviors. Clinicians receive the experiential intervention before they begin delivering an evidence-based brief alcohol intervention (BAI) to PWH with unhealthy alcohol use.

METHODS

Design: In this hybrid type 3 implementation-effectiveness cluster randomized controlled trial, ART clinics (n = 30) will be randomized 1:1 to facilitation, a flexible strategy to address implementation barriers, or facilitation plus the experiential brief alcohol intervention (EBAI). In the EBAI arm, clinicians, irrespective of their alcohol use, will be offered the BAI as experiential learning. EBAI will address clinicians' alcohol-related attitudes and behaviors and increase their knowledge and confidence to deliver the BAI.

PARTICIPANTS

ART clinic staff will be enrolled and assessed at pre-BAI training, post-BAI training, 3, 12, and 24 months. All PWH at the ART clinics who screen positive for unhealthy alcohol use will be offered the BAI. A subset of PWH (n = 810) will be enrolled and assessed at baseline, 3, and 12 months.

OUTCOMES

We will compare implementation outcomes (acceptability, fidelity, penetration, costs, and sustainability) and effectiveness outcomes (viral suppression and alcohol use) between the two arms. We will assess the impact of site-level characteristics on scaling-up the BAI. We will also evaluate how experiencing the BAI affected clinical staff's alcohol use and clinic-level alcohol expectations in the EBAI arm.

DISCUSSION

This trial contributes to implementation science by testing a novel strategy to implement a behavior change intervention in a setting in which clinicians themselves may engage in the behavior. Experiential learning may be useful to address normative and difficult to change lifestyle behaviors that contribute to chronic diseases.

TRIAL REGISTRATION

NCT06358885 (04/10/2024), https://clinicaltrials.gov/study/NCT06358885 .

Sibling-Support for Adolescent Girls (SSAGE): A study protocol for a pilot randomized-controlled trial of a whole-family, gender transformative approach to preventing mental illness among forcibly displaced adolescent girls

BACKGROUND

Forcibly displaced adolescents face increased risks for mental illness and distress, with adolescent girls disproportionately affected in part due to heightened gender inequity. Although the family unit has the potential to promote healthy development in adolescents, few family interventions have employed a gender transformative approach or included male siblings to maximize benefits for adolescent girls.

METHODS

This study will assess a whole-family and gender transformative intervention-Sibling Support for Adolescent Girls in Emergencies (SSAGE)-to prevent mental health disorders among adolescent girls in Colombia who were recently and forcibly displaced from Venezuela. The study will employ a hybrid type 1 effectiveness-implementation pilot randomized control trial (RCT) to test the program's effectiveness to explore determinants of implementation to establish the feasibility, acceptability, and fidelity of SSAGE. To address these aims, we will enroll 180 recently arrived, forcibly displaced adolescent girls in an RCT and examine the program's effectiveness in the prevention of mental illness (through reduction in anxiety, depression, interpersonal sensitivity, and somatization symptoms) one-month post-intervention. We will use contextually adapted to collect data on the hypothesized mechanistic pathways, including family attachment, gender-equitable family functioning, self-esteem, and coping strategies. The implementation evaluation will employ mixed methods to assess the program's feasibility, acceptability, fidelity, and barriers and facilitators to successful implementation.

DISCUSSION

Findings can support humanitarian program implementation, as well as inform policy to support adolescent girls' mental health and to prevent the myriad disorders that can arise as a result of exposure to displacement, conflict, and inequitable gender norms.

Implementing a pharmacist-integrated collaborative model of medication treatment for opioid use disorder in primary care: study design and methodological considerations

BACKGROUND

Pharmacists remain an underutilized resource in the treatment of opioid use disorder (OUD). Although studies have engaged pharmacists in dispensing medications for OUD (MOUD), few studies have evaluated collaborative care models in which pharmacists are an active, integrated part of a primary care team offering OUD care.

METHODS

This study seeks to implement a pharmacist integrated MOUD clinical model (called PrIMO) and evaluate its feasibility, acceptability, and impact across four diverse primary care sites. The Consolidated Framework for Implementation Research is used as an organizing framework for study development and interpretation of findings. Implementation Facilitation is used to support PrIMO adoption. We assess the primary outcome, the feasibility of implementing PrIMO, using the Stages of Implementation Completion (SIC). We evaluate the acceptability and impact of the PrIMO model at the sites using mixed-methods and combine survey and interview data from providers, pharmacists, pharmacy technicians, administrators, and patients receiving MOUD at the primary care sites with patient electronic health record data. We hypothesize that it is feasible to launch delivery of the PrIMO model (reach SIC Stage 6), and that it is acceptable, will positively impact patient outcomes 1 year post model launch (e.g., increased MOUD treatment retention, medication regimen adherence, service utilization for co-morbid conditions, and decreased substance use), and will increase each site's capacity to care for patients with MOUD (e.g., increased number of patients, number of prescribers, and rate of patients per prescriber).

DISCUSSION

This study will provide data on a pharmacist-integrated collaborative model of care for the treatment of OUD that may be feasible, acceptable to both site staff and patients and may favorably impact patients' access to MOUD and treatment outcomes.

TRIAL REGISTRATION

The study was registered on Clinicaltrials.gov (NCT05310786) on April 5, 2022, https://www.

CLINICALTRIALS

gov/study/NCT05310786?id=NCT05310786&rank=1.

Strategies to improve the implementation and effectiveness of community-based psychosocial support interventions for displaced, migrant and host community women in Latin America

As evidence supporting the effectiveness of mental health and psychosocial interventions grows, more research is needed to understand optimal strategies for improving their implementation in diverse contexts. We conducted a qualitative process evaluation of a multicomponent psychosocial intervention intended to promote well-being among refugee, migrant and host community women in three diverse contexts in Ecuador and Panamá. The objective of this study is to describe the relationships among implementation determinants, strategies and outcomes of this community-based psychosocial intervention. The five implementation strategies used in this study included stakeholder engagement, promoting intervention adaptability, group and community-based delivery format, task sharing and providing incentives. We identified 10 adaptations to the intervention and its implementation, most of which were made during pre-implementation. Participants (n = 77) and facilitators (n = 30) who completed qualitative interviews reported that these strategies largely improved the implementation of the intervention across key outcomes and aligned with the study's intervention and implementation theory of change models. Participants and facilitators also proposed additional strategies for improving reach, implementation and maintenance of this community-based psychosocial intervention.

Task Sharing and Remote Delivery of Brief Interpersonal Counseling for Venezuelan Migrants and Refugees Living in Peru during the COVID-19 Pandemic: A Mixed-Methods Pilot Study

Refugees and migrants experience an elevated risk for mental health problems and face significant barriers to receiving services. Interpersonal counseling (IPC-3) is a three-session intervention that can be delivered by non-specialists to provide psychological support and facilitate referrals for individuals in need of specialized care. We piloted IPC-3 delivered remotely by eight Venezuelan refugee and migrant women living in Peru. These counselors provided IPC-3 to Venezuelan refugee and migrant clients in Peru (n = 32) who reported psychological distress. Clients completed assessments of mental health symptoms at baseline and one-month post-intervention. A subset of clients (n = 15) and providers (n = 8) completed post-implementation qualitative interviews. Results showed that IPC-3 filled a gap in the system of mental health care for refugees and migrants in Peru. Some adaptations were made to IPC-3 to promote its relevance to the population and context. Non-specialist providers developed the skills and confidence to provide IPC-3 competently. Clients displayed large reductions in symptoms of depression (d = 1.1), anxiety (d = 1.4), post-traumatic stress (d = 1.0), and functional impairment (d = 0.8). Remote delivery of IPC-3 by non-specialists appears to be a feasible, acceptable, and appropriate strategy to address gaps and improve efficiency within the mental health system and warrants testing in a fully powered effectiveness study.

A Case Study of the Development of a Valid and Pragmatic Implementation Science Measure: The Barriers and Facilitators in Implementation of Task-Sharing Mental Health Interventions (BeFITS-MH) Measure

Background

Few implementation science (IS) measures have been evaluated for validity, reliability and utility - the latter referring to whether a measure captures meaningful aspects of implementation contexts. In this case study, we describe the process of developing an IS measure that aims to assess Barriers and Facilitators in Implementation of Task-Sharing in Mental Health services (BeFITS-MH), and the procedures we implemented to enhance its utility.

Methods

We summarize conceptual and empirical work that informed the development of the BeFITS-MH measure, including a description of the Delphi process, detailed translation and local adaptation procedures, and concurrent pilot testing. As validity and reliability are key aspects of measure development, we also report on our process of assessing the measure's construct validity and utility for the implementation outcomes of acceptability, appropriateness, and feasibility.

Results

Continuous stakeholder involvement and concurrent pilot testing resulted in several adaptations of the BeFITS-MH measure's structure, scaling, and format to enhance contextual relevance and utility. Adaptations of broad terms such as "program," "provider type," and "type of service" were necessary due to the heterogeneous nature of interventions, type of task-sharing providers employed, and clients served across the three global sites. Item selection benefited from the iterative process, enabling identification of relevance of key aspects of identified barriers and facilitators, and what aspects were common across sites. Program implementers' conceptions of utility regarding the measure's acceptability, appropriateness, and feasibility were seen to cluster across several common categories.

Conclusions

This case study provides a rigorous, multi-step process for developing a pragmatic IS measure. The process and lessons learned will aid in the teaching, practice and research of IS measurement development. The importance of including experiences and knowledge from different types of stakeholders in different global settings was reinforced and resulted in a more globally useful measure while allowing for locally-relevant adaptation. To increase the relevance of the measure it is important to target actionable domains that predict markers of utility (e.g., successful uptake) per program implementers' preferences. With this case study, we provide a detailed roadmap for others seeking to develop and validate IS measures that maximize local utility and impact.

Implementation measurement in global mental health: Results from a modified Delphi panel and investigator survey

Limited guidance exists to support investigators in the choice, adaptation, validation and use of implementation measures for global mental health implementation research. Our objectives were to develop consensus on best practices for implementation measurement and identify strengths and opportunities in current practice. We convened seven expert panelists. Participants rated approaches to measure adaptation and validation according to appropriateness and feasibility. Follow-up interviews were conducted and a group discussion was held. We then surveyed investigators who have used quantitative implementation measures in global mental health implementation research. Participants described their use of implementation measures, including approaches to adaptation and validation, alongside challenges and opportunities. Panelists agreed that investigators could rely on evidence of a measure's validity, reliability and dimensionality from similar contexts. Panelists did not reach consensus on whether to establish the pragmatic qualities of measures in novel settings. Survey respondents (n = 28) most commonly reported using the Consolidated Framework for Implementation Research Inner Setting Measures (n = 9) and the Program Assessment Sustainability Tool (n = 5). All reported adapting measures to their settings; only two reported validating their measures. These results will support guidance for implementation measurement in support of mental health services in diverse global settings.

Application of the Expert Recommendations for Implementing Change (ERIC) compilation of strategies to health intervention implementation in low- and middle-income countries: a systematic review

BACKGROUND

The Expert Recommendations for Implementing Change (ERIC) project developed a compilation of implementation strategies that are intended to standardize reporting and evaluation. Little is known about the application of ERIC in low- and middle-income countries (LMICs). We systematically reviewed the literature on the use and specification of ERIC strategies for health intervention implementation in LMICs to identify gaps and inform future research.

METHODS

We searched peer-reviewed articles published through March 2023 in any language that (1) were conducted in an LMIC and (2) cited seminal ERIC articles or (3) mentioned ERIC in the title or abstract. Two co-authors independently screened all titles, abstracts, and full-text articles, then abstracted study, intervention, and implementation strategy characteristics of included studies.

RESULTS

The final sample included 60 studies describing research from all world regions, with over 30% published in the final year of our review period. Most studies took place in healthcare settings (n = 52, 86.7%), while 11 (18.2%) took place in community settings and four (6.7%) at the policy level. Across studies, 548 distinct implementation strategies were identified with a median of six strategies (range 1-46 strategies) included in each study. Most studies (n = 32, 53.3%) explicitly matched implementation strategies used for the ERIC compilation. Among those that did, 64 (87.3%) of the 73 ERIC strategies were represented. Many of the strategies not cited included those that target systems- or policy-level barriers. Nearly 85% of strategies included some component of strategy specification, though most only included specification of their action (75.2%), actor (57.3%), and action target (60.8%). A minority of studies employed randomized trials or high-quality quasi-experimental designs; only one study evaluated implementation strategy effectiveness.

CONCLUSIONS

While ERIC use in LMICs is rapidly growing, its application has not been consistent nor commonly used to test strategy effectiveness. Research in LMICs must better specify strategies and evaluate their impact on outcomes. Moreover, strategies that are tested need to be better specified, so they may be compared across contexts. Finally, strategies targeting policy-, systems-, and community-level determinants should be further explored.

TRIAL REGISTRATION

PROSPERO, CRD42021268374.

Development and Piloting of a Mental Health Prevention and Referral Program for Veterans and Their Families in Ukraine

BACKGROUND

While growing evidence exists for the effectiveness of mental health interventions in global mental health, the evidence base for psychosocial supports is lacking despite the need for a broader range of supports that span the prevention-treatment continuum and can be integrated into other service systems. Following rigorous evaluation of the Common Elements Treatment Approach (CETA) in Ukraine, this article describes the development and feasibility testing of CETA Psychosocial Support (CPSS), a brief psychosocial prevention and referral program for Ukrainian veterans and their families.

CPSS DEVELOPMENT

CPSS development used evidence-based CETA intervention components and was informed by a stakeholder needs analysis incorporating feedback from veterans and their families, literature review, and expert consultations. The program includes psychoeducation, cognitive coping skill development, and a self-assessment tool that identifies participants for potential referral. After initial development of the program, the intervention underwent: (1) initial implementation by skilled providers focused on iterative refinement; (2) additional field-testing of the refined intervention by newly trained providers in real-world conditions; and (3) a formal pilot evaluation with collection of pre-post mental health assessments and implementation ratings using locally validated instruments.

RESULTS

Fifteen CPSS providers delivered 14 group sessions to 109 participants (55 veterans, 39 family members, and 15 providers from veterans' service organizations). After incorporating changes related to content, process, and group dynamics, data from the pilot evaluation suggest the refined CPSS program is an acceptable and potentially effective brief psychosocial prevention and promotion program that can be implemented by trained veteran providers. Forty percent of participants required safety or referral follow-ups.

CONCLUSION

The iterative, inclusive development process resulted in an appropriate program with content and implementation strategies tailored to Ukrainian veterans and their families. Brief psychosocial programs can fit within a larger multitiered mental health and psychosocial continuum of care that supports further referral.

"They are gaining experience; we are gaining extra hands": a mixed methods study to assess healthcare worker perceptions of a novel strategy to strengthen human resources for HIV in South Africa

BACKGROUND

Lay health workers (LHWs) can support the HIV response by bridging gaps in human resources for health. Innovative strategies are needed to expand LHW programs in many low- and middle-income countries. Youth Health Africa (YHA) is a novel LHW approach implemented in South Africa that places young adults needing work experience in one-year non-clinical internships at health facilities to support HIV programs (e.g., as HIV testers, data clerks). While research suggests YHA can increase HIV service delivery, we need to understand healthcare worker perceptions to know if this is an acceptable and appropriate approach to strengthen human resources for health and healthcare delivery.

METHODS

We conducted a convergent mixed methods study to assess healthcare worker acceptance and perceived appropriateness of YHA as implemented in Gauteng and North West provinces, South Africa and identify issues promoting or hindering high acceptability and perceived appropriateness. To do this, we adapted the Johns Hopkins Measure of Acceptability and Appropriateness to survey healthcare workers who supervised interns, which we analyzed descriptively. In parallel, we interviewed frontline healthcare workers who worked alongside YHA interns and conducted an inductive, thematic analysis. We merged quantitative and qualitative results using the Theoretical Framework of Acceptability to understand what promotes or hinders high acceptance and appropriateness of YHA.

RESULTS

Sixty intern supervisors responded to the survey (91% response rate), reporting an average score of 3.5 for acceptability and 3.6 for appropriateness, on a four-point scale. Almost all 33 frontline healthcare workers interviewed reported the program to be highly acceptable and appropriate. Perceptions that YHA was mutually beneficial, easy to integrate into facilities, and helped facilities be more successful promoted a strong sense of acceptability/appropriateness amongst healthcare workers, but this was tempered by the burden of training interns and limited program communication. Overall, healthcare workers were drawn to the altruistic nature of YHA.

CONCLUSION

Healthcare workers in South Africa believed YHA was an acceptable and appropriate LHW program to support HIV service delivery because its benefits outweighed its costs. This may be an effective, innovative approach to strengthen human resources for HIV services and the broader health sector.