Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework

Peers plus mobile app for treatment in HIV (PATH): protocol for a randomized controlled trial to test a community-based integrated peer support and mHealth intervention to improve viral suppression among Hispanic and Black people living with HIV

BACKGROUND

Significant disparities continue to exist in the HIV care continuum, whereby Hispanic and Black people living with HIV (PLWH) are less likely to achieve viral suppression compared to their White counterparts. Studies have shown that intervention approaches that involve peer navigation may play an important role in supporting patients to stay engaged in HIV care. However, implementation may be challenging in real-world settings where there are limited resources to support peer navigators. Combining a peer navigation approach with scalable mobile health (mHealth) technology may improve impact and implementation outcomes.

METHODS

We combined a peer navigation intervention with a mHealth application and are conducting a randomized controlled trial (RCT) to test the efficacy of this integrated "Peers plus mobile App for Treatment in HIV" (PATH) intervention to improve HIV care engagement, and ultimately sustained viral suppression, among Hispanic and Black PLWH. We will enroll up to 375 PLWH into a two-arm prospective RCT, conducting follow-up assessments every 3 months up to 12 months post-baseline. Participants randomized to the control arm will continue to receive usual care Ryan White Program case management services. Individuals randomized to receive the PATH intervention will receive usual care plus access to two main intervention components: (1) a peer navigation program and (2) a mHealth web application. The primary outcome is sustained HIV viral suppression (undetectable viral load observed at 6- and 12-month follow-up). Secondary outcomes are retention in HIV care, gaps in HIV medical visits, and self-reported ART adherence. Recruitment for the RCT began in November 2021 and will continue until June 2024. Follow-up assessments and medical chart abstractions will be conducted to collect measurements of outcome variables.

DISCUSSION

The efficacy trial of PATH will help to fill gaps in our scientific understanding of how a combined peer navigation and mHealth approach may produce effects on HIV care outcomes while addressing potential implementation challenges of peer navigation in Ryan White-funded clinics.

TRIAL REGISTRATION

The PATH trial is registered at the United States National Institutes of Health National Library of Medicine (ClinicalTrials.gov) under ID # NCT05427318 . Registered on 22 June 2022.

Comparative effectiveness of implementation strategies for Accelerating Cervical Cancer Elimination through the integration of Screen-and-treat Services (ACCESS study): protocol for a cluster randomized hybrid type III trial in Nigeria

BACKGROUND

Despite the increased risk of cervical cancer (CC) among women living with HIV (WLHIV), CC screening and treatment (CCST) rates remain low in Africa. The integration of CCST services into established HIV programs in Africa can improve CC prevention and control. However, the paucity of evidence on effective implementation strategies (IS) has limited the success of integration in many countries. In this study, we seek to identify effective IS to enhance the integration of CCST services into existing HIV programs in Nigeria.

METHODS

Our proposed study has formative and experimental activities across the four phases of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Through an implementation mapping conducted with stakeholders in the exploration phase, we identified a core package of IS (Core) and an enhanced package of IS (Core+) mostly selected from the Expert Recommendations for Implementing Change. In the preparation phase, we refined and tailored the Core and Core+ IS with the implementation resource teams for local appropriateness. In the implementation phase, we will conduct a cluster-randomized hybrid type III trial to assess the comparative effectiveness of Core versus Core+. HIV comprehensive treatment sites (k = 12) will be matched by region and randomized to Core or Core+ in the ratio of 1:1 stratified by region. In the sustainment phase, we will assess the sustainment of CCST at each site. The study outcomes will be assessed using RE-AIM: reach (screening rate), adoption (uptake of IS by study sites), IS fidelity (degree to which the IS occurred according to protocol), clinical intervention fidelity (delivery of CC screening, onsite treatment, and referral according to protocol), clinical effectiveness (posttreatment screen negative), and sustainment (continued integrated CCST service delivery). Additionally, we will descriptively explore potential mechanisms, including organizational readiness, implementation climate, CCST self-efficacy, and implementation intentions.

DISCUSSION

The assessment of IS to increase CCST rates is consistent with the global plan of eliminating CC as a public health threat by 2030. Our study will identify a set of evidence-based IS for low-income settings to integrate evidence-based CCST interventions into routine HIV care in order to improve the health and life expectancy of WLHIV.

TRIAL REGISTRATION

Prospectively registered on November 7, 2023, at ClinicalTrials.gov no. NCT06128304. https://classic.

CLINICALTRIALS

gov/ct2/show/study/NCT06128304.

External relationships as implementation determinants in community-engaged, equity-focused COVID-19 vaccination events

Background

While relationships and connectedness among organizations have been included in implementation theories, models, and frameworks, the increased attention to health equity in implementation science raises the urgency of understanding the role of relationships external to the implementing organization. This paper addresses this gap through an exploration of the role of external relationships in community-based, equity-focused interventions.

Methods

This study focuses on an equity-focused, community-based COVID-19 vaccination intervention in Arkansas, drawing upon long-term community-engaged relationships among University of Arkansas for Medical Sciences and the Hispanic and Marshallese Islander communities. We used an exploratory qualitative descriptive design to examine barriers and facilitators to implementation of COVID-19 vaccination events analyzing in-depth qualitative interviews with implementation team members (n = 17).

Results

All participants described pre-existing relationships among the implementing organization, partner organizations, and communities as a key implementation determinant for this equity-focused program. At the inter-organizational level, external relationships included formal connections and informal relationships among staff (e.g., communication channels from prior partnerships). At the individual level, strong external relationships with the community were facilitators leveraging long-term engagement, community familiarity, and staff from the communities of focus. Strong external relationships facilitated program reach in underserved communities through three mechanisms: (1) reduced time required to establish functional working relationships among partners; (2) accessibility and cultural congruence of health services; and (3) increased trust among community members. Barriers to implementation also existed in external relationships, but had less influence than facilitators.

Conclusions

Achieving health equity in implementation science requires greater understanding of external relationships as implementation determinants. This exploratory study makes a significant contribution to the literature by describing the types of external relationships that facilitate equitable implementation and identifying the mechanisms through which they may work. We argue that approaches to community engagement drawn from community-engaged research approaches may be useful, as these processes require investment in building/maintaining formal and informal organizational and interpersonal relationships. Further research is needed to understand connections among external relationships and other implementation determinants.

Setting Families Up for Success: A Pilot Study of a Toolkit to Enhance the Autism Spectrum Disorder Diagnostic Evaluation Process

Families of children with autism spectrum disorder (ASD) face challenges engaging in services following diagnosis. This study: (1) developed and implemented a toolkit to tailor ASD evaluation feedback to families' needs, and (2) evaluated caregiver and provider perceptions of the toolkit. Focus groups with providers (N = 11) informed toolkit development. Seven providers participated in pilot training and implementation. Provider and caregiver toolkit perceptions were assessed using interviews, surveys, and a fidelity checklist. Toolkit strategies reflect focus group themes. Provider and caregiver ratings suggest the initial feasibility, acceptability, and utility of the toolkit. This toolkit may be feasible to implement in community settings and may increase caregiver satisfaction, though further refinements are needed to support service connection.

Implementation Preparation Costs of Virtual Interview Training in Pre-Employment Transition Services: A Budget Impact Analysis

Virtual Reality Job Interview Training (VR-JIT) and Virtual Interview Training for Transition Age Youth (VIT-TAY) demonstrated initial effectiveness at increasing employment among transition-age youth with disabilities engaged in pre-employment transition services. We characterized activities and estimated the labor and non-labor costs required to prepare schools to implement VR-JIT or VIT-TAY. Implementation preparation and support teams reported labor hours throughout the implementation preparation process. Implementation preparation labor hours at 43 schools cost approximately $1,427 per school, while non-labor costs were $100 per trainee (student). We estimated the replication of implementation preparation labor activities would cost $1,024 per school (range: $841-$1,208). Most costs were spent in delivery planning and teacher training. Given that implementation preparation costs can be barriers to intervention adoption, our results provide critical information for contemplating future implementation of VR-JIT or VIT-TAY.

Global Is Local: Leveraging Global Mental-Health Methods to Promote Equity and Address Disparities in the United States

Structural barriers perpetuate mental health disparities for minoritized US populations; global mental health (GMH) takes an interdisciplinary approach to increasing mental health care access and relevance. Mutual capacity building partnerships between low and middle-income countries and high-income countries are beginning to use GMH strategies to address disparities across contexts. We highlight these partnerships and shared GMH strategies through a case series of said partnerships between Kenya-North Carolina, South Africa-Maryland, and Mozambique-New York. We analyzed case materials and narrative descriptions using document review. Shared strategies across cases included: qualitative formative work and partnership-building; selecting and adapting evidence-based interventions; prioritizing accessible, feasible delivery; task-sharing; tailoring training and supervision; and mixed-method, hybrid designs. Bidirectional learning between partners improved the use of strategies in both settings. Integrating GMH strategies into clinical science-and facilitating learning across settings-can improve efforts to expand care in ways that consider culture, context, and systems in low-resource settings.

Contextualizing medications for opioid use disorder and peer support service provision in the probation system with implementation science

BACKGROUND

Medications for opioid use disorder (MOUD) is an evidence-based approach that reduces opioid-related mortality, particularly among criminal legal-involved persons who are at increased risk of adverse outcomes related to OUD. Implementing evidence-based approaches in the context of probation settings requires an in-depth understanding of specific contexts to improve intervention efficacy and effectiveness. Here, we use the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework to understand implementation contexts for MOUD provision in the probation setting.

METHODS

In-depth individual interviews were conducted with key programmatic stakeholders (treatment providers and probation staff involved in service provision for people on probation). The study examined stakeholder perspectives regarding MOUD and Peer Support Service (PSS) implementation among people who are involved in community supervision. Deductive and inductive thematic analysis was conducted, and subsequently the codes, subcodes, and themes were mapped onto the EPIS framework to better understand implementation contexts.

RESULTS

We deduced key inner, outer, and bridging contexts that shape treatment service provision for individuals with OUD who are on probation. Inner contexts include a strong organizational climate that supports MOUD implementation and enthusiasm for peer support services. Outer contexts include difficulty navigating insurance among providers, treatment costs, and systemic stigma towards MOUD. Bridging contexts include a lack of collaboration/communication between relevant agencies (e.g., probation and courts).

CONCLUSIONS

Findings indicate the implementation is complex and requires a coordinated effort between correctional systems, probation agencies, and community-based treatment providers.

Building an HIV Learning Health Care Community for Youth in Florida: Opportunities and Challenges

In Florida, 33% of new HIV infections among men and 21% of new infections among women are among those younger than 29 years of age. We describe the development of a Learning Health Care Community for youth (Y-LHCC) in Orange County, FL. Its core implementation team (iTeam) was composed of representatives from community agencies and academics, whose work was informed by data from the Florida Department of Health (FDOH) and regional research, in-depth interviews (IDIs) with agency representatives, and a pilot implementation of Tailored Motivational Interviewing (TMI) to improve service provision. IDIs revealed limited programming specifically for youth, significant structural challenges providing them with PrEP, and differences in use of evidence-based behavioral interventions to improve HIV services. FDOH provided data on new HIV infections, linkage to care, viral suppression, and PrEP coverage, however, limitations such as minimal data on PrEP referrals and use, agency level data, and inability to generate data quarterly (which would facilitate program improvement) were encountered. Thirty staff members from five agencies serving youth in Orange County participated in TMI training. About half the agency staff (n = 16) completed at least three of the four online training sessions. MI skills improved from pre- (n = 28; M = 1.96) to post TMI training (n = 11; M = 2.48, SD = 0.57); (t(37) = - 3.14, p = 0.0033). The iTeam held seven remote meetings and two in-person half-day meetings at the end of the study, during which they reassessed areas of focus for improving youth services. They also reiterated their commitment to continuing to meet beyond the study period and to engage other agencies in the newly established coalition. Findings highlight the potential of creating a Y-LHCC in Florida as well as some of the challenges that will need to be overcome to achieve ending the HIV Epidemic goals for young people in the region.

Drivers of success: improving implementation research tools for better health outcomes

A thorough examination of context, and how it influences implementation of evidence-based interventions, is a promising strategy for enhancing child survival initiatives. Spreading approaches that are identified as drivers of successful reduction in under-five mortality from 'exemplar' countries could be pivotal in leading to reductions in other settings facing stagnant mortality rates, in particular for low- and middle-income countries with high disease burden and insufficient programmatic capacity to effectively implement evidence-based interventions at scale. Yet there remains a lack of robust analytic methods to accurately assess mortality and describe the drivers of interventions' implementation success at both national and subnational levels. The field of implementation science and its defining targets and tools is well positioned to address this knowledge gap by integrating qualitative and quantitative research methods into an adaptable evaluation framework that can be tailored to meet the specific needs across varying country contexts. These tools enhance the measurement of population health outcomes and provide crucial evidence on implementation barriers and facilitators that can inform policies that can be adjusted for diverse contexts. This commentary aims to emphasize the role of implementation research in understanding how exemplar countries achieved significant improvements in child survival and in identifying replicable lessons for other settings. Ultimately, all manuscripts underscore the relevance of implementation research in bolstering the reduction of under-five mortality.

Implementation of state health insurance benefit mandates for cancer-related fertility preservation: following policy through a complex system

BACKGROUND

A myriad of federal, state, and organizational policies are designed to improve access to evidence-based healthcare, but the impact of these policies likely varies due to contextual determinants of, reinterpretations of, and poor compliance with policy requirements throughout implementation. Strategies enhancing implementation and compliance with policy intent can improve population health. Critically assessing the multi-level environments where health policies and their related health services are implemented is essential to designing effective policy-level implementation strategies. California passed a 2019 health insurance benefit mandate requiring coverage of fertility preservation services for individuals at risk of infertility due to medical treatments, in order to improve access to services that are otherwise cost prohibitive. Our objective was to document and understand the multi-level environment, relationships, and activities involved in using state benefit mandates to facilitate patient access to fertility preservation services.

METHODS

We conducted a mixed-methods study and used the policy-optimized exploration, preparation, implementation, and sustainment (EPIS) framework to analyze the implementation of California's fertility preservation benefit mandate (SB 600) at and between the state insurance regulator, insurer, and clinic levels.

RESULTS

Seventeen publicly available fertility preservation benefit mandate-relevant documents were reviewed. Interviews were conducted with four insurers; 25 financial, administrative, and provider participants from 16 oncology and fertility clinics; three fertility pharmaceutical representatives; and two patient advocates. The mandate and insurance regulator guidance represented two "Big P" (system level) policies that gave rise to a host of "little p" (organizational) policies by and between the regulator, insurers, clinics, and patients. Many little p policies were bridging factors to support implementation across levels and fertility preservation service access. Characterizing the mandate's functions (i.e., policy goals) and forms (i.e., ways that policies were enacted) led to identification of (1) intended and unintended implementation, service, and patient outcomes, (2) implementation processes by level and EPIS phase, (3) actor-delineated key processes and heterogeneity among them, and (4) inner and outer context determinants that drove adaptations.

CONCLUSIONS

Following the midstream and downstream implementation of a state health insurance benefit mandate, data generated will enable development of policy-level implementation strategies, evaluation of determinants and important outcomes of effective implementation, and design of future mandates to improve fit and fidelity.

Specifying cross-system collaboration strategies for implementation: a multi-site qualitative study with child welfare and behavioral health organizations

BACKGROUND

Cross-system interventions that integrate health, behavioral health, and social services can improve client outcomes and expand community impact. Successful implementation of these interventions depends on the extent to which service partners can align frontline services and organizational operations. However, collaboration strategies linking multiple implementation contexts have received limited empirical attention. This study identifies, describes, and specifies multi-level collaboration strategies used during the implementation of Ohio Sobriety Treatment and Reducing Trauma (Ohio START), a cross-system intervention that integrates services across two systems (child welfare and evidence-based behavioral health services) for families that are affected by co-occurring child maltreatment and parental substance use disorders.

METHODS

In phase 1, we used a multi-site qualitative design with 17 counties that implemented Ohio START. Qualitative data were gathered from 104 staff from child welfare agencies, behavioral health treatment organizations, and regional behavioral health boards involved in implementation via 48 small group interviews about collaborative approaches to implementation. To examine cross-system collaboration strategies, qualitative data were analyzed using an iterative template approach and content analysis. In phase 2, a 16-member expert panel met to validate and specify the cross-system collaboration strategies identified in the interviews. The panel was comprised of key child welfare and behavioral health partners and scholars.

RESULTS

In phase 1, we identified seven cross-system collaboration strategies used for implementation. Three strategies were used to staff the program: (1) contract for expertise, (2) provide joint supervision, and (3) co-locate staff. Two strategies were used to promote service access: (4) referral protocols and (5) expedited access agreements. Two strategies were used to align case plans: (6) shared decision-making meetings, and (7) sharing data. In phase 2, expert panelists specified operational details of the cross-system collaboration strategies, and explained the processes by which strategies were perceived to improve implementation and service system outcomes.

CONCLUSIONS

We identified a range of cross-system collaboration strategies that show promise for improving staffing, service access, and case planning. Leaders, supervisors, and frontline staff used these strategies during all phases of implementation. These findings lay the foundation for future experimental and quasi-experimental studies that test the effectiveness of cross-system collaboration strategies.

Advancing sustainable implementation of an evidence-based mental health intervention in Sierra Leone's schools: protocol for a hybrid type 3 implementation-effectiveness trial

BACKGROUND

Mental health disorders among youth contribute substantially to the global burden of disease, which is exacerbated in low- and middle-income countries (LMICs) due to large mental health treatment gaps. In Sierra Leone, a West African country with a long history of complex adversity, the mental health treatment gap is estimated at 98%. Implementing innovative mental health interventions that can be sustained at scale is a priority. The Youth Readiness Intervention (YRI) is an evidence-based mental health intervention for youth that can be delivered feasibly by lay health workers/nonspecialists. Using mobile-based technologies to assist implementation could improve the reach and sustainability of the YRI in Sierra Leone. This study aims to train teachers to deliver the YRI in Sierra Leone's secondary schools and test the feasibility, acceptability, cost, and fidelity to the YRI of a mobile-based supervision model compared with standard, in-person supervision.

METHODS

We will conduct a hybrid type 3 implementation-effectiveness cluster randomized trial to assess the feasibility, acceptability, costs and fidelity to the YRI implemented by teachers receiving mobile-based supervision vs. standard supervision. Enrolled schools (N = 50) will be randomized to YRI + mobile supervision (N = 20), YRI + standard supervision (N = 20) or waitlist control (N = 10). We will recruit and enroll four teachers per intervention-condition school (N = 160) and 1200 youth. We will collect data on implementation outcomes among teachers, principals and youth via a mixed methods approach at baseline and post-intervention. We will also collect quantitative data on youth mental health and functioning as secondary outcomes at baseline and post-intervention, as well as cost-effectiveness data at 12-month follow-up.

DISCUSSION

Study findings have the potential to expand the reach of mental health services among youth in low-resource settings via a teacher workforce. The use of mobile tools, if successful, could support further scale out and sustainment of the YRI to other regions of Sierra Leone and West Africa more broadly, which could help address the mental health treatment gap.

TRIAL REGISTRATION

Clinical Trial Network: NCT05737667.

Investigating influential factors and mechanisms of surgical resident well-being using social network analysis

BACKGROUND

Burnout and depression in General Surgery residents affect patient care and drive attrition. Few impactful interventions exist, in part because little is known about influential drivers and mechanistic relationships.

METHODS

Residents from 16 general surgery programs completed published well-being scales in January 2021. Social network analysis demonstrated influential relationships between factors, and path analysis revealed drivers of burnout and depression.

RESULTS

300 residents completed the survey (34% response rate). Workplace demand and mindfulness influenced depressive symptoms and emotional exhaustion, mediated by perceived stress. Mindfulness increased personal accomplishment, mediated by psychological well-being (p ​< ​0.05 for all results). All mediated effects were greater than direct effects.

CONCLUSIONS

This study yielded a quantitative conceptual model of mechanistic relationships affecting well-being in surgical residency, identifying stress and psychological well-being (measuring sense of purpose) as central mediators, and triangulating workplace demand and mindfulness as potentially high-yield interventional targets for reducing burnout and depression in surgical residency.

Mis-implementation of evidence-based behavioural health practices in primary care: lessons from randomised trials in Federally Qualified Health Centers

Background

Implementing evidence-based practices (EBPs) within service systems is critical to population-level health improvements - but also challenging, especially for complex behavioral health interventions in low-resource settings. "Mis-implementation" refers to poor outcomes from an EBP implementation effort; mis-implementation outcomes are an important, but largely untapped, source of information about how to improve knowledge exchange.

Aims and objectives

We present mis-implementation cases from three pragmatic trials of behavioral health EBPs in U.S. Federally Qualified Health Centers (FQHCs).

Methods

We adapted the Consolidated Framework for Implementation Research and its Outcomes Addendum into a framework for mis-implementation and used it to structure the case summaries with information about the EBP and trial, mis-implementation outcomes, and associated determinants (barriers and facilitators). We compared the three cases to identify shared and unique mis-implementation factors.

Findings

Across cases, there was limited adoption and fidelity to the interventions, which led to eventual discontinuation. Barriers contributing to mis-implementation included intervention complexity, low buy-in from overburdened providers, lack of alignment between providers and leadership, and COVID-19-related stressors. Mis-implementation occurred earlier in cases that experienced both patient- and provider-level barriers, and that were conducted during the COVID-19 pandemic.

Discussion and conclusion

Multi-level determinants contributed to EBP mis-implementation in FQHCs, limiting the ability of these health systems to benefit from knowledge exchange. To minimize mis-implementation, knowledge exchange strategies should be designed around common, core barriers but also flexible enough to address a variety of site-specific contextual factors and should be tailored to relevant audiences such as providers, patients, and/or leadership.

Models and approaches for building knowledge translation capacity and capability in health services: a scoping review

BACKGROUND

Building healthcare service and health professionals' capacity and capability to rapidly translate research evidence into health practice is critical to the effectiveness and sustainability of healthcare systems. This review scoped the literature describing programmes to build knowledge translation capacity and capability in health professionals and healthcare services, and the evidence supporting these.

METHODS

This scoping review was undertaken using the Joanna Briggs Institute scoping review methodology. Four research databases (Ovid MEDLINE, CINAHL, Embase, and PsycInfo) were searched using a pre-determined strategy. Eligible studies described a programme implemented in healthcare settings to build health professional or healthcare service knowledge translation capacity and capability. Abstracts and full texts considered for inclusion were screened by two researchers. Data from included papers were extracted using a bespoke tool informed by the scoping review questions.

RESULTS

Database searches yielded 10,509 unique citations, of which 136 full texts were reviewed. Thirty-four papers were included, with three additional papers identified on citation searching, resulting in 37 papers describing 34 knowledge translation capability building programmes. Programmes were often multifaceted, comprising a combination of two or more strategies including education, dedicated implementation support roles, strategic research-practice partnerships and collaborations, co-designed knowledge translation capability building programmes, and dedicated funding for knowledge translation. Many programmes utilised experiential and collaborative learning, and targeted either individual, team, organisational, or system levels of impact. Twenty-seven programmes were evaluated formally using one or more data collection methods. Outcomes measured varied significantly and included participant self-reported outcomes, perceived barriers and enablers of knowledge translation, milestone achievement and behaviour change. All papers reported that programme objectives were achieved to varying degrees.

CONCLUSIONS

Knowledge translation capacity and capability building programmes in healthcare settings are multifaceted, often include education to facilitate experiential and collaborative learning, and target individual, team, organisational, or supra-organisational levels of impact. Although measured differently across the programmes, the outcomes were positive. The sustainability of programmes and outcomes may be undermined by the lack of long-term funding and inconsistent evaluation. Future research is required to develop evidence-informed frameworks to guide methods and outcome measures for short-, medium- and longer-term programme evaluation at the different structural levels.

The Quality in Acute Stroke Care (QASC) global scale-up using a cascading facilitation framework: a qualitative process evaluation

BACKGROUND

Variation in hospital stroke care is problematic. The Quality in Acute Stroke (QASC) Australia trial demonstrated reductions in death and disability through supported implementation of nurse-led, evidence-based protocols to manage fever, hyperglycaemia (sugar) and swallowing (FeSS Protocols) following stroke. Subsequently, a pre-test/post-test study was conducted in acute stroke wards in 64 hospitals in 17 European countries to evaluate upscale of the FeSS Protocols. Implementation across countries was underpinned by a cascading facilitation framework of multi-stakeholder support involving academic partners and a not-for-profit health organisation, the Angels Initiative (the industry partner), that operates to promote evidence-based treatments in stroke centres. .We report here an a priori qualitative process evaluation undertaken to identify factors that influenced international implementation of the FeSS Protocols using a cascading facilitation framework.

METHODS

The sampling frame for interviews was: (1) Executives/Steering Committee members, consisting of academics, the Angels Initiative and senior project team, (2) Angel Team leaders (managers of Angel Consultants), (3) Angel Consultants (responsible for assisting facilitation of FeSS Protocols into multiple hospitals) and (4) Country Co-ordinators (senior stroke nurses with country and hospital-level responsibilities for facilitating the introduction of the FeSS Protocols). A semi-structured interview elicited participant views on the factorsthat influenced engagement of stakeholders with the project and preparation for and implementation of the FeSS Protocol upscale. Interviews were recorded, transcribed verbatim and analysed inductively within NVivo.

RESULTS

Individual (n = 13) and three group interviews (3 participants in each group) were undertaken. Three main themes with sub-themes were identified that represented key factors influencing upscale: (1) readiness for change (sub-themes: negotiating expectations; intervention feasible and acceptable; shared goal of evidence-based stroke management); (2) roles and relationships (sub-themes: defining and establishing roles; harnessing nurse champions) and (3) managing multiple changes (sub-themes: accommodating and responding to variation; more than clinical change; multi-layered communication framework).

CONCLUSION

A cascading facilitation model involving a partnership between evidence producers (academic partners), knowledge brokers (industry partner, Angels Initiative) and evidence adopters (stroke clinicians) overcame multiple challenges involved in international evidence translation. Capacity to manage, negotiate and adapt to multi-level changes and strategic engagement of different stakeholders supported adoption of nurse-initiated stroke protocols within Europe. This model has promise for other large-scale evidence translation programs.

Referral to and engagement in substance use disorder treatment within opioid intervention courts in New York: a qualitative study of implementation barriers and facilitators

BACKGROUND

People with opioid use disorder (OUD) are frequently in contact with the court system and have markedly higher rates of fatal opioid overdose. Opioid intervention courts (OIC) were developed to address increasing rates of opioid overdose among court defendants by engaging court staff in identification of treatment need and referral for opioid-related services and building collaborations between the court and OUD treatment systems. The study goal was to understand implementation barriers and facilitators in referring and engaging OIC clients in OUD treatment.

METHODS

Semi-structured interviews were conducted with OIC stakeholders (n = 46) in 10 New York counties in the United States, including court coordinators, court case managers, and substance use disorder treatment clinic counselors, administrators, and peers. Interviews were recorded and transcribed and thematic analysis was conducted, guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) framework, employing both inductive and deductive coding.

RESULTS

Results were conceptualized using EPIS inner (i.e., courts) and outer (i.e., OUD treatment providers) implementation contexts and bridging factors that impacted referral and engagement to OUD treatment from the OIC. Inner factors that facilitated OIC implementation included OIC philosophy (e.g., non-punitive, access-oriented), court organizational structure (e.g., strong court staff connectedness), and OIC court staff and client characteristics (e.g., positive medications for OUD [MOUD] attitudes). The latter two also served as barriers (e.g., lack of formalized procedures; stigma toward MOUD). Two outer context entities impacted OIC implementation as both barriers and facilitators: substance use disorder treatment programs (e.g., attitudes toward the OIC and MOUD; operational characteristics) and community environments (e.g., attitudes toward the opioid epidemic). The COVID-19 pandemic and bail reform were macro-outer context factors that negatively impacted OIC implementation. Facilitating bridging factors included staffing practices that bridged court and treatment systems (e.g., peers); barriers included communication and cultural differences between systems (e.g., differing expectations about OIC client success).

CONCLUSIONS

This study identified key barriers and facilitators that OICs may consider as this model expands in the United States. Referral to and engagement in OUD treatment within the OIC context requires ongoing efforts to bridge the treatment and court systems, and reduce stigma around MOUD.

Community implementation of a brief parent mediated intervention for toddlers with probable or confirmed autism spectrum disorder: feasibility, acceptability, and drivers of success (IE Drmic et al.)

Background

Social ABCs is a caregiver-mediated Naturalistic Developmental Behavioral Intervention for toddlers with confirmed/suspected Autism Spectrum Disorder (ASD), with evidence in controlled research settings. Information is lacking on implementation in community settings. We reported on the treatment effectiveness of this program within a community setting, and the current paper describes the implementation phase of this work. Distinguishing between treatment and implementation effectiveness is critical for transporting interventions from laboratory to community.

Objectives

Describe the implementation of Social ABCs through a large public autism service, supported by a research-community partnership.

Methods

We describe this project through the Exploration, Preparation, Implementation, Sustainment (EPIS) framework as it focuses on implementation of evidence-based practices in publicly funded services. We apply this framework to the reporting stage. This project took place in the context of a 3-year government-funded pilot at a hospital-based publicly funded autism service. Participants: Program developers; Autism Service team; toddlers with suspected/confirmed ASD aged 14-34 months (M = 25.18 months) and their caregivers. Training/supervision: Provided by program developers at tapering intensity. Evaluation: Caregivers completed the Caregiver Diary and satisfaction surveys. We explored training processes, intervention uptake, acceptability, adaptations to fit community context, appropriateness, perceived impact, and facilitators/barriers.

Results

Six coaches were trained to fidelity, and three of these were further trained as Site Trainers. 183 clinically referred families enrolled and 89.4% completed the 12-week program. Caregivers reported increases in adherence and competence, high satisfaction and perceived benefits for their children. Coaches reported high satisfaction. Toddlers were appropriately identified to receive the intervention. Referral processes improved, including decreased referral age, and increased family readiness for diagnostic assessment and subsequent services.

Conclusions

Social ABCs was successfully implemented in a community service through a research-community partnership. The program was feasible, acceptable, and appropriate within a community context. Drivers of success included funding, institutional support, shared decision-making, adaptations to fit context, leadership support, perceived positive impact, and commitment to evaluation.

Impact of a deep learning sepsis prediction model on quality of care and survival

Sepsis remains a major cause of mortality and morbidity worldwide. Algorithms that assist with the early recognition of sepsis may improve outcomes, but relatively few studies have examined their impact on real-world patient outcomes. Our objective was to assess the impact of a deep-learning model (COMPOSER) for the early prediction of sepsis on patient outcomes. We completed a before-and-after quasi-experimental study at two distinct Emergency Departments (EDs) within the UC San Diego Health System. We included 6217 adult septic patients from 1/1/2021 through 4/30/2023. The exposure tested was a nurse-facing Best Practice Advisory (BPA) triggered by COMPOSER. In-hospital mortality, sepsis bundle compliance, 72-h change in sequential organ failure assessment (SOFA) score following sepsis onset, ICU-free days, and the number of ICU encounters were evaluated in the pre-intervention period (705 days) and the post-intervention period (145 days). The causal impact analysis was performed using a Bayesian structural time-series approach with confounder adjustments to assess the significance of the exposure at the 95% confidence level. The deployment of COMPOSER was significantly associated with a 1.9% absolute reduction (17% relative decrease) in in-hospital sepsis mortality (95% CI, 0.3%-3.5%), a 5.0% absolute increase (10% relative increase) in sepsis bundle compliance (95% CI, 2.4%-8.0%), and a 4% (95% CI, 1.1%-7.1%) reduction in 72-h SOFA change after sepsis onset in causal inference analysis. This study suggests that the deployment of COMPOSER for early prediction of sepsis was associated with a significant reduction in mortality and a significant increase in sepsis bundle compliance.

A roadmap to address stress in graduate students: How to develop and disseminate a student-led single-session evidence based intervention

Objective: This manuscript describes an evidence-based, student-led, single-session group intervention to support emotional wellbeing among graduate students. The present objective is to provide a roadmap for other universities. Participants: Key participants include clinical psychology graduate students (leader and workshop facilitators), faculty supervisor, representatives from receiving departments or schools, and institutional advocates. Methods: The two-hour workshop was based on four core transdiagnostic cognitive behavioral skills, including psychoeducation about emotions, mindful emotional awareness, cognitive flexibility, and behavior change. The workshop was designed and continues to be led by trained graduate students. Results: Key steps and lessons learned are presented for the exploration, preparation, implementation, and sustainment phases. Conclusions: This program has the potential to be flexibly replicated at other universities to assist with graduate student mental health. It provides unique supports for recipients and unique training opportunities for student facilitators.

The core functions and forms paradigm throughout EPIS: designing and implementing an evidence-based practice with function fidelity

There are numerous frameworks for implementing evidence-based practices (EBPs) in novel settings to achieve "fidelity." However, identifying appropriate referents for fidelity poses a challenge. The Core Functions and Forms paradigm offers a model that can inform adaptation decisions throughout all phases of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. We applied the Core Functions-Forms paradigm throughout the Exploration and Preparation phases of EPIS in the design of two EBPs targeting family protective factors among Latinos in San Diego, as well as describe plans for its use in Implementation and Sustainment. We employed a distinct approach for each intervention element to contrast adaptation decisions that prioritize adherence to either form or function fidelity. We describe our application of the functions-forms paradigm within the EPIS framework, focusing on the Preparation phase. We also provide functions-forms matrices that map out the relationship between individual intervention components (forms) and the essential processes (functions) by which components are theorized to exert their impact. This case study of how the core functions-forms framework can be mapped onto EPIS can support a conceptual shift from prioritizing form fidelity to also focusing on function fidelity. This might allow interventionists to target appropriate fidelity referents when adapting an EBP, rather than defaulting to maintaining fidelity to forms as described in the protocol. We see great promise for using this framework for guiding actions throughout all EPIS phases and informing future applications of this paradigm to foster more robust fidelity to function.

The Family-Check-Up® Autism Implementation Research (FAIR) Study: protocol for a study evaluating the effectiveness and implementation of a family-centered intervention within a Canadian autism service setting

Introduction

Prevalence rates of emotional and behavior problems (EBP) in autistic children and youth are high (40-70%), and often cause severe and chronic impairment. Furthermore, autistic children are also more likely to experience family "social-ecological" adversity compared to neurotypically developing peers, including social isolation, child maltreatment, caregiver mental illness, and socioeconomic risk. These family stressors increase the risk of co-occurring EBP among autistic children and can often impede access to evidence-based care, thus amplifying long-term health inequities for autistic children and their caregivers. In the current autism services landscape, there are few scalable, evidence-based programs that adequately address these needs. The Family Check-Up (FCU®) is a brief, strength-based, and tailored family-centered intervention that supports positive parenting and explicitly assesses the social determinants of child and family mental health within an ecological framework. Studies have demonstrated long-term positive child and caregiver outcomes in other populations, but the FCU® has not been evaluated in families of autistic children and youth. Therefore, we aimed to evaluate FCU® implementation within an established, publicly funded Autism Program in Ontario, Canada, with delivery by autism therapists, to demonstrate sustainable effectiveness within real-world settings.

Methods

In this study, we outline the protocol for a hybrid implementation-effectiveness approach with two key components: (1) A parallel-arm randomized controlled trial of N = 80 autistic children/youth (ages 6-17 years) and high levels of EBP and their caregivers. Primary and secondary outcomes include child EBP, and caregiver well-being and parenting. (2) A mixed methods implementation study, to describe facilitators and barriers to implementation of the FCU® within an autism service setting.

Discussion

Scalable, ecologically focused family-centered interventions offer promise as key components of a public health framework aimed at reducing mental health inequities among autistic children, youth, and their caregivers. Results of this study will inform further program refinement and scale-up.

Sustainability of an intervention to reduce waiting for access to an epilepsy outpatient clinic

Purpose

Delays in outpatient specialist neurologist care for people with epilepsy are common despite recommendations for prompt access. There is evidence to suggest that there are interventions that can minimise waitlists and waiting time. However, little is known about whether such interventions can result in sustained improvements in waiting. The aim of this study was to determine the extent to which an intervention to reduce waiting in an epilepsy specialist outpatient clinic demonstrated sustained outcomes two years after the intervention was implemented.

Methods

This observational study analysed routinely collected epilepsy clinic data over three study periods: pre-intervention, post-intervention and at two-year follow-up. The intervention, Specific Timely Assessment and Triage (STAT), combined a short-term backlog reduction strategy and creation of protected appointments for new referrals based on analysis of demand. After the initial intervention, there was no further active intervention in the following two years. The primary outcome was waiting measured by 1.) waiting time for access to a clinic appointment, defined as the number of days between referral and first appointment for all patients referred to the epilepsy clinic during the three study periods; and 2.) a snapshot of the number of patients on the waitlist at two time points for each of the three study periods.

Results

Two years after implementing the STAT model in an epilepsy clinic, median waiting time from post-intervention to two-year follow-up was stable (52-51 days) and the interquartile range of days waited reduced from 37 to 77 days post-intervention to 45-57 days at two-year follow-up, with a reduction in the most lengthy wait times observed. After a dramatic reduction of the total number of patients on the waitlist immediately following the intervention, a small rise was seen at two years (n = 69) which remained well below the pre-intervention level (n = 582).

Conclusion

The STAT model is a promising intervention for reducing waiting in an epilepsy clinic. While there was a small increase in the waitlist after two years, the median waiting time was sustained.

Autism Caregiver Coaching in Africa (ACACIA): Protocol for a type 1-hybrid effectiveness-implementation trial

BACKGROUND

While early autism intervention can significantly improve outcomes, gaps in implementation exist globally. These gaps are clearest in Africa, where forty percent of the world's children will live by 2050. Task-sharing early intervention to non-specialists is a key implementation strategy, given the lack of specialists in Africa. Naturalistic Developmental Behavioral Interventions (NDBI) are a class of early autism intervention that can be delivered by caregivers. As a foundational step to address the early autism intervention gap, we adapted a non-specialist delivered caregiver coaching NDBI for the South African context, and pre-piloted this cascaded task-sharing approach in an existing system of care.

OBJECTIVES

First, we will test the effectiveness of the caregiver coaching NDBI compared to usual care. Second, we will describe coaching implementation factors within the Western Cape Department of Education in South Africa.

METHODS

This is a type 1 effectiveness-implementation hybrid design; assessor-blinded, group randomized controlled trial. Participants include 150 autistic children (18-72 months) and their caregivers who live in Cape Town, South Africa, and those involved in intervention implementation. Early Childhood Development practitioners, employed by the Department of Education, will deliver 12, one hour, coaching sessions to the intervention group. The control group will receive usual care. Distal co-primary outcomes include the Communication Domain Standard Score (Vineland Adaptive Behavior Scales, Third Edition) and the Language and Communication Developmental Quotient (Griffiths Scales of Child Development, Third Edition). Proximal secondary outcome include caregiver strategies measured by the sum of five items from the Joint Engagement Rating Inventory. We will describe key implementation determinants.

RESULTS

Participant enrolment started in April 2023. Estimated primary completion date is March 2027.

CONCLUSION

The ACACIA trial will determine whether a cascaded task-sharing intervention delivered in an educational setting leads to meaningful improvements in communication abilities of autistic children, and identify implementation barriers and facilitators.

TRIAL REGISTRATION

NCT05551728 in Clinical Trial Registry (https://clinicaltrials.gov).

Educational Intervention to Increase COVID-19 Vaccine Uptake in Rural Patients with Chronic Diseases: Lessons Learned from An Innovative Academic-Community Partnership

BACKGROUND

The pandemic has disproportionately impacted rural communities with a higher burden of chronic disease and COVID-19 infection. West Virginia is a rural state with a high rate of diabetes, hypertension, and COPD, which are known risk factors for severe COVID-19 and long COVID. Yet, there is a significant hesitancy regarding COVID-19 vaccination uptake in the state. The purpose of this study was to use an educational intervention to increase vaccine knowledge and vaccine acceptance in rural patients with chronic disease(s) in West Virginia. This project used an academic-community partnership comprised of researchers, practitioners, community organizations, community-engaged partners, and patient stakeholders to increase COVID-19 health literacy and increase vaccine acceptance among rural West Virginians with chronic conditions.

MATERIALS AND METHODS

A quasi-experimental study design was used to deliver an educational intervention by trained Health Navigators using short videos to increase COVID-19 health literacy and address participants' vaccine concerns. Eligibility included adults (18 years and older) who have at least one chronic condition. A statewide community advisory board (CAB) guided the development of the educational training curriculum and implementation strategies. An adapted version of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework guided the development of the intervention. Health Navigators (n = 45) delivered the educational intervention in their local communities between November 2022 and October 2023 (project implementation is still ongoing). Intervention fidelity checks, an adaptable script, and a flow chart allowed tailoring of brief videos to address participants' specific COVID-19 questions and vaccine concerns. A validated online survey, monitored by an online Research Electronic Data Capture (REDCap) database, assessed participants' knowledge, perceived susceptibility, and vaccine intention.

RESULTS

Health Navigators delivered the intervention to 1368 West Virginians in 52 counties (59.2% women; 61.8% without a college degree). Participants reported living with an average of 2.1 ± 1.4 chronic conditions. The mean age was 43.5 ± 18.8 years. The majority of participants (81.2%) had received the primary vaccination series, and 63.1% had at least one booster. However, 18% were unvaccinated or did not complete the primary COVID-19 vaccine series. Discussions to improve vaccine literacy focused on how the vaccine was so quickly developed and protects against variants, addressing concerns related to the safety, short- and long-term side effects, and importance of vaccine uptake for immunocompromised individuals. Participants with higher concerns were more likely to be unvaccinated and to have not completed their primary series or boosters (p < 0.001). However, the educational intervention improved the willingness of individuals who were either unvaccinated or did not complete their primary vaccine series to get vaccinated (11.4%).

DISCUSSION

Our findings highlight the importance of vaccine literacy in increasing vaccination rates among rural patients with chronic diseases. Using the EPIS framework allowed us to reflect upon the challenges, ensure resilience during changing local contexts, and plan and implement a promising, cost-effective intervention in rural areas.

CONCLUSIONS

This study provides insights into the need for tailored educational interventions based on disease status, which has implications for public health and patient care in rural and underserved communities. Academic-community partnerships can be useful for successful knowledge transfer for vaccine acceptance to reduce rural health disparities.

Protocol for a hybrid type 3 effectiveness-implementation trial of a pragmatic individual-level implementation strategy for supporting school-based prevention programming

BACKGROUND

For approximately one in five children who have social, emotional, and behavioral (SEB) challenges, accessible evidence-based prevention practices (EBPPs) are critical. In the USA, schools are the primary setting for children's SEB service delivery. Still, EBPPs are rarely adopted and implemented by front-line educators (e.g., teachers) with sufficient fidelity to see effects. Given that individual behavior change is ultimately required for successful implementation, focusing on individual-level processes holds promise as a parsimonious approach to enhance impact. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a pragmatic, multifaceted pre-implementation strategy targeting volitional and motivational mechanisms of educators' behavior change to enhance implementation and student SEB outcomes. This study protocol describes a hybrid type 3 effectiveness-implementation trial designed to evaluate the main effects, mediators, and moderators of the BASIS-T implementation strategy as applied to Positive Greetings at the Door, a universal school-based EBPP previously demonstrated to reduce student disruptive behavior and increase academic engagement.

METHODS

This project uses a blocked randomized cohort design with an active comparison control (ACC) condition. We will recruit and include approximately 276 teachers from 46 schools randomly assigned to BASIS-T or ACC conditions. Aim 1 will evaluate the main effects of BASIS-T on proximal implementation mechanisms (attitudes, subjective norms, self-efficacy, intentions to implement, and maintenance self-efficacy), implementation outcomes (adoption, reach, fidelity, and sustainment), and child outcomes (SEB, attendance, discipline, achievement). Aim 2 will examine how, for whom, under what conditions, and how efficiently BASIS-T works, specifically by testing whether the effects of BASIS-T on child outcomes are (a) mediated via its putative mechanisms of behavior change, (b) moderated by teacher factors or school contextual factors, and (c) cost-effective.

DISCUSSION

This study will provide a rigorous test of BASIS-T-a pragmatic, theory-driven, and generalizable implementation strategy designed to target theoretically-derived motivational mechanisms-to increase the yield of standard EBPP training and support strategies.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT05989568. Registered on May 30, 2023.

Adapting a community pharmacy intervention to improve medication safety

BACKGROUND

Community pharmacies are an ideal location to address challenges of over-the-counter medication safety, yet many successful interventions are only tested in a few pharmacies without expansion, creating unrealized opportunities to improve patient care on a larger scale. Scaling up to numerous pharmacies can be challenging because each community pharmacy has unique needs and layouts and requires individualized adaptation.

OBJECTIVES

This paper reports techniques for (a) adapting a community pharmacy intervention to fit the unique physical layout and patient needs of health system pharmacy sites without increasing staff workload, (b) identifying strategies to gather feedback on adaptations from stakeholders, and (c) developing materials to share with pharmacy champions for them to independently implement and sustain the intervention in their organization.

PRACTICE DESCRIPTION

The study team collaborated with Aurora Pharmacy, Inc to develop an intervention designed to increase awareness of safe over-the-counter medication use for older adults.

PRACTICE INNOVATION

Senior Safe, a community pharmacy-based intervention, was designed, implemented, and tested using the Exploration, Preparation, Implementation, and Sustainment implementation framework.

EVALUATION METHODS

Senior Safe was adapted through pilot testing and a randomized control trial. Feedback was collected from key stakeholders, including pharmacy staff, older adults, and a research advisory group.

RESULTS

A finalized version of Senior Safe, as well as an implementation package, was provided to Aurora Pharmacy to integrate into all 63 sites.

CONCLUSION

This multiphase study illustrated that refining an intervention is possible and welcomed by pharmacy staff, but it requires time, resources, and funds to create an impactful, sustainable community pharmacy intervention.

Factors Associated with HIV Testing Among Spanish and English-Speaking Latino Adolescents Aged 13-18

Adolescent Latino men who have sex with men (LMSM) in the U.S. are disproportionately impacted by HIV. However, there has been limited focus on their HIV prevention and risk behaviors. In this study, we examine the rates of HIV testing and explore the significant demographic and healthcare factors that influence HIV prevention among adolescent LMSM. The analysis for this study utilized data collected during the baseline assessment of SMART, a pragmatic trial aimed at evaluating the effectiveness of an online HIV prevention intervention for adolescent LMSM (N = 524). Only 35.5% of participants had ever had an HIV test in their lifetime. Rates of testing increased among adolescent LMSM who had a doctor with whom they spoke about their sexual health (odds ratio: 4.0; 95% confidence interval: 2.1-8.4; P < 0.001) or HIV testing (odds ratio: 5.8; 95% confidence interval: 3.1-10.7; P < 0.001). Out of the 61 participants who took part in the survey conducted in Spanish, only 26% reported ever having an HIV test. Additionally, 24.5% stated that they had discussed their sexual orientation with a doctor, and only 8.2% had undergone HIV testing. Spanish-speaking adolescents who completed the SMART survey were less likely to openly discuss their sexual orientation or sexual health with most people or have a doctor with whom they discussed these topics, compared to those who completed the survey in English. These findings suggest that Spanish-speaking adolescent LMSM may face obstacles in accessing HIV prevention services in the U.S.

Barriers and enablers to implementing police mental health co-responder programs: A qualitative study using the consolidated framework for implementation research

Background

Police and mental health co-responder programs operate internationally and can be effective in providing timely and appropriate assessment, brief intervention, and referral services for people experiencing mental health crises. However, these models vary greatly, and little is known about how the design and implementation of these programs impacts their effectiveness.

Method

This study was a qualitative, post hoc implementation determinant evaluation of mental health co-responder units in Brisbane, Australia, comprising of verbal or written interviews with police and mental health staff with an on-road role in the co-responder units, and their managers. The Consolidated Framework for Implementation Research was used to identify barriers and enablers to the program's implementation and effectiveness.

Results

Participants (n = 30) from all groups felt strongly that the co-responder units are a substantial improvement over the usual police management of mental health crisis cases, and lead to better outcomes for consumers and the service. Enablers included an information-sharing agreement; the Mental Health Co-Responder (MHCORE) program's compatibility with existing police and mental health services; and the learning opportunity for both organizations. Barriers included cultural differences between the organizations, particularly risk-aversion to suicidality for police and a focus on least-restrictive practices for health; extensive documentation requirements for health; and a lack of specific mental health training for police.

Conclusions

Using an evidence-based implementation science framework enabled identification of a broad range of contextual barriers and enablers to implementation of police mental health co-responder programs. Adapting the program to address these barriers and enablers during the planning, implementation, monitoring, and evaluation phases increases the likelihood of the service's effectiveness. These findings will inform the spread and scale of the co-responder program across Queensland, and will be relevant to police districts internationally considering implementing a co-responder program.

Outer-context determinants on the implementation of school-based interventions for LGBTQ+ adolescents

Background

Schools are critical venues for supporting LGBTQ+ youth well-being. Implementing LGBTQ-supportive practices can decrease experiences of stigmatization, discrimination, and victimization that lead to adverse mental health outcomes like anxiety, depression, and suicidality. However, schools are also subject to a wide range of outer-context pressures that may influence their priorities and implementation of LGBTQ-supportive practices. We assessed the role of emergent outer-context determinants in the context of a 5-year cluster randomized controlled trial to study the implementation of LGBTQ-supportive evidence-informed practices (EIPs) in New Mexico high schools.

Method

Using an iterative coding approach, we analyzed qualitative data from annual interviews with school professionals involved in EIP implementation efforts.

Results

The analysis yielded three categories of outer-context determinants that created challenges and opportunities for implementation: (a) social barriers related to heterocentrism, cisgenderism, and religious conservatism; (b) local, state, and national policy and political discourse; and (c) crisis events.

Conclusions

By exploring the implications of outer-context determinants for the uptake of LGBTQ-supportive practices, we demonstrate that these elements are dynamic-not simply reducible to barriers or facilitators-and that assessing outer-context determinants shaping implementation environments is crucial for addressing LGBTQ health equity.

The motivation and process for developing a consortium-wide time and motion study to estimate resource implications of innovations in the use of genome sequencing to inform patient care

Costs of implementing genomic testing innovations extend beyond the cost of sequencing, affecting personnel and infrastructure for which little data are available. We developed a time and motion (T&M) study within the Clinical Sequencing Evidence-Generating Research (CSER) consortium to address this gap, and herein describe challenges of conducting T&M studies within a research consortium and the approaches we developed to overcome them. CSER investigators created a subgroup to carry out the T&M study (authors). We describe logistical and administrative challenges associated with resource use data collection across heterogeneous projects conducted in real-world clinical settings, and our solutions for completing this study and harmonizing data across projects. We delineate processes for feasible data collection on workflow, personnel, and resources required to deliver genetic testing innovations in each CSER project. A critical early step involved developing detailed project-specific process flow diagrams of innovation implementation in projects' clinical settings. Analyzing diagrams across sites, we identified common process-step themes, used to organize project-specific data collection and cross-project analysis. Given the heterogeneity of innovations, study design, and workflows, which affect resources required to deliver genetic testing innovations, flexibility was necessary to harmonize data collection. Despite its challenges, this heterogeneity provides rich insights about variation in clinical processes and resource implications for implementing genetic testing innovations.

Patient Participant Perspectives on Implementation of Long-Acting Cabotegravir and Rilpivirine: Results From the Cabotegravir and Rilpivirine Implementation Study in European Locations (CARISEL) Study

INTRODUCTION

CARISEL is an implementation-effectiveness "hybrid" study examining the perspectives of people living with HIV-1 (patient study participants [PSPs]) on cabotegravir (CAB) plus rilpivirine (RPV) long-acting (LA) dosed every 2 months (Q2M) across 5 European countries.

METHODS

PSPs completed questionnaires on acceptability (Acceptability of Intervention Measure), appropriateness (Intervention Appropriateness Measure), and feasibility (Feasibility of Intervention Measure) at their first (Month [M] 1), third (M4), and seventh (M12) injection visits. Semistructured qualitative interviews were also conducted.

RESULTS

Overall, 437 PSPs were enrolled, of whom 430 received treatment. Median (interquartile range) age was 44 (37-51) years, 25.3% (n = 109/430) were female (sex at birth), and 21.9% (n = 94/430) were persons of color. Across time points, PSPs found CAB + RPV LA highly acceptable, appropriate, and feasible (mean scores ≥4.47/5). Qualitative data supported these observations.

CONCLUSIONS

PSPs found CAB + RPV LA Q2M to be an acceptable, appropriate, and feasible treatment option.

Testing the incremental effectiveness of pay-for-performance to improve implementation of a motivational interviewing brief intervention for substance use disorders in HIV settings: Results of a cluster-randomized type 3 hybrid trial

Background

Substance use disorders (SUDs) have a serious adverse impact on people living with HIV. Previously, using a 39-site dual-randomized type 2 hybrid trial design, findings from the Substance Abuse Treatment to HIV Care Project supported the Implementation and Sustainment Facilitation (ISF) strategy to improve implementation and effectiveness of a motivational interviewing brief intervention (MIBI) for SUD within HIV service settings across the United States (US). Building on this trial, this cluster-randomized type 3 hybrid trial aimed to test the incremental effectiveness of a pay-for-performance (P4P), a form of the "alter incentive/allowance structures" strategy.

Methods

Twenty-six HIV service organizations, their staff participants (N=87), and their client participants (N=341) were cluster-randomized to one of two implementation conditions. The control condition included staff-focused training, feedback, and consultation (TFC) and team-focused implementation and sustainment (ISF). The experimental condition included TFC+ISF as well as P4P (TFC+ISF+P4P). P4P used financial incentives to reward MIBI implementation (US$10 per MIBI delivered) and MIBI implementation at or above a pre-defined level of quality (US$10 per demonstration). In addition to these outcomes, past 4-week changes/reductions in client participant's days of primary substance use and anxiety symptoms were examined.

Results

The addition of P4P had a large and significant effect on the number of MIBIs implemented (d=1.30, p<.05) and reduction in anxiety (d=-1.54), but there was no impact on days of substance use. P4P had large effects on MIBI quality (d=1.24) and MIBI implementation effectiveness (d=1.28), but these were not significant (p<.10).

Conclusions

P4P is a form of the "alter incentive/allowance structures" strategy Its function is to reward the implementation of a clinical innovation. Rewarding implementation is consistent with the theory of implementation effectiveness, which suggests implementation climate (i.e., the extent to which implementation is expected, supported, and rewarded) is a key antecedent of implementation effectiveness (i.e., the consistency and quality of implementation). We found that P4P had a significant, positive impact on MIBI implementation in HIV service settings, but client-level outcomes were mixed. Future research should examine the cost-effectiveness of this strategy, as well as to examine the effectiveness of P4P to improve the implementation of other evidence-based innovations.

Trial registration

ClinicalTrials.gov: NCT04687917. Registered 12/18/2020.

Examination of provider knowledge, attitudes, and behaviors associated with lung cancer screening among Black men receiving care at a federally qualified health center

The study's goal was to look at providers' knowledge, attitudes, and behaviors regarding lung cancer screening among Black male smokers served by a federally qualified healthcare center. Participants in the study were interviewed in depth. Participants completed a short (5-10 minute) survey that assessed demographics, training, and attitudes toward lung cancer screening. For quantitative data, descriptive statistics were used, and for qualitative data, deductive thematic analysis was used. This study included ten healthcare professionals, the majority of whom identified as Black (80%) and were trained as advanced practice providers (60%). The majority of providers (90%) have heard of LDCT lung cancer screening; however, participants reported only being "somewhat" familiar with the LDCT eligibility criteria (70%). Despite generally positive attitudes toward LDCT, patient referral rates for screening were low. Barriers included a lack of provider knowledge about screening eligibility, a lack of use of shared decision-making tools, and patient concerns about screening risks. The reasons for the low referral rates varied, but they included a preference to refer patients for smoking cessation rather than screening, low screening completion and follow-up rates among referred patients, and a lower likelihood that Black smokers will meet pack-year requirements for screening. Additionally, providers discussed patient-level factors such as a lack of information, mistrust, and transportation. The study findings add to the body of knowledge about lung cancer knowledge and screening practices among providers in FQHC settings. This data can be used to create health promotion interventions aimed at smoking cessation and lung cancer screening in Black males and other high-risk smokers.

MiQuit: A Study Protocol to Link Low-Income Smokers to a State Tobacco Quitline

Purpose

To conduct a randomized controlled trial to compare 3 implementation strategies and the impact of facilitated referrals on linkage of Federally Qualified Health Center patients to the Illinois Tobacco Quitline (ITQL).

Methods

This study will be a hybrid type 3 implementation-effectiveness trial guided by 2 implementation science frameworks: reach, effectiveness, adoption, implementation, and maintenance and exploration preparation implementation sustainment. We will evaluate whether sending provider messages through the patient electronic health portal increases patient linkage to the ITQL. We will (1) randomly assign all eligible patients to receive 1 of 3 messages (information about quitting, advice to quit, and advice to quit or cut down), and (2) we will offer a facilitated linkage to the ITQL. For patients who opt into a facilitated referral, we will share their contact information with the ITQL, who will contact them. Four weeks after the initial message, patients who expressed interest in services but were not reached by the ITQL will be rerandomized to 1 of 2 arms, an offer to reconnect to the ITQL or an offer to engage a peer navigator who can help them reconnect to the ITQL. We will assess the implementation strategies' reach, adoption, linkage, and sustainability with the ITQL.

Discussion

This study will provide a new cost-effective and efficient model to link low-income smokers to state tobacco quitlines. Message delivery via patient health portals has important implications for addressing other tobacco-related morbidities.

Community and Healthcare Perspectives on Implementing Hypertension Interventions for a Multiethnic Safety-Net Population

Objective

To synthesize community and healthcare informants' perspectives on contextual considerations and tailoring recommendations for high-quality, sustainable implementation of evidence-based practices (EBPs) for managing hypertension (HTN) in a multiethnic safety-net population.

Design

Structured focus-group discussions and semistructured qualitative interviews.

Background

High-quality, sustainable implementation of HTN-related EBPs can promote equitable care. Implementation challenges extend beyond individual patients to span multiple levels of context. Few studies have systematically engaged community and healthcare perspectives to inform the design of HTN intervention trials.

Setting

A large safety-net healthcare system.

Participants/Methods

We conducted four structured discussions with each of five race- or ethnicity-specific community action boards (CABs) to understand community members' HTN-related norms, assets, needs, and experiences across local healthcare systems. We interviewed 41 personnel with diverse roles in our partnered healthcare system to understand the system's HTN-related strengths and needs. We solicited EBP tailoring recommendations from both groups. We summarized the findings using rapid content analysis.

Results

Participants identified contextual considerations spanning seven themes: social determinants, healthcare engagement, clinical interaction, system operations, standardization, patient education, and partnerships and funding. They offered tailoring recommendations spanning nine themes: addressing complex contexts, addressing social needs, system operations, healthcare system training and resources, linguistic and cultural tailoring, behavioral engagement, relational engagement, illness-course engagement, and community partnerships.

Conclusions

Engaging community and healthcare informants can ground implementation in the policy, community, healthcare system, clinical, and interpersonal contexts surrounding diverse patients at risk for disparities. Such grounding can reframe inequitable implementation as a multilevel social problem facing communities and healthcare systems, rather than individuals.

10 Lessons Learned in Launching a Division-Wide Measurement-Based Care Initiative

Mental health problems are a major source of morbidity and mortality for children and adolescents, affecting 15% to 20% of those under 18 years of age in the US.1 Half of all mental health conditions start by age 14 years, although most cases remain undetected and untreated.2 Despite knowing much about mental health conditions affecting children, many speculate that the lack of standardized approaches to patient care contribute to poor outcomes, including substantial diagnostic variation, few remissions, risk for relapse or recidivism, and, ultimately, greater mortality due to an inability to accurately predict who will make a suicide attempt.3-5 Studies support this over-reliance on the "art of medicine" (ie, subjective judgment without use of standardized measures), finding that only 17.9% of psychiatrists and 11.1% of psychologists in the US routinely administer symptom rating scales to their patients, despite studies suggesting that when using clinical judgment alone, mental health providers detect deterioration for only 21.4% of patients.4.

Using the exploration, preparation, implementation, sustainment (EPIS) framework to assess the cooperative re-engagement controlled trial (CoRECT)

Background

"Data to Care" (D2C) is a strategy which relies on a combination of public health surveillance data supplemented by clinic data to support continuity of HIV care. The Cooperative Re-Engagement Controlled Trial (CoRECT) was a CDC-sponsored randomized controlled trial of a D2C model, which provided an opportunity to examine the process of implementing an intervention for people with HIV (PWH) who are out-of-care across three public health department jurisdictions. Using the EPIS (Exploration, Preparation, Implementation, Sustainment) framework, we aimed to retrospectively describe the implementation process for each site to provide insights and guidance to inform future D2C activities implemented by public health agencies and their clinical and community partners.

Methods

After completion of CoRECT, the three (Connecticut, Massachusetts, Philadelphia) trial sites reviewed study protocols and held iterative discussions to describe and compare their processes regarding case identification, interactions with partnering clinics and patients, and sustainability. The EPIS framework provided a structure for comparing key organizational and operational practices and was applied to the entire implementation process.

Results

The trial sites varied in their implementation processes and the specific elements of the intervention. Factors including prior D2C experience, data management and analytic infrastructure, staff capacity, and relationships with clinic partners informed intervention development and implementation. Additionally, this review identified key lessons learned including to: (1) explore new supplemental sources for public health surveillance data; (2) work with stakeholders representing core functions/components in the early stages of the intervention design process; (3) build flexibility into all components of the follow-up activities; and (4) integrate data sharing, project management, and follow-up activities within existing DPH organizational structure.

Conclusion

The CoRECT study provides a general blueprint and lessons learned for implementing a D2C intervention for re-engagement in HIV care. Interventions should be tailored to local operational and structural factors, and responsive to evolving clinical and public health practices.

Mechanisms of Successful Implementation of Tailored Motivational Interviewing in a Multisite Study of Youth HIV Clinics in the United States

BACKGROUND

A recent implementation science stepped-wedge trial of motivational interviewing (MI) in adolescent HIV clinics indicated variable degrees of implementation success. The present mixed-methods study analyzed trajectories of postimplementation MI competence scores and compared postimplementation qualitative interviews among the clinics with the highest levels of provider competency and the lowest levels of competency to further understand mechanisms of successful implementation.

SETTING

Ten HIV clinics in the Adolescent Trials Network for HIV/AIDS Interventions.

METHODS

This study used a sequential explanatory mixed-methods design. Continuous MI competency data from the parent study were structured with repeated measurements nested within providers nested within 10 sites. A mixed-effects regression model rank ordered the clinics by competence scores. Key stakeholders (N = 77) at the 10 randomized clinics completed a 1-hour qualitative interview at 12-month follow-up (immediately postimplementation). Using the phases of reflexive thematic analysis, interviews from the 3 highest competence clinics and the 3 lowest competence clinics were pragmatically analyzed.

RESULTS

Thematic analysis suggested 3 central themes that influenced successful evidence-based practice (EBP) implementation. Organizational culture included the leadership, collective effort, and resources that influenced how the organization at large responded to the implementation intervention. Staff attitudes encapsulated individual providers' mindsets and attitudes about MI and the implementation intervention. EBP integration reflected the perception and use of MI by individuals and the organization as a whole. These themes and their subthemes are interconnected and exerted an influence on each other through the implementation process.

CONCLUSIONS

Findings suggest additional implementation strategies to improve implementation of EBPs. Such mixed-methods research is critical to understanding the mechanisms of successful implementation of EBP and improving future implementation strategies.

Early Pandemic Access to COVID-19 Testing in the Somali Community in King County, Washington, USA: a Mixed-Methods Evaluation

BACKGROUND

Racial and ethnic disparities in COVID-19 infection and outcomes have been documented, but few studies have examined disparities in access to testing.

METHODS

We conducted a mixed methods study of access to COVID-19 testing in the Somali immigrant community in King County, Washington, USA, early during the COVID-19 pandemic. In September 2020-February 2021, we conducted quantitative surveys in a convenience sample (n = 528) of individuals who had accessed PCR testing, recruited at King County testing sites near Somali population centers and through social media outreach in the Somali community. We compared self-identified Somali and non-Somali responses using Chi-square and Wilcoxon rank sum tests. We also conducted three Somali-language focus groups (n = 26) by video conference to explore Somali experiences with COVID-19 testing, and in-depth interviews with King County-based policymakers and healthcare workers (n = 13) recruited through the research team's professional network to represent key demographics and roles. Data were analyzed using qualitative rapid analysis to explore the county's COVID-19 testing landscape.

RESULTS

Among 420 survey respondents who had received COVID-19 testing in the prior 90 days, 29% of 140 Somali vs. 11% of 280 non-Somali respondents tested because of symptoms (p = 0.001), with a trend for longer time from symptom onset to testing (a measure of testing access) among Somali respondents (median 3.0 vs. 2.0 days, p = 0.06). Focus groups revealed barriers to testing, including distrust, misinformation, stigma, language, lack of awareness, and transportation. Stakeholders responding from all sectors highlighted the importance of community partnership to improve access.

CONCLUSION

Somali communities experience barriers to COVID-19 testing, as evidenced by the longer time from symptom onset to testing and corroborated by our qualitative findings. These barriers, both structural and community-derived, may be overcome through partnerships between government and community to support community-led, multilingual service delivery and racial representation among medical staff.

Implementation costs of sugary drink policies in the United States

To support implementation of important public health policies, policymakers need information about implementation costs over time and across stakeholder groups. We assessed implementation costs of two federal sugar-sweetened beverage (SSB) policies of current policy interest and with evidence to support their effects: excise taxes and health warning labels. Our analysis encompassed the entire policy life cycle using the Exploration, Preparation, Implementation, and Sustainment framework. We identified implementation actions using key informant interviews and developed quantitative estimates of implementation costs using published literature and government documents. Results show that implementation costs vary over time and among stakeholders. Explicitly integrating implementation science theory and using mixed methods improved the comprehensiveness of our results. Although this work is specific to federal SSB policies, the process can inform how we understand the costs of many public health policies, providing crucial information for public health policy making.

A bibliographic review of sustainability research output and investment in 10 leading public health journals across three time periods

Objectives

Long-term delivery, or sustainability, of evidence-based interventions is necessary for public health benefits to be realised. However, sustainment of effective interventions is poor. Understanding the evidence-base and identifying potential gaps is necessary to inform where future research efforts are most warranted.

Study design

We undertook a repeat cross-sectional bibliographic review of research published in 10 public health journals across three time periods (2010, 2015 and 2020/2021).

Methods

Studies were eligible if they were a data-based study or review article. Studies were assessed as to whether they focused on sustainability. The percentage of public health research studies assessing sustainability overall and by the three time periods was calculated. The association between time period and the proportion of sustainability articles was assessed using logistic regression. Descriptive statistics were used to summarise study characteristics overall and by time period.

Results

10,588 data-based articles were identified, of which 1.3 % (n = 136) focused on sustainability. There was a statistically significant association between time period and the proportion of sustainability research, with a slight increase across the three time periods: 0.3 % (95 % CI: 0.1 %, 0.7 %) in 2010, 1.4 % (95 % CI: 1.0 %, 1.9 %) in 2015 and 1.6 % (95 % CI: 1.3 %, 1.9 %) in 2020/2021. Most research was descriptive/epidemiological (n = 69, 51 %), few focused on measurement (n = 2, 1.5 %) and none on cost effectiveness. Only one intervention study assessed the effect of specific sustainability strategies.

Conclusions

This bibliographic review highlights the need for more public health research on sustainability, particularly in the areas of measurement, sustainability interventions, and cost effectiveness.

Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE)

BACKGROUND

For youth receiving care in community mental health centers, comorbidities are the rule rather than the exception. Using measurement-based care (MBC), or the routine evaluation of symptoms to inform care decisions, as the foundation of treatment for youth with comorbid problems significantly improves the impact of psychotherapy by focusing care and building engagement and alliance. MBC increases the rate of symptom improvement, detects clients who would otherwise deteriorate, and alerts clinicians to non-responders. Despite its demonstrated utility, MBC is rarely implemented with fidelity; less than 15% of providers report using MBC per recommendations. Previous efforts to support MBC implementation have yielded suboptimal outcomes, in part, due to organizations' challenges with identifying and prioritizing barriers and selecting and developing strategies to overcome them. New methods are needed for identifying and prioritizing barriers, and matching strategies to barriers to optimize MBC implementation and treatment quality to improve youth mental health outcomes in community settings.

METHODS

Pragmatic implementation methods will be piloted in four diverse community mental health centers. Methods include (a) rapid evidence synthesis; (b) rapid ethnography; (c) design kits (e.g., kits with disposable cameras, journals, maps); (d) barrier prioritization, and (e) causal pathway diagramming. These activities will generate actionable barriers; subsequently, we will use facilitated group processes to prioritize barriers and develop causal pathway diagrams to match strategies to barriers to create implementation plans that optimize MBC fidelity (Aim 1). We will track strategy deployment for 6 months, then compare MBC fidelity for another 6 months post-implementation with data from 2 years of historical controls (Aim 2). Finally, we will co-design a toolkit for design kit methods with youth and the practice and scientific communities (Aim 3).

DISCUSSION

Optimizing MBC implementation in community mental health centers could transform youth mental health care by ensuring the most pressing symptoms are targeted early in treatment. The discussion section highlights expected challenges and limits to using the five methods, including recruitment and engagement given the high pressure on community mental health settings.

TRIAL REGISTRATION

Clinicaltrials.gov. NCT05644756 . Registered on 18 November 2022. This trial was retrospectively registered.

The Longitudinal Implementation Strategy Tracking System (LISTS): feasibility, usability, and pilot testing of a novel method

BACKGROUND

Systematic approaches are needed to accurately characterize the dynamic use of implementation strategies and how they change over time. We describe the development and preliminary evaluation of the Longitudinal Implementation Strategy Tracking System (LISTS), a novel methodology to document and characterize implementation strategies use over time.

METHODS

The development and initial evaluation of the LISTS method was conducted within the Improving the Management of SymPtoms during And following Cancer Treatment (IMPACT) Research Consortium (supported by funding provided through the NCI Cancer MoonshotSM). The IMPACT Consortium includes a coordinating center and three hybrid effectiveness-implementation studies testing routine symptom surveillance and integration of symptom management interventions in ambulatory oncology care settings. LISTS was created to increase the precision and reliability of dynamic changes in implementation strategy use over time. It includes three components: (1) a strategy assessment, (2) a data capture platform, and (3) a User's Guide. An iterative process between implementation researchers and practitioners was used to develop, pilot test, and refine the LISTS method prior to evaluating its use in three stepped-wedge trials within the IMPACT Consortium. The LISTS method was used with research and practice teams for approximately 12 months and subsequently we evaluated its feasibility, acceptability, and usability using established instruments and novel questions developed specifically for this study.

RESULTS

Initial evaluation of LISTS indicates that it is a feasible and acceptable method, with content validity, for characterizing and tracking the use of implementation strategies over time. Users of LISTS highlighted several opportunities for improving the method for use in future and more diverse implementation studies.

CONCLUSIONS

The LISTS method was developed collaboratively between researchers and practitioners to fill a research gap in systematically tracking implementation strategy use and modifications in research studies and other implementation efforts. Preliminary feedback from LISTS users indicate it is feasible and usable. Potential future developments include additional features, fewer data elements, and interoperability with alternative data entry platforms. LISTS offers a systematic method that encourages the use of common data elements to support data analysis across sites and synthesis across studies. Future research is needed to further adapt, refine, and evaluate the LISTS method in studies with employ diverse study designs and address varying delivery settings, health conditions, and intervention types.

Essential content for teaching implementation practice in healthcare: a mixed-methods study of teams offering capacity-building initiatives

BACKGROUND

Applying the knowledge gained through implementation science can support the uptake of research evidence into practice; however, those doing and supporting implementation (implementation practitioners) may face barriers to applying implementation science in their work. One strategy to enhance individuals' and teams' ability to apply implementation science in practice is through training and professional development opportunities (capacity-building initiatives). Although there is an increasing demand for and offerings of implementation practice capacity-building initiatives, there is no universal agreement on what content should be included. In this study we aimed to explore what capacity-building developers and deliverers identify as essential training content for teaching implementation practice.

METHODS

We conducted a convergent mixed-methods study with participants who had developed and/or delivered a capacity-building initiative focused on teaching implementation practice. Participants completed an online questionnaire to provide details on their capacity-building initiatives; took part in an interview or focus group to explore their questionnaire responses in depth; and offered course materials for review. We analyzed a subset of data that focused on the capacity-building initiatives' content and curriculum. We used descriptive statistics for quantitative data and conventional content analysis for qualitative data, with the data sets merged during the analytic phase. We presented frequency counts for each category to highlight commonalities and differences across capacity-building initiatives.

RESULTS

Thirty-three individuals representing 20 capacity-building initiatives participated. Study participants identified several core content areas included in their capacity-building initiatives: (1) taking a process approach to implementation; (2) identifying and applying implementation theories, models, frameworks, and approaches; (3) learning implementation steps and skills; (4) developing relational skills. In addition, study participants described offering applied and pragmatic content (e.g., tools and resources), and tailoring and evolving the capacity-building initiative content to address emerging trends in implementation science. Study participants highlighted some challenges learners face when acquiring and applying implementation practice knowledge and skills.

CONCLUSIONS

This study synthesized what experienced capacity-building initiative developers and deliverers identify as essential content for teaching implementation practice. These findings can inform the development, refinement, and delivery of capacity-building initiatives, as well as future research directions, to enhance the translation of implementation science into practice.

The application of implementation science methods in correctional health intervention research: a systematic review

BACKGROUND

Improving access to high-quality healthcare for individuals in correctional settings is critical to advancing health equity in the United States. Compared to the general population, criminal-legal involved individuals experience higher rates of chronic health conditions and poorer health outcomes. Implementation science frameworks and strategies offer useful tools to integrate health interventions into criminal-legal settings and to improve care. A review of implementation science in criminal-legal settings to date is necessary to advance future applications. This systematic review summarizes research that has harnessed implementation science to promote the uptake of effective health interventions in adult criminal-legal settings.

METHODS

A systematic review of seven databases (Academic Search Premier, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Social Work Abstracts, ProQuest Criminal Justice Database, ProQuest Sociological Abstracts, MEDLINE/PubMed) was conducted. Eligible studies used an implementation science framework to assess implementation outcomes, determinants, and/or implementation strategies in adult criminal-legal settings. Qualitative synthesis was used to extract and summarize settings, study designs, sample characteristics, methods, and application of implementation science methods. Implementation strategies were further analyzed using the Pragmatic Implementation Reporting Tool.

RESULTS

Twenty-four studies met inclusion criteria. Studies implemented interventions to address infectious diseases (n=9), substance use (n=6), mental health (n=5), co-occurring substance use and mental health (n=2), or other health conditions (n=2). Studies varied in their operationalization and description of guiding implementation frameworks/taxonomies. Sixteen studies reported implementation determinants and 12 studies measured implementation outcomes, with acceptability (n=5), feasibility (n=3), and reach (n=2) commonly assessed. Six studies tested implementation strategies. Systematic review results were used to generate recommendations for improving implementation success in criminal-legal contexts.

CONCLUSIONS

The focus on implementation determinants in correctional health studies reflects the need to tailor implementation efforts to complex organizational and inter-agency contexts. Future studies should investigate policy factors that influence implementation success, design, and test implementation strategies tailored to determinants, and investigate a wider array of implementation outcomes relevant to criminal-legal settings, health interventions relevant to adult and juvenile populations, and health equity outcomes.

TRIAL REGISTRATION

A study protocol (CRD42020114111) was registered with Prospero.

Contextualizing Medications for Opioid Use Disorder and Peer Support Service Provision in the Probation System with Implementation Science

Background

Medications for opioid use disorder (MOUD) is an evidence-based approach that reduces opioid-related mortality, particularly among criminal legal-involved persons who are at increased risk of adverse outcomes related to OUD. Implementing evidence-based approaches in the context of probation settings requires an in-depth understanding of specific contexts to improve intervention efficacy and effectiveness. Here, we use the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework to understand implementation contexts for MOUD provision to the probation setting.

Methods

In-depth individual interviews were conducted with key programmatic stakeholders (treatment providers and probation staff involved in service provision for people on probation). The study examined stakeholder perspectives regarding MOUD and Peer Support Service (PSS) implementation among people who are involved in community supervision. Deductive and inductive thematic analysis was conducted, and subsequently the codes, subcodes, and themes were mapped onto the EPIS framework to better understand implementation contexts.

Results

We deduced key inner, outer, and bridging contexts that shape treatment service provision for individuals with OUD who are on probation. Inner contexts include a strong organizational climate that supports MOUD implementation and enthusiasm for peer support services. Outer contexts include difficulty navigating insurance among providers, treatment costs, and systemic stigma towards MOUD. Bridging contexts include a lack of collaboration/communication between relevant agencies (e.g., probation and courts).

Conclusions

Findings indicate the implementation is complex and requires a coordinated effort between correctional systems, probation agencies, and community-based treatment providers.

Guideline evaluation and implementation mechanisms in school health services (GuideMe): protocol for a hybrid randomized factorial trial

BACKGROUND

Norwegian school health services received a national best-practice guideline in 2017. To promote healthy life skills and identify adolescents needing support, the guideline includes strong recommendations for individual consultations with all 8th graders and increased collaboration with schools. To help implement the recommendations, a blended implementation strategy (SchoolHealth) was co-created with school nurses, students, and stakeholders. SchoolHealth consists of three implementation elements: Digital dialog and administration tool (audit and feedback +), Dialog support (external consultation), and Collaboration materials (targeted dissemination). This hybrid study will test the main and combined effects of the elements on guideline fidelity and effectiveness.

METHODS

The GuideMe study is a factorial cluster randomized controlled trial examining SchoolHealth's effectiveness on guideline fidelity and guideline effectiveness goals. Forty Norwegian secondary schools will be randomized to eight different combinations of the elements in SchoolHealth. Participants will include school nurses and school personnel from these schools, and 8th grade students (n = 1200). Primary outcomes are school nurses' fidelity to the guidelines and student's ability to cope with their life (i.e., health literacy, positive health behaviors and self-efficacy). Quantitative methods will be used to test effects and mechanisms, while mixed- and qualitative methods will be used to explore mechanisms, experiences, and other phenomena in depth. Participants will complete digital questionnaires at the start and end of the schoolyear, and after the consultation during the schoolyear. The study will run in two waves, each lasting for one school year. The multifactorial design allows testing of interactions and main effects due to equal distribution of all factors within each main effect. Sustainment and scale-up of optimized SchoolHealth elements using national infrastructure are simultaneously prepared.

DISCUSSION

The study will investigate possible effects of the implementation elements in isolation and in combination, and hypothesized implementation mechanisms. In-depth study of user experiences will inform improvements to elements in SchoolHealth. The results will yield causal knowledge about implementation strategies and the mechanisms through which they assert effects. Mixed-methods will provide insights into how and when the elements work. Optimizing guideline implementation elements can support adolescents in a crucial life phase.

TRAIL REGISTRATION

ISRCTN24173836. Registration date 8 August 2022.

Methodological analysis of a community-based training initiative using the EPIS framework: an ongoing initiative to empower 10 million bystanders in CPR and bleeding control

Background

Out-of-hospital cardiac arrest (OHCA) and life-threatening bleeding from trauma are leading causes of preventable mortality globally. Early intervention from bystanders can play a pivotal role in increasing the survival rate of victims. While great efforts for bystander training have yielded positive results in high-income countries, the same has not been replicated in low and middle-income countries (LMICs) due to resources constraints. This article describes a replicable implementation model of a nationwide program, aimed at empowering 10 million bystanders with basic knowledge and skills of hands-only cardiopulmonary resuscitation (CPR) and bleeding control in a resource-limited setting.

Methods

Using the EPIS (Exploration, Preparation, Implementation and Sustainment) framework, we describe the application of a national bystander training program, named 'Pakistan Life Savers Programme (PLSP)', in an LMIC. We discuss the opportunities and challenges faced during each phase of the program's implementation and identify feasible and sustainable actions to make them reproducible in similar low-resource settings.

Results

A high mortality rate owing to OHCA and traumatic life-threatening bleeding was identified as a national issue in Pakistan. After intensive discussions during the exploration phase, PLSP was chosen as a potential solution. The preparation phase oversaw the logistical administration of the program and highlighted avenues using minimal resources to attain maximum outreach. National implementation of bystander training started as a pilot in suburban schools and expanded to other institutions, with 127 833 bystanders trained to date. Sustainability of the program was targeted through its addition in a single national curriculum taught in schools and the development of a cohesive collaborative network with entities sharing similar goals.

Conclusion

This article provides a methodological framework of implementing a national intervention based on bystander response. Such programs can increase bystander willingness and confidence in performing CPR and bleeding control, decreasing preventable deaths in countries having a high mortality burden.

Level of evidence

Level VI.

Revisiting the policy ecology framework for implementation of evidence-based practices in mental health settings

BACKGROUND

Over the past three decades, policy actors and actions have been highly influential in supporting the implementation of evidence-based practices (EBPs) in mental health settings. An early examination of these actions resulted in the Policy Ecology Framework (PEF), which was originally developed as a tactical primer for state and local mental health regulators in the field of child mental health. However, the policy landscape for implementation has evolved significantly since the original PEF was published. An interrogation of the strategies originally proposed in the PEF is necessary to provide an updated menu of strategies to improve our understanding of the mechanisms of policy action and promote system improvement.

OBJECTIVES

This paper builds upon the original PEF to address changes in the policy landscape for the implementation of mental health EBPs between 2009 and 2022. We review the current state of policy strategies that support the implementation of EBPs in mental health care and outline key areas for policy-oriented implementation research. Our review identifies policy strategies at federal, state, agency, and organizational levels, and highlights developments in the social context in which EBPs are implemented. Furthermore, our review is organized around some key changes that occurred across each PEF domain that span organizational, agency, political, and social contexts along with subdomains within each area.

DISCUSSION

We present an updated menu of policy strategies to support the implementation of EBPs in mental health settings. This updated menu of strategies considers the broad range of conceptual developments and changes in the policy landscape. These developments have occurred across the organizational, agency, political, and social contexts and are important for policymakers to consider in the context of supporting the implementation of EBPs. The updated PEF expands and enhances the specification of policy levers currently available, and identifies policy targets that are underdeveloped (e.g., de-implementation and sustainment) but are becoming visible opportunities for policy to support system improvement. The updated PEF clarifies current policy efforts within the field of implementation science in health to conceptualize and better operationalize the role of policy in the implementation of EBPs.