A Practical, Robust Implementation and Sustainability Model (PRISM) for Integrating Research Findings into Practice

Positioning implementation science in national immunization programmes to improve coverage equity and advance progress toward Immunization Agenda 2030: An urgent global health imperative

Despite the availability of effective vaccines for preventing common childhood infectious diseases, there is still significant disparities in access and utilization across many low- and middle-income countries (LMIC). The factors that drive these disparities are often multilevel, originating from individuals, health facilities, health systems and communities, and also multifaceted. Implementation science has emerged as a field to help address "know-do" gaps in health systems, and can play a significant role in strengthening immunization systems to understand and solve implementation barriers that limit access and uptake within their contexts. This article presents a reflexive perspective on how to position implementation research in immunization programmes to improve coverage equity. Furthermore, key points of synergy between implementation research and vaccination are highlighted, and some potential practice changes that can be applied within specific contexts were proposed. Using a human rights lens, it was concluded that the cost that is associated with implementation failure in immunization programmes is significant and unjust, and future directions for implementation research to optimize its application in practice settings have been recommended.

Comparing Two Training Modalities Supporting the Adoption of the SEEK Approach in Pediatric Primary Care 6/30/24

OBJECTIVE

To compare the impact of two common continuing medical education training modalities - independent online training (IND) and a Maintenance of Certification-4 activity (MOC) - on primary care professionals' (PCPs') thinking and practice behavior regarding the Safe Environment for Every Kid (SEEK) approach. This was part of an implementation science study scaling up the evidence-based practice, SEEK.

METHODS

This is a longitudinal, multi-site, mixed methods, cluster randomized controlled trial comparing 21 pediatric primary care practices across the U.S. randomized to one of two training modalities. Two hundred and ten PCPs completed surveys up to 4 times over a two-year period to assess their thinking and practice regarding SEEK; a subset was interviewed up to 3 times.

RESULTS

Training led to significant and sustained improvements in PCPs' thinking and behavior related to SEEK, with no significant differences between the IND and MOC groups. PCPs mostly viewed their training positively, but several described shortcomings. PCP characteristics, such as age and sex, did not moderate the impact of the training, nor did the presence of a behavioral health professional.

CONCLUSIONS

The lack of significant differences between the training modalities favors the simpler IND modality. This was despite the MOC training employing key principles of adult education. Of note, MOC-4 credits are required for pediatric board certification. More research is needed to optimize continuing medical education and to tailor approaches for different learners.

The Reporting Recommendations Intended for Pharmaceutical Risk Minimization Evaluation Studies: Standards for Reporting of Implementation Studies Extension (RIMES-SE)

INTRODUCTION

The Reporting recommendations Intended for pharmaceutical risk Minimization Evaluation Studies (RIMES) was developed to improve the quality of reporting of risk minimization program evaluations. In light of continued inadequacies in study reporting, and high-profile program implementation failures, we updated the RIMES Checklist to incorporate additional concepts from the Standards for Reporting of Implementation studies (StaRI).

METHODS

The development of the updated checklist, the RIMES-StaRI Extension (RIMES-SE), entailed developing a study protocol and drafting an initial pool of items based on a mapping of the RIMES against the StaRI checklist. A modified e-Delphi exercise was then conducted to determine the importance and understandability of items for checklist inclusion. An expert workshop and an online commentary period for additional feedback followed.

RESULTS

The RIMES-SE contains 27 items. It includes two signature features of the StaRI Checklist: 1) a dual strand of items (represented in two columns) describing the risk minimization program (the 'intervention') and the corresponding implementation strategy; and 2) applicable to an array of different research methodologies.

CONCLUSIONS

The RIMES-SE Statement and Checklist extends the reporting guidelines set forth in the original RIMES Checklist via inclusion of key implementation science concepts. It is intended to improve the quality and transparency of reporting of risk minimization evaluation studies so as to advance drug safety science.

Improving Students Access to Primary Health Care Through School-Based Health Centers

BACKGROUND

More than 20 million children in the United States lack access to primary health care.

PRACTICE LEARNING

Research shows that students with regular access to physical and mental health services have fewer absences, are more social, less likely to participate in risky behaviors, have improved focus and higher test scores.

IMPLICATION FOR SCHOOL HEALTH POLICY, PRACTICE, AND EQUITY

School-based health centers (SBHCs) can be an important, valuable and viable health care delivery option to meet the full-range of primary health care needs of students where they spend the majority of their wake hours, ie, in school. Children in rural and other underserved communities, as well as those underinsured, non-insured, economically challenged, underserved, and the most vulnerable among us are especially at risk.

CONCLUSIONS

This paper discusses the history, value, and importance of SBHCs from myriad perspectives, including physical and emotional wellbeing, academic and social success, and the promotion of a positive transition to adulthood. In addition, the authors' experiences that resulted in building the first SBHC in the Mid-Hudson Valley Region of New York State are shared. These experiences form the foundation for creating an important roadmap for individuals and school leaders that are interested in bringing a SBHC to their school and district.

A Qualitative Study of A Health Center-Based Mobile Produce Market

Healthcare-based food assistance programs have the potential to improve patients' food security, but are underutilized. We conducted a qualitative study of user and staff perceptions of an on-site mobile market at a federally-qualified health center (FQHC). Five themes were identified: 1) financial need drives the decision to use the market, 2) people attend specifically to receive healthy food, 3) users feel a connection to the FQHC, which increases participation, 4) social networks increase usage of the program, and 5) long lines, inclement weather, inaccessibility, and inconsistent marketing and communication are attendance barriers. Findings should inform implementation of future healthcare-based food assistance programs.

Hospital Staff Perspectives on the Drivers and Challenges in Implementing a Virtual Rehabilitation Ward: Qualitative Study

Background

Over the past decade, the adoption of virtual wards has surged. Virtual wards aim to prevent unnecessary hospital admissions, expedite home discharge, and enhance patient satisfaction, which are particularly beneficial for the older adult population who faces risks associated with hospitalization. Consequently, substantial investments are being made in virtual rehabilitation wards (VRWs), despite evidence of varying levels of success in their implementation. However, the facilitators and barriers experienced by virtual ward staff for the rapid implementation of these innovative care models remain poorly understood.

Objective

This paper presents insights from hospital staff working on an Australian VRW in response to the growing demand for programs aimed at preventing hospital admissions. We explore staff's perspectives on the facilitators and barriers of the VRW, shedding light on service setup and delivery.

Methods

Qualitative interviews were conducted with 21 VRW staff using the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework. The analysis of data was performed using framework analysis and the 7 domains of the NASSS framework.

Results

The results were mapped onto the 7 domains of the NASSS framework. (1) Condition: Managing certain conditions, especially those involving comorbidities and sociocultural factors, can be challenging. (2) Technology: The VRW demonstrated suitability for technologically engaged patients without cognitive impairment, offering advantages in clinical decision-making through remote monitoring and video calls. However, interoperability issues and equipment malfunctions caused staff frustration, highlighting the importance of promptly addressing technical challenges. (3) Value proposition: The VRW empowered patients to choose their care location, extending access to care for rural communities and enabling home-based treatment for older adults. (4) Adopters and (5) organizations: Despite these benefits, the cultural shift from in-person to remote treatment introduced uncertainties in workflows, professional responsibilities, resource allocation, and intake processes. (6) Wider system and (7) embedding: As the service continues to develop to address gaps in hospital capacity, it is imperative to prioritize ongoing adaptation. This includes refining the process of smoothly transferring patients back to the hospital, addressing technical aspects, ensuring seamless continuity of care, and thoughtfully considering how the burden of care may shift to patients and their families.

Conclusions

In this qualitative study exploring health care staff's experience of an innovative VRW, we identified several drivers and challenges to implementation and acceptability. The findings have implications for future services considering implementing VRWs for older adults in terms of service setup and delivery. Future work will focus on assessing patient and carer experiences of the VRW.

Rapid jail-based implementation of overdose education and naloxone distribution in response to the COVID-19 pandemic

BACKGROUND

People incarcerated in jails are highly impacted by the opioid epidemic, and overdose education and naloxone distribution (OEND) is an effective strategy to reduce opioid overdose deaths. This study examines barriers and facilitators of fast-track OEND implementation within the jails in the Wave 1 Kentucky counties of the HEALing Communities Study during the COVID-19 pandemic.

METHODS

Meeting minutes with jail stakeholders were qualitatively coded using the Practical, Robust Implementation and Sustainability Model (PRISM) as the coding framework. The analysis highlighted the top barriers and facilitators to fast-track OEND implementation within the PRISM framework.

RESULTS

Space and staffing shortages related to the COVID-19 pandemic, disruptions in interorganizational programming from pandemic-related service suspensions, and a lack of technological solutions (e.g., reliable Internet access) for socially distanced delivery were the top barriers to fast-track OEND implementation. In addition, there were limitations on non-jail staff access to jails during COVID-19. Top facilitators included jail leadership support, the option to prioritize high-risk groups, and the incorporation of OEND processes into existing communications and management software. While the COVID-19 pandemic strained jail infrastructure, jail and partner agency collaboration led to creative implementation strategies for the successful integration of OEND into jail operations. Urban jails were more likely than rural jails to be early adopters of OEND during the public health emergency.

CONCLUSIONS

Understanding the barriers to and facilitators of OEND within jails will improve implementation efforts seeking to curb opioid overdose deaths. Jail leadership support and interorganizational efforts were key facilitators to implementation; therefore, it is recommended to increase buy-in with multiple agencies to promote success. Challenges brought on by COVID-19 have resulted in a need for innovative solutions for implementation.

CLINICAL TRIAL INFORMATION

ClinicalTrials.gov, NCT04111939, Submitted 30 September 2019, https://clinicaltrials.gov/study/NCT04111939?titles=HEALing%20Communities%20Study&rank=1 .

Adapting an Efficacious Peer-Delivered Physical Activity Program for Survivors of Breast Cancer for Web Platform Delivery: Protocol for a 2-Phase Study

BACKGROUND

Interventions promoting physical activity (PA) among survivors of cancer improve their functioning, reduce fatigue, and offer other benefits in cancer recovery and risk reduction for future cancer. There is a need for interventions that can be implemented on a wider scale than that is possible in research settings. We have previously demonstrated that a 3-month peer-delivered PA program (Moving Forward Together [MFT]) significantly increased the moderate to vigorous PA (MVPA) of survivors of breast cancer.

OBJECTIVE

Our goal is to scale up the MFT program by adapting an existing peer mentoring web platform, Mentor1to1. InquistHealth's web platform (Mentor1to1) has demonstrated efficacy in peer mentoring for chronic disease management. We will partner with InquisitHealth to adapt their web platform for MFT. The adaptation will allow for automating key resource-intensive components such as matching survivors with a coach via the web-based peer mentoring platform and collecting key indexes to prepare for large-scale implementation. The aim is to streamline intervention delivery, assure fidelity, and improve survivor outcomes.

METHODS

In phase 1 of this 2-phase study, we will interview 4 peer mentors or coaches with experience in delivering MFT and use their feedback to create Mentor1to1 web platform adapted for MFT (webMFT). Next, another 4 coaches will participate in rapid, iterative user-centered testing of webMFT. In phase 2, we will conduct a randomized controlled trial by recruiting and training 10 to 12 coaches from cancer organizations to deliver webMFT to 56 survivors of breast cancer, who will be assigned to receive either webMFT or MVPA tracking (control) for 3 months. We will assess effectiveness with survivors' accelerometer-measured MVPA and self-reported psychosocial well-being at baseline and 3 months. We will assess implementation outcomes, including acceptability, feasibility, and program costs from the perspective of survivors, coaches, and collaborating organizations, as guided by the expanded Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework.

RESULTS

As of September 2023, phase 1 of the study was completed, and 61 survivors were enrolled in phase 2. Using newer technologies for enhanced intervention delivery, program management, and automated data collection has the exciting promise of facilitating effective implementation by organizations with limited resources. Adapting evidence-based MFT to a customized web platform and collecting data at multiple levels (coaches, survivors, and organizations) along with costs will provide a strong foundation for a robust multisite implementation trial to increase MVPA and its benefits among many more survivors of breast cancer.

CONCLUSIONS

The quantitative and qualitative data collected from survivors of cancer, coaches, and organizations will be analyzed to inform a future larger-scale trial of peer mentoring for PA delivered by cancer care organizations to survivors.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05409664; https://clinicaltrials.gov/study/NCT05409664.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52494.

A data-driven approach to implementing the HPTN 094 complex intervention INTEGRA in local communities

BACKGROUND

HIV burden in the US among people who inject drugs (PWID) is driven by overlapping syndemic factors such as co-occurring health needs and environmental factors that synergize to produce worse health outcomes among PWID. This includes stigma, poverty, and limited healthcare access (e.g. medication to treat/prevent HIV and for opioid use disorder [MOUD]). Health services to address these complex needs, when they exist, are rarely located in proximity to each other or to the PWID who need them. Given the shifting drug use landscapes and geographic heterogeneity in the US, we evaluate a data-driven approach to guide the delivery of such services to PWID in local communities.

METHODS

We used a hybrid, type I, embedded, mixed method, data-driven approach to identify and characterize viable implementation neighborhoods for the HPTN 094 complex intervention, delivering integrated MOUD and HIV treatment/prevention through a mobile unit to PWID across five US cities. Applying the PRISM framework, we triangulated geographic and observational pre-implementation phase data (epidemiological overdose and HIV surveillance data) with two years of implementation phase data (weekly ecological assessments, study protocol meetings) to characterize environmental factors that affected the viability of implementation neighborhoods over time and across diverse settings.

RESULTS

Neighborhood-level drug use and geographic diversity alongside shifting socio-political factors (policing, surveillance, gentrification) differentially affected the utility of epidemiological data in identifying viable implementation neighborhoods across sites. In sites where PWID are more geographically dispersed, proximity to structural factors such as public transportation and spaces where PWID reside played a role in determining suitable implementation sites. The utility of leveraging additional data from local overdose and housing response systems to identify viable implementation neighborhoods was mixed.

CONCLUSIONS

Our findings suggest that data-driven approaches provide a contextually relevant pragmatic strategy to guide the real-time implementation of integrated care models to better meet the needs of PWID and help inform the scale-up of such complex interventions. This work highlights the utility of implementation science methods that attend to the impact of local community environmental factors on the implementation of complex interventions to PWID across diverse drug use, sociopolitical, and geographic landscapes in the US.

TRIAL REGISTRATION

ClincalTrials.gov, Registration Number: NCT04804072 . Registered 18 February 2021.

Expanding Outcomes in Cancer Screening Safety Net Programs: Promoting Sustainability and Policy Reform

Community-engaged patient navigation safety net programs are established as an evidence-based approach to address cancer prevention and early detection efforts, but barriers to expand and sustain such programs persist. In addition, few studies describe how these programs impact buy-in among communities and policy change within health care systems and government. We describe how we used the Capacity for Sustainability Framework to guide efforts for program sustainability and community, institutional, and policy level change in a breast cancer screening and patient navigation safety net program. The nine domains of the Capacity for Sustainability Framework were used to develop program logic models, to inform program implementation and quality improvement agendas, and to guide multi-level partner and stakeholder engagement, outreach, and dissemination of outcomes. The program is currently in its seventh year and continues to be annually funded by a city public health department. In 2021, additional 5-year renewable funding from a state public health department was secured. In addition, institutional program support was expanded for patients diagnosed with breast cancer. Program leaders worked with policymakers to draft legislation to support training certification and third-payor reimbursement for patient navigators and community health workers. The program is well-known and trusted among community members, community-based organizations, and providers. Community, organizational, and policy-level outcomes demonstrate that community-engaged patient navigation safety net programs can influence more than individual and interpersonal outcomes and can be sustained over time.

The Role of Cooperative Extension in Delivering Training and Technical Assistance to Support Evidence-Based Behavioral Health Practices in Rural Communities

The opioid epidemic in the United States continues to disproportionately affect those in rural, compared to urban, areas due to a variety of treatment and recovery barriers. One mechanism to increase capacity of rural-serving providers is through delivery of training and technical assistance (TTA) for evidence-based programs by leveraging the Cooperative Extension System. Guided by the Interactive Systems Framework, the current study evaluates TTA delivered by the Northwest Rural Opioid Technical Assistance Collabroative to opioid prevention, treatment, and recovery providers on short- (satisfaction, anticipated benefit), medium-, (behavioral intention to change current practice), and long-term goals (changes toward adoption of evidence-based practices). We also evaluated differences in short- and medium-term goals by intensity of TTA event and rurality of provider. Surveys of 351 providers who received TTA indicated high levels of satisfaction with TTA events attended, expressed strong agreement that they would benefit from the event, intended to make a professional practice change, and preparation toward implementing changes. Compared to urban-based providers, rural providers reported higher intention to use TTA information to change current practice. We conclude with a review of remaining gaps in the research to practice pipeline and recommendations for moving forward.

Feasibility of Fit24, a Digital Diabetes Prevention Program for Hispanic Adolescents: Qualitative Evaluation Study

BACKGROUND

Digital health interventions are promising for reaching and engaging high-risk youth in disease prevention opportunities; however, few digital prevention interventions have been developed for Hispanic youth, limiting our knowledge of these strategies among this population.

OBJECTIVE

This study qualitatively assessed the feasibility and acceptability of Fit24, a 12-week goal-setting intervention that uses a Fitbit watch (Fitbit Inc) and theoretically grounded SMS text messages to promote physical activity and sleep among Hispanic adolescents (aged between 14 and 16 years) with obesity.

METHODS

After completing the intervention, a subsample of youth (N=15) participated in an in-depth interview. We categorized the themes into dimensions based on participant perspectives using the Practical, Robust Implementation, and Sustainability Model (PRISM) framework.

RESULTS

Participants shared positive perceptions of wearing the Fitbit and receiving SMS text messages. Youth were highly engaged in monitoring their behaviors and perceived increased activity and sleep. Almost all youth organically received social support from a peer or family member and suggested the use of a group chat or team challenge for integrating peers into future interventions. However, most youth also expressed the need to take personal responsibility for the change in their behavior. Barriers that impacted the feasibility of the study included the skin-irritating material on the Fitbit watch band and environmental barriers (eg, lack of resources and school schedules), that limited participation in activity suggestions. Additionally, sync issues with the Fitbit limited the transmission of data, leading to inaccurate feedback.

CONCLUSIONS

Fit24 is a promising approach for engaging Hispanic youth in a diabetes prevention program. Strategies are needed to address technical issues with the Fitbit and environmental issues such as message timing. While integrating peer social support may be desired by some, peer support strategies should be mindful of youth's desire to foster personal motivation for behavior change. Findings from this study will inform future diabetes prevention trials of Fit24 and other digital health interventions for high-risk pediatric populations.

"We all see things through a different lens based on our life experiences": co-production of a web-based implementation toolkit with stakeholders across the health and social care system

Background

Implementing new innovations across the health and social care system is complex, involving many factors that in recent years have been compounded by Covid-19. While a plethora of implementation tools and frameworks are available, there are limitations in terms of their design and accessibility. Co-production is a valuable mechanism for developing tools that have utility and accessibility for those tasked with using them in health and social care organisations and there is growing acknowledgement of increasing the role of co-production in implementation science. This paper provides novel insight into co-production practices and relevance to implementation science by reporting findings from a study to co-produce a web-based implementation toolkit (WIT) that is accessible, usable and designed to support adaptive implementation across health and social care systems. Key themes relating to the process of co-production are outlined and the value of using co-production in implementation processes are discussed.

Methods

A web-based survey (n = 36) was conducted with a range of stakeholders across health and social care. Findings identified a need for WIT. Survey respondents were invited to express interest in becoming part of a co-production group and to take part in three online interactive workshops to co-produce WIT. Workshops took place with the group (n = 12) and focused on key developmental stages of WIT.

Results

Online co-production workshops were integral to the development and refinement of WIT. Benefits of using this process identified three interrelated themes: (i) Co-designing key features of the toolkit, (ii) Co-producing a toolkit with utility for users across health and social care settings, (iii) Co-producing a toolkit to support the implementation journey. Our approach of undertaking co-production as a dialogic process enabled generation of these themes. To illuminate discussion of these themes we draw upon iterative co-development of the "active ingredients" of key components (e.g., interactive Implementation Wheel) and functions (e.g., interactive "pop-up" definitions of keyword) and features (e.g., case studies) of WIT.

Conclusion

Using a co-production approach with a range of end-users across health and social care systems, highlights the benefits of understanding implementation processes for users in these settings. User-centred design and processes for ensuring accessibility readily support the translation of implementation into rapidly changing health and social care systems to benefit outcomes for patients, their families, carers, service users and practitioners.

Sexual and reproductive health implementation research in humanitarian contexts: a scoping review

BACKGROUND

Meeting the health needs of crisis-affected populations is a growing challenge, with 339 million people globally in need of humanitarian assistance in 2023. Given one in four people living in humanitarian contexts are women and girls of reproductive age, sexual and reproductive health care is considered as essential health service and minimum standard for humanitarian response. Despite growing calls for increased investment in implementation research in humanitarian settings, guidance on appropriate methods and analytical frameworks is limited.

METHODS

A scoping review was conducted to examine the extent to which implementation research frameworks have been used to evaluate sexual and reproductive health interventions in humanitarian settings. Peer-reviewed papers published from 2013 to 2022 were identified through relevant systematic reviews and a literature search of Pubmed, Embase, PsycInfo, CINAHL and Global Health databases. Papers that presented primary quantitative or qualitative data pertaining to a sexual and reproductive health intervention in a humanitarian setting were included.

RESULTS

Seven thousand thirty-six unique records were screened for inclusion, and 69 papers met inclusion criteria. Of these, six papers explicitly described the use of an implementation research framework, three citing use of the Consolidated Framework for Implementation Research. Three additional papers referenced other types of frameworks used in their evaluation. Factors cited across all included studies as helping the intervention in their presence or hindering in their absence were synthesized into the following Consolidated Framework for Implementation Research domains: Characteristics of Systems, Outer Setting, Inner Setting, Characteristics of Individuals, Intervention Characteristics, and Process.

CONCLUSION

This review found a wide range of methodologies and only six of 69 studies using an implementation research framework, highlighting an opportunity for standardization to better inform the evidence for and delivery of sexual and reproductive health interventions in humanitarian settings. Increased use of implementation research frameworks such as a modified Consolidated Framework for Implementation Research could work toward both expanding the evidence base and increasing standardization. Three hundred thirty-nine million people globally were in need of humanitarian assistance in 2023, and meeting the health needs of crisis-affected populations is a growing challenge. One in four people living in humanitarian contexts are women and girls of reproductive age, and provision of sexual and reproductive health care is considered to be essential within a humanitarian response. Implementation research can help to better understand how real-world contexts affect health improvement efforts. Despite growing calls for increased investment in implementation research in humanitarian settings, guidance on how best to do so is limited. This scoping review was conducted to examine the extent to which implementation research frameworks have been used to evaluate sexual and reproductive health interventions in humanitarian settings. Of 69 papers that met inclusion criteria for the review, six of them explicitly described the use of an implementation research framework. Three used the Consolidated Framework for Implementation Research, a theory-based framework that can guide implementation research. Three additional papers referenced other types of frameworks used in their evaluation. This review summarizes how factors relevant to different aspects of implementation within the included papers could have been organized using the Consolidated Framework for Implementation Research. The findings from this review highlight an opportunity for standardization to better inform the evidence for and delivery of sexual and reproductive health interventions in humanitarian settings. Increased use of implementation research frameworks such as a modified Consolidated Framework for Implementation Research could work toward both expanding the evidence base and increasing standardization.

Implementation Science to Achieve Equity in Heart Failure Care: A Scientific Statement From the American Heart Association

Guideline-directed medical therapies and guideline-directed nonpharmacological therapies improve quality of life and survival in patients with heart failure (HF), but eligible patients, particularly women and individuals from underrepresented racial and ethnic groups, are often not treated with these therapies. Implementation science uses evidence-based theories and frameworks to identify strategies that facilitate uptake of evidence to improve health. In this scientific statement, we provide an overview of implementation trials in HF, assess their use of conceptual frameworks and health equity principles, and provide pragmatic guidance for equity in HF. Overall, behavioral nudges, multidisciplinary care, and digital health strategies increased uptake of therapies in HF effectively but did not include equity goals. Few HF studies focused on achieving equity in HF by engaging stakeholders, quantifying barriers and facilitators to HF therapies, developing strategies for equity informed by theory or frameworks, evaluating implementation measures for equity, and titrating strategies for equity. Among these HF equity studies, feasibility was established in using various educational strategies to promote organizational change and equitable care. A couple include ongoing randomized controlled pragmatic trials for HF equity. There is great need for additional HF implementation trials designed to promote delivery of equitable guideline-directed therapy.

Perspectives on supporting Veterans' social needs during hospital to home health transitions: findings from the Transitions Nurse Program

BACKGROUND

Veterans who need post-acute home health care (HHC) are at risk for adverse outcomes and unmet social needs. Veterans' social needs could be identified and met by community-based HHC clinicians due to their unique perspective from the home environment, acuity of Veterans they serve, and access to Veterans receiving community care. To understand these needs, we explored clinician, Veteran, and care partner perspectives to understand Veterans' social needs during the transition from hospital to home with skilled HHC.

METHODS

Qualitative data were collected through individual interviews with Veterans Health Administration (VHA) inpatient & community HHC clinicians, Veterans, and care partners who have significant roles facilitating Veterans' hospital to home with HHC transition. To inform implementation of a care coordination quality improvement intervention, participants were asked about VHA and HHC care coordination and Veterans' social needs during these transitions. Interviews were recorded, transcribed, and analyzed inductively using thematic analysis and results were organized deductively according to relevant transitional care domains (Discharge Planning, Transition to Home, and HHC Delivery).

RESULTS

We conducted 35 interviews at 4 VHA Medical Centers located in Western, Midwestern, and Southern U.S. regions during March 2021 through July 2022. We organized results by the three care transition domains and related themes by VHA, HHC, or Veteran/care partner perspective. Our themes included (1) how social needs affected access to HHC, (2) the need for social needs screening during hospitalization, (3) delays in HHC for Veterans discharged from community hospitals, and (4) a need for closed-loop communication between VHA and HHC to report social needs.

CONCLUSIONS

HHC is an underexplored space for Veterans social needs detection. While this research is preliminary, we recommend two steps forward from this work: (1) develop closed-loop communication and education pathways with HHC and (2) develop a partnership to integrate a social risk screener into HHC pathways.

RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program

Background

The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process.

Methods

We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM.

Results

Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need.

Discussion

The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

From bench to policy: a critical analysis of models for evidence-informed policymaking in healthcare

Background

The use of research evidence in policy making is a complex and challenging process that has a long history in various fields, especially in healthcare. Different terms and concepts have been used to describe the relationship between research and policy, but they often lack clarity and consensus. To address this gap, several strategies and models have been proposed to facilitate evidence informed policy making and to identify the key factors and mechanisms involved. This study aims to critically review the existing models of evidence informed policy making (EIPM) in healthcare and to assess their strengths and limitations.

Method

A systematic search and review conducted to identify and critically assess EIPM models in healthcare. We searched PubMed, Web of Science and Scopus databases as major electronic databases and applied predefined inclusion criteria to select the models. We also checked the citations of the included models to find other scholars' perspectives. Each model was described and critiqued each model in detail and discussed their features and limitations.

Result

Nine models of EIPM in healthcare were identified. While models had some strengths in comprehension, flexibility and theoretical foundations, analysis also identified limitations including: presupposing rational policymaking; lacking alternatives for time-sensitive situations; not capturing policy complexity; neglecting unintended effects; limited context considerations; inadequate complexity concepts; limited collaboration guidance; and unspecified evidence adaptations.

Conclusion

The reviewed models provide useful frameworks for EIPM but need further improvement to address their limitations. Concepts from sociology of knowledge, change theory and complexity science can enrich the models. Future EIPM models should better account for the complexity of research-policy relationships and provide tailored strategies based on the policy context.

Project CHARIOT: study protocol for a hybrid type 1 effectiveness-implementation study of comprehensive tele-harm reduction for engagement of people who inject drugs in HIV prevention services

BACKGROUND

People who inject drugs (PWID) remain a high priority population under the federal Ending the HIV Epidemic initiative with 11% of new HIV infections attributable to injection drug use. There is a critical need for innovative, efficacious, scalable, and community-driven models of healthcare in non-stigmatizing settings for PWID. We seek to test a Comprehensive-TeleHarm Reduction (C-THR) intervention for HIV prevention services delivered via a syringe services program (SSP).

METHODS

The CHARIOT trial is a hybrid type I effectiveness-implementation study using a parallel two-arm randomized controlled trial design. Participants (i.e., PWID; n = 350) will be recruited from a syringe services program (SSP) in Miami, Florida. Participants will be randomized to receive either C-THR or non-SSP clinic referral and patient navigation. The objectives are: (1) to determine if the C-THR intervention increases engagement in HIV prevention (i.e., HIV pre-exposure prophylaxis; PrEP or medications for opioid use disorder; MOUD) compared to non-SSP clinic referral and patient navigation, (2) to examine the long-term effectiveness and cost-effectiveness of the C-THR intervention, and (3) to assess the barriers and facilitators to implementation and sustainment of the C-THR intervention. The co-primary outcomes are PrEP or MOUD engagement across follow-up at 3, 6, 9 and 12 months. For PrEP, engagement is confirmed by tenofovir on dried blood spot or cabotegravir injection within the previous 8 weeks. For MOUD, engagement is defined as screening positive for norbuprenorphine or methadone on urine drug screen; or naltrexone or buprenorphine injection within the previous 4 weeks. Secondary outcomes include PrEP adherence, engagement in HCV treatment and sustained virologic response, and treatment of sexually transmitted infections. The short and long term cost-effectiveness analyses and mixed-methods implementation evaluation will provide compelling data on the sustainability and possible impact of C-THR on comprehensive HIV prevention delivered via SSPs.

DISCUSSION

The CHARIOT trial will be the first to our knowledge to test the efficacy of an innovative, peer-led telehealth intervention with PWID at risk for HIV delivered via an SSP. This innovative healthcare model seeks to transform the way PWID access care by bypassing the traditional healthcare system, reducing multi-level barriers to care, and meeting PWID where they are.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05897099. Trial registry name: Comprehensive HIV and Harm Prevention Via Telehealth (CHARIOT). Registration date: 06/12/2023.

Developing Community-Level Implementation Networks to Connect Older Adults to Evidence-Based Falls Prevention Programs

Background: Evidence-based falls prevention programs are available in many communities, but participation in such programs remains low. This study aimed to develop community-based referral networks of organizations to facilitate the uptake of evidence-based falls prevention programs through engaging older adults at risk for falls with the RememberingWhen™ program and connecting them to evidence-based programs in Midwestern communities. Methods: Guided by the Practical, Robust Implementation and Sustainability Model (PRISM), referral networks were developed in two Midwestern communities (urban and micropolitan) through a seven-step community engagement plan: establishing and operationalizing the State-level Advisory Board (SAB), identifying falls prevention resources, conducting community assessments, developing Local Advisory Groups (LAG), operationalizing the LAG, developing referral network and protocols, and implementing the network. Semistructured interviews guided by the RE-AIM framework were conducted with members of the SAB, LAG, administrators and staff from organizations that participated in networks, and older adult participants. Results: After participating in the development of referral networks, participants felt they learned important skills that they can use to develop additional collaborations and networks in the future, emphasized the benefits of building community capacity among organizations with common missions. Interview data yielded strategies on enhancing the referral network's reach, impact, adoption, implementation efficiency, and maintenance. Conclusion: Future sustainability studies of such networks should explore identified challenges and strategies to sustain efforts. Results highlight the importance of ongoing funds to support the efforts of organizational networks in communities.

Factors Impacting the Implementation of Mobile Integrated Health Programs for the Acute Care of Older Adults

Objective: Emergency services utilization is increasing in older adult populations. Many such encounters may be preventable with better access to acute care in the community. Mobile integrated health (MIH) programs leverage mobile resources to deliver care and services to patients in the out-of-hospital environment and have the potential to improve clinical outcomes and decrease health care costs; however, they have not been widely implemented. We assessed barriers, potential facilitators, and other factors critical to the implementation of MIH programs with key vested partners.Methods: Professional and community-member partners were purposefully recruited to participate in recorded structured interviews. The study team used the Practical Robust Implementation and Sustainability Model (PRISM) framework to develop an interview guide and codebook. Coders employed a combination of deductive and inductive coding strategies to identify common themes across partner groups.Results: The study team interviewed 22 participants (mean age 56, 68% female). A cohort of professional subject matter experts included physicians, paramedics, public health personnel, and hospital administrators. A cohort of lay community partners included patients and caregivers. Coders identified three prominent themes that impact MIH implementation. First, MIH is disruptive to existing clinical workflows. Second, using MIH to improve patients' experience during acute care encounters is key to intervention adoption. Finally, legislative action is needed to augment central financial and regulatory policies to ensure the adoption of MIH programs.Conclusions: Common themes impacting the implementation of MIH programs were identified across vested partner groups. Multilevel strategies are needed to address patient adoption, clinical partners' workflow, and legislative policies to ensure the success of MIH programs.

Assessing the implementation of a multi-component hypertension program in a Guatemalan under-resourced dynamic context: an application of the RE-AIM/PRISM extension for sustainability and health equity

BACKGROUND

The COVID-19 pandemic necessitated rapid changes in healthcare delivery in Guatemala's public primary care settings. A new hypertension program, implemented as part of a type 2 hybrid trial since 2019, exemplifies an implementation effort amidst a changing context in an under-resourced setting. We assessed the implementation of an evidence-based intervention (EBI; protocol-based hypertension treatment) and one of its main implementation strategies (team-based collaborative care), raising implications for health equity and sustainability. We present innovative application of systems thinking visuals.

METHODS

Conducting a convergent mixed methods analysis, we assessed implementation in response to contextual changes across five Ministry of Health (MoH) districts at the pandemic's onset. Utilizing quantitative programmatic data and qualitative interviews with stakeholders (n=18; health providers, administrators, study staff), we evaluated dimensions of "Reach, Effectiveness, Adoption, Implementation and Maintenance," RE-AIM (Reach, Implementation delivery + adaptations), and "Practical Robust Implementation and Sustainability Model," PRISM (Organizational perspective on the EBI, Fit, Implementation and sustainability infrastructure) frameworks. We assessed representativeness by comparing participants to census data. To assess implementation delivery, we built behavior-over-time (BOT) graphs with quantitative programmatic data (July 2019-July 2021). To assess adaptations and contextual changes, we performed matrix-based thematic qualitative analysis. We converged quantitative implementation delivery data + qualitative adaptations data in joint displays. Finally, we analyzed qualitative and quantitative results across RE-AIM/PRISM and health districts to identify equity and sustainability considerations.

RESULTS

Contextual factors that facilitated program delivery included the perception that the EBI was beneficial, program champions, and staff communication. Key barriers to implementation delivery included competition with other primary care activities and limited implementation infrastructure (e.g., equipment, medications). Contextual changes related to COVID-19 hindered implementation delivery, threatened sustainability, and may have exacerbated inequities. However, adaptations that were planned enhanced implementation delivery and may have supported improved equity and sustainability.

CONCLUSIONS

Recognition of an EBI's benefits and program champions are important for supporting initial uptake. The ability to plan adaptations amid rapid contextual changes has potential advantages for sustainability and equitable delivery. Systems thinking tools and mixed methods approaches may shed light on the relations between context, adaptations, and equitable and sustainable implementation.

TRIAL REGISTRATION

NCT03504124.

An mHealth Intervention to Address Depression and Improve Antiretroviral Therapy Adherence Among Youths Living With HIV in Uganda: Protocol for a Pilot Randomized Controlled Trial

BACKGROUND

People living with HIV often struggle with mental health comorbidities that lower their antiretroviral therapy (ART) adherence. There is growing evidence that depression treatment may improve ART adherence and result in improved HIV outcomes. Given that mental health services are severely underequipped in low-resource settings, including in Uganda, new solutions to increase access to mental health care and close the treatment gap are urgently needed. This protocol paper presents the Suubi-Mhealth study, which proposed to develop a mobile health (mHealth) intervention for use among Ugandan youths (14-17 years) with comorbid HIV and depression, taking into account their unique contextual, cultural, and developmental needs.

OBJECTIVE

The proposed study is guided by the following objectives: (1) to develop and iteratively refine an intervention protocol for Suubi-Mhealth based on formative work to understand the needs of youths living with HIV; (2) to explore the feasibility and acceptability of Suubi-Mhealth on a small scale to inform subsequent refinement; (3) to test the preliminary impact of Suubi-Mhealth versus a waitlist control group on youths' outcomes, including depression and treatment adherence; and (4) to examine barriers and facilitators for integrating Suubi-Mhealth into health care settings.

METHODS

Youths will be eligible to participate in the study if they are (1) 14-17 years of age, (2) HIV-positive and aware of their status, (3) receiving care and ART from one of the participating clinics, and (4) living within a family. The study will be conducted in 2 phases. In phase 1, we will conduct focus group discussions with youths and health care providers, for feedback on the proposed intervention content and methods, and explore the feasibility and acceptability of the intervention. In phase II, we will pilot-test the preliminary impact of the intervention on reducing depression and improving ART adherence. Assessments will be conducted at baseline, 1-, 2-, and 6-months post intervention completion.

RESULTS

Participant recruitment for phase 1 is completed. Youths and health care providers participated in focus group discussions to share their feedback on the proposed Suubi-Mhealth intervention content, methods, design, and format. Transcription and translation of focus group discussions have been completed. The team is currently developing Suubi-Mhealth content based on participants' feedback.

CONCLUSIONS

This study will lay important groundwork for several initiatives at the intersection of digital therapeutics, HIV treatment, and mental health, especially among sub-Saharan African youths, as they transition through adolescence and into adult HIV care settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05965245; https://clinicaltrials.gov/study/NCT05965245.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/54635.

Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework

For the fields of implementation science and health equity, understanding and being responsive to local contexts is of utmost importance to better inform the development, implementation, and evaluation of healthcare and public health interventions to increase their uptake and sustainment. Contexts are multi-level and include political, historical, economic, and social factors that influence health, as well as organizational characteristics, reflecting the richness of members' views, resources, values, and needs. Poor alignment between solutions and those contextual characteristics could have an impact on inequities. The PRISM (Practical Robust Implementation and Sustainability Model) is a context-based implementation science framework that incorporates RE-AIM outcomes (Reach, Effectiveness, Adoption, Implementation, Maintenance) and offers guidance to researchers, practitioners, and their patient and community partners on how to conceptualize, assess, and address contextual domains with a focus on health equity. Drawing from systems thinking, participatory engagement, and health equity principles, this commentary expands on previous work to 1) offer a novel perspective on how to align an intervention's core functions and forms with the PRISM's contextual domains, and 2) foster an ongoing and iterative engagement process with diverse partners throughout the research and practice process using a co-creation approach. We recommend intervention-to-context alignment through iterative cycles. To that end, we present the RE-AIM Framework's 'outcomes cascade' to illustrate touch points of opportunity and gaps within and across each of the five RE-AIM outcomes to illustrate 'where things go wrong'. We present a case study to illustrate and offer recommendations for research and practice efforts to increase contextual responsiveness, and enhance alignment with context before, during, and after implementation efforts and to ensure equity is being addressed. We strive to make a conceptual contribution to advance the field of pragmatic research and implementation of evidence-based practices through the application of the contextually-based PRISM framework with a focus on health equity.

Empowering Ontario's long-term care residents to shape the place they call home: a codesign protocol

BACKGROUND

Canada's long-term care (LTC) homes were founded on an institutional model that viewed residents as passive recipients of care. Many homes continue to follow this model leaving residents removed from operational decision-making within their homes. However, involving residents in the design of their LTC home's environment, programmes and operations can improve the residents' quality of life and other outcomes. This codesign project creates a toolkit/resource for LTC homes to facilitate meaningful resident engagement in their home's organisational design and governance.

METHOD

This three-part project consists of a scoping review, qualitative interviews, toolkit/resource development and prototyping. In part 1, we conduct a scoping review to synthesise existing knowledge on approaches to engaging LTC home residents in organisational design and governance of their LTC homes, as well as explore barriers, challenges and facilitators of engagement, considerations for diversity and cognitive change, and approaches to evaluation. In part 2, we will have interviews and focus groups with residents, team members (staff) and administrators to assess community capacity to implement and sustain a programme to engage LTC residents in organisational design and governance of their LTC homes. The third part of our project uses these findings to help codesign toolkit(s)/resource(s) to enable the engagement of LTC residents in the organisational design and governance of their LTC homes.

ETHICS AND DISSEMINATION

The project is conducted in partnership with the Ontario Association of Residents' Councils. We will leverage their communication to disseminate findings and support the use of the codesigned toolkit(s)/resource(S) with knowledge users. We will also publish the study results in an academic journal and present at conferences, webinars and workshops. These results can influence practices within LTC homes by inspiring an organisational culture where residents help shape the place they call home. The interviews and focus groups, conducted in part 2, have been submitted to the University Health Network Research Ethics Board.

Implementation and evaluation of Exercise is Medicine in primary care clinics within a large academic health system

OBJECTIVE

Exercise is Medicine (EIM) is a global initiative encouraging healthcare providers to routinely assess and promote physical activity (PA) among patients. The objective of this study was to evaluate the feasibility, adoption, implementation and effectiveness of EIM from patient, clinician and healthcare staff perspectives using a combination of electronic health record (EHR), survey and interview data.

DESIGN

This study used a combination of the Practical Robust Implementation and Sustainability Model (PRISM) and the Learning Evaluation model to implement EIM. Data captured from the EHR, including Physical Activity Vital Sign (PAVS) scores, and data collected from qualitative surveys and interviews were used to evaluate the programme's Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM, which is embedded within PRISM) from provider, staff and patient perspectives.

SETTING

Five primary care clinics within a large academic health system.

PARTICIPANTS

A total of 24 443 patients from all participating clinics had at least one PAVS score during the study period. A total of 17 clinicians completed surveys, and 4 clinicians, 8 medical assistants and 9 patients completed interviews.

RESULTS

Implementation fidelity metrics varied widely between components and across clinics but were generally consistent over time, indicating a high degree of programme maintenance. Fidelity was highest during the first 6 months of the COVID-19 pandemic when most visits were virtual. Mean PAVS scores increased from 57.7 (95% CI: 56 to 59.4) to 95.2 (95% CI: 91.6 to 98.8) min per week at 6 months for patients not meeting PA guidelines at baseline and decreased from 253.84 (95% CI: 252 to 255.7) to 208.3 (95% CI: 204.2 to 212.4) min per week at 6 months for patients meeting PA guidelines at baseline. After EIM implementation, clinician-estimated time spent discussing PA with patients increased for 35% of providers and stayed the same for 53%.

CONCLUSION

Overall, this study established EIM's feasibility, adoption, implementation and maintenance in routine primary care practice within a large academic health system. From a population health perspective, EIM is a model to emulate to help primary care providers efficiently address healthy lifestyle behaviours in routine primary care visits.

Staff Perspectives on Dementia Care in Nursing Homes: A Pre-Implementation, Content Analysis Study Guided by the Practical, Robust Implementation and Sustainability Model

PURPOSE

To assess implementation context prior to the implementation of Dementia Collaborative Coaching (DCC), a person-centered, communication coaching intervention for speech-language pathologists, certified nursing assistants, and people living with dementia in nursing homes.

METHODS

This was a pre-implementation, content analysis of focus groups. Focus group questions and subsequent analysis were guided by the Practical, Robust Implementation and Sustainability Model.

RESULTS

Employees (N = 27) from three nursing homes participated in five focus groups. Five themes from directed content analysis included (a) Dementia Care Needs Improvement; (b) Dementia Collaborative Coaching Appears Promising; (c) Awareness of Necessary Implementation and Sustainability Plans; (d) Regulations Need Accurate Interpretation and Local Dissemination; and (e) Appropriate Staffing Concerns.

CONCLUSION/IMPLICATIONS

Key factors related to the implementation of DCC included a perceived tension for change from staff to improve dementia care, concerns about appropriate staffing, and the need for explicit implementation and sustainability plans. The importance of continuing education with specific attention to temporary staff was also found to be a necessary element to support better uptake of the person-centered intervention. [Journal of Gerontological Nursing, 50(2), 5-9.].

Facilitators and barriers of digital health technologies implementation in hospital settings in lower-income and middle-income countries since the COVID-19 pandemic: a scoping review protocol

INTRODUCTION

The implementation of digital health technologies (DHTs) in hospitals worldwide has been uneven since the COVID-19 pandemic. Ambiguity in defining the landscape of DHTs adds to the complexity of this process. To address these challenges, this scoping review aims to identify the facilitators and barriers of implementing DHTs in hospitals in lower-income and middle-income countries (LMIC) since COVID-19, describe the DHTs that have been adopted in hospital settings in LMIC during this period, and develop a comprehensive classification framework to define the landscape of DHTs implemented in LMIC.

METHODS AND ANALYSIS

We will conduct a systematic search in PubMed, Scopus, Web of Science and grey literature. Descriptive statistics will be used to report the characteristics of included studies. The facilitators and barriers to DHTs implementation, gathered from both quantitative and qualitative data, will be synthesised using a parallel-results convergent synthesis design. A thematic analysis, employing an inductive approach, will be conducted to categorise these facilitators and barriers into coherent themes. Additionally, we will identify and categorise all available DHTs based on their equipment types and methods of operation to develop an innovative classification framework.

ETHICS AND DISSEMINATION

Formal ethical approval is not required, as primary data collection is not involved in this study. The findings will be disseminated through peer-reviewed publications, conference presentations and meetings with key stakeholders and partners in the field of digital health.

Formative Evaluation of a Comprehensive Self-Management Intervention for Irritable Bowel Syndrome, Comorbid Anxiety, and Depression: Mixed Methods Study

BACKGROUND

Irritable bowel syndrome (IBS) is a disorder of the gut-brain interaction that is associated with abdominal pain, altered bowel patterns, and reduced quality of life. Up to 50% of patients with IBS also report anxiety or depressive symptoms. Although effective self-management interventions exist for individuals with IBS, few have been effectively implemented, and most do not consider the unique needs of patients with comorbid IBS and anxiety or depression.

OBJECTIVE

This study aimed to determine the anticipated acceptability, appropriateness, feasibility, and usability of a comprehensive self-management intervention using an implementation science and human-centered design approach among individuals with comorbid IBS and anxiety or depression and health care providers.

METHODS

A convergent mixed methods design was used to elicit feedback on the comprehensive self-management intervention outline and content to identify refinement needs before testing. Patients with IBS and moderate to severe anxiety or depression and health care providers were purposefully sampled from primary care and gastroenterology settings. Participants completed semistructured interviews and surveys on anticipated acceptability, appropriateness, feasibility, and usability.

RESULTS

Patient participants (n=12) were on average 36.8 (SD 12.2) years of age, and 42% (5/12) were currently receiving psychological therapy. Health care providers (n=14) were from primary care (n=7) and gastroenterology (n=7) settings. The mean usability scores (out of 100) were 52.5 (SD 14.5) for patients and 45.6 (SD 11.6) for providers. For patients and providers, qualitative data expanded the quantitative findings for acceptability and appropriateness. Acceptability findings were the comprehensive nature of the intervention and discussion of the gut-brain interaction. For appropriateness, participants reported that the intervention provided structure, accountability, and support. Feasibility was confirmed for patients, but there was a divergence of findings between quantitative and qualitative measures for providers. Patients focused on intervention feasibility, while providers focused on implementation feasibility in the clinic. Identified usability issues to address before implementation included the intervention delivery format, length, and lack of integration into health care settings that, if not addressed, may limit the reach of the intervention.

CONCLUSIONS

Patients and health care providers found the intervention acceptable and appropriate. Several feasibility and usability issues were identified, including intervention delivery methods, length of intervention, and the best methods to implement in the clinic setting. The next steps are to refine the intervention to address the identified issues and test in a pilot study whether addressing usability issues leads to the anticipated improvements in implementation and uptake.

The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: findings from a quasi-experimental study in Lilongwe, Malawi

Background

Retaining clients on antiretroviral therapy (ART) is challenging especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi.

Methods

Between August 2021 - June 2023, a quasi-experimental study compared outcomes between two cohorts of new ART clients: 1) those opting into 2wT with combined automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as "the proportion clients ≤6 months of ART initiation eligible for 2wT". 2wT effectiveness was assessed in time-to-event analysis comparing Kaplan-Meier plots of 6- and 12-month retention between 2wT and SoC using a log-rank test. The effect of 2wT on ART drop out was estimated using multivariable Cox proportional hazard models, adjusting for sex, age and WHO stage at ART initiation.

Results

Of the 1,146 clients screened, 645 were ineligible (56%) largely due to lack of phone access (393/645; 61%) and illiteracy (149/645; 23%): a reach of 44%. Among 468 2wT participants, the 12-month probability of ART retention was 91% (95%CI: 88% - 93%) compared to 75% (95%CI: 71% - 79%) among 468 SoC participants (p<0.0001). Compared to SoC participants, 2wT participants had a 62% lower hazard of dropping out of ART care at all time points (hazard ratio 0.38, 95% CI: 0.26-0.54; p<0.001).

Conclusions

Not all clients were reached with 2wT. For those who opted-in, 2wT reduced drop out throughout the first year on ART and significantly increased 12-month retention. The proactive 2wT approach should be expanded as a complement to other interventions in routine, low-resource settings to improve ART retention.

The Implementation Success of Technology-Based Counseling in Dementia Care: Scoping Review

BACKGROUND

Implementing technology-based counseling as a complex intervention in dementia care poses challenges such as adaptation to stakeholders' needs and limited resources. While studies have examined the effectiveness of technology-based counseling, its successful implementation remains largely unexplored.

OBJECTIVE

We aimed to review the knowledge about the implementation success of technology-based counseling interventions for people with dementia and their informal caregivers.

METHODS

We conducted a scoping review and systematically searched CINAHL, the Cochrane Library including the Cochrane Central Register of Controlled Trials, MEDLINE, PsycINFO, and Web of Science Core Collection databases (April 2021) in combination with citation searching and web searching (November 2021). Studies reporting on technology-based counseling interventions for people with dementia or their informal caregivers were included, irrespective of the design. We used the conceptual framework for implementation outcomes to operationalize implementation success and applied the outcomes acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability as categories to inform data extraction. We identified dimensions within the categories and synthesized results narratively and graphically.

RESULTS

We included 52 publications reporting on 27 technology-based counseling interventions. The studies were conducted in 9 countries and published between 1993 and 2021. As the design of the included studies varied, the number of participants and the type of data reported varied as well. The intervention programs were heterogeneous and ranged from single counseling interventions (such as helpline services) to counseling as part of a multicomponent program. Telephone, email, videoconferencing, social media (respectively chats), and web-based platforms were used for delivering counseling. We found data on appropriateness for all interventions and data on acceptability for most interventions, describing aspects such as consumer-perceived usefulness and helpfulness of services, as well as satisfaction. Information on the other categories of adoption, feasibility, fidelity, implementation cost, penetration, and sustainability was fragmented.

CONCLUSIONS

The scope and depth of information on conceptual categories of the implementation success of technology-based counseling for people with dementia and informal caregivers varied. The data only partially covered the concept of implementation success, which highlights the need for a systematic evaluation accompanying the implementation. The application of theoretical approaches for implementation and adherence to the framework for developing and evaluating complex interventions are required to promote the implementation of complex interventions and to comprehensively assess implementation success.

TRIAL REGISTRATION

PROSPERO CRD42021245473; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=245473.

Interventions to de-implement unnecessary antibiotic prescribing for ear infections (DISAPEAR Trial): protocol for a cluster-randomized trial

BACKGROUND

Watchful waiting management for acute otitis media (AOM), where an antibiotic is used only if the child's symptoms worsen or do not improve over the subsequent 2-3 days, is an effective approach to reduce antibiotic exposure for children with AOM. However, studies to compare the effectiveness of interventions to promote watchful waiting are lacking. The objective of this study is to compare the effectiveness and implementation outcomes of two pragmatic, patient-centered interventions designed to facilitate use of watchful waiting in clinical practice.

METHODS

This will be a cluster-randomized trial utilizing a hybrid implementation-effectiveness design. Thirty-three primary care or urgent care clinics will be randomized to one of two interventions: a health systems-level intervention alone or a health systems-level intervention combined with use of a shared decision-making aid. The health systems-level intervention will include engagement of a clinician champion at each clinic, changes to electronic health record antibiotic orders to facilitate delayed antibiotic prescriptions as part of a watchful waiting strategy, quarterly feedback reports detailing clinicians' use of watchful waiting individually and compared with peers, and virtual learning sessions for clinicians. The hybrid intervention will include the health systems-level intervention plus a shared decision-making aid designed to inform decision-making between parents and clinicians with best available evidence. The primary outcomes will be whether an antibiotic was ultimately taken by the child and parent satisfaction with their child's care. We will explore the differences in implementation effectiveness by patient population served, clinic type, clinical setting, and organization. The fidelity, acceptability, and perceived appropriateness of the interventions among different clinician types, patient populations, and clinical settings will be compared. We will also conduct formative qualitative interviews and surveys with clinicians and administrators, focus groups and surveys of parents of patients with AOM, and engagement of two stakeholder advisory councils to further inform the interventions.

DISCUSSION

This study will compare the effectiveness of two pragmatic interventions to promote use of watchful waiting for children with AOM to reduce antibiotic exposure and increase parent satisfaction, thus informing national antibiotic stewardship policy development.

CLINICAL TRIAL REGISTRATION

NCT06034080.

Cluster-randomized implementation trial of two facilitation strategies to implement a novel information and communications technology at the Veterans Health Administration

BACKGROUND

Information and communication technologies (ICTs) improve quality and efficiency of healthcare, but effective practices for implementing new ICTs are unknown. From 2019 to 2021, the Veterans Health Administration (VHA) implemented FLOW3, an ICT that facilitates prosthetic limb care. The goal of this study was to compare the impact of two facilitation strategies on FLOW3 adoption, implementation, and sustainment.

METHODS

FLOW3 is a computerized workflow management system comprised of three applications that facilitate the three steps for prosthesis authorization. During VHA's implementation of FLOW3, we randomized 60 VHA sites to basic or enhanced facilitation groups. Basic facilitation included a manualized training toolkit and office hours. Enhanced facilitation included basic facilitation plus monthly learning collaboratives and site-specific performance reports. Outcomes included time to adoption of FLOW3 and complete FLOW3 utilization rates during implementation and sustainment periods. We compared outcomes between sites assigned to basic versus enhanced facilitation groups. Results were calculated using both intent-to-treat (ITT) and dose-response analyses. The dose-response analysis used a per-protocol approach and required sites in the enhanced facilitation group to join two of six learning collaboratives; sites that attended fewer were reassigned to the basic group.

RESULTS

Randomization assigned 30 sites to enhanced facilitation and 30 to basic. Eighteen of 30 randomized sites were included in the enhanced facilitation group for dose-response analysis. During the implementation period, enhanced facilitation sites were significantly more likely to completely utilize FLOW3 than basic facilitation sites (HR: 0.17; 95% CI: 1.18, 4.53, p = 0.02) based on ITT analysis. In the dose-response analysis, the enhanced group was 2.32 (95% CI: 1.18, 4.53) times more likely to adopt FLOW3 than basic group (p = 0.014).

CONCLUSIONS

Enhanced facilitation including a learning collaborative and customized feedback demonstrated greater likelihood for sites to complete a prosthetics consult using FLOW3 throughout our study. We identified statistically significant differences in likelihood of adoption using the dose-response analysis and complete utilization rate using ITT analysis during the implementation period. All sites that implemented FLOW3 demonstrated improvement in completion rate during the sustainment period, but the difference between facilitation groups was not statistically significant. Further study to understand sustainability is warranted.

Enhancing the implementation of provider-to-provider telehealth in rural and remote areas: A mixed methods study protocol

Background

Virtual healthcare solutions are proposed as a way to combat the inequity of access to healthcare in rural and remote areas, and to better support the front-line providers who work in these areas. Rural provider-to-provider telehealth (RPPT) connects rural and remote clinicians to a 'hub' of healthcare specialists who can increase access to emergency and specialised healthcare via an integrated model. Reported benefits for the place-based provider include enhanced knowledge, expanded professional development opportunities, improved scope of practice, and increased confidence in treating more complex cases. These reported benefits could have implications for supporting and futureproofing our health workforce in terms of productivity, burnout, recruitment, and retention.

Methods

The research uses an explanatory sequential mixed methods approach across multiple phases to evaluate the current implementation of Western Australia Country Health Service's (WACHS) Command Centre (CC) services and explore factors associated with their differential use. The primary population of interest and participants in this study are the place-based providers in country Western Australia (WA). Patient data constitutes the secondary population, informing the access and reach of CC services into country WA. Data collection will include service data, an online survey, and semi-structured interviews with the primary population. The data will be interpreted to inform evidence-based strategies and recommendations to improve the implementation and sustainment of RPPT.

Discussion

Innovative and sustained workforce models and solutions are needed globally. Virtual healthcare, including provider-to-provider models, demonstrate potential, especially in rural and remote areas, designed to increase access to specialised expertise for patients and to support the local workforce. This research will generate new data around behaviour, perceptions, and value from the WACHS rural and remote workforce about provider-to-provider telehealth, to explore the implementation and investigate strategies for the long-term sustainment of RPPT services.

Applying Human-Centered Design to Replicate an Adolescent Sexual and Reproductive Health Intervention: A Case Study of Binti Shupavu in Kenya

We present a case study describing the use of human-centered design (HCD) to determine how to adapt intervention components from an existing contraceptive uptake program for adolescent girls in 4 geographical contexts (Ethiopia, northern Nigeria, southern Nigeria, and Tanzania) for use in Kenya. First, we prioritized existing intervention components to be tested in Kenya using sacrificial concepts. Through these concepts, we identified key insights and behavioral archetypes from which to build higher-fidelity prototypes, leveraging existing program knowledge and resources while responding to unique opportunities for Kenyan adolescent girls. After 2 rounds of prototyping, we launched a high-fidelity intervention designed to improve contraceptive uptake among girls. We used program experience to identify strategies for improvement during early implementation. The resulting model, Binti Shupavu, is designed to tap into girls' aspirations and connect them with contraceptive use, build their trust in the health system, and work with influencers to build support for adolescent contraceptive use, following the global user journey. In the first year of implementation (January-December 2022), the intervention was scaled from 90 facilities to 360 facilities and reached 60,111 adolescent girls aged 10-19 years. Of these, 21,698 were new voluntary contraceptive users (36%) and an additional 3,873 (19%) were continuing users.Our design process suggests that HCD is a promising tool for navigating replication. The emphasis on users' perspectives, testing to learn, and collaboration facilitated a deep understanding of the new user population, thus guiding program designers to balance using existing components with developing new ones based on the population's unique needs. Finally, HCD has potential to support the localization agenda if design teams are supported by national, regional, and global experts to be aware of and use the evidence and implementation experience from earlier work.

Nurse Care Management for Opioid Use Disorder Treatment: The PROUD Cluster Randomized Clinical Trial

Importance

Few primary care (PC) practices treat patients with medications for opioid use disorder (OUD) despite availability of effective treatments.

Objective

To assess whether implementation of the Massachusetts model of nurse care management for OUD in PC increases OUD treatment with buprenorphine or extended-release injectable naltrexone and secondarily decreases acute care utilization.

Design, Setting, and Participants

The Primary Care Opioid Use Disorders Treatment (PROUD) trial was a mixed-methods, implementation-effectiveness cluster randomized clinical trial conducted in 6 diverse health systems across 5 US states (New York, Florida, Michigan, Texas, and Washington). Two PC clinics in each system were randomized to intervention or usual care (UC) stratified by system (5 systems were notified on February 28, 2018, and 1 system with delayed data use agreement on August 31, 2018). Data were obtained from electronic health records and insurance claims. An implementation monitoring team collected qualitative data. Primary care patients were included if they were 16 to 90 years old and visited a participating clinic from up to 3 years before a system's randomization date through 2 years after.

Intervention

The PROUD intervention included 3 components: (1) salary for a full-time OUD nurse care manager; (2) training and technical assistance for nurse care managers; and (3) 3 or more PC clinicians agreeing to prescribe buprenorphine.

Main Outcomes and Measures

The primary outcome was a clinic-level measure of patient-years of OUD treatment (buprenorphine or extended-release injectable naltrexone) per 10 000 PC patients during the 2 years postrandomization (follow-up). The secondary outcome, among patients with OUD prerandomization, was a patient-level measure of the number of days of acute care utilization during follow-up.

Results

During the baseline period, a total of 130 623 patients were seen in intervention clinics (mean [SD] age, 48.6 [17.7] years; 59.7% female), and 159 459 patients were seen in UC clinics (mean [SD] age, 47.2 [17.5] years; 63.0% female). Intervention clinics provided 8.2 (95% CI, 5.4-∞) more patient-years of OUD treatment per 10 000 PC patients compared with UC clinics (P = .002). Most of the benefit accrued in 2 health systems and in patients new to clinics (5.8 [95% CI, 1.3-∞] more patient-years) or newly treated for OUD postrandomization (8.3 [95% CI, 4.3-∞] more patient-years). Qualitative data indicated that keys to successful implementation included broad commitment to treat OUD in PC from system leaders and PC teams, full financial coverage for OUD treatment, and straightforward pathways for patients to access nurse care managers. Acute care utilization did not differ between intervention and UC clinics (relative rate, 1.16; 95% CI, 0.47-2.92; P = .70).

Conclusions and Relevance

The PROUD cluster randomized clinical trial intervention meaningfully increased PC OUD treatment, albeit unevenly across health systems; however, it did not decrease acute care utilization among patients with OUD.

Trial Registration

ClinicalTrials.gov Identifier: NCT03407638.

The application of implementation science methods in correctional health intervention research: a systematic review

BACKGROUND

Improving access to high-quality healthcare for individuals in correctional settings is critical to advancing health equity in the United States. Compared to the general population, criminal-legal involved individuals experience higher rates of chronic health conditions and poorer health outcomes. Implementation science frameworks and strategies offer useful tools to integrate health interventions into criminal-legal settings and to improve care. A review of implementation science in criminal-legal settings to date is necessary to advance future applications. This systematic review summarizes research that has harnessed implementation science to promote the uptake of effective health interventions in adult criminal-legal settings.

METHODS

A systematic review of seven databases (Academic Search Premier, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Social Work Abstracts, ProQuest Criminal Justice Database, ProQuest Sociological Abstracts, MEDLINE/PubMed) was conducted. Eligible studies used an implementation science framework to assess implementation outcomes, determinants, and/or implementation strategies in adult criminal-legal settings. Qualitative synthesis was used to extract and summarize settings, study designs, sample characteristics, methods, and application of implementation science methods. Implementation strategies were further analyzed using the Pragmatic Implementation Reporting Tool.

RESULTS

Twenty-four studies met inclusion criteria. Studies implemented interventions to address infectious diseases (n=9), substance use (n=6), mental health (n=5), co-occurring substance use and mental health (n=2), or other health conditions (n=2). Studies varied in their operationalization and description of guiding implementation frameworks/taxonomies. Sixteen studies reported implementation determinants and 12 studies measured implementation outcomes, with acceptability (n=5), feasibility (n=3), and reach (n=2) commonly assessed. Six studies tested implementation strategies. Systematic review results were used to generate recommendations for improving implementation success in criminal-legal contexts.

CONCLUSIONS

The focus on implementation determinants in correctional health studies reflects the need to tailor implementation efforts to complex organizational and inter-agency contexts. Future studies should investigate policy factors that influence implementation success, design, and test implementation strategies tailored to determinants, and investigate a wider array of implementation outcomes relevant to criminal-legal settings, health interventions relevant to adult and juvenile populations, and health equity outcomes.

TRIAL REGISTRATION

A study protocol (CRD42020114111) was registered with Prospero.

Applying Customer Discovery Method to a Chronic Disease Self-Management Mobile App: Qualitative Study

BACKGROUND

A significant health challenge is evident in the United States, with 6 in 10 adults having a chronic disease and 4 in 10 adults having 2 or more. Chronic disease self-management aims to prevent or delay disease progression and disability and reduce mortality risk. The evidence to support the use of information technology tools, including mobile apps, web-based portals, and web-based educational interventions, that support disease self-management and improve clinical outcomes is growing. Customer discovery and value proposition design methodology is a form of stakeholder engagement and is based on marketing and lean start-up business methods. As applied in health care, customer discovery and value proposition methodology can be used to understand the clinical problem and articulate the product's hypothesized unique value proposition relative to alternative options that are available to end users.

OBJECTIVE

This study aims to describe the experience and findings of academic researchers applying the customer discovery and value proposition methodology to identify stakeholders, needs, adaptability, and sustainability of a chronic disease self-management mobile app (CDapp). The motivation of the work is to make mobile health app interventions accessible and acceptable for all segments of patients' chronic diseases.

METHODS

Data were obtained through key informant interviews and analyzed using rapid qualitative analysis techniques. The value proposition framework was used to build the interview guide. The aim was to identify the needs, challenges (pains), and potential benefits (gains) of the CDapp for our stakeholders.

RESULTS

Our results showed that the primary consumers (end users) of a CDapp were the patients. The app adopters (decision makers) can be medical center leaders including population health department managers or insurance providers, while the consumer adoption influencers (influencers or saboteurs) are clinicians and patient caregivers. We developed an ecosystem map to visualize the clinical practice workflow and how an app for chronic disease management might integrate within an academic health care center or system. A value proposition for the identified customer segments was generated. Each stakeholder segment was working within a different framework to improve patient self-management. Patients needed help to adhere to self-care activities and they needed tailored health education. Health care leaders aim to improve the quality of care while reducing costs and workload. Clinicians wanted to improve patient education and care while reducing the time burden. Our results also showed that within academic medical centers, there were variations regarding patients' self-reported abilities to manage their diseases.

CONCLUSIONS

Customer discovery is a useful form of stakeholder engagement when designing studies that seek to implement, adapt, and sustain an intervention. The customer discovery and value proposition methodology can be used as an alternative or complementary approach to formative research to generate valuable information in a brief period.

Adapting, Implementing, and Maintaining a Group Cognitive Behavioral Therapy Program at an Inpatient Addiction Treatment Facility

Background

Quality training is an oft-cited barrier to effective implementation and ongoing delivery of high-quality evidence-based practice (EBP) across fields. This is especially true in the addiction field, but there is little cited evidence for optimal methods to improve EBP in inpatient addiction facilities with minimal resources.

Objective

The current paper focuses on evaluating the state of our facility's group CBT manual and clinical training on the manual in a "realistic" (ie, non-RCT, non-grant-funded) inpatient addiction treatment setting.

Methods

Five full-time clinicians volunteered to take part in the study (woman = 60%; Mage = 36.20 years). The study involved a mix of semi-structured interviews and surveys designed to measure seven outcomes (barriers, feasibility, useability, appropriateness, acceptability, burden, trialability).

Results

Three themes emerged from the data that impacted the group CBT manual: training, timing, and functionality. Addressing these themes allowed for a new, optimal manual and training procedure to be put into place.

Conclusion

The current study highlights that under-resourced inpatient addiction facilities can still methodically utilize implementation approaches to study their EBP, namely CBT. Such an approach will ensure that the highest quality care is being delivered to patients and actively addresses known training barriers that prevent proper EBP delivery.

Engaging interested parties to optimize wildfire smoke communication in Canada: challenges with initiating change

Background

In February 2022, an online Wildfire Smoke Communication Workshop series identified priorities and strategies to improve wildfire smoke communication in Canada. We evaluated the engagement methods, the workshop series and workshop summary report, to determine if participants/organizations initiated changes identified in the workshop to optimize wildfire smoke communication plans.

Methods

Three evaluation surveys were developed using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework dimensions and PRISM (Practical, Robust, Implementation, and Sustainability Model) contextual domains to measure the engagement impact. Surveys 1, 2, and 3 were disseminated to workshop participants between February 2022 (post-workshop series), May 2022 (pre-wildfire season), and September 2022 (post-wildfire season). Likert survey responses were analyzed descriptively using means and standard deviations. Open-ended written responses were analyzed using deductive reasoning and response proportions.

Results

Of 69 workshop participants, 28, 19, and 13 responded to surveys 1, 2, and 3, respectively. Workshop participation helped survey 1 respondents consider optimizing wildfire smoke communication (M = 3.93, SD = 0.88). Workshop participation and the summary report helped survey 2 respondents consider new actions to optimize wildfire smoke communication (M = 3.84, SD = 0.74). The most intended action in survey 2 (68%, n = 13) and the most common action taken in survey 3 (62%, n = 8) was to simplify message content. The primary limitation to optimization was capacity.

Conclusion

The engagement methods, particularly the summary report, were beneficial for organizations to take action to optimize wildfire smoke communication in Canada. Future engagement methods should examine persisting system-level issues and capacity limitations as they undermine the ability to optimize wildfire smoke communication in Canada.

Management of Fall Risk Among Older Adults in Diverse Primary Care Settings

OBJECTIVES

Falls are persistent among community-dwelling older adults despite existing prevention guidelines. We described how urban and rural primary care staff and older adults manage fall risk and factors important to integration of computerized clinical decision support (CCDS).

METHODS

Interviews, contextual inquiries, and workflow observations were analyzed using content analysis and synthesized into a journey map. Sociotechnical and PRISM domains were applied to identify workflow factors important to sustainable CCDS integration.

RESULTS

Participants valued fall prevention and described similar approaches. Available resources differed between rural and urban locations. Participants wanted evidence-based guidance integrated into workflows to bridge skills gaps.

DISCUSSION

Sites described similar clinical approaches with differences in resource availability. This implies that a single intervention would need to be flexible to environments with differing resources. Electronic Health Record's inherent ability to provide tailored CCDS is limited. However, CCDS middleware could integrate into different settings and increase evidence use.

Examining adaptations necessary to support the implementation of a parent-mediated intervention for children with autism spectrum disorder and moderate feeding problems

LAY ABSTRACT

Moderate feeding problems and disruptive mealtime behaviors are common in children with autism spectrum disorder. Although parent-mediated interventions are able to support feeding problems in autistic children, most research has occurred within specialty clinics when delivered by highly trained clinicians. Thus, the fit of these interventions within community settings is not clear. To address this limitation, this study explored adaptations to a parent-mediated intervention, Managing Eating Aversions and Limited Variety (i.e. MEAL Plan), to improve its fit and use within community settings. Participants were 14 multidisciplinary providers who attended one of the three intensive workgroups that included focus groups about the fit of MEAL Plan in their practice setting. Qualitative analysis was used to determine the main themes that came up within the focus groups. Specific themes included the appropriateness MEAL Plan for autistic and non-autistic children, how providers might adapt their delivery of MEAL Plan, billing and insurance considerations, administrator support for MEAL Plan, and the content and format of ongoing training and consultation. By proactively considering and responding to these factors, it may be possible to enhance MEAL Plan so that it is better able to be delivered and sustained within community practices that support autistic children.

Utilizing PRISM and RE-AIM to implement and evaluate the Rural Telementoring Training Center (RTTC) for health care workforce development in rural communities

Introduction

Amid rural health worker shortages and hospital closures, it is imperative to build and maintain the local workforce. Telementoring (TM) or technology-enabled mentoring, is a tool for improving health care quality and access by increasing workforce capacity and support. The national Rural Telementoring Training Center (RTTC) was developed to compile and disseminate TM best practices by delivering free training, tools, and technical assistance to support the implementation, sustainability, and evaluation of new and current TM programs for rural health workers. This paper details how the Practical, Robust Implementation and Sustainability Model (PRISM) was used to understand the context that shaped implementation as well as how Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) was concurrently applied to frame outcomes.

Methods

The RTTC has three implementation strategies: outreach, training and technical assistance (TTA), and a Quality Measure Toolkit. Ongoing periodic reflections with the RTTC team, informed by PRISM, were collected, as were RE-AIM outcomes. Central to this design was the continuous review of incoming data in team meetings to inform programmatic changes by identifying challenges and applying modifications to strategies in real time.

Results

Major implementation changes discussed during reflections included providing timely and relevant messaging through various platforms, streamlining and customizing a TTA approach, and offering different options for accessing the Toolkit. The outreach strategy resulted in high Reach across the US, with over 300 organizations contacted. The effectiveness of the RTTC was demonstrated by counts of people engaging with outreach (ex. over 8,300 impressions on LinkedIn), the website (over 6,400 views), and e-bursts (33% open rate). Moreover, there were 32 TTA requests and 70 people accessing the Toolkit. Adoption was demonstrated by 27 people participating in TTA and 14 individuals utilizing the Toolkit.

Discussion

The integration of PRISM and RE-AIM frameworks promoted a holistic implementation and evaluation plan. Using PRISM, the RTTC team was able to reflect on the implementation strategies through the lens of contextual factors and make rapid programmatic changes within team meetings. That process resulted in outcomes framed by RE-AIM. The integration of two frameworks in tandem provided an adaptive and comprehensive approach to implementing a large-scale, national program.

Community-engaged optimization of COVID-19 rapid evaluation and testing experiences: roll-out implementation optimization trial

BACKGROUND

There continues to be a need for COVID-19 testing that is pragmatic, community-centered, and sustainable. This study will refine and test implementation strategies prioritized by community partners: (1) walk-up no-cost testing, (2) community health worker (promotores)-facilitated testing and preventive care counseling, (3) vending machines that dispense no-cost, self-testing kits.

METHODS

A co-designed Theory of Change from an earlier study phase and the Practical, Robust Implementation and Sustainment Model (PRISM) will guide the study design, measures selection, and evaluation. The first aim is to refine and operationalize a multi-component implementation strategy bundle and outcome measures for COVID-19 testing. A Community and Scientific Advisory Board (CSAB) will be established and include community members, clinical providers/staff from the partnering Federally Qualified Health Center (FQHC), public health researchers, policymakers, and a county health department ambassador. Engagement of CSAB members will be assessed through structured ethnography and a survey about the quality and quantity of engagement practices. The second aim is to implement and evaluate the impact of the implementation strategy bundle to optimize COVID-19 testing in communities using a roll-out implementation optimization (ROIO) design. Seven thousand and five hundred community members will be enrolled across four FQHC clinics over 18 months. Participants will be invited to complete an electronic survey about their demographics, health, and COVID-19 testing results and experiences. CSAB members and clinic partners will participate in PRISM fit and determinant assessments prior to each clinic rollout and post-trial. Interviews will be conducted with 60 community participants and 12 providers/staff following a 3-month rollout period at each clinic, inquiring about their experiences with the implementation strategies. Quantitative data will be analyzed using hierarchical multilevel models to determine the impact of implementation strategies. Qualitative data will be analyzed using rapid qualitative approaches to summarize implementation experiences and identify necessary changes prior to subsequent rollouts. A matrix approach will be used to triangulate data from quantitative and qualitative sources based on PRISM domains.

DISCUSSION

This is one of the first pragmatic implementation trials to use a ROIO design and aims to co-create a sustainable and equitable COVID-19 testing program. Findings are likely to generalize to other public health prevention efforts.

TRIAL REGISTRATION

NCT05894655 March 2, 2023.

Preventing Suicide in Health Systems: How Can Implementation Science Help?

Suicide prevention is an emotive, complex goal for clinicians and health systems. Effective interventions for suicidality do exist; however, many patients do not receive them because implementation efforts tend to be time-limited and unsystematic. Implementation science is the study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice. This narrative review introduces implementation science to suicide researchers, with a special focus on healthcare settings. We outline prominent theories, methods, and measures, as well as examples of implementation research from suicidology. By embracing the principles of implementation science, suicidologists can help to close the gap between evidence-based practice and routine practice, thereby improving the delivery and uptake of suicide-related interventions and prevention programs.

Vitalizing Community for Health Promotion Against Modifiable Risk Factors of Noncommunicable Diseases (V-CaN) in Rural Central India: Protocol for a Hybrid Type II Implementation Effectiveness Trial

BACKGROUND

Low- and middle-income countries are facing the emerging burden of chronic noncommunicable diseases (NCDs). Apart from loss of human lives and premature deaths, NCDs result in huge costs for treatment to individuals and the health system. Although NCDs develop in later life, the risk factors begin at an early age. The key to the control of the global epidemic of NCDs is primary prevention based on comprehensive community-based programs.

OBJECTIVE

This study aims to develop, implement, and evaluate the effect of a participatory health promotion initiative utilizing the existing mechanisms of Village Health Nutrition and Sanitation Committees (VHNSCs), women's self-help groups (SHGs), and schools on modifiable risk factors for NCDs among young people aged 10-30 years.

METHODS

The proposed type II hybrid effectiveness implementation cluster randomized field trial will be conducted in the catchment area of 4 primary health centers (PHCs) in Wardha district, India, comprising 100 villages with a population of 144,000. Each PHC will be randomly allocated to one of the 3 intervention arms or the control arm. The 3-intervention arm PHCs will utilize a unique strategy with either VHNSC or SHG members or school students as change agents for health action against common modifiable NCD risk factors. This study will be implemented in 3 phases from January 2022 to December 2024. First, the preparatory phase for baseline assessments includes anthropometry, behavioral and biochemical risk factors for NCDs, and participatory development of the health promotion intervention modules. Second, the implementation phase will focus on capacity building of the change agents and implementation of the participatory health promotion initiative. The implementation will include organization of community-based events, 6-monthly participatory assessment of change, and preparation of a sustainability and exit plan toward the end of this phase. Third, the evaluation phase will consist of studying the effectiveness of each intervention strategy in the reduction of risk factor prevalence at the population level.

RESULTS

We will assess 12,000 (3000 in each arm) randomly selected individuals for behavioral risk factors and 1600 (400 in each arm) individuals for biochemical risk factors during baseline as well as endline assessments. Difference in differences, ANOVA or multivariate analysis of covariance, and regression analysis will be performed to assess the effectiveness of the interventions. Qualitative methods such as focus group discussions and stories of change will be documented and analyzed using thematic framework analysis. The implementation outcomes will be reported using the PRISM (Practical Robust Implementation and Sustainability Model) RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. The results are expected to be published by mid-2025.

CONCLUSIONS

This study will show the magnitude of risk factors for NCDs, its determinants, feasibility, effectiveness of community-based interventions, and health promotion models for NCD prevention.

TRIAL REGISTRATION

Clinical Trials Registration India CTRI/2020/10/028700; https://ctri.nic.in/Clinicaltrials/showallp.php?mid1=47597&EncHid=&userName=V-CaN.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/42450.

The iPRISM webtool: an interactive tool to pragmatically guide the iterative use of the Practical, Robust Implementation and Sustainability Model in public health and clinical settings

BACKGROUND

To increase uptake of implementation science (IS) methods by researchers and implementers, many have called for ways to make it more accessible and intuitive. The purpose of this paper is to describe the iPRISM webtool (Iterative, Practical, Robust Implementation and Sustainability Model) and how this interactive tool operationalizes PRISM to assess and guide a program's (a) alignment with context, (b) progress on pragmatic outcomes, (c) potential adaptations, and (d) future sustainability across the stages of the implementation lifecycle.

METHODS

We used an iterative human-centered design process to develop the iPRISM webtool.

RESULTS

We conducted user-testing with 28 potential individual and team-based users who were English and Spanish speaking from diverse settings in various stages of implementing different types of programs. Users provided input on all aspects of the webtool including its purpose, content, assessment items, visual feedback displays, navigation, and potential application. Participants generally expressed interest in using the webtool and high likelihood of recommending it to others. The iPRISM webtool guides English and Spanish-speaking users through the process of iteratively applying PRISM across the lifecycle of a program to facilitate systematic assessment and alignment with context. The webtool summarizes assessment responses in graphical and tabular displays and then guides users to develop feasible and impactful adaptations and corresponding action plans. Equity considerations are integrated throughout.

CONCLUSIONS

The iPRISM webtool can intuitively guide individuals and teams from diverse settings through the process of using IS methods to iteratively assess and adapt different types of programs to align with the context across the implementation lifecycle. Future research and application will continue to develop and evaluate this IS resource.

Implementation of Machine Learning Applications in Health Care Organizations: Protocol for a Systematic Review of Empirical Studies

BACKGROUND

An increasing interest in machine learning (ML) has been observed among scholars and health care professionals. However, while ML-based applications have been shown to be effective and have the potential to change the delivery of patient care, their implementation in health care organizations is complex. There are several challenges that currently hamper the uptake of ML in daily practice, and there is currently limited knowledge on how these challenges have been addressed in empirical studies on implemented ML-based applications.

OBJECTIVE

The aim of this systematic literature review is twofold: (1) to map the ML-based applications implemented in health care organizations, with a focus on investigating the organizational dimensions that are relevant in the implementation process; and (2) to analyze the processes and strategies adopted to foster a successful uptake of ML.

METHODS

We developed this protocol following the PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) guidelines. The search was conducted on 3 databases (PubMed, Scopus, and Web of Science), considering a 10-year time frame (2013-2023). The search strategy was built around 4 blocks of keywords (artificial intelligence, implementation, health care, and study type). Based on the detailed inclusion criteria defined, only empirical studies documenting the implementation of ML-based applications used by health care professionals in clinical settings will be considered. The study protocol was registered in PROSPERO (International Prospective Register of Systematic Reviews).

RESULTS

The review is ongoing and is expected to be completed by September 2023. Data analysis is currently underway, and the first results are expected to be submitted for publication in November 2023. The study was funded by the European Union within the Multilayered Urban Sustainability Action (MUSA) project.

CONCLUSIONS

ML-based applications involving clinical decision support and automation of clinical tasks present unique traits that add several layers of complexity compared with earlier health technologies. Our review aims at contributing to the existing literature by investigating the implementation of ML from an organizational perspective and by systematizing a conspicuous amount of information on factors influencing implementation.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/47971.

The role of organizational capacity in intervention efficacy in a church-based cancer education program: A configurational analysis

It is well-established in the field of implementation science that the context in which an intervention is delivered can play a crucial role in how well it is implemented. However, less is known about how organizational context or capacity relates to efficacy outcomes, particularly with health promotion interventions delivered outside of healthcare settings. The present study examined whether organizational capacity indicators were linked to key efficacy outcomes in an evidence-based cancer control intervention delivered in 13 African American churches in Maryland. Outcomes included increases in colorectal cancer knowledge and self-report colonoscopy screening behavior from baseline to follow-up. We used Coincidence Analysis to identify features of organizational capacity that uniquely distinguished churches with varying levels of cancer knowledge and screening. Indicators of organizational capacity (e.g., congregation size, prior health promotion experience) were from an existing measure of church organizational capacity for health promotion. A single solution pathway accounted for greater increases in colorectal cancer knowledge over 12 months, a combination of two conditions: conducting 3 or more health promotion activities in the prior 2 years together with not receiving any technical assistance from outside partners in the prior 2 years. A single condition accounted for greater increases in colonoscopy screening over 24 months: churches that had conducted health promotion activities in 1-4 different topical areas in the prior 2 years. Findings highlight aspects of organizational capacity (e.g., prior experience in health promotion) that may facilitate intervention efficacy and can help practitioners identify organizational settings most promising for intervention impact.

Development and testing of a decision aid to achieve shared decision-making for routine labor induction

BACKGROUND

This quality improvement project aimed to create a decision aid for labor induction in healthy pregnancies at or beyond 39 weeks that met the needs of pregnant people least likely to experience shared decision-making and to identify and test implementation strategies to support its use in prenatal care.

METHODS

We used quality improvement and qualitative methods to develop, test, and refine a patient decision aid. The decision aid was tested in three languages by providers across obstetrics, family medicine, and midwifery practices at a tertiary care hospital and two community health centers. Outcomes included patients' understanding of their choices, pros and cons of choices, and the decision being theirs or a shared one with their provider.

RESULTS

Patient interview data indicated that shared decision-making on labor induction was achieved. Across three Plan-Do-Study-Act cycles, we interviewed a diverse group of 24 pregnant people: 20 were people of color, 16 were publicly insured, and 15 were born outside the United States. All but one (23/24) reported feeling the decision was theirs or a shared one with their provider. The majority could name induction choices they had along with pros and cons. Interviewees described the decision-making experience as empowering and positive. Nine medical providers tested the decision aid and gave feedback. Providers stated the tool helped improve the quality of their counseling and reduce bias.

CONCLUSION

This project suggests that using an evidence-based and well-tested decision aid can help achieve shared decision-making on labor induction for a diverse group of pregnant people.