RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review

Reach and Engagement With Population Health Management Interventions to Address COVID-19 Among Safety-Net Health Care Systems

Interventions designed to address COVID-19 needed to be rapidly scaled up to the population level, and to address health equity by reaching historically marginalized populations most affected by the pandemic (e.g., racial/ethnic minorities and rural and low socioeconomic status populations). From February 2021 to June 2022, SCALE-UP Utah used text messaging interventions to reach 107 846 patients from 28 clinics within seven safety-net health care systems. Interventions provided informational and motivational messaging regarding COVID-19 testing and vaccination, and were developed using extensive community partner input. (Am J Public Health. 2024;114(11):1207-1211. https://doi.org/10.2105/AJPH.2024.307770).

Community-based diet and obesity-related policy, system, and environmental interventions for obesity prevention during the first 1000 days: A scoping review

Community-based policy, systems, and environmental interventions have the potential to reduce modifiable risk factors for obesity early in life. The purpose of this scoping review was to characterize the breadth, generalizability, and methodological quality of community-based diet and obesity-related policy, system, and environmental interventions during the first 1000 days of life, from pregnancy to 24 months of age. Eight databases were searched, and 83 studies (122 references) were included. Data were extracted for breadth (intervention characteristics), generalizability (reach, effectiveness, adoption, implementation, and maintenance), and study quality (Downs and Black Checklist). Systems and environmental approaches were common (> 80%), relative to policy approaches (39%). The majority (60-69%) occurred in the prenatal period and early infancy (0-3 months), assessed breastfeeding or child growth/obesity (53% for both), and included people with lower income (80%) or racial and/or ethnic minority groups (63%). Many interventions reported positive outcomes (i.e., in the expected direction) for child diet, breastfeeding, and feeding practices (> 62%). Few reported intervention maintenance or spanned the full 1000 days. Most studies were classified as good (32%) or fair (56%) methodological quality. The interventions mainly addressed pregnancy and early infancy. Rigorous and representative investigation is needed to improve intervention reach, sustainability, and application in toddlerhood.

Applying Implementation Science to Advance Electronic Health Record-Driven Learning Health Systems: Case Studies, Challenges, and Recommendations

With the widespread implementation of electronic health records (EHRs), there has been significant progress in developing learning health systems (LHSs) aimed at improving health and health care delivery through rapid and continuous knowledge generation and translation. To support LHSs in achieving these goals, implementation science (IS) and its frameworks are increasingly being leveraged to ensure that LHSs are feasible, rapid, iterative, reliable, reproducible, equitable, and sustainable. However, 6 key challenges limit the application of IS to EHR-driven LHSs: barriers to team science, limited IS experience, data and technology limitations, time and resource constraints, the appropriateness of certain IS approaches, and equity considerations. Using 3 case studies from diverse health settings and 1 IS framework, we illustrate these challenges faced by LHSs and offer solutions to overcome the bottlenecks in applying IS and utilizing EHRs, which often stymie LHS progress. We discuss the lessons learned and provide recommendations for future research and practice, including the need for more guidance on the practical application of IS methods and a renewed emphasis on generating and accessing inclusive data.

Mujeres Unidas: A Pilot Study to Educate Latina Women

In the United States, it is estimated that 15% of Latinos will experience a depressive or anxiety disorder during their lifetime. Education, prevention programming, and health interventions around topics such as stress, nutrition, mental health, and health maintenance for Latino immigrants are lacking, inadequate, or nonexistent. This type of programming may be protective against depression and anxiety. A total of 19 Latina women completed a five-week, group-based intervention to learn about stress, stress management, nutrition, mental health, and healthy behaviors in a culturally sensitive environment taught by native Spanish speakers. Program evaluation occurred through in-depth interviews and changes in anxiety and depression scores via the Generalized Anxiety Scale and the Patient Health Questionnaire, respectively. The team saw statistically significant decreases in the GAD-7 scores pre- and post-intervention (8.00 versus 5.08, p<0.05), but no differences in the PSS or the PHQ-2 scores. Group-based intervention and education taught by native Spanish speakers may be an acceptable and feasible approach to addressing anxiety in Latina immigrants.

Evaluating the effectiveness of a multi-component lifestyle therapy program versus psychological therapy for managing mood disorders (HARMON-E): protocol of a randomised non-inferiority trial

BACKGROUND

Mood disorders, including unipolar and bipolar depression, contribute significantly to the global burden of disease. Psychological therapy is considered a gold standard non-pharmacological treatment for managing these conditions; however, a growing body of evidence also supports the use of lifestyle therapies for these conditions. Despite some clinical guidelines endorsing the application of lifestyle therapies as a first-line treatment for individuals with mood disorders, there is limited evidence that this recommendation has been widely adopted into routine practice. A key obstacle is the insufficient evidence on whether lifestyle therapies match the clinical and cost effectiveness of psychological therapy, particularly for treating those with moderate to severe symptoms. The HARMON-E Trial seeks to address this gap by conducting a non-inferiority trial evaluating whether a multi-component lifestyle therapy program is non-inferior to psychological therapy on clinical and cost-effectiveness outcomes over 8-weeks for adults with major depressive disorder and bipolar affective disorder.

METHODS

This trial uses an individually randomised group treatment design with computer generated block randomisation (1:1). Three hundred and seventy-eight adults with clinical depression or bipolar affective disorder, a recent major depressive episode, and moderate-to-severe depressive symptoms are randomised to receive either lifestyle therapy or psychological therapy (adjunctive to any existing treatments, including pharmacotherapies). Both therapy programs are delivered remotely, via a secure online video conferencing platform. The programs comprise an individual session and six subsequent group-based sessions over 8-weeks. All program aspects (e.g. session duration, time of day, and communications between participants and facilitators) are matched except for the content and program facilitators. Lifestyle therapy is provided by a dietitian and exercise physiologist focusing on four pillars of lifestyle (diet, physical activity, sleep, and substance use), and the psychological therapy program is provided by two psychologists using a cognitive behavioural therapy approach. Data collection occurs at baseline, 8-weeks, 16-weeks, and 6 months with research assistants blinded to allocation. The primary outcome is depressive symptoms at 8 weeks, measured using the Montgomery-Åsberg Depression Rating Scale (MADRS) (minimal clinically important difference = 1.6). A pre-specified within-trial economic evaluation will also be conducted.

DISCUSSION

Should lifestyle therapy be found to be as clinically and cost effective as psychological therapy for managing mood disorders, this approach has potential to be considered as an adjunctive treatment for those with moderate to severe depressive symptoms.

TRIAL REGISTRATION

Australia and New Zealand Clinical Trials Register (ANZCTR): ACTRN12622001026718, registered 22nd July 2022.

PROTOCOL VERSION

 4.14, 26/06/2024.

What does it take for healthy food retail programmes to be successful? Lessons learned in New York City

OBJECTIVE

Healthy food retail programmes (HFRP) in the USA generally aim to increase healthy foods access to improve diet quality and health, yet the impact is mixed. These programmes primarily target adults, even though adolescents frequently and independently visit stores to purchase snacks. This study's aims are to explore successes and challenges of implementing HFRP (Aim 1) and examine how HFRP can be tailored to adolescents (Aim 2).

DESIGN

One-time, virtual, semi-structured interviews with individuals who were involved in a HFRP, followed by a socio-demographic characteristics survey. Interviews were designed based on the RE-AIM framework and the Hexagon Tool and analysed using Braun and Clark's (2006) thematic analysis approach. Descriptive statistics were used to summarise participants' socio-demographic characteristics.

SETTING

New York City (NYC).

PARTICIPANTS

Adults (18 years or older) who have designed, implemented and/or evaluated an HFRP in NYC and speak/understand English (n 21).

RESULTS

Aim 1: For successes, strategies to build relationships with the community were most discussed. Regarding challenges, securing reliable funding was the hardest to overcome. Suggested solutions included designing profitable HFRP, targeting shortcomings in food distribution systems and increasing consumer demand. Aim 2: Most participants had not considered adolescents in previous HFRP but suggested involving youth in developing HFRP to encourage youth-driven solutions and promote youth advocacy.

CONCLUSIONS

Future HFRP should focus on activities that help store owners purchase affordable healthy foods from distributors, which translates to affordability for customers. Federal and local policies can assist by funding complementary programmes. Additionally, adolescents should be considered in these efforts.

A case study in science-to-service application of epilepsy self-management

AIMS

Epilepsy self-management (ESM), the overall approach of reducing seizures and optimizing whole-health, is a targeted approach to improve population health for people with epilepsy (PWE). "Self-management for people with epilepsy and a history of negative health events" (SMART) is an 8-session group-format, remotely delivered ESM. This report describes the evolution of SMART development, testing and scale-up, taking advantage of ESM team expertise, community relationships and infrastructure established by social service agencies that deliver support to PWE.

METHODS

This is a case-study dissemination and implementation (D&I) science-to-service model using the RE-AIM framework approach (Reach, Effectiveness, Adoption, Implementation, and Maintenance) focused on 5 dimensions of individual- and setting-level outcomes important to program adoption, impact and sustainability. Performance evaluations include participation representativeness, ESM attendance and acceptability as well as change in relevant health outcomes.

RESULTS

SMART D & I is implemented via a collaboration of 3 unique regional, epilepsy-focused nonprofit social service organizations and a university team that developed SMART. The ongoing collaboration is expanding SMART delivery to PWE across 13 U.S. states. Thus far, we have trained 17 Nurse and Peer Educators (NEs and PEs). PEs (N = 10) have a mean age 51.1 (SD 10.4) years and a mean age of epilepsy diagnosis of 29.4 (SD 19.3). Of 128 participants offered SMART, and who provided age data (N = 86) mean age was 37.7 years (SD 14.4). Of participants who provided data on gender and race (N = 89), 65 were women (73.9 %), 18 African-American (20.2 %). Mean age of epilepsy diagnosis was 19.4 years (SD 16.6) and 59 (52.2 %) of PWE reported having seizures in the last 30 days pre-SMART sessions. Among those with attendance data (N = 103), mean number of SMART groups attended was 5.7 (SD 2.3). Mean values for past 30-day seizure frequency, 9-item Patient Health Questionnaire (PHQ-9), Generalized Anxiety Disorder Inventory (GAD-7) and 10-item Quality of Life in Epilepsy Scale (QOLIE-10) for PWE that provided both pre and post SMART data were 7.6 (SD 15.8) vs 2.8 (SD 3.4) p = 0.3, 7.63 (SD 6.6) vs 6.3 (SD 5.7) p = 0.95, 6.6 (SD 5.7) vs 6.67(SD 5.3) p = 0.47 and 2.8 (SD 0.8) vs 2.7 (SD 1.0) p = 0.07 respectively.

CONCLUSIONS

Implementing ESM using a RE-AIM/Iterative RE-AIM framework links intervention developers and community partners. While PWE have substantial barriers to health, including frequent seizures, they are able engage in the SMART program. Although a major limitation to patient-level evaluation is challenges in collecting post-SMART follow-up data, preliminary findings suggest a trend for improved quality of life.

Exploring the Safewards Programme to Reduce Restrictive Practices in Residential Aged Care: Protocol for a Pilot and Feasibility Study

INTRODUCTION

Restrictive practice use in residential aged care homes internationally is unacceptably high. Although policies and legislation mandate the reduction or elimination of restrictive practices, there remains a gap in knowledge regarding strategies that have been effective in achieving a sustained reduction in restraint use. There is an urgent need to identify effective and feasible interventions that aged care staff can implement in everyday practice to reduce restraint use. Safewards is an evidence-based programme that has demonstrated effectiveness in reducing conflict and restrictive practice use in inpatient psychiatric settings and has the potential to address the issue of restraint use in aged care homes. This study aims to evaluate the feasibility of Safewards in reducing restrictive practices in residential aged care homes.

METHODS

This pilot and feasibility study will adopt a mixed methods process and outcomes evaluation. Safewards will be implemented in two Australian residential aged care homes. The Reach, Effectiveness, Adoption, Implementation and Maintenance framework will be used to evaluate implementation outcomes. Additionally, the Consolidated Framework for Implementation Research will be used to guide qualitative data collection (including semi-structured interviews with residents/family members, aged care leaders and staff) and explain the facilitators and barriers to effective implementation.

CONCLUSION

This study will provide pilot evidence on the feasibility of the Safewards programme in residential aged care homes. Understanding the processes and adaptations for implementing and evaluating Safewards in residential aged care will inform a future trial in aged care to assess its effectiveness. More broadly, the findings will support the implementation of an international aged care policy of reducing restrictive practices in residential aged care.

PATIENT OR PUBLIC CONTRIBUTION

A person with lived experience of caring for someone with dementia is employed as a Safewards facilitator and is a member of the steering committee. Residents and family members will be invited to participate in the project steering committee and provide feedback on their experience of Safewards.

TRIAL REGISTRATION

ACTRN12624000044527.

State Department of Health's Equitable Funding Allocation Methodology to Address COVID-19 Health Disparities Among High-Risk and Underserved Populations

The Washington State Department of Health developed an equitable funding allocation methodology incorporating quantitative and qualitative decision-making components. We describe the methodology and an implementation evaluation performed by an external evaluation team using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) evaluation framework. The evaluation team concluded that the methodology was developed in a way that used a racial equity lens and prioritized intersectionalities in the communities that the funding was intended to serve. (Am J Public Health. 2024;114(S7):S575-S579. https://doi.org/10.2105/AJPH.2024.307833).

Increasing goals of care conversations in primary care: Study protocol for a cluster randomized, pragmatic, sequential multiple assignment randomized trial

BACKGROUND

Goals of care conversations explore seriously ill patients' values to guide medical decision making and often inform decisions about life sustaining treatments. Ideally, conversations occur before a health crisis between patients and clinicians in the outpatient setting. In the United States Veterans Affairs (VA) healthcare system, most conversations still occur in the inpatient setting. Strategies are needed to improve implementation of outpatient, primary care goals of care conversations.

METHODS

We plan a cluster randomized (clinician-level) sequential, multiple assignment randomized trial to evaluate the effectiveness of patient implementation strategies on the outcome of goals of care conversation documentation when delivered in combination with clinician implementation strategies. Across three VA healthcare system sites, we will enroll primary care clinicians with low rates of goals of care conversations and their patients with serious medical illness in the top 10th percentile of risk of hospitalization or death. We will compare the effectiveness of sequences of implementation strategies and explore how patient and site factors modify implementation strategy effects. Finally, we will conduct a mixed-methods evaluation to understand implementation strategy success or failure. The design includes two key innovations: (1) strategies that target both clinicians and patients and (2) sequential strategies with increased intensity for non-responders.

CONCLUSION

This study aims to determine the effect of different sequences and combinations of implementation strategies on primary care documentation of goals of care conversations. Study partners, including the VA National Center for Ethics in Health Care and Office of Primary Care, can consider policies based on study findings.

Promoting serious illness conversations in primary care through telehealth among persons living with cognitive impairment

BACKGROUND

serious illness conversations (SIC), particularly for persons living with cognitive impairment (PLCI), inconsistently happen in primary care. Pragmatic, scalable strategies are needed to promote SIC for PLCI.

DESIGN

Pragmatic, prospective single-arm pilot study that occurred between July 1, 2021 and May 30, 2022 across seven primary care practices in North Carolina.

PARTICIPANTS

Community-dwelling patients aged 65 and older with known or probable mild cognitive impairment or dementia (with decision-making capacity) and their care partners (if available).

INTERVENTION

SIC telehealth intervention (TeleVoice) via video or telephone to assist PLCI in discussing their current goals, values, and future medical preferences, while facilitating documentation within the EHR.

MAIN OUTCOMES

Main feasibility outcomes included reach/enrollment, intervention completion, and adoption rates at the clinic and provider level. Primary effectiveness outcomes included SIC documentation and quality within the EHR and usage of advance care planning billing (ACP) codes.

RESULTS

Of the 163 eligible PLCI approached, 107 (66%) enrolled (mean age 83.7 years, 68.2% female, 16.8% Black, 22% living in a geographic area of high socioeconomic disadvantage) and 81 (76%) completed the SIC telehealth intervention; 45 care partners agreed to participate (mean age 71.5 years, 80% female). Adoption at clinic level was 50%, while 75% of providers within these clinics participated. Among PLCI that completed the intervention, SIC documentation and usage of ACP billing codes was 100% and 96%, respectively, with 96% (n = 78) having high-quality SIC documentation. No significant differences were observed between telephone and video visits.

CONCLUSION

These findings provide preliminary evidence to support the feasibility of conducting SICs through telehealth to specifically meet the needs of community-dwelling PLCI. Further investigation of the sustainability of the intervention and its long-term impact on patient and caregiver outcomes is needed.

Iohexol plasma clearance measurement protocol standardization for adults: a consensus paper of the European Kidney Function Consortium

International consensus supports the development of standardized protocols for measured glomerular filtration rate (mGFR) to facilitate the integration of mGFR testing in both clinical and research settings. To this end, the European Kidney Function Consortium convened an international group of experts with relevant experience in mGFR. The working group performed an extensive literature search to inform the development of recommendations for mGFR determination using 1-compartment plasma clearance models and iohexol as the exogenous filtration marker. Iohexol was selected as it is non-radio labeled, inexpensive, and safe, can be assayed at a central laboratory, and the other commonly used non-radio-labeled tracers have been (inulin) or are soon to be (iothalamate) discontinued. A plasma clearance model was selected over urine clearance as it requires no urine collection. A 1 compartment was preferred to 2 compartments as it requires fewer samples. The recommendations are based on published evidence complemented by expert opinion. The consensus paper covers practical advice for patients and health professionals, preparation, administration, and safety aspects of iohexol, laboratory analysis, blood sample collection and sampling times using both multiple and single-sample protocols, description of the mGFR mathematical calculations, as well as implementation strategies. Supplementary materials include patient and provider information sheets, standard operating procedures, a study protocol template, and support for mGFR calculation.

Integrating Heart Rate Monitoring Into a Camp for Children With Neuromotor Disorders: A Case Series

PURPOSE

This case series investigated the implementation fidelity, feasibility, and effectiveness of integrating continuous heart rate monitoring with visual feedback into an established, intensive physical therapy camp for children with neuromotor disorders.

SUMMARY OF KEY POINTS

The provision of continuous visual feedback through color-coded, individually calculated heart rate zones was a feasible and effective intervention, encouraging pediatric gait camp participants to exercise at intensities that produced aerobic and functional gains. The use of technology facilitated participation with peers, an outcome equally as important as their endurance and functional improvements.

CONCLUSIONS AND RECOMMENDATIONS FOR CLINICAL PRACTICE

Pediatric physical therapists play a crucial role in enhancing the well-being and physical fitness of children with disabilities. Encouraging regular exercise in a social environment fosters enjoyable, inclusive experiences while promoting overall health. It is important for clinicians in various pediatric rehabilitation settings to establish programs that offer such opportunities for children with neuromotor disorders.

A telehealth yoga program for older adults in rural Wisconsin: intervention development and process outcomes

Although yoga improves physical functioning, balance, and quality of life in older adults, rural residents are less likely to participate due to issues related to availability, access, and beliefs regarding yoga practice. To address these barriers, we worked with community partners to adapt a yoga program designed for older adults for telehealth delivery. In this report, intervention development and process outcomes are presented. Community collaborators identified strategies to recruit and retain older adults and suggested modifications required to maximize the adoption and maintenance of a telehealth exercise program by local community organizations. Four rural serving organizations evaluated the program using a wait-list comparison group design. Process measures collected at post-intervention supplemented program evaluation measures collected pre- and post-intervention. The adapted 8-week program consisted of two weekly group sessions delivered over video conferencing software. Of 48 enrolled participants, 83% completed the program. Participants were on average 72.6 (SD=6) years old, majority white (98%), female (85.7%), and attended some college (92%). Most were satisfied with the telehealth delivery, program content, and yoga instructor with mixed results regarding logistical issues such as program length and duration. Community organizations similar to those that will ultimately disseminate the program, yoga teachers, and older adults were engaged to maximize the feasibility of this telehealth exercise program. The program appeared to be safe and acceptable, indicating telehealth may be a strategy to increase access to yoga programs for rural-dwelling older adults. Lessons learned will inform future telehealth iterations of this and similar exercise programming.

Implementation and Impact of Perinatal Food Is Medicine Programs: A Qualitative Research Study

BACKGROUND

Improving social determinants of health, such as access to nutritious food, is crucial for achieving health equity. Nutrition insecurity, especially during pregnancy and postpartum, can lead to poor maternal and birth outcomes. Food is Medicine (FIM) programs, which integrate food into the health care system to prevent or manage disease, have the potential to improve nutrition insecurity, but research about perinatal FIM programs is limited.

OBJECTIVE

The purpose of this study was to explore perceptions of public health impacts of perinatal FIM programs from the perspectives of both program implementers and program supporters and implementation strategies used to enhance program adoption, implementation, and maintenance.

DESIGN

Qualitative data were collected through semi-structured interviews. The interview guide was based on the Reach, Effectiveness, Adoption, Implementation, Maintenance framework.

PARTICIPANTS/SETTING

Program implementers (n = 16) and program supporters (n = 20) were recruited across the United States through purposive sampling in 2022 and 2023.

ANALYSIS

Data were analyzed using deductive thematic analysis and an iterative feedback loop with the project partner.

RESULTS

Interviews were completed with program implementers and program supporters and generated meaning units (n = 1,942), which were coded into themes aligned with each Reach, Effectiveness, Adoption, Implementation, Maintenance dimension. Perinatal FIM programs reached multiple priority populations who were mainly recruited through health care systems. Effectiveness measures typically included nutrition patterns and practices, as well as return on investment. Motivations for adopting programs primarily included partnerships and connections, financing, and policies and laws. Program components varied and were adapted to meet participants and setting needs. Policy, evidence, funding, and partnerships could lead to program maintenance. Implementation strategies applied by the program supporters included financial strategies and infrastructure changes.

CONCLUSIONS

There is a need to identify the core functions and adaptable forms of perinatal FIM programs, which could lead to identification of standard evaluation metrics. This could result in greater uptake by potential delivery agents, increased funding and policy support, and enhanced benefits for perinatal population experiencing health disparities.

Addressing the challenges of integrating care for perinatal depression in primary care in Nigeria

PURPOSE

This report provides the results of a task-shared approach for integrating care for perinatal depression (PND) within primary maternal and child healthcare (PMCH), including the factors that may facilitate or impede the process.

METHODS

This hybrid implementation-effectiveness study guided by the Replicating Effective Programmes framework was conducted in 27 PMCH clinics in Ibadan, Nigeria. The primary implementation outcome was change in the identification rates of PND by primary health care workers (PHCW) while the primary effectiveness outcome was the difference in symptom remission (EPDS score ≤ 5) 6 months postpartum. Outcome measures were compared between two cohorts of pregnant women, one recruited before and the other after training PHCW to identify and treat PND. Barriers and facilitators were explored in qualitative interviews.

RESULTS

Identification of PND improved from 1.4% before to 17.4% after training; post-training rate was significantly higher in clinics where PHCW routinely screened using the 2-item patient health questionnaire (24.8%) compared to non-screening clinics (5.6%). At 6-months postpartum, 60% of cohort one experienced remission from depression, compared to 56.5% cohort two [OR-0.9 (95%CI-0.6, 1.3) p = 0.58]. Identified facilitators for successful integration included existence of policy specifying mental health as a component of PHC, use of screening to aid identification and supportive supervision, while barriers included language and cultural attitudes towards mental health and human resource constraints. PHCW were able to make adaptations to address these barriers.

CONCLUSIONS

Successful implementation of task-shared care for perinatal depression requires addressing staff shortages and adopting strategies that can improve identification by non-specialist providers.

TRIAL REGISTRATION

This study was retrospectively registered 03 Dec 2019. https://doi.org/10.1186/ISRCTN94230307 .

National implementation trial of BeUpstanding™: an online initiative for workers to sit less and move more

BACKGROUND

The online BeUpstanding™ program is an eight-week workplace-delivered intervention for desk-based workers to raise awareness of the benefits of sitting less and moving more and build a supportive culture for change. A workplace representative (the "champion") delivers the program, which includes a workshop where teams collectively choose their sit less/move more strategies. A toolkit provides the champion with a step-by-step guide and associated resources to support program uptake, delivery, and evaluation. Here we report on the main findings from the Australian national implementation trial of BeUpstanding.

METHODS

Recruitment (12/06/2019 to 30/09/2021) was supported by five policy and practice partners, with desk-based work teams from across Australia targeted. Effectiveness was measured via a single arm, repeated-measures trial. Data were collected via online surveys, toolkit analytics, and telephone calls with champions. The RE-AIM framework guided evaluation, with adoption/reach (number and characteristics); effectiveness (primary: self-reported workplace sitting time); implementation (completion of core components; costs); and, maintenance intentions reported here. Linear mixed models, correcting for cluster, were used for effectiveness, with reach, adoption, implementation, and maintenance outcomes described.

RESULTS

Of the 1640 website users who signed-up to BeUpstanding during the recruitment period, 233 were eligible, 198 (85%) provided preliminary consent, and 118 (50.6%) champions consented and started the trial, with 94% (n = 111 champions) completing. Trial participation was from across Australia and across industries, and reached 2,761 staff, with 2,248 participating in the staff survey(s): 65% female; 64% university educated; 17% from a non-English speaking background. The program effectively changed workplace sitting (-38.5 [95%CI -46.0 to -28.7] minutes/8-hour workday) and all outcomes targeted by BeUpstanding (behaviours and culture), with small-to-moderate statistically-significant effects observed. All participating teams (n = 94) completed at least 5/7 core steps; 72.4% completed all seven. Most champions spent $0 (72%) or >$0-$5 (10%) per team member; most (67/70 96%) intended to continue or repeat the program.

CONCLUSIONS

BeUpstanding can be adopted and successfully implemented by a range of workplaces, reach a diversity of staff, and be effective at creating a supportive culture for teams of desk-based workers to sit less and move more. Learnings will inform optimisation of the program for longer-term sustainability.

TRIAL REGISTRATION

ACTRN12617000682347.

Using Neuropsychological Profiling to Tailor Mental Health Care for Children and Youth: a Quality Improvement Project to Measure Feasibility

OBJECTIVE

Precision child and youth mental healthcare has great potential to improve treatment success by tailoring interventions to individual needs. An innovative care pathway in a pediatric mental health outpatient clinic was designed to allow for neuropsychology data to be integrated in psychotherapeutic care. This paper describes the feasibility of this new pathway, including implementation outcomes, acceptability, and potential for future integration.

METHOD

The target population was outpatients 6-17 years old referred for individual treatment to a tertiary outpatient mental health (OPMH) clinic. The new care pathway was co-developed by neuropsychologists and mental health practitioners. A logic model was created to guide the evaluation, which was informed by the Reach Effectiveness Adoption Implementation Maintenance framework. As part of the logic model, a stepped assessment protocol was implemented, and reports on neuropsychological function were shared with patients, caregivers, and care providers. Evaluation data were collected from phone surveys, questionnaires, a focus group, and administrative records.

RESULTS

Forty-two patients scheduled to receive therapy over a 6-month period were offered the opportunity to participate in the new care pathway and 39 (93%) agreed. Self-reported outcome data showed that 83% of patients and 94% of caregivers valued neuropsychology-informed care, with some describing it as transformative. Almost all practitioners (91%) reported that the project added value to their clinical care. There were no adverse effects on participants nor the flow of patients through the system.

CONCLUSIONS

Neuropsychology-informed pediatric OPMH care was feasible and well-received. Clinical effectiveness should be studied in an experimental trial.

Building capacity and capability for quality improvement: insights from a nascent regional health system

OBJECTIVES

Quality improvement (QI) is critical in facilitating advancements in patient outcomes, system efficiency and professional growth. This paper aimed to elucidate the underlying rationale and framework guiding JurongHealth Campus (JHC), a nascent Regional Health System, in developing its QI capacity and capability at all levels of the organisation.

METHODS

An exhaustive analysis of high-performance management systems and effective improvement frameworks was conducted, and the principles were customised to suit the local context.A three-phased approach was applied: (1) developing the JHC QI framework; (2) building capacity through a dosing approach and (3) building capability through QI projects and initiatives using the model for improvement (MFI). Three components of the RE-AIM implementation strategy were assessed: (1) Reach-overall percentage of staff trained; (2) Effectiveness-outcomes from organisation-wide improvement projects and (3) Adoption-number of QI projects collated and presented.

RESULTS

The percentage of staff trained in QI increased from 11.3% to 22.0% between January 2020 and March 2024, with over 350 projects documented in the central repository. The effectiveness of the MFI was demonstrated by improving inpatient discharges before 12pm performance from 21.52% to 25.84% and reducing the 30-day inpatient readmission rate from 13.92% to 12.96%.

CONCLUSION

Four critical factors for an effective QI framework were identified: (1) establishing a common language for improvement; (2) defining distinct roles and skills for improvement at different levels of the organisation; (3) adopting a dosing approach to QI training according to the defined roles and skills and (4) building a critical mass of committed staff trained in QI practice. The pragmatic approach to developing QI capability is both scalable and applicable to emerging healthcare institutions.

A hybrid type II effectiveness-implementation trial of a positive emotion regulation intervention among people living with HIV engaged in Ryan White Medical Case Management: protocol and design for the ORCHID study

BACKGROUND

The Ryan White Medical Case Management System, which serves more than half of people living with HIV (PLWH) in the USA, is an opportune setting for identifying and addressing depression among PLWH. A growing body of research suggests that interventions that promote positive emotion may lessen symptoms of depression and improve physical and psychological well-being among people experiencing a variety of health-related stress, including living with HIV. Research on how best to integrate standardized mental health screening and referral to evidence-based interventions in Ryan White Medical Case Management settings has the potential to improve the health and wellbeing of PLWH.

METHODS

This mixed-methods study will enroll up to N = 300 Ryan White clients who screen positive for depressive symptoms in ORCHID (Optimizing Resilience and Coping with HIV through Internet Delivery), a web-based, self-guided positive emotion regulation intervention. The study will be conducted in 16 Ryan White Medical Case Management clinics in Chicago, IL. Following pre-implementation surveys and interviews with Medical Case Managers (MCMs) and Supervisors to develop an implementation facilitation strategy, we will conduct a hybrid type 2 implementation-effectiveness stepped wedge cluster randomized trial to iteratively improve the screening and referral process via interviews with MCMs in each wedge. We will test the effectiveness of ORCHID on depression and HIV care outcomes for PLWH enrolled in the program. RE-AIM is the implementation outcomes framework and the Consolidated Framework for Implementation Research is the implementation determinants framework.

DISCUSSION

Study findings have the potential to improve mental health and substance use screening of Ryan White clients, decrease depression and improve HIV care outcomes, and inform the implementation of other evidence-based interventions in the Ryan White Medical Case Management System.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05123144. Trial registered 6/24/2021.

MINISTOP 3.0: Implementation of a mHealth obesity prevention program within Swedish child healthcare - study protocol for a cluster randomized controlled trial

BACKGROUND

Previously, we have reported on the efficacy and real-world effectiveness of a parent-oriented mobile health intervention (MINISTOP 1.0 and 2.0), which have shown improvements in pre-school children's lifestyle behaviours. However, there is a need for implementation evidence. The overall aims of this study are to: (i) compare two different implementation strategies for MINISTOP 3.0 (Basic vs. Enhanced) on: acceptability, appropriateness, feasibility, organizational readiness to implement MINISTOP 3.0 within Swedish child healthcare (primary outcomes) as well as reach, costs, and adoption of MINISTOP 3.0 (secondary outcomes); (ii) evaluate cost-effectiveness of MINISTOP 3.0; (iii) explore the sustainability of MINISTOP 3.0; (iv) evaluate the determinants of effectiveness of MINISTOP 3.0 on children's key lifestyle behaviours; and (v) investigate the long-term effects of MINISTOP 3.0 on children's body mass index.

METHODS

A hybrid type III implementation-effectiveness design will be used. A cluster randomized controlled trial will be conducted to compare the effects of basic versus enhanced implementation strategies on the outcomes at the child healthcare level. A minimum of 50 child healthcare centers across Sweden will participate and we aim to recruit 120 nurses. Child healthcare nurses in both groups will offer the MINISTOP 3.0 app to the families at the 2.5/3-year routine visit. Basic implementation strategies include educational meeting with nurses, formal implementation blueprint, develop/distribute educational materials and enhanced implementation includes all aforementioned strategies plus auditing/providing feedback and ongoing training for nurses. All outcomes will be assessed at baseline and 12 months post-implementation. Implementation outcomes will be assessed quantitatively using questionnaires and sustainability will be assessed qualitatively at 12 months. Children's key lifestyle behaviours will be collected through a parental questionnaire within the MINISTOP app at baseline and 6 months after they have received the app. Children's weight/height will be measured at routine visits at 2.5/3 (baseline), 4 and 5 years of age.

DISCUSSION

This study will provide important implementation evidence with regards to implementing mHealth interventions within Swedish child healthcare at scale and these results have the potential to be generalized to other digital interventions being implemented in child healthcare.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT05667753. Registered December 29, 2022.

Digital Intervention to Improve Health Services for Young People in Zimbabwe: Process Evaluation of 'Zvatinoda!' (What We Want) Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) Framework

BACKGROUND

Youth in Southern Africa face a high burden of HIV and sexually transmitted infections, yet they exhibit low uptake of health care services.

OBJECTIVE

The Zvatinoda! intervention, co-designed with youth, aims to increase the demand for and utilization of health services among 18-24-year-olds in Chitungwiza, Zimbabwe.

METHODS

The intervention utilized mobile phone-based discussion groups, complemented by "ask the expert" sessions. Peer facilitators, supported by an "Auntie," led youth in anonymous online chats on health topics prioritized by the participants. Feedback on youth needs was compiled and shared with health care providers. The intervention was tested in a 12-week feasibility study involving 4 groups of 7 youth each, totaling 28 participants (n=14, 50%, female participants), to evaluate feasibility and acceptability. Mixed methods process evaluation data included pre- and postintervention questionnaires (n=28), in-depth interviews with participants (n=15) and peer facilitators (n=4), content from discussion group chats and expert guest sessions (n=24), facilitators' debrief meetings (n=12), and a log of technical challenges. Descriptive quantitative analysis and thematic qualitative analysis were conducted. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework was adapted to analyze and present findings on (1) reach, (2) potential efficacy, (3) adoption, (4) implementation, and (5) maintenance.

RESULTS

Mobile delivery facilitated engagement with diverse groups, even during COVID-19 lockdowns (reach). Health knowledge scores improved from pre- to postintervention across 9 measures. Preintervention scores varied from 14% (4/28) for contraception to 86% (24/28) for HIV knowledge. After the intervention, all knowledge scores reached 100% (28/28). Improvements were observed across 10 sexual and reproductive health (SRH) self-efficacy measures. The most notable changes were in the ability to start a conversation about SRH with older adults in the family, which increased from 50% (14/28) preintervention to 86% (24/28) postintervention. Similarly, the ability to use SRH services even if a partner does not agree rose from 57% (16/28) preintervention to 89% (25/28) postintervention. Self-reported attendance at a health center in the past 3 months improved from 32% (9/28) preintervention to 86% (24/28) postintervention (potential efficacy). Chat participation varied, largely due to network challenges and school/work commitments. The key factors facilitating peer learning were interaction with other youth, the support of an older, knowledgeable "Auntie," and the anonymity of the platform. As a result of COVID-19 restrictions, regular feedback to providers was not feasible. Instead, youth conveyed their needs to stakeholders through summaries of key themes from chat groups and a music video presented at a final in-person workshop (adoption and implementation). Participation in discussions decreased over time. To maintain engagement, introducing an in-person element was suggested (maintenance).

CONCLUSIONS

The Zvatinoda! intervention proved both acceptable and feasible, showing promise for enhancing young people's knowledge and health-seeking behavior. Potential improvements include introducing in-person discussions once the virtual group has established rapport and enhancing feedback and dialog with service providers.

Use of continuous positive airway pressure in drainage of pleural effusion: Educational intervention for evidence-based practice

OBJECTIVE

To create an educational intervention for health professionals and test its effectiveness in implementing the use of CPAP in hospitalized patients with pleural effusion undergoing thoracic drainage.

METHODS

This implementation study was developed in 5 hospitals in Brazil and one in Belgium within four phases: (I) Situational diagnosis (professionals and patients' knowledge about CPAP usage for drained pleural effusion and checking medical records for the last 6 months); (II) Education and training of professionals; (III) New situational diagnosis (equal to phase I); (IV) Follow-up for two years.

RESULTS

65 professionals, 117 patients' medical records, and 64 patients were enrolled in this study. Initially, only 72% of medical records presented a description of interventions. CPAP usage was mentioned in only one patient with a chest tube. After phase III, the number of professionals who used CPAP for their patients with drained pleural effusion increased from 28.8% to 66.7%, p < 0.001. Similarly, the acceptability of this therapy for this clinical situation also increased among professionals from 6.4 ± 1.3 to 7.8 ± 1.4, p < 0.001. However, before the implementation, only one medical record described the use of CPAP in one patient with drained pleural effusion. After two years, the use of CPAP therapy by healthcare professionals for patients with drained thoracic drainage was sustained in 3 hospitals.

CONCLUSIONS

The educational intervention for the use of CPAP in patients with drained pleural effusion was effective for health professionals. Results were sustained after two years in three of the six hospitals.

Improving possible serious bacterial infection (PSBI) management in young infants when referral is not feasible: lessons from embedded implementation research in Ethiopia and Kenya

BACKGROUND

Sepsis is a leading cause of neonatal mortality, despite the availability of effective treatment of possible serious bacterial illness (PSBI), including when referral to a hospital is not feasible. Gaps in access and delivery worsened during COVID-19. We conducted embedded implementation research in Ethiopia and Kenya aimed at mitigating the impact of COVID-19 and addressing various implementation challenges to improve PSBI management.

METHODS

The implementation research projects were implemented at the subnational level in Ethiopia and Kenya between November 2020-June 2022 (Ethiopia) and December 2020-August 2022 (Kenya). Guided by the implementation research frameworks, both projects conducted mixed formative quantitative and exploratory research from April to May 2021, followed by summative evaluations conducted between June and July 2022. Frameworks encompassed Consolidated Framework for Implementation Research (CFIR), Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), as well as health systems framework that incorporates cascades of care and World Health Organization Health Systems Building Blocks. Results were synthesized across the projects through document review and sharing cross-project measures and strategies through a project community of practice.

RESULTS

Despite differences in settings across the projects, cross-cutting facilitators included community health worker program and support, and existence of guidelines for PSBI management at primary care levels. Barriers included community attitudes towards seeking care for sick newborns, COVID-19 risks and fear, and lack of health care worker competence. Country-specific contextual barriers included supply chain issues, civil conflict (Ethiopia), and labor strikes (Kenya). Strategies chosen to mitigate barriers and support implementation and sustainability in both settings included leveraging community health workers to address resistance to care-seeking, health workers' training, COVID-19 infection prevention measures, stakeholder engagement, and advocacy to integrate PSBI management into existing programs, policies, and training. Other strategies addressing emerging project-specific barriers, included improving follow-up through a community health desk and PSBI mobile app (Kenya) and supply chain strengthening (Ethiopia). Both projects improved PSBI management coverage, increased adoption and uptake, and informed national policy changes supporting potential for sustainability.

CONCLUSIONS

Pragmatic embedded implementation research effectively supports the identification of barriers and mapping to strategies designed to increase effective coverage of PSBI management when referral is not feasible during the COVID-19 pandemic. Despite differences in context, cross-cutting strategies identified could inform broader scale-up in the region, including during future health system shocks.

Implementation of an electronic prospective surveillance model for cancer rehabilitation: a mixed methods study protocol

INTRODUCTION

An electronic prospective surveillance model (ePSM) uses patient-reported outcomes to monitor impairments along the cancer pathway for timely management. Randomised controlled trials show that ePSMs can effectively manage cancer-related impairments. However, ePSMs are not routinely embedded into practice and evidence-based approaches to implement them are limited. As such, we developed and implemented an ePSM, called REACH, across four Canadian centres. The objective of this study is to evaluate the impact and quality of the implementation of REACH and explore implementation barriers and facilitators.

METHODS AND ANALYSIS

We will conduct a 16-month formative evaluation, using a single-arm mixed methods design to routinely monitor key implementation outcomes, identify barriers and adapt the implementation plan as required. Adult (≥18 years) breast, colorectal, lymphoma or head and neck cancer survivors will be eligible to register for REACH. Enrolled patients complete brief assessments of impairments over the course of their treatment and up to 2 years post-treatment and are provided with a personalised library of self-management education, community programmes and when necessary, suggested referrals to rehabilitation services. A multifaceted implementation plan will be used to implement REACH within each clinical context. We will assess several implementation outcomes including reach, acceptability, feasibility, appropriateness, fidelity, cost and sustainability. Quantitative implementation data will be collected using system usage data and evaluation surveys completed by patient participants. Qualitative data will be collected through focus groups with patient participants and interviews with clinical leadership and management, and analysis will be guided by the Consolidated Framework for Implementation Research.

ETHICS AND DISSEMINATION

Site-specific ethics approvals were obtained. The results from this study will be presented at academic conferences and published in peer-reviewed journals. Additionally, knowledge translation materials will be co-designed with patient partners and will be disseminated to diverse knowledge users with support from our national and community partners.

The development and evaluation of the Designing for Dissemination and Implementation Learning Hub

There is a growing emphasis on reducing the gap between research and routine practice. Dissemination and Implementation (D&I) science offers theories, models, and frameworks to enhance the implementation, impact, and sustainment of new programs and interventions. Few training opportunities are available that help leaders, researchers, clinicians, and staff (implementers) translate original research into practice settings in a more timely and effective manner without requiring significant time away from their primary clinical duties. To address these needs, we designed a virtual Designing for Dissemination and Implementation (D4D&I) Learning Hub that offered foundational D&I knowledge and opportunities for skill building. We developed the D4D&I Learning Hub curricula to train novice participants in the multicomponent D4D&I implementation strategy bundle when implementing new programs or innovations. The components of the D4D&I strategy bundle include (i) Pre-implementation assessment for proactive planning and multilevel contextual assessment, (ii) Multilevel partner engagement to learn what is important to end-users and obtain buy-in, (iii) Implementation and adaptations guided by a pre-implementation assessment while retaining program fidelity, and (iv) Program evaluation. We utilized a virtual e-learning platform, expert trainers, mentorship, and a Virtual Learning Collaborative to deliver the six-module curricula to support participants' growth and success. We used quantitative and qualitative methods informed by the Kirkpatrick Evaluation Model to evaluate the D4D&I Learning Hub. Thirty-one participants completed the D4D&I Learning Hub across four cohorts. Participants found the D4D&I curricula relevant and favorable, indicating they acquired the intended knowledge and skills. In presentations of their key takeaways, participants cited a greater understanding of how to apply various D&I theories, models, and frameworks to their research, engage multilevel partners during all phases of implementation and evaluation, and assess fidelity and adaptations. Participants planned to incorporate the acquired D&I knowledge and skills in future publications, grant applications, and when implementing new programs and projects in clinical settings. The D4D&I Learning Hub provides foundational education for novice participants of D&I science. It promotes designing, disseminating, implementing, and evaluating effective programs in clinical settings. This article discusses the development and implementation of the D4D&I Learning Hub. In addition, we evaluated the first four cohorts using the Kirkpatrick Evaluation Model.

Community-Based Cluster-Randomized Trial to Reduce Opioid Overdose Deaths

BACKGROUND

Evidence-based practices for reducing opioid-related overdose deaths include overdose education and naloxone distribution, the use of medications for the treatment of opioid use disorder, and prescription opioid safety. Data are needed on the effectiveness of a community-engaged intervention to reduce opioid-related overdose deaths through enhanced uptake of these practices.

METHODS

In this community-level, cluster-randomized trial, we randomly assigned 67 communities in Kentucky, Massachusetts, New York, and Ohio to receive the intervention (34 communities) or a wait-list control (33 communities), stratified according to state. The trial was conducted within the context of both the coronavirus disease 2019 (Covid-19) pandemic and a national surge in the number of fentanyl-related overdose deaths. The trial groups were balanced within states according to urban or rural classification, previous overdose rate, and community population. The primary outcome was the number of opioid-related overdose deaths among community adults.

RESULTS

During the comparison period from July 2021 through June 2022, the population-averaged rates of opioid-related overdose deaths were similar in the intervention group and the control group (47.2 deaths per 100,000 population vs. 51.7 per 100,000 population), for an adjusted rate ratio of 0.91 (95% confidence interval, 0.76 to 1.09; P = 0.30). The effect of the intervention on the rate of opioid-related overdose deaths did not differ appreciably according to state, urban or rural category, age, sex, or race or ethnic group. Intervention communities implemented 615 evidence-based practice strategies from the 806 strategies selected by communities (254 involving overdose education and naloxone distribution, 256 involving the use of medications for opioid use disorder, and 105 involving prescription opioid safety). Of these evidence-based practice strategies, only 235 (38%) had been initiated by the start of the comparison year.

CONCLUSIONS

In this 12-month multimodal intervention trial involving community coalitions in the deployment of evidence-based practices to reduce opioid overdose deaths, death rates were similar in the intervention group and the control group in the context of the Covid-19 pandemic and the fentanyl-related overdose epidemic. (Funded by the National Institutes of Health; HCS ClinicalTrials.gov number, NCT04111939.).

Strengthening China's National Essential Public Health Services Package for hypertension and diabetes care: protocol for an interrupted time series study with mixed-methods process evaluation and health economic evaluation

BACKGROUND

Despite major primary health care (PHC) reforms in China with the 2009 launch of the National Essential Public Health Service Package, the country experiences many challenges in improving the management of non-communicable diseases in PHC facilities. "EMERALD" is a multifaceted implementation strategy to strengthen the management of hypertension and type-2 diabetes mellitus (T2DM) in PHC facilities. The study aims to: (1) examine the effectiveness of EMERALD in improving hypertension and T2DM management; (2) evaluate the implementation of the interventions; and (3) use the study findings to model the long-term health economic impact of the interventions.

METHODS

The EMERALD intervention components include: (1) empowerment for PHC providers through training and capacity building; (2) empowerment for patient communities through multi-media health education; and  (3) empowerment for local health administrators through health data monitoring and strengthening governance of local PHC programs. An interrupted time series design will be used to determine the effectiveness of the interventions based on routinely collected health data extracted from local health information systems. The primary effectiveness outcome is the guideline-recommended treatment rates for people with hypertension and T2DM. Secondary effectiveness outcomes include hypertension and T2DM diagnosis and control rates, and enrolment and adherence rates to the recommended care processes in the National Essential Public Health Service Package. A mixed-methods process evaluation will be conducted to evaluate the implementation of the interventions, including the reach of the target population, adequacy of adoption, level of implementation fidelity, and maintenance. Qualitative interviews with policy makers, health administrators, PHC providers, and patients with hypertension and/or T2DM will be conducted to further identify factors influencing the implementation. In addition, health economic modelling will be performed to explore the long-term incremental costs and benefits of the interventions.

DISCUSSION

This study is expected to generate important evidence on the effectiveness, implementation, and health economic impact of complex PHC interventions to strengthen the primary care sector's contribution to addressing the growing burden of non-communicable diseases in China.

TRIAL REGISTRATION

The study has been registered on Chinese Clinical Trial Registry at https://www.chictr.org.cn/ (Registration number ChiCTR2400082036, on March 19th 2024).

Developing Evidence to Support Policy: Protocol for the StrAtegic PoLicy EvIdence-Based Evaluation CeNTer (SALIENT)

BACKGROUND

All federal agencies are required to support appropriation requests with evidence and evaluation (US Public Law 115-435; the Evidence Act). The StrAtegic PoLicy EvIdence-Based Evaluation CeNTer (SALIENT) is 1 of 6 centers that help the Department of Veterans Affairs (VA) meet this requirement.

OBJECTIVE

Working with the existing VA evaluation structure, SALIENT evaluations will contribute to (1) optimize policies and programs for veteran populations; (2) improve outcomes regarding health, equity, cost, and provider well-being; (3) advance the science of dissemination and knowledge translation; and (4) expand the implementation and dissemination science workforce.

METHODS

We leverage the Lean Sprint methodology (iterative, incremental, rule-governed approach to clearly defined, and time-boxed work) and 3 cores to develop our evaluation plans collaboratively with operational partners and key stakeholders including veterans, policy experts, and clinicians. The Operations Core will work with evaluation teams to develop timelines, facilitate work, monitor progress, and guide quality improvement within SALIENT. The Methods Core will work with evaluation teams to identify the most appropriate qualitative, quantitative, and mixed methods approaches to address each evaluation, ensure that the analyses are conducted appropriately, and troubleshoot when problems with data acquisition and analysis arise. The Knowledge Translation (KT) Core will target key partners and decision makers using a needs-based market segmentation approach to ensure that needs are incorporated in the dissemination of knowledge. The KT Core will create communications briefs, playbooks, and other materials targeted at these market segments to facilitate implementation of evidence-based practices and maximize the impact of evaluation results.

RESULTS

The SALIENT team has developed a center infrastructure to support high-priority evaluations, often to be responsive to shifting operational needs and priorities. Our team has engaged in our core missions and operations to rapidly evaluate a high-priority areas, develop a comprehensive Lean Sprint systems redesign approach to training, and accelerate rapid knowledge translation.

CONCLUSIONS

With an array of interdisciplinary expertise, operational partnerships, and integrated resources, SALIENT has an established and evolving infrastructure to rapidly develop and implement high-impact evaluations. Projects are developed with sustained efficiency approaches that can pivot to new priorities as needed and effectively translate knowledge for key stakeholders and policy makers, while creating a learning health system infrastructure to foster the next generation of evaluation and implementation scientists.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/59830.

Identifying Facilitators and Barriers to Implementation of AI-Assisted Clinical Decision Support in an Electronic Health Record System

Recent advancements in computing have led to the development of artificial intelligence (AI) enabled healthcare technologies. AI-assisted clinical decision support (CDS) integrated into electronic health records (EHR) was demonstrated to have a significant potential to improve clinical care. With the rapid proliferation of AI-assisted CDS, came the realization that a lack of careful consideration of socio-technical issues surrounding the implementation and maintenance of these tools can result in unanticipated consequences, missed opportunities, and suboptimal uptake of these potentially useful technologies. The 48-h Discharge Prediction Tool (48DPT) is a new AI-assisted EHR CDS to facilitate discharge planning. This study aimed to methodologically assess the implementation of 48DPT and identify the barriers and facilitators of adoption and maintenance using the validated implementation science frameworks. The major dimensions of RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) and the constructs of the Consolidated Framework for Implementation Research (CFIR) frameworks have been used to analyze interviews of 24 key stakeholders using 48DPT. The systematic assessment of the 48DPT implementation allowed us to describe facilitators and barriers to implementation such as lack of awareness, lack of accuracy and trust, limited accessibility, and transparency. Based on our evaluation, the factors that are crucial for the successful implementation of AI-assisted EHR CDS were identified. Future implementation efforts of AI-assisted EHR CDS should engage the key clinical stakeholders in the AI tool development from the very inception of the project, support transparency and explainability of the AI models, provide ongoing education and onboarding of the clinical users, and obtain continuous input from clinical staff on the CDS performance.

A parenting program delivered through existing community-based peer groups to improve early child development in Homabay and Busia Counties, Kenya: study protocol for a cluster-randomized controlled trial

BACKGROUND

Poor early childhood development (ECD) is a major global health concern that is associated with various adverse outcomes over the lifecourse. Parenting interventions especially during the earliest years of life can benefit ECD. However, there is limited evidence from Kenya about the effectiveness of parenting interventions for improving ECD outcomes especially across rural disadvantaged communities. This paper describes the study protocol for an impact and implementation evaluation of a community-based group parenting program that aims to improve ECD in rural Kenya.

METHODS

We will conduct a cluster-randomized controlled trial to determine the effectiveness of a parenting program for caregivers of young children in Homabay and Busia counties in Western Kenya. Sixty-four village clusters will be randomly assigned to either the parenting intervention arm or the waitlist control arm with stratification by county. In each village, 10 primary caregivers with a child aged 0-24 months will be enrolled. The parenting program will be delivered through existing peer groups within communities whereby caregivers will receive counseling and psychosocial support to enhance their parenting skills and wellbeing to in turn promote ECD. The intervention curriculum comprises 21 sessions targeting various nurturing care messages, including early learning, responsive caregiving, child nutrition, health, protection, and caregiver mental health. Group sessions are facilitated by a trained volunteer biweekly for a total of 11 months. The primary trial outcome is an overall measure of ECD using the Global Scales of Early Development long form version. Secondary outcomes include various caregiver outcomes (e.g., parenting practices, mental health) and other child outcomes (e.g., socioemotional development, dietary diversity). All outcomes will be assessed at baseline and endline. We will also conduct a qualitative implementation evaluation at endline and interview various stakeholders to assess program fidelity, quality, and sustainability.

DISCUSSION

This trial will evaluate the effectiveness of a parenting intervention on ECD and caregiving outcomes and assess program implementation quality as delivered through existing community-based peer groups. This study will provide rigorous evidence that can be used to inform scale-up of this program model that leverages existing community social networks and resources for improving caregivers' parenting skills and promoting ECD in rural Kenya and other similar settings across LMICs.

TRIAL REGISTRATION

ClinicalTrials.gov #NCT06165315. Registered on December 11, 2023.

Pharmacist Use of a Population Management Dashboard for Safe Anticoagulant Prescribing: Evaluation of a Nationwide Implementation Effort

BACKGROUND

Direct oral anticoagulants (DOACs) have complex dosing regimens and are often incorrectly prescribed. We evaluated a nationwide DOAC population management dashboard rollout whose purpose includes pharmacist review and correction of off-label dosing prescriptions.

METHODS AND RESULTS

Using data from Veterans Health Affairs, we identified all patients prescribed DOACs for atrial fibrillation or venous thromboembolism between August 2015 and December 2019. Sites were grouped on the basis of the timing of moderate-high usage of the DOAC population management tool dashboard. Effectiveness was defined as the monthly rate of off-label DOAC prescribing and the rate of clinical adverse events (bleeding, composite of stroke or venous thromboembolism). Implementation was evaluated as the percentage of off-label DOAC prescriptions changed within 7 days. Among the 128 652 patients receiving DOAC therapy at 123 centers, between 6.9% and 8.6% had off-label DOAC prescriptions. Adoption of the DOAC population management tool dashboard before July 2018 was associated with a decline in off-label dosing prescriptions (8.7%-7.6%). Only 1 group demonstrated a significant reduction in monthly rates of bleeding following implementation. All sites experienced a reduction in the composite of venous thromboembolism or stroke following dashboard adoption. There was no difference in the implementation outcome of DOAC prescription change within 7 days in any of the adoption groups.

CONCLUSIONS

Early adoption of the DOAC population management tool dashboard was associated with decreased rates of off-label DOAC dosing prescription and reduced bleeding. Following adoption of the DOAC population management tool dashboard, all sites experienced reductions in venous thromboembolism and stroke events.

Implementation of collaborative care for depression in VA HIV clinics: Translating Initiatives for Depression into Effective Solutions (HITIDES): protocol for a cluster-randomized type 3 hybrid effectiveness-implementation trial

BACKGROUND

Depression is the most diagnosed mental health condition among people living with HIV. Collaborative care is an effective intervention for depression, typically delivered in primary care settings. The HIV Translating Initiatives for Depression into Effective Solutions (HITIDES) clinical intervention involves a depression care team housed off-site that supports depression care delivery by HIV care providers. In a randomized controlled trial, HITIDES significantly improved depression symptoms for veterans living with HIV and delivered cost savings. However, no HIV clinics in the Veterans Health Administration (VHA) have implemented HITIDES; as such, it is unclear what implementation strategies are necessary to launch and sustain this intervention.

METHODS

This hybrid type-3 effectiveness-implementation trial examines the implementation and effectiveness of HITIDES in 8 VHA HIV clinics randomly assigned to one of two implementation arms. Each arm uses a different implementation strategy package. Arm 1 includes an intervention operations guide; an on-site clinical champion who, with the help of a peer community of practice, will work with local clinicians and leadership to implement HITIDES at their site; and patient engagement in implementation tools. Arm 2 includes all strategies from Arm 1 with assistance from an external facilitator. The primary implementation outcomes is reach; secondary outcomes include adoption, implementation dose, depressive symptoms, and suicidal ideation. We will conduct a budget impact analysis of the implementation strategy packages. We hypothesize that Arm 2 will be associated with greater reach and adoption and that Arm 1 will be less costly.

DISCUSSION

Preliminary work identified implementation strategies acceptable to veterans living with HIV and HIV care providers; however, the effectiveness and cost of these strategies are unknown. While the depression care team can deliver services consistently with high quality, the ability of the depression care team to engage with HIV care providers at sites is unknown. Findings from this study will be used to inform selection of implementation strategies for a broad rollout to enhance depression and suicide care for people living with HIV.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT05901272, Registered 10 May 2023, https://clinicaltrials.gov/study/NCT05901272.

Shared-Care in Complex Malignant Hematology: An Integrative Review Using the RE-AIM Evaluation Framework

Complex malignant hematology (CMH) shared-care programs have been established to support patients with access to care closer to home. This integrative review examined what is known about CMH shared-care using the RE-AIM evaluation framework. We searched five electronic databases for articles published until 16 January 2024. Articles were included if they were qualitative or quantitative studies, reviews or discussion papers, and reported on an experience with shared-care (defined as a reciprocal, ongoing patient-sharing relationship between a specialist centre and community hospital) for patients with hematological malignancies, and examined one or more aspects of the RE-AIM framework. The search yielded 6523 articles; 10 articles describing eight shared-care experiences. Indicators of reach were reported for 65% of the programs, and emphasized some patient eligibility criteria. Effectiveness indicators were reported for 28% of programs, and suggested favourable survival outcomes within a shared-care model; however, health system impact and quality of life studies were lacking. Indicators of adoption and implementation were reported for 56% and 42% of programs, respectively, and emphasized multidisciplinary teams, infrastructure support, and communication strategies. Maintenance was not reported. Common elements contribute to the implementation of existing CMH shared-care programs; however, a formal evaluation remains an area of need.

Transgender-Specific Differentiated HIV Service Delivery Models in the South African Public Primary Health Care System (Jabula Uzibone): Protocol for an Implementation Study

BACKGROUND

Almost 60% of transgender people in South Africa are living with HIV. Ending the HIV epidemic will require that transgender people successfully access HIV prevention and treatment. However, transgender people often avoid health services due to facility-based stigma and lack of availability of gender-affirming care. Transgender-specific differentiated service delivery (TG-DSD) may improve engagement and facilitate progress toward HIV elimination. Wits RHI, a renowned South African research institute, established 4 TG-DSD demonstration sites in 2019, with funding from the US Agency for International Development. These sites offer unique opportunities to evaluate the implementation of TG-DSD and test their effectiveness.

OBJECTIVE

The Jabula Uzibone study seeks to assess the implementation, effectiveness, and cost of TG-DSD for viral suppression and prevention-effective adherence.

METHODS

The Jabula Uzibone study collects baseline and 12-month observation checklists at 8 sites and 6 (12.5%) key informant interviews per site at 4 TG-DSD and 4 standard sites (n=48). We seek to enroll ≥600 transgender clients, 50% at TG-DSD and 50% at standard sites: 67% clients with HIV and 33% clients without HIV per site type. Participants complete interviewer-administered surveys quarterly, and blood is drawn at baseline and 12 months for HIV RNA levels among participants with HIV and tenofovir levels among participants on pre-exposure prophylaxis. A subset of 30 participants per site type will complete in-depth interviews at baseline and 12 months: 15 participants will be living with HIV and 15 participants will be HIV negative. Qualitative analyses will explore aspects of implementation; regression models will compare viral suppression and prevention-effective adherence by site type. Structural equation modeling will test for mediation by stigma and gender affirmation. Microcosting approaches will estimate the cost per service user served and per service user successfully treated at TG-DSD sites relative to standard sites, as well as the budget needed for a broader implementation of TG-DSD.

RESULTS

Funded by the US National Institutes of Mental Health in April 2022, the study was approved by the Human Research Ethics Committee at University of Witwatersrand in June 2022 and the Duke University Health System Institutional Review Board in June 2023. Enrollment began in January 2024. As of July 31, 2024, a total of 593 transgender participants have been enrolled: 348 are living with HIV and 245 are HIV negative. We anticipate baseline enrollment will be complete by August 31, 2024, and the final study visit will take place no later than August 2025.

CONCLUSIONS

Jabula Uzibone will provide data to inform HIV policies and practices in South Africa and generate the first evidence for implementation of TG-DSD in sub-Saharan Africa. Study findings may inform the use of TG-DSD strategies to increase care engagement and advance global progress toward HIV elimination goals.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/64373.

Changing the focus: Facilitating engagement in physical activity for people living with mild dementia in a local community-Protocol for a pre-post mixed methods feasibility study

This study aims to address and improve the low physical activity levels among people with mild dementia by implementing a novel shared decision-making and motivational support program, named "Changing the Focus". It will utilise a pre-post mixed methods approach, aiming to recruit 60 community living older people with mild dementia and their care-partners. The shared decision-making process will involve the person living with dementia, their care-partner, and a research therapist, using a purpose-designed discussion tool including factors such as preferred physical activities, health status, local opportunities and program accessibility. This process aims to identify personalised local physical activity opportunities. Participants will be supported with the help of a research therapist to engage in targeted community-based physical activities for 12-months, to progress towards the recommended physical activity guidelines of 150 minutes per week. The intervention provided by the research therapist will include three home visits (baseline, 6- and 12-months) and seven motivational support phone calls (within the first six months). Research therapists may provide additional home visits and support calls as needed. Primary outcomes include program participation (participants living with dementia continuing with the program after 12-months), total physical activity time per week (measured using the Active Australia Survey at baseline, 6- and 12- months) and program acceptability (assessed through semi-structured interviews with participants, care-partners, referrers, and physical activity providers). Secondary outcomes include physical performance, mental health, wellbeing measures, and impact on care-partners (evaluated through physical tests or validated scales at baseline, 6- and 12-months). Other implementation aspects include reach, maintenance, safety (falls, other adverse events) and an economic evaluation. Results will inform feasibility, potential benefits, and challenges associated with this innovative shared decision-making and supported physical activity program for people living with mild dementia. Findings will guide future large-scale studies and contribute to enhancing physical activity opportunities for this population.

Refining, implementing, and evaluating an anesthesia choice conversation aid for older adults with hip fracture: protocol for a stepped wedge cluster randomized trial

BACKGROUND

Hip fracture surgery under general or spinal anesthesia is a common procedure for older adults in the United States (US). Although spinal or general anesthesia can be appropriate for many patients, and the choice between anesthesia types is preference-sensitive, shared decision-making is not consistently used by anesthesiologists counseling patients on anesthesia for this procedure. We designed an Option Grid™-style conversation aid, My Anesthesia Choice─Hip Fracture, to promote shared decision making in this interaction. This study will refine the aid and evaluate its implementation and effectiveness in clinical practice.

METHODS

The study will be conducted over 2 phases: qualitative interviews with relevant clinicians and patients to refine the aid, followed by a stepped wedge cluster randomized trial of the intervention at 6 settings in the US. Primary outcomes will include the percentage of eligible patients who receive the intervention (intervention reach) and the change in quality of patient/clinician communication (intervention effectiveness). Secondary outcomes addressing other RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) domains will also be collected. Outcomes will be compared between baseline data and an active implementation period and then compared between the active implementation period and a sustainment period. Implementation strategies are guided by three constructs from the Practical, Robust Implementation and Sustainability Model (PRISM): intervention, recipients, and implementation and sustainability infrastructure.

DISCUSSION

This is a novel, large-scale trial evaluating and implementing a shared decision-making conversation aid for anesthesia choices. Strong buy-in from site leads and expert advisors will support both the success of implementation and the future dissemination of results and the intervention. Results from this study will inform the broader implementation of this aid for patients with hip fractures and can lead to the development and implementation of similar conversation aids for other anesthesia choices.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT06438640.

Comparing cognitive behavioral therapy and social prescribing in patients with loneliness on long-term opioid therapy to reduce opioid misuse: protocol for a randomized controlled trial

BACKGROUND

Patients with chronic pain on opioids frequently experience loneliness, which is associated with poorer health outcomes and higher risk for opioid misuse and opioid use disorder. Given that almost half of opioids are prescribed in primary care, a critical need exists for the development and testing of interventions to reduce loneliness in primary care patients at risk for opioid misuse. Cognitive behavioral therapy and social prescribing have been shown to be efficacious in reducing loneliness and improving outcomes in other populations but have not been tested in patients at risk for substance use disorder. The overall objective of our study is to reduce opioid misuse and opioid use disorder by addressing loneliness in patients on long-term opioid therapy in real-world primary care settings.

METHODS

We will conduct a 3-arm pragmatic, randomized controlled trial to compare the effectiveness of two group-based, telehealth-delivered interventions with treatment as usual: (1) cognitive behavioral therapy to address maladaptive thought patterns and behaviors around social connection and (2) a social prescribing intervention to connect participants with social opportunities and develop supportive social networks. Our primary outcome is loneliness as measured by the UCLA Loneliness Scale and our dependent secondary outcome is opioid misuse as measured by the Common Opioid Misuse Measure. We will recruit 102 patients on long-term opioid therapy who screen positive for loneliness from 2 health care systems in Washington State. Implementation outcomes will be assessed using the RE-AIM framework.

DISCUSSION

Our study is innovative because we are targeting loneliness, an under-addressed but critical social risk factor that may prevent opioid misuse and use disorder in the setting where most patients are receiving their opioid prescriptions for chronic pain. If successful, the project will have a positive impact in reducing loneliness, reducing opioid misuse, improving function and preventing substance use disorder.

TRIAL REGISTRATION

NCT06285032, issue date: February 28, 2024, original.

Strategies for Implementing GlobalConsent to Prevent Sexual Violence in University Men (SCALE): Study Protocol for a National Implementation Trial

Background

Globally, women 15-24 years are at heightened risk of sexual violence victimization, a risk factor for adverse mental, physical, and behavioral health outcomes. Sexual violence is common at universities and most often perpetrated by men, yet few evidence-based prevention strategies targeting men have been tested in low- and middle-income countries. GlobalConsent is a six-module, web-based educational program adapted from an efficacious U.S.-based program. Nine months post-treatment in a randomized trial in Vietnam, GlobalConsent reduced men's sexually violent behavior (Odds Ratio [OR] = 0.71, 95%CI 0.50-1.00) and increased prosocial intervening behavior (OR = 1.51, 1.00-2.28) relative to an attention-control. Evidence regarding optimal implementation strategies for scale up is needed.

Methods

We will randomize six medical universities in North, Central, and South Vietnam to deliver GlobalConsent using two different packages of implementation strategies that vary in intensity. Higher-intensity strategies will include greater 1) pre- and post-implementation engagement with university leaders and faculty, and 2) greater pre-implementation outreach, follow-up, and incentives for students to promote engagement and completion of GlobalConsent. Higher intensity universities will receive additional training and support for their added activities. We will compare implementation drivers and outcomes, intervention effectiveness, and cost-effectiveness across the two implementation bundles. Our mixed-methods comparative interrupted time-series design includes 1) qualitative interviews and quantitative surveys with university leaders and implementation teams to assess implementation barriers and facilitators; 2) repeated surveys with leaders and faculty, implementation teams, and male students to assess multilevel implementation drivers and outcomes, 3) repeated surveys with male students to assess behavioral outcomes (sexual violence and intervening behavior) and mediating variables (knowledge, attitudes, affect, and capacities), and 4) time diaries and cost tracking to assess cost effectiveness of the two implementation-strategies bundles.

Discussion

This project is the first to assess packages of implementation strategies to deliver an efficacious web-based sexual-violence-prevention program for undergraduate men across all regions of Vietnam and synergizes with a violence-prevention training initiative (D43TW012188). This approach will produce rigorous evidence about how to disseminate GlobalConsent nationally, which holds promise to reduce gender-based health inequities linked to sexual violence as GlobalConsent is brought to scale.

Trial registration

NCT06443541. Retrospectively registered with clinicaltrials.gov.

Using Systems Engineering and Implementation Science to Design an Implementation Package for Preoperative Comprehensive Geriatric Assessment Among Older Adults Having Major Abdominal Surgery: Protocol for a 3-Phase Study

BACKGROUND

Older Americans, a growing segment of the population, have an increasing need for surgical services, and they experience a disproportionate burden of postoperative complications compared to their younger counterparts. A preoperative comprehensive geriatric assessment (pCGA) is recommended to reduce risk and improve surgical care delivery for this population, which has been identified as vulnerable. The pCGA optimizes multiple chronic conditions and factors commonly overlooked in routine preoperative planning, including physical function, polypharmacy, nutrition, cognition, mental health, and social and environmental support. The pCGA has been shown to decrease postoperative morbidity, mortality, and length of stay in a variety of surgical specialties. Although national guidelines recommend the use of the pCGA, a paucity of strategic guidance for implementation limits its uptake to a few academic medical centers. By applying implementation science and human factors engineering methods, this study will provide the necessary evidence to optimize the implementation of the pCGA in a variety of health care settings.

OBJECTIVE

The purpose of this paper is to describe the study protocol to design an adaptable, user-centered pCGA implementation package for use among older adults before major abdominal surgery.

METHODS

This protocol uses systems engineering methods to develop, tailor, and pilot-test a user-centered pCGA implementation package, which can be adapted to community-based hospitals in preparation for a multisite implementation trial. The protocol is based upon the National Institutes of Health Stage Model for Behavioral Intervention Development and aligns with the goal to develop behavioral interventions with an eye to real-world implementation. In phase 1, we will use observation and interviews to map the pCGA process and identify system-based barriers and facilitators to its use among older adults undergoing major abdominal surgery. In phase 2, we will apply user-centered design methods, engaging health care providers, patients, and caregivers to co-design a pCGA implementation package. This package will be applicable to a diverse population of older patients undergoing major abdominal surgery at a large academic hospital and an affiliate community site. In phase 3, we will pilot-test and refine the pCGA implementation package in preparation for a future randomized controlled implementation-effectiveness trial. We anticipate that this study will take approximately 60 months (April 2023-March 2028).

RESULTS

This study protocol will generate (1) a detailed process map of the pCGA; (2) an adaptable, user-centered pCGA implementation package ready for feasibility testing in a pilot trial; and (3) preliminary pilot data on the implementation and effectiveness of the package. We anticipate that these data will serve as the basis for future multisite hybrid implementation-effectiveness clinical trials of the pCGA in older adults undergoing major abdominal surgery.

CONCLUSIONS

The expected results of this study will contribute to improving perioperative care processes for older adults before major abdominal surgery.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/59428.

Training health workers and community influencers to be Vaccine Champions: a mixed-methods RE-AIM evaluation

INTRODUCTION

Increasing trust and confidence in vaccines is a global priority, as countries have grappled with delivering COVID-19 vaccines, maintaining routine childhood vaccination rates and introducing new vaccines. Community-based vaccine promotion interventions are commonly implemented, but effectiveness evidence is limited. In 2022, supported by the Australian Government and in partnership with Fiji's Ministry of Health and UNICEF, we codesigned, delivered and comprehensively evaluated a vaccine education and communication training programme for health workers and community influencers to promote COVID-19 and routine immunisation.

METHODS

The Vaccine Champions programme included three phases: (1) codesign with Fiji stakeholders; (2) vaccine education and communication training for Vaccine Champions and (3) support for Champions to deliver community vaccine discussion sessions over 6 months.The RE-AIM framework evaluation measured programme reach, effectiveness, adoption, implementation and maintenance. Mixed-methods data were collected through interviews, surveys and field notes, integrating qualitative and quantitative data to triangulate findings. Primary outcomes included Champions' knowledge, communication self-efficacy, trust in COVID-19 vaccines, programme satisfaction and community members' intention to vaccinate.

RESULTS

We trained 35 Champions (27/35 female), including health workers, faith and community influencers. Half had a health background (17/35). Champions conducted 54 discussion sessions, reaching 1717 community members. Most Champions (22/35) conducted at least 1 session, with 16 running 3 or more. Champions who did not run sessions reported barriers like lack of confidence and competing duties. Training increased Champions' communication self-efficacy and trust in COVID-19 vaccines. Community member intention to vaccinate increased from 41% (394/960) to 83% (822/991) before and after a session. The programme was well received with interest in continued engagement.

CONCLUSION

Training health workers and community Vaccine Champions can promote vaccine confidence. Programmes require government support and engagement for sustainability. Robust evaluation frameworks are needed to build the evidence base.

Real-life implementation and evaluation of the e-referral system SIPILINK

INTRODUCTION

General Practitioners (GPs) play a key role of gatekeeper, as they coordinate patients' care. However, most of them reported having difficulty to refer patients to hospital, especially in semi-urgent context. To facilitate the referral of semi-urgent patients, we implemented an e-referral platform, named SIPILINK, within 4 wards from a large public French hospital (internal medicine, diabetology, gynaecological surgery and oncology wards). Here, we aimed to evaluate the SIPILINK e-referral platform after 2 years of implementation.

METHODS

The evaluation included a multidimensional assessment based on the RE-AIM framework with the analysis of implementation, requests, health professionals' satisfaction, and estimated hospital payment.

RESULTS

Over 2 years of implementation, GPs sent 113 requests to hospital. Hospital respected the time of response requested by GPs in 93 % of cases and proposed a consultation or hospitalization in respectively 40.7 % and 10.6 % of cases. 100 % of GPs and 78 % of Hospital Practitioners (HPs) were satisfied with the quality of exchanges. 77 % of HPs and 100 % of Care Pathway Managers (CPMs) found that patient care pathways were improved. Nearly all practitioners would recommend this platform for patient referrals.

DISCUSSION

SIPILINK shows promise in streamlining the referral process, enhancing communication, and improving patient care pathways. Further studies including the impact on the quality of care, are needed to assess its effectiveness and sustainability in healthcare settings.

Identification of weight loss interventions for translation among endometrial cancer survivors: A RE-AIM analysis

Interventions for obesity-related cancers that combine nutrition and physical activity for weight loss exist; however, their application to survivors of endometrial cancer is unknown. Furthermore, little is known about pre-implementation perceptions of existing programs from a variety of interested persons (physicians, researchers) who may be part of the implementation team. Adapting an existing intervention rather than developing a new intervention may speed the translational lag time as long as intervention characteristics and fit within the delivery system are considered during the planning phase. To describe the process of determining the core elements of obesity-related interventions for cancer survivors and determine which one might be best delivered by an urban healthcare system that predominantly serves individuals who live in rural areas of Virginia and West Virginia. A pragmatic review of the literature was conducted via PubMed and Google Scholar with broad search terms of cancer survivor AND weight loss AND health intervention. Identified interventions were scored related to the Practical, Robust Implementation and Sustainability Model-which is an extension of RE-AIM framework to guide the understanding of who, what, where, when, and how the intervention was conducted. Intervention characteristics are reported. In addition, ratings from three independent reviewers on the validated 5-point Likert scale of an intervention's acceptability, appropriateness, and feasibility in the intended delivery system were collected and summarized. Twelve interventions were identified with an average sample size of 241(±195) and a range of 48-683 participants. Target populations included survivors of colorectal, breast, and endometrial cancers as well as general cancer survivors and included both men and women or only women. Most participants (74%) identified as white/Caucasian and average age ranged from 47.1 to 65.9 years. Program duration ranged from 4 weeks to 18 months, with an average duration of 32 weeks. Intervention dosage ranged from three times a week to once a month. Intervention acceptability, appropriateness, and feasibility had average and standard deviation ratings of 3.52(±0.46), 3.41(±0.45), and 3.21(±0.46), respectively, out of 5. The four interventions with the highest combined acceptable, appropriate, and feasible scores are being considered for potential use as an obesity-related intervention for survivors of endometrial cancer. Future work is needed to determine relevant adaptations and efficacy among survivors of endometrial cancer with obesity. Our approach may be beneficial for other interventionists aiming to speed intervention development and implementation.

Innovate! Accelerate! Evaluate! Harnessing the RE-AIM framework to examine the global dissemination of parenting resources during COVID-19 to more than 210 million people

BACKGROUND

Parents were at the forefront of responding to the needs of children during the COVID-19 pandemic. This study used the RE-AIM framework to examine the Reach, Effectiveness, Adoption, Implementation, and Maintenance of a global inter-agency initiative that adapted evidence-based parenting programs to provide immediate support to parents.

METHODS

Data were collected via short surveys sent via email, online surveys, and analysis of social media metrics and Google Analytics. Retrospective surveys with 1,303 parents and caregivers in 11 countries examined impacts of the resources on child maltreatment, positive relationship building, parenting efficacy, and parenting stress.

RESULTS

The parenting resources were translated into over 135 languages and dialects; reached an estimated minimum 212.4 million people by June 2022; were adopted by 697 agencies, organizations, and individuals; and were included in 43 national government COVID-19 responses. Dissemination via social media had the highest reach (n = 144,202,170, 67.9%), followed by radio broadcasts (n = 32,298,525, 15.2%), text messages (n = 13,565,780, 6.4%), and caseworker phone calls or visits (n = 8,074,787, 3.8%). Retrospective surveys showed increased parental engagement and play, parenting self-efficacy, confidence in protecting children from sexual abuse, and capacity to cope with stress, as well as decreased physical and emotional abuse. Forty-four organizations who responded to follow-up surveys in April 2021 reported sustained use of the resources as part of existing services and other crisis responses.

CONCLUSION

This study highlights the importance of a) establishing an international collaboration to rapidly adapt and disseminate evidence-based content into easily accessible resources that are relevant to the needs of parents; b) creating open-source and agile delivery models that are responsive to local contexts and receptive to further adaptation; and c) using the best methods available to evaluate a rapidly deployed global emergency response in real-time. Further research is recommended to empirically establish the evidence of effectiveness and maintenance of these parenting innovations.

Optimization of implementation strategies using the Multiphase Optimization STratgey (MOST) framework: Practical guidance using the factorial design

The Multiphase Optimization STrategy (MOST) is a framework that uses three phases-preparation, optimization, and evaluation-to develop multicomponent interventions that achieve intervention EASE by strategically balancing Effectiveness, Affordability, Scalability, and Efficiency. In implementation science, optimization of the intervention requires focus on the implementation strategies-things that we do to deliver the intervention-and implementation outcomes. MOST has been primarily used to optimize the components of the intervention related to behavioral or health outcomes. However, innovative opportunities to optimize discrete (i.e. single strategy) and multifaceted (i.e. multiple strategies) implementation strategies exist and can be done independently, or in conjunction with, intervention optimization. This article details four scenarios where the MOST framework and the factorial design can be used in the optimization of implementation strategies: (i) the development of new multifaceted implementation strategies; (ii) evaluating interactions between program components and a discrete or multifaceted implementation strategies; (iii) evaluating the independent effects of several discrete strategies that have been previously evaluated as a multifaceted implementation strategy; and (iv) modification of a discrete or multifaceted implementation strategy for the local context. We supply hypothetical school-based physical activity examples to illustrate these four scenarios, and we provide hypothetical data that can help readers make informed decisions derived from their trial data. This manuscript offers a blueprint for implementation scientists such that not only is the field using MOST to optimize the effectiveness of an intervention on a behavioral or health outcome, but also that the implementation of that intervention is optimized.

Tracking implementation strategies in real-world settings: VA Office of Rural Health enterprise-wide initiative portfolio

OBJECTIVE

To use a practical approach to examining the use of Expert Recommendations for Implementing Change (ERIC) strategies by Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) dimensions for rural health innovations using annual reports on a diverse array of initiatives.

DATA SOURCES AND STUDY SETTING

The Veterans Affairs (VA) Office of Rural Health (ORH) funds initiatives designed to support the implementation and spread of innovations and evidence-based programs and practices to improve the health of rural Veterans. This study draws on the annual evaluation reports submitted for fiscal years 2020-2022 from 30 of these enterprise-wide initiatives (EWIs).

STUDY DESIGN

Content analysis was guided by the RE-AIM framework conducted by the Center for the Evaluation of Enterprise-Wide Initiatives (CEEWI), a Quality Enhancement Research Initiative (QUERI)-ORH partnered evaluation initiative.

DATA COLLECTION AND EXTRACTION METHODS

CEEWI analysts conducted a content analysis of EWI annual evaluation reports submitted to ORH. Analysis included cataloguing reported implementation strategies by Reach, Adoption, Implementation, and Maintenance (RE-AIM) dimensions (i.e., identifying strategies that were used to support each dimension) and labeling strategies using ERIC taxonomy. Descriptive statistics were conducted to summarize data.

PRINCIPAL FINDINGS

A total of 875 implementation strategies were catalogued in 73 reports. Across these strategies, 66 unique ERIC strategies were reported. EWIs applied an average of 12 implementation strategies (range 3-22). The top three ERIC clusters across all 3 years were Develop stakeholder relationships (21%), Use evaluative/iterative strategies (20%), and Train/educate stakeholders (19%). Most strategies were reported within the Implementation dimension. Strategy use among EWIs meeting the rurality benchmark were also compared.

CONCLUSIONS

Combining the dimensions from the RE-AIM framework and the ERIC strategies allows for understanding the use of implementation strategies across each RE-AIM dimension. This analysis will support ORH efforts to spread and sustain rural health innovations and evidence-based programs and practices through targeted implementation strategies.

Implementation of a rural emergency department-initiated buprenorphine program in the mountain west: a study protocol

BACKGROUND

Opioid related overdose morbidity and mortality continue to significantly impact rural communities. Nationwide, emergency departments (EDs) have seen an increase in opioid use disorder (OUD)-related visits compared to other substance use disorders (SUD). ED-initiated buprenorphine is associated with increased treatment engagement at 30 days. However, few studies assess rural ED-initiated buprenorphine implementation, which has unique implementation barriers. This protocol outlines the rationale and methods of a rural ED-initiated buprenorphine program implementation study.

METHODS

This is a two-year longitudinal implementation design with repeated qualitative and quantitative measures of an ED-initiated buprenorphine program in the rural Mountain West. The Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework outlines intervention assessments. The primary outcome is implementation measured by ED-initiated buprenorphine protocol core components. Reach, adoption, and maintenance are secondary outcomes. External facilitators from an academic institution with addiction medicine and prior program implementation expertise partnered with community hospital internal facilitators to form an implementation team. External facilitators provide ongoing support, recommendations, education, and academic detailing. The implementation team designed and implemented the rural ED-initiated buprenorphine program. The program includes OUD screening, low-threshold buprenorphine initiation, naloxone distribution and administration training, and patient navigator incorporation to provide warm hand off referrals for outpatient OUD management. To address rural based implementation barriers, we organized implementation strategies based on Expert Recommendations for Implementing Change (ERIC). Implementation strategies include ED workflow redesign, local needs assessments, ED staff education, hospital leadership and clinical champion involvement, as well as patient and community resources engagement.

DISCUSSION

Most ED-initiated buprenorphine implementation studies have been conducted in urban settings, with few involving rural areas and none have been done in the rural Mountain West. Rural EDs face unique barriers, but tailored implementation strategies with external facilitation support may help address these. This protocol could help identify effective rural ED-initiated buprenorphine implementation strategies to integrate more accessible OUD treatment within rural communities to prevent further morbidity and mortality.

TRIAL REGISTRATION

ClinicalTrials.gov National Clinical Trials, NCT06087991. Registered 11 October 2023 - Retrospectively registered, https://clinicaltrials.gov/study/NCT06087991 .

Mobile clinics for opioid use disorders: What they do and how they do it. A qualitative analysis

INTRODUCTION

People with substance use disorders (SUD) face many barriers to receiving evidence-based treatments including access to and cost of treatment. People who use drugs face stigma that limits access to traditional office-based clinics. With the goal of reducing morbidity and mortality, mobile clinics reduce many of these barriers by providing harm reduction and on-demand low-threshold medical care.

METHODS

In 2020 Massachusetts Department of Public Health (DPH) Mobile Addiction Services Program expanded a program called Community Care in Reach building on its success in reducing barriers to care and increasing patient encounters. In the current evaluation we conducted site visits to the four new mobile clinics and conducted one individual semi-structured provider interview at each of the four clinics. In addition, we supported a monthly learning collaborative of staff in four agencies involved with this initiative. The current evaluation used the RE-AIM framework to analyze the implementation of the mobile clinics.

RESULTS

Clinicians described many challenges and opportunities. The typical patient is unhoused, having a substance use disorder, and disconnected from traditional pathways to care. Clinicians are able to initiate people on buprenorphine largely due to the trust they establish with patients. Referral networks are facilitated by established community linkages. The philosophy of care is patient-centered. Mobile clinics provide a wide range of healthcare services including harm reduction, although finding a location to park and relations with police can be challenging. The workflow is uneven due to the model that is built on unscheduled visits.

CONCLUSION

This study provides insight into how mobile clinics address the gaps in care for persons with OUD and fatal opioid overdoses. Harm reduction services are a critical intervention and financial sustainability of mobile clinics has to be tested.

Trends in publication impact of evidence-based healthcare terminology (2013-2022)

AIMS

This article explored the publication impact of evidence-based healthcare terminology to determine usage and discuss options for low usage terms.

BACKGROUND

A plethora of terms describe the scholarship of evidence-based healthcare. Several terms are synonyms, creating redundancy and confusion. The abundance and overlap of terms may impede the discovery of evidence.

DESIGN

This discursive article explored and discussed publication impact of evidence-based healthcare terms.

METHODS

Evidence-based healthcare terms were identified, and their 10-year (2013-2022) publication impact was assessed in the CINAHL and Medline databases. A card sort method was also used to identify terms with low usage.

RESULTS

A total of 18/32 terms were included in the review. The terms evidence-based practice, quality improvement, research and translational research were the most highly published terms. Publication data were presented yearly over a 10-year period. Most terms increased in publication use over time, except for three terms whose use decreased. Several terms related to translational research have multiple synonyms. It remains unknown whether these terms are interchangeable and possibly redundant, or if there are nuanced differences between terms.

CONCLUSION

We suggest a follow-up review in 3-5 years to identify publication trends to assess context and terms with continued low publication usage. Terms with persistent low usage should be considered for retirement in the reporting of scholarly activities. Additionally, terms with increasing publication trends should be treated as emerging terms that contribute to evidence-based healthcare terminology.

IMPLICATIONS FOR NURSING

Confusion about the use of appropriate terminology may hinder progress in the scholarship of evidence-based healthcare. We encourage scholars to be aware of publication impact as it relates to the use of specific terminology and be purposeful in the selection of terms used in scholarly projects and publications.

Implementation and evaluation of a proactive consultation-liaison model on an inpatient obstetric unit

OBJECTIVE

Perinatal mental and anxiety disorders (PMADs) contribute to adverse health outcomes, though they are underrecognized and undertreated. Inpatient obstetric settings represent a unique opportunity for behavioral health engagement, including screening, brief treatment, and referrals for outpatient care. The proactive consultation-liaison (CL) model has proven effective in general hospital settings but is not well-studied in obstetric settings. This article describes the implementation and evaluation of a proactive CL model in an inpatient obstetric unit within a tertiary medical center.

METHODS

We implemented a multidisciplinary, proactive CL model in an inpatient obstetric unit with the purpose of identifying patients at risk for or experiencing PMADs and providing intervention and/or referral to treatment. Systematic screening of 7322 admitted patients was performed over a 17-month period to identify eligible patients for behavioral health consultation. Consultation data was retrospectively extracted from the electronic medical record. Key implementation outcomes were assessed using a RE-AIM measures (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework.

RESULTS

1589 initial consults were conducted by the multidisciplinary team, yielding a consult rate of 21.7 %. The majority of consults (94 %) were completed by a social worker or psychologist, with most patients identified for consultation at multidisciplinary rounds (60.7 %). The most common indications for consultation with a psychiatrist included medication management, history of bipolar disorder, and history of anxiety. All invited staff and providers participated in the model. Alternative funding sources agreed to cover the salaries of the multidisciplinary team following conclusion of pilot grant funding.

CONCLUSIONS

A proactive CL model implemented in an inpatient obstetric unit led to a higher consult rate (21.7 %) than is observed with traditional CL services. A multidisciplinary proactive CL model shows promise in identifying people at-risk for PMADs and providing targeted interventions to prevent PMADs and treat those with active symptoms.