Revisiting concepts of evidence in implementation science

Process Evaluation and Investigation of Cultural Adaptations for an Online Parent-Based Intervention Using a Mixed-Method Approach

Most alcohol intervention research focuses on program efficacy, yet few studies have investigated the acceptability of a program's design and implementation to the target population or adapting existing alcohol interventions to different populations. To address these gaps in the literature, we (1) examined participant responsiveness to and implementation quality of FITSTART+, a web-app delivered parent-based alcohol intervention designed for incoming first-year college students in the United States, and (2) gathered feedback on how this intervention could be adapted to other populations of parents. A sample of U.S. parents of 17-20-year-old first-year college students (N = 109) participated in FITSTART+ during their child's first year of college and completed a survey about parents' responsiveness to the app and its quality. Next, a sample of non-U.S. parents of adolescents aged 13 to 19 (N = 44) participated in one of 11 focus groups in which they briefly explored the app and then discussed how it could be adapted to be applicable and culturally relevant for them and their context. Results revealed that U.S. parents rated the intervention's quality as high and parents were responsive to the web-app's content, but some did not visit one of the most critical aspects of the intervention (i.e., alcohol-related parenting resources). Non-U.S. participants provided a range of suggestions for adapting the intervention to their context, which varied by culture. Results identify areas for improvement, particularly regarding the use of alcohol-related parenting resources, in this intervention and for web-delivered PBIs more broadly.

Fostering citizen-engaged HIV implementation science

INTRODUCTION

Successful implementation of evidence-based practices depends on contextual factors like stakeholder engagement, the socio-political environment, resource availability, and stakeholders' felt needs and preferences. Nevertheless, inequities in implementation exist and undermine efforts to address HIV in marginalized key populations. Implementation science shows promise in addressing such inequities in the HIV response, but can be limited without meaningful engagement from citizens or communities.

DISCUSSION

We define the concept of a citizen-engaged HIV implementation science as one that involves citizens and communities deeply in HIV implementation science activities. In this commentary, we discuss how citizen science approaches can be leveraged to spur equity in HIV implementation science. Drawing on three areas previously defined by Geng and colleagues that serve to drive impactful implementation science in the HIV response, we discuss how citizens can be engaged when considering "whose perspectives?", "what questions are being asked?" and "how are questions asked?". With respect to "whose perspectives?" a citizen-engaged HIV implementation science would leverage participatory methods and tools, such as co-creation, co-production and crowdsourcing approaches, to engage the public in identifying challenges, solve health problems and implement solutions. In terms of "what questions are being asked?", we discuss how efforts are being made to synthesize citizen or community-led approaches with existing implementation science frameworks and approaches. This also means that we ensure communities have a say in interrogating and deconstructing such frameworks and adapting them to local contexts through participatory approaches. Finally, when considering "how are questions asked?", we argue for the development and adoption of broad, guiding principles and frameworks that account for dynamic contexts to promote citizen-engaged research in HIV implementation science. This also means avoiding narrow definitions that limit the creativity, innovation and ground-up wisdom of local citizens.

CONCLUSIONS

By involving communities and citizens in the development and growth of HIV implementation science, we can ensure that our implementation approaches remain equitable and committed to bridging divides and ending AIDS as a public health threat. Ultimately, efforts should be made to foster a citizen- and community-engaged HIV implementation science to spur equity in our global HIV response.

Estimating the potential value of MSM-focused evidence-based implementation interventions in three Ending the HIV Epidemic jurisdictions in the United States: a model-based analysis

INTRODUCTION

Improving the delivery of existing evidence-based interventions to prevent and diagnose HIV is key to Ending the HIV Epidemic in the United States. Structural barriers in the access and delivery of related health services require municipal or state-level policy changes; however, suboptimal implementation can be addressed directly through interventions designed to improve the reach, effectiveness, adoption or maintenance of available interventions. Our objective was to estimate the cost-effectiveness and potential epidemiological impact of six real-world implementation interventions designed to address these barriers and increase the scale of delivery of interventions for HIV testing and pre-exposure prophylaxis (PrEP) in three US metropolitan areas.

METHODS

We used a dynamic HIV transmission model calibrated to replicate HIV microepidemics in Atlanta, Los Angeles (LA) and Miami. We identified six implementation interventions designed to improve HIV testing uptake ("Academic detailing for HIV testing," "CyBER/testing," "All About Me") and PrEP uptake/persistence ("Project SLIP," "PrEPmate," "PrEP patient navigation"). Our comparator scenario reflected a scale-up of interventions with no additional efforts to mitigate implementation and structural barriers. We accounted for potential heterogeneity in population-level effectiveness across jurisdictions. We sustained implementation interventions over a 10-year period and evaluated HIV acquisitions averted, costs, quality-adjusted life years and incremental cost-effectiveness ratios over a 20-year time horizon (2023-2042).

RESULTS

Across jurisdictions, implementation interventions to improve the scale of HIV testing were most cost-effective in Atlanta and LA (CyBER/testing cost-saving and All About Me cost-effective), while interventions for PrEP were most cost-effective in Miami (two of three were cost-saving). We estimated that the most impactful HIV testing intervention, CyBER/testing, was projected to avert 111 (95% credible interval: 110-111), 230 (228-233) and 101 (101-103) acquisitions over 20 years in Atlanta, LA and Miami, respectively. The most impactful implementation intervention to improve PrEP engagement, PrEPmate, averted an estimated 936 (929-943), 860 (853-867) and 2152 (2127-2178) acquisitions over 20 years, in Atlanta, LA and Miami, respectively.

CONCLUSIONS

Our results highlight the potential impact of interventions to enhance the implementation of existing evidence-based interventions for the prevention and diagnosis of HIV.

Integrating a mental health intervention into PrEP services for South African young women: a human-centred implementation research approach to intervention development

INTRODUCTION

Adolescent girls and young women (AGYW) who may benefit from HIV pre-exposure prophylaxis (PrEP) face high levels of common mental disorders (e.g. depression, anxiety). Common mental disorders can reduce PrEP adherence and increase HIV risk, yet mental health interventions have not been well-integrated into PrEP delivery.

METHODS

We conducted a four-phase human-centred design process, from December 2020 to April 2022, to understand mental health challenges among AGYW in Johannesburg, South Africa and barriers to integrated mental health and PrEP services. In the "Discover" phase, we conducted in-depth interviews with AGYW and key informants (KIs) in Johannesburg. We conducted a rapid qualitative analysis, informed by the Consolidated Framework for Implementation Research (CFIR), to identify facilitators and barriers of integrated mental health and PrEP services and mapped barriers to potential implementation strategies. In the "Design" and "Build" phases, we conducted stakeholder workshops to iteratively adapt an evidence-based mental health intervention, the Friendship Bench, and refine implementation strategies for South African PrEP delivery settings. In the "Test" phase, we piloted our adapted Friendship Bench package.

RESULTS

Interviews with 70 Discover phase participants (48 AGYW, 22 KIs) revealed the importance of integrated mental health and PrEP services for South African AGYW. Interviewees described barriers and implementation strategies for mental health and PrEP services around the CFIR domains: intervention characteristics (e.g. challenges with AGYW "opening up"); outer Johannesburg setting (e.g. community stigma); inner clinic setting (e.g. judgemental healthcare providers); characteristics of counsellors (e.g. training gaps); and the implementation process (e.g. need for demand creation). The Design and Build workshops included 13 AGYW and 15 KIs. Implementation barriers related to the quality and accessibility of public-sector clinic services, lay counsellor training, and community education and demand creation activities were prioritized. This led to 12 key Friendship Bench adaptations and the specification of 10 implementation strategies that were acceptable and feasible in initial pilot testing with three AGYW.

CONCLUSIONS

Using a human-centred approach, we identified determinants and potential solutions for integrating mental health interventions within PrEP services for South African AGYW. This design process centred stakeholders' perspectives, enabling rapid development of an adapted Friendship Bench intervention implementation package.

Use of concept mapping to inform a participatory engagement approach for implementation of evidence-based HPV vaccination strategies in safety-net clinics

BACKGROUND

Multiple evidence-based strategies (EBS) for promoting HPV vaccination exist. However, adolescent HPV vaccination rates remain below target levels in communities at high risk for HPV-associated cancers and served by safety-net clinics. Participatory engaged approaches are needed to leverage the expertise of community and clinical partners in selecting EBS relevant to their local context. We engaged concept mapping as a method to inform the adoption and adaptation of EBS that seeks to empower implementation partners to prioritize, select, and ultimately implement context-relevant EBS for HPV vaccination.

METHODS

Using 38 EBS statements generated from qualitative interviews and national HPV vaccine advocacy sources, we conducted a modified concept mapping activity with partners internal to safety-net clinics and external community members in two study sites of a larger implementation study (Greater Los Angeles and New Jersey), to sort EBS into clusters and rate each EBS by importance and feasibility for increasing HPV vaccination within safety-net clinics. Concept mapping findings (EBS statement ratings, ladder graphs and go-zones) were shared with leaders from a large federally qualified health center (FQHC) system (focusing on three clinic sites), to select and implement EBS over 12 months.

RESULTS

Concept mapping participants (n=23) sorted and rated statements, resulting in an eight-cluster solution: 1) Community education and outreach; 2) Advocacy and policy; 3) Data access/quality improvement monitoring; 4) Provider tracking/audit and feedback; 5) Provider recommendation/communication; 6) Expanding vaccine access; 7) Reducing missed opportunities; and 8) Nurse/staff workflow and training. The FQHC partner then selected to intervene on eight of 17 EBS statements in the "go-zone" for action, with three from "reducing missed opportunities," two from "nurse/staff workflow and training," and one each from "provider tracking/audit and feedback," "provider recommendation/communication," and "expanding vaccine access," which the research team addressed through the implementation of three multi-level intervention strategies (e.g., physician communication training, staff training and workflow assessment, audit and feedback of clinic processes).

CONCLUSIONS

Concept mapping provided a powerful participatory approach to identify multilevel EBS for HPV vaccination relevant to the local safety-net clinic context, particularly when several strategies exist, and prioritization is necessary. This study demonstrates how a clinic system benefited directly from the ratings and prioritization of EBS by multilevel clinic and community partners within the broader safety-net clinic context to identify and adapt prioritized solutions needed to advance HPV vaccine equity.

Implementation of Complex Suicide Prevention Interventions: Insights into Barriers, Facilitators and Lessons Learned

INTRODUCTION

Effective suicide prevention interventions are infrequently translated into practice and policy. One way to bridge this gap is to understand the influence of theoretical determinants on intervention delivery, adoption, and sustainment and lessons learned. This study aimed to examine barriers, facilitators and lessons learned from implementing complex suicide prevention interventions across the world.

METHODS AND MATERIALS

This study was a secondary analysis of a systematic review of complex suicide prevention interventions, following updated PRISMA guidelines. English published records and grey literature between 1990 and 2022 were searched on PubMed, CINAHL, PsycINFO, ProQuest, SCOPUS and CENTRAL. Related reports were organized into clusters. Data was extracted from clusters of reports on interventions and were mapped using the updated Consolidated Framework for Implementation Research.

RESULTS

The most frequently-reported barriers were reported within the intervention setting and were related to the perceived appropriateness of interventions within settings; shared norms, beliefs; and maintaining formal and informal networks and connections. The most frequently reported facilitators concerned individuals' motivation, capability/capacity, and felt need. Lessons learned focused on the importance of tailoring the intervention, responding to contextual needs and the importance of community engagement throughout the process.

CONCLUSION

This study emphasizes the importance of documenting and analyzing important influences on implementation. The complex interplay between the contextual determinants and implementation is discussed. These findings contribute to a better understanding of barriers and facilitators salient for implementation of complex suicide prevention interventions.

Family-Based Motivational Interviewing and Resource Mobilization to Prevent Obesity: Living Well Together Trial

OBJECTIVE

Test an obesity intervention for families with low incomes.

METHODS

A total of 208 families were included (a parent with a body mass index [BMI] ≥ 30 and a child aged 6-12 years). A 12-month randomized controlled trial combining family health coaching (motivational interviewing) and connection to community resources. Comparison group: referrals for basic needs, written educational materials. Questionnaires, accelerometry, and anthropometrics. Intention-to-treat analysis of change in outcomes. Two-sided t test with multiple imputation.

RESULTS

Parents were 95% female, 31% Black, and 27% Hispanic. Children had a mean BMI-Z score of 1.15. Primary outcomes did not differ between groups at 12 months. Both groups significantly (P < 0.05) improved on the Family Nutrition and Physical Activity Scale for behaviors related to childhood obesity (mean ± SE: comparison, 2.8 ± 1.0; intervention, 2.2 ± 0.9), increased child sedentary activity (comparison, 32.5 ± 12.1; intervention, 39.9 ± 12.4 min/d), and decreased child moderate-vigorous physical activity (comparison, -9.6 ± 3.3; intervention -7.0 ± 3.0 min/d). Parents had no change in BMI.

CONCLUSIONS AND IMPLICATIONS

We successfully embedded screening and referral to address social needs within an obesity intervention. The coaching intervention did not provide additional benefits. Future research could explore ways to make these interventions more accessible, valuable, and effective for families.

A streamlined approach to classifying and tailoring implementation strategies: recommendations to speed the translation of research to practice

BACKGROUND

Implementation science emerged from the recognized need to speed the translation of effective interventions into practice. In the US, the science has evolved to place an ever-increasing focus on implementation strategies. The long list of implementation strategies, terminology used to name strategies, and time required to tailor strategies all may contribute to delays in translating evidence-based interventions (EBIs) into practice. To speed EBI translation, we propose a streamlined approach to classifying and tailoring implementation strategies.

MAIN TEXT

A multidisciplinary team of eight scholars conducted an exercise to sort the Expert Recommendations for Implementing Change (ERIC) strategies into three classes: implementation processes (n = 25), capacity-building strategies (n = 20), and integration strategies (n = 28). Implementation processes comprise best practices that apply across EBIs and throughout the phases of implementation from exploration through sustainment (e.g., conduct local needs assessment). Capacity-building strategies target either general or EBI-specific knowledge and skills (e.g., conduct educational meetings). Integration strategies include "methods and techniques" that target barriers or facilitators to implementation of a specific EBI beyond those targeted by capacity building. Building on these three classes, the team collaboratively developed recommendations for a pragmatic, five-step approach that begins with the implementation processes and capacity-building strategies practice-settings are already using prior to tailoring integration strategies. A case study is provided to illustrate use of the five-step approach to tailor the strategies needed to implement a transitional care intervention in skilled nursing facilities.

CONCLUSIONS

Our proposed approach streamlines the formative work required prior to implementing an EBI by building on practice partner preferences, expertise, and infrastructure while also making the most of prior research findings.

A realist evaluation of community champion and participatory action approaches during the COVID-19 pandemic

Background

During the COVID-19 pandemic, public health teams tried several approaches to circulate accurate health information and engage with community members to understand what they need from public health services. Two such approaches were community champions and community participatory action research (CPAR). This study evaluates two champion programmes and a CPAR programme in terms of what worked, for whom, and in what contexts, including the funding and resourcing associated with implementation.

Methods

Between June 2022 and June 2023, a realist evaluation of three distinct case studies (COVID-19 champions, Vaccine Champions, and CPAR programmes) in the city of Southampton in England was conducted in three stages: development of initial programme theories and collection of additional contextual information, including funding and resources associated with delivering each programme; initial programme theory testing; synthesis of final programme theories. Data was collected primarily through semi-structured interviews (n = 29) across programme and training leads, voluntary services, community organisations, volunteers, and local community members, and one focus group with local community members (n = 8).

Results

The City Council used £642 k from two funding awards to deliver the programmes: COVID-19 Champions £41 k; Vaccine Champions £485 k; and CPAR programmes £115 k. Twenty-eight initial programme theories were generated, which were "tested" to support, refine, or refute context-mechanism-outcome relationships, resulting finally in a set of 22 programme theories across the three programmes. Six demi-regularities were generated, each featuring in multiple programme theories, and providing data on how and why these programmes can work, and in which contexts: (1) building trust through community connections; (2) fostering relationships and collaboration; (3) provision of training and resources; (4) local community knowledge and expertise; (5) community representation and leadership; (6) appropriate communication and information sharing.

Conclusion

This study provides new knowledge and understanding of the factors affecting the implementation of community champion and CPAR approaches during public health emergencies. These findings suggest that representation and involvement of community members, establishing and building on trust, adequate training and resources, and clear communication from trusted community members and organisations are catalysts for meaningful engagement with communities.Evaluation registration: Research Registry identifier: researchregistry8094.

Using Participatory Implementation Science to Advance Health Equity

Participatory approaches to implementation science (IS) offer an inclusive, collaborative, and iterative perspective on implementing and sustaining evidence-based interventions (EBIs) to advance health equity. This review provides guidance on the principles and practice of participatory IS, which enables academic researchers, community members, implementers, and other actors to collaboratively integrate practice-, community-, and research-based evidence into public health and health care services. With a foundational focus on supporting academics in coproducing knowledge and action, participatory IS seeks to improve health, reduce inequity, and create transformational change. The three main sections of this review provide (a) a rationale for participatory approaches to research in implementation science, (b) a framework for integrating participatory approaches in research utilizing IS theory and methods, and (c) critical considerations for optimizing the practice and impact of participatory IS. Ultimately, participatory approaches can move IS activities beyond efforts to make EBIs work within harmful systems toward transformative solutions that reshape these systems to center equity.

Advancing the Science and Application of Implementation Science to Promote Health Equity: Commentary on the Symposium

There has been an increasing focus on making health equity a more explicit and foundational aspect of the research being conducted in public health and implementation science. This commentary provides an overview of five reviews in this Annual Review of Public Health symposium on Implementation Science and Health Equity. These articles reflect on and advance the application of core implementation science principles and concepts, with a focus on promoting health equity across a diverse range of public health and health care settings. Taken together, the symposium articles highlight critical conceptual, methodological, and empirical advances in the study designs, frameworks, and approaches that can help address equity considerations in the use of implementation science in both domestic and global contexts. Finally, this commentary highlights how work featured in this symposium can help inform future directions for rapidly taking public health to scale, particularly among systemically marginalized populations and communities.

Implementation processes of social network interventions for physical activity and sedentary behavior among children and adolescents: a scoping review

BACKGROUND

The characteristics of the implementation process of interventions are essential for bridging the gap between research and practice. This scoping review aims to identify the implementation process of social network interventions (SNI) to address physical activity and sedentary behaviors in children and adolescents.

METHODS

The scoping review was conducted adhering to the established guidelines. The search was carried out in the ERIC, EBSCO, EMBASE, SCOPUS, and Lilacs databases in April 2023. Social network intervention studies in children and adolescents were included, addressing physical activity or sedentary behaviors. Replicability (TIDieR), applicability (PRECIS-2), and generalizability (RE-AIM) were the explored components of the implementation process. Each component was quantitatively and separately analyzed. Then, a qualitative integration was carried out using a narrative method.

RESULTS

Most SNI were theoretically framed on the self-determination theory, used social influence as a social mechanism, and used the individual typology of network intervention. Overall, SNI had strong replicability, tended to be pragmatic, and three RE-AIM domains (reach, adoption (staff), and implementation) showed an acceptable level of the generalizability of findings.

CONCLUSIONS

The analyzed SNI for physical activity and sedentary behaviors in adolescents tended to be reported with high replicability and were conducted pragmatically, i.e., with very similar conditions to real settings. The RE-AIM domains of reach, adoption (staff), and implementation support the generalizability of SNI. Some domains of the principles of implementation strategies of SNI had acceptable external validity (actor, action targets, temporality, dose, and theoretical justification).

First-line managers' experience of guideline implementation during the COVID-19 pandemic

AIM(S)

To explore first-line managers' experience of guideline implementation in orthopaedic care during the COVID-19 pandemic.

DESIGN

A descriptive, qualitative study.

METHODS

Semi-structured interviews with 30 first-line nursing and rehabilitation managers in orthopaedic healthcare at university, regional and local hospitals. The interviews were analysed by thematic analysis.

RESULTS

First-line managers described the implementation of guidelines related to the pandemic as different from everyday knowledge translation, with a swifter uptake and time freed from routine meetings in order to support staff in adoption and adherence. The urgent need to address the crisis facilitated guideline implementation, even though there were specific pandemic-related barriers such as staffing and communication issues. An overarching theme, Hanging on to guidelines for dear life, is substantiated by three themes: Adapting to facilitate change, Anchoring safety through guidelines and Embracing COVID guidelines.

CONCLUSION

A health crisis such as the COVID-19 pandemic can generate enabling elements for guideline implementation in healthcare, despite prevailing or new hindering components. The experience of guideline implementation during the COVID-19 pandemic can improve understanding of context aspects that can benefit organizations in everyday translation of evidence into practice.

IMPLICATIONS FOR THE PROFESSION AND/OR PATIENT CARE

Recognizing what enabled guideline implementation in a health crisis can help first-line managers to identify local enabling context elements and processes. This can facilitate future guideline implementation.

IMPACT

During the COVID-19 pandemic, the healthcare context and staff's motivation for guideline recognition and adoption changed. Resources and ways to bridge barriers in guideline implementation emerged, although specific challenges arose. Nursing managers can draw on experiences from the COVID-19 pandemic to support implementation of new evidence-based practices in the future.

REPORTING METHOD

This study adheres to the EQUATOR guidelines by using Standards for Reporting Qualitative Research (SRQR). No Patient or Public Contribution.

Improvement of adenoma detection rate by two computer-aided colonic polyp detection systems in high adenoma detectors: a randomized multicenter trial

BACKGROUND

This study aimed to evaluate the benefits of a self-developed computer-aided polyp detection system (SD-CADe) and a commercial system (CM-CADe) for high adenoma detectors compared with white-light endoscopy (WLE) as a control.

METHODS

Average-risk 50-75-year-old individuals who underwent screening colonoscopy at five referral centers were randomized to SD-CADe, CM-CADe, or WLE groups (1:1:1 ratio). Trainees and staff with an adenoma detection rate (ADR) of ≥35% were recruited. The primary outcome was ADR. Secondary outcomes were the proximal adenoma detection rate (pADR), advanced adenoma detection rate (AADR), and the number of adenomas, proximal adenomas, and advanced adenomas per colonoscopy (APC, pAPC, and AAPC, respectively).

RESULTS

The study enrolled 1200 participants. The ADR in the control, CM-CADe, and SD-CADe groups was 38.3%, 50.0%, and 54.8%, respectively. The pADR was 23.0%, 32.3%, and 38.8%, respectively. AADR was 6.0%, 10.3%, and 9.5%, respectively. After adjustment, the ADR and pADR in both intervention groups were significantly higher than in controls (all P<0.05). The APC in the control, CM-CADe, and SD-CADe groups was 0.66, 1.04, and 1.16, respectively. The pAPC was 0.33, 0.53, and 0.64, respectively, and the AAPC was 0.07, 0.12, and 0.10, respectively. Both CADe systems showed significantly higher APC and pAPC than WLE. AADR and AAPC were improved in both CADe groups versus control, although the differences were not statistically significant.

CONCLUSION

Even in high adenoma detectors, CADe significantly improved ADR and APC. The AADR tended to be higher with both systems, and this may enhance colorectal cancer prevention.

Enhancing Impact: A Call to Action for Equitable Implementation Science

Despite investments in evidence-based interventions and Implementation Science, most evidence-based interventions are not widely or routinely adopted, delivered, or sustained in many real-world community and healthcare settings. This gap is even greater in settings and populations experiencing numerous social and structural barriers to health, with important implications for persistent patterns in health inequities. In this Viewpoint, as part of a Special Issue on Advancing the Adaptability of Chronic Disease Prevention and Management through Implementation Science, we outline seven calls to action for the field of Implementation Science, with the goal of encouraging researchers, practitioners, and funders to be more intentional and accountable in applying Implementation Science to have greater impact on promoting health equity. Calls to action include (1) enhance public health, community, and multi-sectoral partnerships to promote health equity and equitable implementation; (2) revisit and build the evidence base needed to promote health equity and impact at multiple levels; (3) prioritize focus on policy development, dissemination, and implementation; (4) be agile and responsive in application of Implementation Science frameworks, processes, and methods; (5) identify and redefine meaningful metrics for equity and impact; (6) disseminate scientific evidence and research to a diverse range of partners and potential beneficiaries; and (7) extend focus on de-implementation, mis-implementation, and sustainability which are central to enhancing health equity. Additionally, we outline why a focus on prevention and public health is essential to making progress towards health equity in Implementation Science, summarize important advancements that the field has made towards making equity more foundational, and pose important research questions to enhance equitable impact of work in this area.

Food is Medicine and implementation science: A recipe for health equity

Diet-related chronic diseases such as Type II diabetes, cardiometabolic diseases, and cancer are among the leading causes of death in the USA. Nutrition security has emerged as a target outcome and a national priority for preventative medicine and the treatment of diet-related chronic diseases. Food is Medicine (FIM) initiatives encompass programs and interventions to meet priority population's needs across food and nutrition security continuums as a mechanism to address persistent food and nutrition inequities. In this position statement, we draw on implementation science, specifically the Exploration, Preparation, Implementation, and Sustainment (EPIS) Framework and health equity principles to provide guidance on FIM initiatives. As the FIM evidence base continues to grow, we encourage the EPIS framework be applied as one lens through which we can improve our understanding of FIM implementation among multiple contexts to understand what works, for whom, and under what circumstances. Ultimately, this position statement aims to call to action the incorporation of implementation science and equity principles into FIM efforts.

Assessing the implementation of a multi-component hypertension program in a Guatemalan under-resourced dynamic context: an application of the RE-AIM/PRISM extension for sustainability and health equity

BACKGROUND

The COVID-19 pandemic necessitated rapid changes in healthcare delivery in Guatemala's public primary care settings. A new hypertension program, implemented as part of a type 2 hybrid trial since 2019, exemplifies an implementation effort amidst a changing context in an under-resourced setting. We assessed the implementation of an evidence-based intervention (EBI; protocol-based hypertension treatment) and one of its main implementation strategies (team-based collaborative care), raising implications for health equity and sustainability. We present innovative application of systems thinking visuals.

METHODS

Conducting a convergent mixed methods analysis, we assessed implementation in response to contextual changes across five Ministry of Health (MoH) districts at the pandemic's onset. Utilizing quantitative programmatic data and qualitative interviews with stakeholders (n=18; health providers, administrators, study staff), we evaluated dimensions of "Reach, Effectiveness, Adoption, Implementation and Maintenance," RE-AIM (Reach, Implementation delivery + adaptations), and "Practical Robust Implementation and Sustainability Model," PRISM (Organizational perspective on the EBI, Fit, Implementation and sustainability infrastructure) frameworks. We assessed representativeness by comparing participants to census data. To assess implementation delivery, we built behavior-over-time (BOT) graphs with quantitative programmatic data (July 2019-July 2021). To assess adaptations and contextual changes, we performed matrix-based thematic qualitative analysis. We converged quantitative implementation delivery data + qualitative adaptations data in joint displays. Finally, we analyzed qualitative and quantitative results across RE-AIM/PRISM and health districts to identify equity and sustainability considerations.

RESULTS

Contextual factors that facilitated program delivery included the perception that the EBI was beneficial, program champions, and staff communication. Key barriers to implementation delivery included competition with other primary care activities and limited implementation infrastructure (e.g., equipment, medications). Contextual changes related to COVID-19 hindered implementation delivery, threatened sustainability, and may have exacerbated inequities. However, adaptations that were planned enhanced implementation delivery and may have supported improved equity and sustainability.

CONCLUSIONS

Recognition of an EBI's benefits and program champions are important for supporting initial uptake. The ability to plan adaptations amid rapid contextual changes has potential advantages for sustainability and equitable delivery. Systems thinking tools and mixed methods approaches may shed light on the relations between context, adaptations, and equitable and sustainable implementation.

TRIAL REGISTRATION

NCT03504124.

Exploring the diverse definitions of 'evidence': a scoping review

OBJECTIVES

To systematically collect and analyse diverse definitions of 'evidence' in both health and social sciences, and help users to correctly use the term 'evidence' and rethink what is the definition of 'evidence' in scientific research.

DESIGN

Scoping review.

METHODS

Definitions of evidence in the health sciences and social sciences were included. We have excluded the definition of evidence applied in the legal field, abstracts without full text, documents not published in either Chinese or English and so on. We established a multidisciplinary working group and systematically searched five electronic databases including Medline, Web of Science, EBSCO, the Chinese Social Sciences Citation Index and the Chinese Science Citation Database from their inception to 26 February 2022. We also searched websites and reviewed the reference lists of the identified studies. Six reviewers working in pairs, independently, selected studies according to the inclusion and exclusion criteria, and extracted information. Any differences were discussed in pairs, and if there was disagreement, it was resolved via discussion or with the help of a third reviewer. Reviewers extracted document characteristics, the original content for the definitions of 'evidence', assessed definitions as either intensional or extensional, and any citations for the given definition.

RESULTS

Forty-nine documents were finally included after screening, and 68 definitions were obtained. After excluding duplicates, a total of 54 different definitions of 'evidence' were identified. There were 42 intensional definitions and 12 extensional definitions. The top three definiens were 'information', 'fact' and 'research/study'. The definition of 'evidence' differed between health and social sciences. The term 'research' appeared most frequently in the definitions.

CONCLUSIONS

The definition of 'evidence' has gradually attracted the attention of many scholars and decision-makers in health and social sciences. Nevertheless, there is no widely recognised and accepted definition in scientific research. Given the wide use of the term, we need to think about whether, or under what circumstances, a standardised, clear, meaningful and widely applicable definition of 'evidence' might be helpful.

Insights into implementation planning for point-of-care testing to guide treatment of chronic obstructive pulmonary disease exacerbation: a mixed methods feasibility study

The purpose of this mixed methods feasibility study was to gain insights into unmet clinical needs, stakeholder preferences and potential barriers and enablers to adoption for planning the implementation of point-of-care testing for earlier detection and guided treatment of chronic obstructive pulmonary disease (COPD) acute exacerbation in the NHS in England. Exacerbations of COPD cause considerable mortality and morbidity. Earlier identification of exacerbations and guided treatment would lead to reduced exacerbation duration, reduced hospitalizations and mortality, improve health-related quality of life, reduce unnecessary treatments (including inappropriate antibiotic prescribing) which could save the NHS over £400 per patient. During the early stages of product design, we took a multi-disciplinary approach to evidence generation, gaining insights from key stakeholders to test the product concept and inform evidence-based implementation planning. Primary data was collected from 11 health care and service professionals involved in the management of acute COPD exacerbations. Overall, participants agreed that by earlier differentiation of acute exacerbation from stable COPD, patients could be started on appropriate treatment. To implement point-of-care testing into clinical practice, evidence is required to demonstrate the accuracy of differentiating between exacerbation etiologies and to provide information on the beneficial impact to the system in terms of optimized management, reduced long-term side effects, admission avoidance, and cost-effectiveness. This research provides an evidence base for future implementation planning of point-of-care testing for earlier detection and guided treatment of COPD acute exacerbation. Moreover, the technology developers can decide whether to refine the product design and value proposition thereby de-risking product development.

Trauma-Informed Leadership in Quality Improvement: What We Learned From Practicing in a Pandemic

In 2020, midway through the Collaborative Improvement and Innovation Network to Advance Care for Children with Medical Complexity project, the coronavirus disease 2019 pandemic erupted and caused significant disruptions for the 10 participating state teams, the project leadership, and collaborative partner organizations. Clinics shut down for in-person care, a scramble ensued to quickly leverage telehealth to fill the gap, and the trauma caused by anxiety, isolation, and exhaustion affected the health and wellbeing of children, families, and clinicians alike. We conducted a series of key informant interviews and surveys, alongside other process measures, to learn from state teams what it was like "on the ground" to try to continue improving care delivery, child quality of life, and family wellbeing under such upheaval. In this article, we synthesize qualitative and descriptive findings from these varied data sources within the framework of the trauma-informed principles we applied as a leadership team to prevent burnout, increase resilience, and maintain progress among all project participants, especially clinicians and the uniquely vulnerable family leaders. Lessons learned will be offered that can be applied to future natural and human-made emergencies that impact responsive pediatric care delivery improvement.

Hyperlocal lessons from the COVID-19 pandemic: Toward an equity-centered implementation science approach

COVID-19 vaccination campaigns across the US were implemented to mitigate the disproportionate hospitalizations and unnecessary deaths across many communities that experienced unequal gaps in initial vaccine distribution rollout and uptake. In parallel, the COVID-19 pandemic created declines in routine vaccination coverage for adults, adolescents, and children; particularly, in communities experiencing overlapping social disadvantage. Community-based efforts offer a solution to narrow immunization gaps but have not been replicated consistently nor demonstrated widespread success during the pandemic as evidenced by prevailing disparities in immunization uptake. We offer an equity centered implementation science approach that involves co-designing, co-implementing, and co-evaluating solutions with the community and all partners investing in the shared goal of sustainable improvement in health outcomes.

A scoping review reveals candidate quality indicators of knowledge translation and implementation science practice tools

OBJECTIVES

To identify candidate quality indicators from existing tools that provide guidance on how to practice knowledge translation and implemenation science (KT practice tools) across KT domains (dissemination, implementation, sustainability, and scalability).

STUDY DESIGN AND SETTING

We conducted a scoping review using the Joanna Briggs Institute Manual for Evidence Synthesis. We systematically searched multiple electronic databases and the gray literature. Documents were independently screened, selected, and extracted by pairs of reviewers. Data about the included articles, KT practice tools, and candidate quality indicators were analyzed, categorized, and summarized descriptively.

RESULTS

Of 43,060 titles and abstracts that were screened from electronic databases and gray literature, 850 potentially relevant full-text articles were identified, and 253 articles were included in the scoping review. Of these, we identified 232 unique KT practice tools from which 27 unique candidate quality indicators were generated. The identified candidate quality indicators were categorized according to the development (n = 17), evaluation (n = 5) and adaptation (n = 3) of the tools, and engagement of knowledge users (n = 2). No tools were identified that appraised the quality of KT practice tools.

CONCLUSIONS

The development of a quality appraisal instrument of KT practice tools is needed. The results will be further refined and finalized in order to develop a quality appraisal instrument for KT practice tools.

What Families of Children With Medical Complexity Say They Need: Humanism in Care Delivery Change

There is growing consensus that centering lived experience is needed to meaningfully transform the burdensome systems of care for children with medical complexity (CMC) and their families. The Collaborative Improvement and Innovation Network to Advance Care for Children with Medical Complexity quality improvement initiative, co-led with family colleagues, illuminates a critical real-world view of systems change to address unintended bias and demystify the medical model of care. We share candid themes in which families describe the need for systems to counteract widespread misconceptions and bias to achieve meaningful system change. We held family-designed, family-led focus groups (N = 127 across 27 groups) within 10 diverse state teams. Families were asked about CMC quality of life and family wellbeing. We transcribed and coded the responses to uncover salient themes. We uncovered 2 major themes from families with direct applicability to systems of care: "What's Missing - Human Dignity" and "What Families Really Need and Recommend in Care." Families shared that valuing each child and creating opportunities for the child and family to enjoy their lives were most important in addressing human dignity in systems of care. They recommended centering the whole child, building relationships of trust and communication, and valuing family-to-family supports to transform the system of care aligned to humanism in care. Families express an urgency for systems to uphold dignity, valuing their child as a whole human being whose quality of life holds meaning and joy, not just as a diagnosis. The highly untenable cost of navigating dehumanizing systems of care reduces quality of life and wellbeing and must be transformed.

Instrumental variables for implementation science: exploring context-dependent causal pathways between implementation strategies and evidence-based interventions

BACKGROUND

The impact of both implementation strategies (IS) and evidence-based interventions (EBI) can vary across contexts, and a better understanding of how and why this occurs presents fundamental but challenging questions that implementation science as a field will need to grapple with. We use causal epidemiologic methods to explore the mechanisms of why sharp distinctions between implementation strategies (IS) and efficacy of an evidence-based intervention (EBI) may fail to recognize that the effect of an EBI can be deeply intertwined and dependent on the context of the IS leading to its uptake.

METHODS

We explore the use of instrumental variable (IV) analyses as a critical tool for implementation science methods to isolate three relevant quantities within the same intervention context when exposure to an implementation strategy is random: (1) the effect of an IS on implementation outcomes (e.g., uptake), (2) effect of EBI uptake on patient outcomes, and (3) overall effectiveness of the IS (i.e., ~ implementation*efficacy). We discuss the mechanisms by which an implementation strategy can alter the context, and therefore effect, of an EBI using the underlying IV assumptions. We illustrate these concepts using examples of the implementation of new ART initiation guidelines in Zambia and community-based masking programs in Bangladesh.

RESULTS

Causal questions relevant to implementation science are answered at each stage of an IV analysis. The first stage assesses the effect of the IS (e.g., new guidelines) on EBI uptake (e.g., same-day treatment initiation). The second stage leverages the IS as an IV to estimate the complier average causal effect (CACE) of the EBI on patient outcomes (e.g., effect of same-day treatment initiation on viral suppression). The underlying assumptions of CACE formalize that the causal effect of EBI may differ in the context of a different IS because (1) the mechanisms by which individuals uptake an intervention may differ and (2) the subgroup of individuals who take up an EBI may differ. IV methods thus provide a conceptual framework for how IS and EBIs are linked and that the IS itself needs to be considered a critical contextual determinant. Moreover, it also provides rigorous methodologic tools to isolate the effect of an IS, EBI, and combined effect of the IS and EBI.

DISCUSSION

Leveraging IV methods when exposure to an implementation strategy is random helps to conceptualize the context-dependent nature of implementation strategies, EBIs, and patient outcomes. IV methods formalize that the causal effect of an EBI may be specific to the context of the implementation strategy used to promote uptake. This integration of implementation science concepts and theory with rigorous causal epidemiologic methods yields novel insights and provides important tools for exploring the next generation of questions related to mechanisms and context in implementation science.

Prioritizing a research agenda on built environments and physical activity: a twin panel Delphi consensus process with researchers and knowledge users

BACKGROUND

The growth of urban dwelling populations globally has led to rapid increases of research and policy initiatives addressing associations between the built environment and physical activity (PA). Given this rapid proliferation, it is important to identify priority areas and research questions for moving the field forward. The objective of this study was to identify and compare research priorities on the built environment and PA among researchers and knowledge users (e.g., policy makers, practitioners).

METHODS

Between September 2022 and April 2023, a three-round, modified Delphi survey was conducted among two independent panels of international researchers (n = 38) and knowledge users (n = 23) to identify similarities and differences in perceived research priorities on the built environment and PA and generate twin 'top 10' lists of the most important research needs.

RESULTS

From a broad range of self-identified issues, both panels ranked in common the most pressing research priorities including stronger study designs such as natural experiments, research that examines inequalities and inequities, establishing the cost effectiveness of interventions, safety and injuries related to engagement in active transportation (AT), and considerations for climate change and climate adaptation. Additional priorities identified by researchers included: implementation science, research that incorporates Indigenous perspectives, land-use policies, built environments that support active aging, and participatory research. Additional priorities identified by knowledge users included: built environments and PA among people living with disabilities and a need for national data on trip chaining, multi-modal travel, and non-work or school-related AT.

CONCLUSIONS

Five common research priorities between the two groups emerged, including (1) to better understand causality, (2) interactions with the natural environment, (3) economic evaluations, (4) social disparities, and (5) preventable AT-related injuries. The findings may help set directions for future research, interdisciplinary and intersectoral collaborations, and funding opportunities.

Current evidence and opportunities in child and adolescent public mental health: a research review

BACKGROUND

A public mental health lens is increasingly required to better understand the complex and multifactorial influences of interpersonal, community and institutional systems on the mental health of children and adolescents.

METHODS

This research review (1) provides an overview of public mental health and proposes a new interactional schema that can guide research and practice, (2) summarises recent evidence on public mental health interventions for children and adolescents, (3) highlights current challenges for this population that might benefit from additional attention and (4) discusses methodological and conceptual hurdles and proposes potential solutions.

RESULTS

In our evidence review, a broad range of universal, selective and indicated interventions with a variety of targets, mechanisms and settings were identified, some of which (most notably parenting programmes and various school-based interventions) have demonstrated small-to-modest positive effects. Few, however, have achieved sustained mental health improvements.

CONCLUSIONS

There is an opportunity to re-think how public mental health interventions are designed, evaluated and implemented. Deliberate design, encompassing careful consideration of the aims and population-level impacts of interventions, complemented by measurement that embraces complexity through more in-depth characterisation, or 'phenotyping', of interpersonal and environmental elements is needed. Opportunities to improve child and adolescent mental health outcomes are gaining unprecedented momentum. Innovative new methodology, heightened public awareness, institutional interest and supportive funding can enable enhanced study of public mental health that does not shy away from complexity.

Guideline evaluation and implementation mechanisms in school health services (GuideMe): protocol for a hybrid randomized factorial trial

BACKGROUND

Norwegian school health services received a national best-practice guideline in 2017. To promote healthy life skills and identify adolescents needing support, the guideline includes strong recommendations for individual consultations with all 8th graders and increased collaboration with schools. To help implement the recommendations, a blended implementation strategy (SchoolHealth) was co-created with school nurses, students, and stakeholders. SchoolHealth consists of three implementation elements: Digital dialog and administration tool (audit and feedback +), Dialog support (external consultation), and Collaboration materials (targeted dissemination). This hybrid study will test the main and combined effects of the elements on guideline fidelity and effectiveness.

METHODS

The GuideMe study is a factorial cluster randomized controlled trial examining SchoolHealth's effectiveness on guideline fidelity and guideline effectiveness goals. Forty Norwegian secondary schools will be randomized to eight different combinations of the elements in SchoolHealth. Participants will include school nurses and school personnel from these schools, and 8th grade students (n = 1200). Primary outcomes are school nurses' fidelity to the guidelines and student's ability to cope with their life (i.e., health literacy, positive health behaviors and self-efficacy). Quantitative methods will be used to test effects and mechanisms, while mixed- and qualitative methods will be used to explore mechanisms, experiences, and other phenomena in depth. Participants will complete digital questionnaires at the start and end of the schoolyear, and after the consultation during the schoolyear. The study will run in two waves, each lasting for one school year. The multifactorial design allows testing of interactions and main effects due to equal distribution of all factors within each main effect. Sustainment and scale-up of optimized SchoolHealth elements using national infrastructure are simultaneously prepared.

DISCUSSION

The study will investigate possible effects of the implementation elements in isolation and in combination, and hypothesized implementation mechanisms. In-depth study of user experiences will inform improvements to elements in SchoolHealth. The results will yield causal knowledge about implementation strategies and the mechanisms through which they assert effects. Mixed-methods will provide insights into how and when the elements work. Optimizing guideline implementation elements can support adolescents in a crucial life phase.

TRAIL REGISTRATION

ISRCTN24173836. Registration date 8 August 2022.

External context in individual placement and support implementation: a scoping review with abductive thematic analysis

BACKGROUND

Context including the external context may considerably affect the adoption, implementation, sustainment, and scale-up of evidence-based practices. We investigated external contextual features by conducting a scoping review of empirical research regarding the implementation of an evidence-based psychiatric or mental health vocational rehabilitation service called Individual Placement and Support (IPS).

METHODS

The protocol for the scoping review was registered with the Open Science Framework. We used the methodology by Joanna Briggs Institute for conducting the scoping review and reported it according to the PRISMA-ScR checklist. We searched 12 databases for research regarding 'Individual Placement and Support' or 'Evidence-Based Supported Employment'. We retained peer-reviewed empirical studies investigating external contextual factors and their impact on IPS implementation outcomes. We extracted data from the eligible articles and conducted descriptive and thematic analyses.

RESULTS

Fifty-nine original research papers met our eligibility requirements and were retained after reviewing 1124 titles and abstracts and 119 full texts. The analysis generated two main themes: (1) external contextual determinants of service delivery and (2) external systems influencing the evidence-to-practice process. The first main theme encompassed policies and laws, financing, and administratively instituted support resources, and organizational arrangements associated with external stakeholders that may facilitate or hinder the local implementation. The second main theme comprised strategies and actions used by different stakeholders to facilitate implementation locally or scale-up efforts at a system level.

DISCUSSION

Our scoping review illustrates the important role that external contextual factors play and how they may facilitate or hinder the implementation and scale-up of the IPS model across mental health services in different countries. Consideration of these factors by decision-makers in mental health and welfare services, planners, providers, and practitioners is likely to facilitate the development of effective strategies for bridging the evidence-practice gap in implementing the EBPs. Finally, the scoping review identified gaps in knowledge and offered suggestions for future research.

TRIAL REGISTRATION

Open Science Framework.

Revisiting the policy ecology framework for implementation of evidence-based practices in mental health settings

BACKGROUND

Over the past three decades, policy actors and actions have been highly influential in supporting the implementation of evidence-based practices (EBPs) in mental health settings. An early examination of these actions resulted in the Policy Ecology Framework (PEF), which was originally developed as a tactical primer for state and local mental health regulators in the field of child mental health. However, the policy landscape for implementation has evolved significantly since the original PEF was published. An interrogation of the strategies originally proposed in the PEF is necessary to provide an updated menu of strategies to improve our understanding of the mechanisms of policy action and promote system improvement.

OBJECTIVES

This paper builds upon the original PEF to address changes in the policy landscape for the implementation of mental health EBPs between 2009 and 2022. We review the current state of policy strategies that support the implementation of EBPs in mental health care and outline key areas for policy-oriented implementation research. Our review identifies policy strategies at federal, state, agency, and organizational levels, and highlights developments in the social context in which EBPs are implemented. Furthermore, our review is organized around some key changes that occurred across each PEF domain that span organizational, agency, political, and social contexts along with subdomains within each area.

DISCUSSION

We present an updated menu of policy strategies to support the implementation of EBPs in mental health settings. This updated menu of strategies considers the broad range of conceptual developments and changes in the policy landscape. These developments have occurred across the organizational, agency, political, and social contexts and are important for policymakers to consider in the context of supporting the implementation of EBPs. The updated PEF expands and enhances the specification of policy levers currently available, and identifies policy targets that are underdeveloped (e.g., de-implementation and sustainment) but are becoming visible opportunities for policy to support system improvement. The updated PEF clarifies current policy efforts within the field of implementation science in health to conceptualize and better operationalize the role of policy in the implementation of EBPs.

Making the connection between health equity and sustainability

Sustainability and health inequities are key challenges in public health and healthcare. Research suggests that only about half of evidence-based interventions (EBIs) are sustained over time, and settings and populations experiencing systemic and structural barriers to health (e.g., poverty, racism, stigma, and discrimination) experience even greater challenges to sustainability. In this article, we argue that an enhanced focus on sustainability in the field of implementation science is critical in order to maximize the long-term health benefits and broader societal impacts of EBIs for all populations and settings. From an equity perspective, a focus on sustainability is particularly critical to prioritize among population sub-groups that have not historically received the benefits of health-related EBIs. We discuss how a health equity framing is essential to sustaining EBIs in under-resourced communities, and requires moving away from a deficit mindset that focuses on why EBIs are challenging to sustain, to one that focuses more on identifying and nurturing existing assets within individuals and communities to increase the likelihood that EBIs are sustained. We conclude with a discussion of future directions as well as recommendations and resources (e.g., frameworks, tools) to advance and make progress toward sustainability from a health equity mindset, including: (1) Actively planning early for sustainability alongside key partners; (2) Tracking progress toward enhancing sustainability and being accountable in doing so equitably for all settings and populations; and (3) Focusing on both equity and engagement early and often throughout the research process and all implementation phases.

Age-Based Genomic Screening during Childhood: Ethical and Practical Considerations in Public Health Genomics Implementation

Genomic sequencing offers an unprecedented opportunity to detect inherited variants that are implicated in rare Mendelian disorders, yet there are many challenges to overcome before this technology can routinely be applied in the healthy population. The age-based genomic screening (ABGS) approach is a novel alternative to genome-scale sequencing at birth that aims to provide highly actionable genetic information to parents over the course of their child's routine health care. ABGS utilizes an established metric to identify conditions with high clinical actionability and incorporates information about the age of onset and age of intervention to determine the optimal time to screen for any given condition. Ongoing partnerships with parents and providers are instrumental to the co-creation of educational resources and strategies to address potential implementation barriers. Implementation science frameworks and informative empirical data are used to evaluate strategies to establish this unique clinical application of targeted genomic sequencing. Ultimately, a pilot project conducted in primary care pediatrics clinics will assess patient and implementation outcomes, parent and provider perspectives, and the feasibility of ABGS. A validated, stakeholder-informed, and practical ABGS program will include hundreds of conditions that are actionable during infancy and childhood, setting the stage for a longitudinal implementation that can assess clinical and health economic outcomes.

Key insights on multisector community partnerships from real-world efforts to address social determinants of health

PURPOSE

To better understand and inform how multisector community partnerships (MCPs) perform meaningful work to prevent chronic disease and advance health equity by addressing social determinants of health (SDOH).

METHODS

We conducted a rapid retrospective evaluation of SDOH initiatives implemented within the past three years by 42 established MCPs across the United States. The mixed methods evaluation included document review and coding of available outcomes data, virtual discussions, and Prevention Impacts Simulation Model (PRISM) analysis.

RESULTS

All 42 MCPs built community capacity for addressing SDOH through new or strengthened data systems, leveraged resources, or engaged residents, for example. Most MCPs (N = 38, 90%) reported contributions to community changes that promote healthy living. More than half of the MCPs (N = 22) reported health outcomes data for their SDOH initiatives, including improved health behaviors and clinical outcomes. Based on reach data provided by 27 MCPs, PRISM analysis results suggest that sustained initiatives could save over $633 million in productivity and medical costs cumulatively through 20 years.

CONCLUSIONS

With sufficient technical assistance and funding resources, MCPs are a key component of the public health strategy to address SDOH.

Understanding Misimplementation in U.S. State Health Departments: An Agent-Based Model

INTRODUCTION

The research goal of this study is to explore why misimplementation occurs in public health agencies and how it can be reduced. Misimplementation is ending effective activities prematurely or continuing ineffective ones, which contributes to wasted resources and suboptimal health outcomes.

METHODS

The study team created an agent-based model that represents how information flow, filtered through organizational structure, capacity, culture, and leadership priorities, shapes continuation decisions. This agent-based model used survey data and interviews with state health department personnel across the U.S. between 2014 and 2020; model design and analyses were conducted with substantial input from stakeholders between 2019 and 2021. The model was used experimentally to identify potential approaches for reducing misimplementation.

RESULTS

Simulations showed that increasing either organizational evidence-based decision-making capacity or information sharing could reduce misimplementation. Shifting leadership priorities to emphasize effectiveness resulted in the largest reduction, whereas organizational restructuring did not reduce misimplementation.

CONCLUSIONS

The model identifies for the first time a specific set of factors and dynamic pathways most likely driving misimplementation and suggests a number of actionable strategies for reducing it. Priorities for training the public health workforce include evidence-based decision making and effective communication. Organizations will also benefit from an intentional shift in leadership decision-making processes. On the basis of this initial, successful application of agent-based model to misimplementation, this work provides a framework for further analyses.

Speeding implementation in cancer: The National Cancer Institute's Implementation Science Centers in Cancer Control

The National Cancer Institute's Implementation Science Centers in Cancer Control (ISC3) Network represents a large-scale initiative to create an infrastructure to support and enable the efficient, effective, and equitable translation of approaches and evidence-based treatments to reduce cancer risk and improve outcomes. This Cancer MoonshotSM-funded ISC3 Network consists of 7 P50 Centers that support and advance the rapid development, testing, and refinement of innovative approaches to implement a range of evidence-based cancer control interventions. The Centers were designed to have research-practice partnerships at their core and to create the opportunity for a series of pilot studies that could explore new and sometimes risky ideas and embed in their infrastructure a 2-way engagement and collaboration essential to stimulating lasting change. ISC3 also seeks to enhance capacity of researchers, practitioners, and communities to apply implementation science approaches, methods, and measures. The Organizing Framework that guides the work of ISC3 highlights a collective set of 3 core areas of collaboration within and among Centers, including to 1) assess and incorporate dynamic, multilevel context; 2) develop and conduct rapid and responsive pilot and methods studies; and 3) build capacity for knowledge development and exchange. Core operating principles that undergird the Framework include open collaboration, consideration of the dynamic context, and engagement of multiple implementation partners to advance pragmatic methods and health equity and facilitate leadership and capacity building across implementation science and cancer control.

Advancing considerations of context in the evaluation and implementation of evidence-based biomedical HIV prevention interventions: a review of recent research

PURPOSE OF REVIEW

A paradigm shift is needed in how we think about biomedical HIV prevention product effectiveness. Often, we expect randomized trial findings to be generalizable across populations and settings where products will be delivered, without consideration of key contextual drivers that could impact effectiveness. Moreover, researchers and policy-makers generally discount products with varied effect sizes across contexts, rather than explicating the drivers of these differences and using them to inform equitable product choice and delivery. We conducted a review of the recent HIV prevention research to advance considerations of context in choices of when, why, and how to implement biomedical HIV prevention products, with a particular focus on daily oral preexposure prophylaxis (PrEP) and the dapivirine vaginal ring (DPV).

RECENT FINDINGS

Findings across recent studies of PrEP and DPV emphasize that products that do not work well in one context might be highly desirable in another. Key contextual drivers of PrEP and DPV effectiveness, use, and implementation include population, health system, cultural, and historical factors. We recommend conceptualization, measurement, and analysis approaches to fully understand the potential impact of context on prevention product delivery. Execution of these approaches has real-world implications for HIV prevention product choice and could prevent the field from dismissing biomedical HIV prevention products based on trial findings alone.

SUMMARY

Ending the HIV epidemic will require tailored, person-centered, and equitable approaches to design, implement, and evaluate HIV prevention products which necessitates considerations of context in ongoing research and implementation.

Amplifying consumers as partners in dissemination and implementation science and practice

Background

This Viewpoint argues for consumers (people with lived experience and their families) to be amplified as key partners in dissemination and implementation science and practice.

Method

We contend that consumer opinion and consumer demand can be harnessed to influence practitioners and policymakers.

Results

Amplifying consumers' voices can improve the fit of evidence-based interventions to the intended end user. We offer recommendations of frameworks to engage consumers in the dissemination and implementation of health interventions. We discuss the primary types of evidence consumers may rely upon, including testimonials and lived experience.

Conclusions

Our intention is for this Viewpoint to continue the momentum in dissemination and implementation science and practice of engaging consumers in our work.

Municipal officials' perspectives on policymaking for addressing obesity and health equity

Background

Obesity evidence-based policies (EBPs) can make a lasting, positive impact on community health; however, policy development and enactment is complex and dependent on multiple forces.

Aims and objectives

This study investigated key factors affecting municipal officials' policymaking for obesity and related health disparities.

Methods

Semi-structured interviews were conducted with 20 local officials from a selection of municipalities with high obesity or related health disparities across the United States between December 2020 and April 2021.

Findings

Policymakers follow a general decision-making process with limited distinction between health and other policy areas. Factors affecting policymaking included: being informed about other local, state, and federal policy, conducting their own research using trustworthy sources, and seeking constituent and stakeholder perspectives. Key facilitators included the need for timely, relevant local data, and seeing or hearing from those impacted. Key local policymaking barriers included constituent opposition, misinformation, controversial issues with contentious solutions, and limited understanding of the connection between issues and obesity/health. Policymakers had a range of understanding about causes of health disparities, including views of individual choices, environmental influences on behaviors, and structural factors impacting health. To address health disparities, municipal officials described: a variety of roles policymakers can take, limitations based on the scope of government, challenges with intergovernmental collaboration or across government levels, ability of policymakers and government employees to understand the problem, and the challenge of framing health disparities given the social-political context.

Discussion and conclusion

Understanding factors affecting the uptake of EBPs can inform local-level interventions that encourage EBP adoption.

Evidence for objects of implementation in healthcare: considerations for Implementation Science and Implementation Science Communications

The journals Implementation Science and Implementation Science Communications are focused on the implementation of evidence into healthcare practice and policy. This editorial offers reflections on how we handle this as editors. Studies that focus on the simultaneous implementation of implementation objects and (technological or other) structures to enable their implementation are considered on a case-by-case basis regarding their contribution to implementation science. Studies on implementation objects with limited, mixed, or of out-of-context evidence are considered if the evidence for key components of the object of interest is sufficiently robust. We follow GRADE principles in our assessment of the certainty of research findings for health-related interventions in individuals. Adapted thresholds apply to evidence for population health interventions, organizational changes, health reforms, health policy innovations, and medical devices. The added value of a study to the field of implementation science remains of central interest for our journals.

Proceedings from the Second Annual Conference of the Norwegian Network for Implementation Research

In 2019, Norwegian implementation researchers formed a network to promote implementation research and practice in the Norwegian context. On November 19th, 2021, the second annual Norwegian implementation conference was held in Oslo. Ninety participants from all regions of the country gathered to showcase the frontiers of Norwegian implementation research. The conference also hosted a panel discussion about critical next steps for implementation science in Norway. The conference included 17 presentations from diverse disciplines within health and welfare services, including schools. The themes presented included stakeholder engagement, implementation mechanisms, evaluations of the implementation of specific interventions, the use of implementation guidelines and frameworks, the development and validation of implementation measurements, and barriers and facilitators for implementation. The panel discussion highlighted several critical challenges with the implementation of evidence-informed practices in Norway, including limited implementation competence and capacity among practice leaders and workforces, few opportunities for education in implementation science, limited implementation research in the Norwegian context, scarce funding possibilities for implementation research, and a lack of long-term perspectives on implementation processes. Overall, the 2021 Norwegian implementation conference showed an encouraging sign of a maturing field of science in Norway. The more voluminous proceedings from the 2020 conference called for several important advancements to improve implementation science and practice in Norway, and the 2021 conference indicates that steps have already been taken in favorable directions in terms of, for instance, research designs and measurements. However, there are still unexploited potentials for improvements in implementation research, funding, policies, and practice. Norwegian implementation researcher should be mindful of the challenges and potential pitfalls implementation science currently face as a scientific discipline.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-022-00069-w.

Dissemination Research in Communication Sciences and Disorders: A Tutorial

PURPOSE

The purpose of this tutorial is threefold: (a) to bring attention to the role and value of dissemination research in communication sciences and disorders (CSD), (b) to introduce a model that can be used to guide dissemination research, and (c) to demonstrate strategic steps toward generating research questions and planning methods for dissemination research using an example from the authors' work.

METHOD

This tutorial begins with a discussion of the role of dissemination in clinical research, with emphasis on differentiating the unique value of dissemination within the broader context of dissemination and implementation (D&I) research. The tutorial next presents a model of dissemination from the extant literature and describes how this model can be applied in CSD using examples from the authors' respective programs of clinical research. This is followed by an example that illustrates how the model can be used to determine research questions and guide the development of methods. Finally, the tutorial ends by discussing the potential impact of dissemination research for advancing efforts in CSD for closing the research-to-practice gap.

CONCLUSIONS

Dissemination research is an often overlooked but critical component of D&I efforts. When approached systematically and rigorously, dissemination can make meaningful contributions to clinical research in CSD.

Sustainability in pediatric hospitals: An exploration at the intersection of quality improvement and implementation science

Background

Although new evidence-based practices are frequently implemented in clinical settings, many are not sustained, limiting the intended impact. Within implementation science, there is a gap in understanding sustainability. Pediatric healthcare settings have a robust history of quality improvement (QI), which includes a focus on continuation of change efforts. QI capability and sustainability capacity, therefore, serve as a useful concept for connecting the broader fields of QI and implementation science to provide insights on improving care. This study addresses these gaps in understanding of sustainability in pediatric settings and its relationship to QI.

Methods

This is a cross-sectional observational study conducted within pediatric academic medical centers in the United States. Clinicians surveyed worked with one of three evidence-based clinical programs: perioperative antimicrobial stewardship prescribing, early mobility in the intensive care unit, and massive blood transfusion administration. Participants completed two assessments: (1) the Clinical Sustainability Assessment Tool (CSAT) and (2) a 19-question assessment that included demographics and validation questions, specifically a subset of questions from the Change Process Capability Questionnaire, a QI scale. Initial descriptive and bivariate analyses were conducted prior to building mixed-effects models relating perceived QI to clinical sustainability capacity.

Results

A total of 181 individuals from three different programs and 30 sites were included in the final analyses. QI capability scores were assessed as a single construct (5-point Likert scale), with an average response of 4.16 (higher scores indicate greater QI capability). The overall CSAT score (7-point Likert scale) was the highest for massive transfusion programs (5.51, SD = 0.91), followed by early mobility (5.25, SD = 0.92) and perioperative antibiotic prescribing (4.91, SD = 1.07). Mixed-effects modeling illustrated that after controlling for person and setting level variables, higher perceptions of QI capabilities were significantly related to overall clinical sustainability.

Conclusion

Organizations and programs with higher QI capabilities had a higher sustainability capacity, even when controlling for differences at the individual and intervention levels. Organizational factors that enable evidence-based interventions should be further studied, especially as they relate to sustainability. Issues to be considered by practitioners when planning for sustainability include bedside provider perceptions, intervention achievability, frequency of delivery, and organizational influences.

Program adaptation by health departments

Introduction

The dissemination of evidence-based interventions (i.e., programs, practices, and policies) is a core function of US state health departments (SHDs). However, interventions are originally designed and tested with a specific population and context. Hence, adapting the intervention to meet the real-world circumstances and population's needs can increase the likelihood of achieving the expected health outcomes for the target population from the implemented intervention. This study identified how SHD employees decide to adapt public health programs and what influences decisions on how to adapt them.

Materials and methods

SHD employees (n = 45) were interviewed using a qualitative semi-structured interview guide. Telephone interviews were audio-recorded and transcribed verbatim. The transcripts were consensus-coded and themes were identified using thematic analysis. Several themes aligned with the Model for Adaptation Design and Impact.

Results

Data, outcomes, and health department evaluations influenced decisions to adapt a program (pre-adaptation), and reasons to adapt a program included organizational and sociopolitical contextual factors. SHD middle-level managers, program managers and staff, and local agencies were involved in the decisions to adapt the programs. Finally, the goals for adapting a program included enhancing effectiveness/outcomes, reach and satisfaction with the program; funding; and partner engagement. After SHD employees decided to adapt a program, data and evidence guided the changes. Program staff and evaluators were engaged in the adaptation process. Program managers consulted partners to gather ideas on how best to adapt a program based on partners' experiences implementing the program and obtaining community input. Lastly, program managers also received input on adapting content and context from coalition meetings and periodic technical assistance calls.

Discussion

The findings related to decisions to adapt public health programs provide practitioners with considerations for adapting them. Findings reaffirm the importance of promoting public health competencies in program evaluation and adaptation, as well as systematically documenting and evaluating the adaptation processes. In addition, the themes could be studied in future research as mechanisms, mediators, and moderators to implementation outcomes.

Results of a multi-site pragmatic hybrid type 3 cluster randomized trial comparing level of facilitation while implementing an intervention in community-dwelling disabled and older adults in a Medicaid waiver

Background

Evidence-based interventions that optimize physical function for disabled and older adults living in the community who have difficulty with daily living tasks are available. However, uptake has been limited, particularly in resource-constrained (Medicaid) settings. Facilitation may be an effective implementation strategy. This study’s aim was to compare internal facilitation (IF) versus IF and external facilitation (EF) on adoption and sustainability of an intervention in a Medicaid home and community-based waiver.

Methods

In a hybrid type 3 trial, waiver sites (N = 18) were randomly assigned to implement the intervention using a bundle of strategies with either IF or IF and EF. Adoption and sustainability were assessed via Stages of Implementation Completion (SIC) for each site. Clinician attitudes toward evidence-based practice and self-efficacy were evaluated among 539 registered nurses, social workers, and occupational therapists. Medicaid beneficiary outcomes of activities of daily living, depression, pain, falls, emergency department visits, and hospitalizations were evaluated in a sample of N = 7030 as reflected by electronic health records data of the Medicaid waiver program. Linear mixed-effects models were used to compare outcomes between trial arms while accounting for cluster-randomized design.

Results

The mean SIC scores were 72.22 (standard deviation [SD] = 16.98) in the IF arm (9 sites) and 61.33 (SD = 19.29) in the IF + EF arm (9 sites). The difference was not statistically significant but corresponded to the medium clinically important effect size Cohen’s d = 0.60. Clinician implementation outcomes of attitudes and self-efficacy did not differ by trial arm. Beneficiary depression was reduced significantly in the IF + EF arm compared to the IF arm (p = .04, 95% confidence interval for the difference [0.01, 0.24]). No differences between trial arms were found for other beneficiary outcomes.

Conclusions

Level of facilitation did not enhance capacity for adoption and sustainability of an evidence-based intervention in a Medicaid setting that cares for disabled and older adults. Improved beneficiary depression favored use of IF and EF compared to IF alone, and no differences were found for other outcomes. These findings also suggest level of facilitation may not have impacted beneficiary outcomes.

Trial registration

ClinicalTrials.gov, NCT03634033; date registered August 16, 2018.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01232-5.

Implementation strategy mapping methods to improve autism intervention use in community settings: a study protocol

Background

Implementation strategies are purported to facilitate adoption and use of evidence-based practices (EBPs) across settings. The use of tailored implementation strategies may be particularly effective, as they are selected with the explicit purpose of addressing setting-specific implementation determinants. However, methods to select and tailor implementation strategies, including in community settings, remain understudied. This project will identify and describe implementation strategy mapping methods (ISMMs) from extant peer-reviewed literature and pilot test a method to match implementation strategies with determinants in low-resourced community mental health (CMH) agencies that deliver services to children on the autism spectrum.

Methods

Aim 1: A scoping review, following PRISMA guidelines, will be conducted to identify implementation strategy mapping methods (ISMMs) utilized in child mental health settings. Data extraction will identify and describe each ISMM, including identifying methodological and procedural steps, analyzing the frequency of ISMM use, and identifying outcomes measured in eligible ISMM studies.

Aim 2: Using scoping review findings, select and pilot test one ISMM within five community mental health agencies in Michigan that provide services to autistic children. We will recruit five directors/agency leaders, supervisors, and direct providers at each of the eligible agencies (expected N = 25). A sequential explanatory (QUAN➔ QUAL) mixed methods design will be used. Participants will complete a demographics and client survey, as well as a needs assessment to identify implementation determinants. The impact of the ISMM on organizational readiness for change (from pre- to post-ISMM), as well as implementation outcomes of the ISMM (feasibility, acceptability, appropriateness, usability), will be examined. Semi-structured interviews will elicit stakeholder perspectives on the mapping method.

Discussion

The current project aims to advance our knowledge of methods for selecting, tailoring, and mapping implementation strategies to address context-specific determinants to implementation. Additionally, this project will contribute to growing science found at the intersection of implementation science and autism research by utilizing the implementation determinants framework, the CFIR, to guide data collection, analysis, and interpretation of findings. Finally, these findings may support future EBP implementation efforts within low-resourced communities, with the ultimate goal of increasing equity in access to EBPs for autistic children.

Quantitative measures used in empirical evaluations of mental health policy implementation: A systematic review

Background

Mental health is a critical component of wellness. Public policies present an opportunity for large-scale mental health impact, but policy implementation is complex and can vary significantly across contexts, making it crucial to evaluate implementation. The objective of this study was to (1) identify quantitative measurement tools used to evaluate the implementation of public mental health policies; (2) describe implementation determinants and outcomes assessed in the measures; and (3) assess the pragmatic and psychometric quality of identified measures.

Method

Guided by the Consolidated Framework for Implementation Research, Policy Implementation Determinants Framework, and Implementation Outcomes Framework, we conducted a systematic review of peer-reviewed journal articles published in 1995-2020. Data extracted included study characteristics, measure development and testing, implementation determinants and outcomes, and measure quality using the Psychometric and Pragmatic Evidence Rating Scale.

Results

We identified 34 tools from 25 articles, which were designed for mental health policies or used to evaluate constructs that impact implementation. Many measures lacked information regarding measurement development and testing. The most assessed implementation determinants were readiness for implementation, which encompassed training (n  =  20, 57%) and other resources (n  =  12, 34%), actor relationships/networks (n  =  15, 43%), and organizational culture and climate (n  =  11, 31%). Fidelity was the most prevalent implementation outcome (n  =  9, 26%), followed by penetration (n  =  8, 23%) and acceptability (n  =  7, 20%). Apart from internal consistency and sample norms, psychometric properties were frequently unreported. Most measures were accessible and brief, though minimal information was provided regarding interpreting scores, handling missing data, or training needed to administer tools.

Conclusions

This work contributes to the nascent field of policy-focused implementation science by providing an overview of existing measurement tools used to evaluate mental health policy implementation and recommendations for measure development and refinement. To advance this field, more valid, reliable, and pragmatic measures are needed to evaluate policy implementation and close the policy-to-practice gap.

Plain Language Summary

Mental health is a critical component of wellness, and public policies present an opportunity to improve mental health on a large scale. Policy implementation is complex because it involves action by multiple entities at several levels of society. Policy implementation is also challenging because it can be impacted by many factors, such as political will, stakeholder relationships, and resources available for implementation. Because of these factors, implementation can vary between locations, such as states or countries. It is crucial to evaluate policy implementation, thus we conducted a systematic review to identify and evaluate the quality of measurement tools used in mental health policy implementation studies. Our search and screening procedures resulted in 34 measurement tools. We rated their quality to determine if these tools were practical to use and would yield consistent (i.e., reliable) and accurate (i.e., valid) data. These tools most frequently assessed whether implementing organizations complied with policy mandates and whether organizations had the training and other resources required to implement a policy. Though many were relatively brief and available at little-to-no cost, these findings highlight that more reliable, valid, and practical measurement tools are needed to assess and inform mental health policy implementation. Findings from this review can guide future efforts to select or develop policy implementation measures.