What strategies are used to build practitioners' capacity to implement community-based interventions and are they effective?: a systematic review

Remote coaching for supporting the implementation of treatment for depression in primary care in Madhya Pradesh, India: protocol for a cluster randomized controlled trial

Background

Upwards of ninety percent of individuals living with depression in India do not have access to evidence-based treatments, especially in rural areas. Integrating these treatments into primary care is essential for bridging this care gap. This trial aims to evaluate whether a remote coaching implementation support strategy, referred to as Enhanced Implementation Support, is superior to routine support, referred to as Routine Implementation Support, in supporting the delivery of collaborative depression care in rural primary care centers.

Methods

Employing a cluster-randomized hybrid type-III implementation trial design, 14 primary care facilities in Sehore district, Madhya Pradesh, will implement a collaborative depression care package based on the WHO's mhGAP program. Facilities will be randomized to either Enhanced Implementation Support or the Routine Implementation Support control condition. Enhanced Implementation Support consists of remote coaching and technical assistance, supplemented with in-person visits, and guided by the Plan-Do-Study-Act implementation cycles. The primary implementation outcome is the proportion of outpatients screened for depression by facility staff, with secondary outcomes including the proportions of outpatients who screen positive for depression, are referred to the medical officer, and initiate treatment. Secondary patient outcomes include proportion of patients who achieve reduction in depression symptom severity at 3-month follow up. Acceptability, feasibility, and fidelity of the depression care package will be assessed through routine observations collected during field visits, facility audits, and qualitative exit interviews with facility staff. Costs of delivering the Enhanced Implementation Support strategy will also be estimated.

Discussion

This trial can inform efforts to integrate depression care in rural primary care facilities in a low-resource setting, and illuminate whether external coaching support is superior relative to existing implementation support for achieving these goals.

Trial Registration

NCT05264792.

Practitioner perspectives on equitable implementation of evidence-based interventions for cancer prevention and control

Longstanding inequities in cancer prevention and control require novel approaches to improve evidence-based intervention implementation. Exploring and elevating the perspectives of cancer prevention and control practitioners working to advance health equity and equitably implement evidence-based interventions is an important yet underutilized step among researchers working in this space. The purpose of this study was to explore practitioners' perspectives of how health equity is defined and integrated into their work, challenges of advancing health equity for implementation in local settings, and associated strategies. We conducted virtual key informant interviews and focus groups with 16 US practitioners (e.g. clinicians, health administrators, public health professionals) in 2021-2022. Interviews and focus groups were audio recorded and transcribed. Data were coded using inductive content analysis and summarized into themes. Four major themes emerged: (i) how health equity is conceptualized as a process and outcome; (ii) need to shift equity mindsets; (iii) importance of community partnerships; (iv) organizational policies and strategies for fostering equity in implementation. Respondents noted the need for research and medical communities to learn about the importance and benefits of allowing communities to shape implementation to advance equity in the delivery of evidence-based interventions and outcomes. Additionally, respondents emphasized that institutional leaders should initiate changes regarding equitable implementation at the organizational- and system-levels. Respondents endorsed the need to address equity issues related to the implementation of cancer prevention and control programs, practices, and policies. Many findings can be applied beyond cancer prevention and control to support equitable implementation and outcomes more generally.

Adapting and Evaluating a Brief Advice Tobacco Cessation Intervention in High-reach, Low-resource Settings in India: Protocol for a Cluster Randomized Controlled Trial

BACKGROUND

About 1.35 million deaths annually are attributed to tobacco use in India. The main challenge, given the magnitude of tobacco use and limited resources, is delivering cessation support at scale, low cost, and through a coordinated cross-system effort; one such example being brief advice interventions. However, highly credentialed staff to identify and counsel tobacco users are scarce. Task-shifting is an important opportunity for scaling these interventions.

OBJECTIVE

The LifeFirst SWASTH (Supporting Wellbeing among Adults by Stopping Tobacco Habit) program-adapted from the LifeFirst program (developed by the Narotam Sekhsaria Foundation, Mumbai, India)-is a tobacco cessation program focusing on lower-socioeconomic status patients in Mumbai receiving private health care. This parallel-arm, cluster randomized controlled trial investigates whether the LifeFirst SWASTH program increases tobacco cessation rates in low-resource, high-reach health care settings in Mumbai.

METHODS

This study will target tuberculosis-specific nongovernmental organizations (NGOs), dental clinics, and NGOs implementing general health programs serving lower-socioeconomic status patients. Intervention arm patients will receive a pamphlet explaining tobacco's harmful effects. Practitioners will be trained to deliver brief cessation advice, and interested patients will be referred to a Narotam Sekhsaria Foundation counselor for free telephone counseling for 6 months. Control arm patients will receive the same pamphlet but not brief advice or counseling. Practitioners will have a customized mobile app to facilitate intervention delivery. Practitioners will also have access to a peer network through WhatsApp. The primary outcome is a 30-day point prevalence abstinence from tobacco. Secondary outcomes for patients and practitioners relate to intervention implementation.

RESULTS

The study was funded in June 2020. Due to the COVID-19 pandemic, the study experienced some delays, and practitioner recruitment commenced in November 2023. As of July 2024, all practitioners have been recruited, and practitioner recruitment and training are complete. Furthermore, 36% (1687/4688) of patients have been recruited.

CONCLUSIONS

It is hypothesized that those patients who participated in the LifeFirst SWASTH program will be more likely to have been abstinent from tobacco for 30 consecutive days by the end of 6 months or at least decreased their tobacco use. LifeFirst SWASTH, if found to be effective in terms of cessation outcomes and implementation, has the potential to be scaled to other settings in India and other low- and middle-income countries. The study will be conducted in low-resource settings and will reach many patients, which will increase the impact if scaled. It will use task-shifting and an app that can be tailored to different settings, also enabling scalability. Findings will build the literature for translating evidence-based interventions from high-income countries to low- and middle-income countries and from high- to low-resource settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05234983; https://clinicaltrials.gov/study/NCT05234983.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/57236.

Development of the Technical Assistance Engagement Scale: a modified Delphi study

BACKGROUND

Technical assistance (TA) is a tailored approach to capacity building that is commonly used to support implementation of evidence-based interventions. Despite its widespread applications, measurement tools for assessing critical components of TA are scant. In particular, the field lacks an expert-informed measure for examining relationship quality between TA providers and recipients. TA relationships are central to TA and significantly associated with program implementation outcomes. The current study seeks to address the gap in TA measurement tools by providing a scale for assessing TA relationships.

METHODS

We utilized a modified Delphi approach involving two rounds of Delphi surveys and a panel discussion with TA experts to garner feedback and consensus on the domains and items that compose the TA Engagement Scale.

RESULTS

TA experts represented various U.S. organizations and TA roles (e.g., provider, recipient, researcher) with 25 respondents in the first survey and 26 respondents in the second survey. The modified Delphi process resulted in a scale composed of six domains and 22 items relevant and important to TA relationships between providers and recipients.

CONCLUSION

The TA Engagement Scale is a formative evaluation tool intended to offer TA providers the ability to identify strengths and areas for growth in the provider-recipient relationship and to communicate about ongoing needs. As a standard measurement tool, it lends a step toward more systematic collection of TA data, the ability to generate a more coherent body of TA evidence, and enables comparisons of TA relationships across settings.

Demonstration Projects to Test Built Environment Changes: A Systematic Review

CONTEXT

Built environment interventions (pedestrian/bicycle infrastructure and enhanced access) mitigate barriers to physical activity by making the healthy choice the default choice. Demonstration projects (eg, temporary pedestrian lanes or sidewalks marked with tape) are used to test these interventions before making permanent changes. However, it is unknown whether demonstration projects lead to desired built environment changes.

OBJECTIVE

To systematically review the literature to determine outcomes and overall public health impacts of demonstration projects and whether they lead to permanent changes to the built environment.

DESIGN

Systematic review, conducted from March to September 2022 by searching PubMed and EBSCOhost for peer-reviewed literature and Google for gray (non-peer-reviewed) literature. Inclusion criteria were policy, systems, or environmental interventions; temporary implementation; and presence of evaluation data. Exclusion criteria were individual/interpersonal-level interventions, permanent implementation, and absence of evaluation data. Two authors coded for inclusion/exclusion and resolved discrepancies, coded a portion of included sources and resolved discrepancies, refined coding guide definitions, and coded remaining sources.

MAIN OUTCOME MEASURES

Data were extracted based on the expanded RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, which incorporates constructs of the Implementation Outcomes Framework (acceptability, appropriateness, feasibility).

RESULTS

Gray (N = 23) and peer-reviewed (N = 1) sources describing unique demonstration projects (N = 31) met inclusion criteria. Projects tested built environment interventions including traffic calming measures, crosswalks, bike lanes, intersection design, and trails. Sources primarily reported effectiveness (typically improved safety), maintenance, acceptability, and appropriateness. Most sources did not report projects leading to permanent changes to the built environment.

CONCLUSIONS

Based on inconsistent reporting of key outcomes (number of community members reached, changes to physical activity levels), overall impacts are unknown. Most demonstration projects captured community members' feedback, which was typically positive, but it is unknown whether feedback led to long-term changes. We recommend providing improved demonstration project guidance for practitioners to facilitate robust data collection, including suggested evaluation methods and tools.

A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022

BACKGROUND

Studies of implementation strategies range in rigor, design, and evaluated outcomes, presenting interpretation challenges for practitioners and researchers. This systematic review aimed to describe the body of research evidence testing implementation strategies across diverse settings and domains, using the Expert Recommendations for Implementing Change (ERIC) taxonomy to classify strategies and the Reach Effectiveness Adoption Implementation and Maintenance (RE-AIM) framework to classify outcomes.

METHODS

We conducted a systematic review of studies examining implementation strategies from 2010-2022 and registered with PROSPERO (CRD42021235592). We searched databases using terms "implementation strategy", "intervention", "bundle", "support", and their variants. We also solicited study recommendations from implementation science experts and mined existing systematic reviews. We included studies that quantitatively assessed the impact of at least one implementation strategy to improve health or health care using an outcome that could be mapped to the five evaluation dimensions of RE-AIM. Only studies meeting prespecified methodologic standards were included. We described the characteristics of studies and frequency of implementation strategy use across study arms. We also examined common strategy pairings and cooccurrence with significant outcomes.

FINDINGS

Our search resulted in 16,605 studies; 129 met inclusion criteria. Studies tested an average of 6.73 strategies (0-20 range). The most assessed outcomes were Effectiveness (n=82; 64%) and Implementation (n=73; 56%). The implementation strategies most frequently occurring in the experimental arm were Distribute Educational Materials (n=99), Conduct Educational Meetings (n=96), Audit and Provide Feedback (n=76), and External Facilitation (n=59). These strategies were often used in combination. Nineteen implementation strategies were frequently tested and associated with significantly improved outcomes. However, many strategies were not tested sufficiently to draw conclusions.

CONCLUSION

This review of 129 methodologically rigorous studies built upon prior implementation science data syntheses to identify implementation strategies that had been experimentally tested and summarized their impact on outcomes across diverse outcomes and clinical settings. We present recommendations for improving future similar efforts.

Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA.

Unpacking Technical Assistance (TA) Strategies Within a State-Level Prevention Support System: A Mixed-Method Study in Determining Types and Amount of TA

The research-practice gap between evidence-based intervention efficacy and its uptake in real-world contexts remains a central challenge for prevention and implementation science. Providing technical assistance (TA) is considered a crucial support mechanism that can help narrow the gap. However, empirical measurement of TA strategies and their variation is often lacking. The current study unpacks the black box of TA, highlighting different TA strategies, amounts, and their relation to intervention characteristics. First, we qualitatively categorized interactions between TA providers and implementers. Second, we explored how characteristics of implementing organizations and the intervention related to variations in the amount of TA delivered. Using data spanning six years, we analyzed over 10,000 encounters between TA providers and implementers. Content analysis yielded four distinct strategies: Consultation (27.2%), Coordination Logistics (24.5%), Monitoring (16.5%), and Resource Delivery (28.2%). Organizations with prior experience required less monitoring and resource delivery. Additionally, characteristics of the intervention were significantly associated with the amount of consultation, monitoring, coordination logistics, and resource delivery provided. The specific features of the intervention showed significant variation in their relation to TA strategies. These findings provide initial insights into the implications of intervention characteristics in determining how much of which TA strategies are needed to support implementations in real-world settings.

Evaluating variations in the barriers to colorectal cancer screening associated with telehealth use in rural U.S. Pacific Northwest

PURPOSE

The incidence and mortality rates of colorectal cancer (CRC) remain consistently high in rural populations. Telehealth can improve screening uptake by overcoming individual and environmental disadvantages in rural communities. The present study aimed to characterize varying barriers to CRC screening between rural individuals with and without experience in using telehealth.

METHOD

The cross-sectional study surveyed 250 adults aged 45-75 residing in rural U.S. states of Alaska, Idaho, Oregon, and Washington from June to September 2022. The associations between CRC screening and four sets of individual and environmental factors specific to rural populations (i.e., demographic characteristics, accessibility, patient-provider factors, and psychological factors) were assessed among respondents with and without past telehealth adoption.

RESULT

Respondents with past telehealth use were more likely to screen if they were married, had a better health status, had experienced discrimination in health care, and had perceived susceptibility, screening efficacy, and cancer fear, but less likely to screen when they worried about privacy or had feelings of embarrassment, pain, and discomfort. Among respondents without past telehealth use, the odds of CRC screening decreased with busy schedules, travel burden, discrimination in health care, and lower perceived needs.

CONCLUSION

Rural individuals with and without previous telehealth experience face different barriers to CRC screening. The finding suggests the potential efficacy of telehealth in mitigating critical barriers to CRC screening associated with social, health care, and built environments of rural communities.

Mobilizing community-driven health promotion through community granting programs: a rapid systematic review

BACKGROUND

Effective health promotion responds to the unique needs of communities. Community granting programs that fund community-driven health promotion initiatives are a potential mechanism to meet those unique needs. While numerous community health-focused programs are available, the various strategies used by granting programs to foster engagement, administer grants and support awardees have not been systematically evaluated. This rapid systematic review explores the administration of community granting programs and how various program components impact process and population health outcomes.

METHODS

A systematic search was conducted across three databases: Medline, SocINDEX, and Political Science Database. Single reviewers completed screening, consistent with a rapid review protocol. Studies describing or evaluating community granting programs for health or public health initiatives were included. Data regarding program characteristics were extracted and studies were evaluated for quality. A convergent integrated approach was used to analyze quantitative and qualitative findings.

RESULTS

Thirty-five community granting programs, described in 36 studies, were included. Most were descriptive reports or qualitative studies conducted in the USA. Program support for grant awardees included technical assistance, workshops and training, program websites, and networking facilitation. While most programs reported on process outcomes, few reported on community or health outcomes; such outcomes were positive when reported. Programs reported that many funded projects were likely sustainable beyond program funding, due to the development of awardee skills, new partnerships, and securing additional funding. From the perspectives of program staff and awardees, facilitators included the technical assistance and workshops provided by the programs, networking amongst awardees, and the involvement of community members. Barriers included short timelines to develop proposals and allocate funds.

CONCLUSIONS

This review provides a comprehensive overview of health-related community granting programs. Grant awardees benefit from technical assistance, workshops, and networking with other awardees. Project sustainability is enhanced by the development of new community partnerships and grant-writing training for awardees. Community granting programs can be a valuable strategy to drive community health, with several key elements that enhance community mobilization.

REGISTRATION

PROSPERO #CRD42023399364.

Navigating the field of implementation science towards maturity: challenges and opportunities

BACKGROUND

The field of implementation science has significantly expanded in size and scope over the past two decades, although work related to understanding implementation processes have of course long preceded the more systematic efforts to improve integration of evidence-based interventions into practice settings. While this growth has had significant benefits to research, practice, and policy, there are some clear challenges that this period of adolescence has uncovered.

MAIN BODY

This invited commentary reflects on the development of implementation science, its rapid growth, and milestones in its establishment as a viable component of the biomedical research enterprise. The authors reflect on progress in research and training, and then unpack some of the consequences of rapid growth, as the field has grappled with the competing challenges of legitimacy among the research community set against the necessary integration and engagement with practice and policy partners. The article then enumerates a set of principles for the field's next developmental stage and espouses the aspirational goal of a "big tent" to support the next generation of impactful science.

CONCLUSION

For implementation science to expand its relevance and impact to practice and policy, researchers must not lose sight of the original purpose of the field-to support improvements in health and health care at scale, the importance of building a community of research and practice among key partners, and the balance of rigor, relevance, and societal benefit.

Physical and occupational therapists' perceptions of sustainability of a knowledge translation intervention to improve the use of outcome measures in inpatient rehabilitation: a qualitative study

PURPOSE

To assess the perceptions, barriers, and facilitators of sustaining the use of outcome measures of physical and occupational therapists following a three-year knowledge translation intervention.

METHODS

A phenomenological qualitative study was conducted at an inpatient rehabilitation hospital on 13 clinicians (6 physical therapists and 7 occupational therapists) participating in the knowledge translation intervention. Data collection used semi-structured interviewing during three focus groups to understand the lived experience of clinicians participating in the knowledge translation project. Data were analyzed using the Consolidated Framework for Implementation Research (CFIR) codebook.

RESULTS

Two investigators coded twelve CFIR constructs into barriers and facilitators for outcome measure use. Four key themes emerged as determinants for outcome measures use: (1) Organizational support and clinician engagement; (2) the knowledge translation intervention; (3) the outcome measures themselves; and (4) the patients. Clinicians reported using outcome measures for patient education, treatment planning, and goal setting, while they found other outcome measures lacked functional significance. Facilitators included organizational support, access to knowledge, ongoing training, and clinician engagement. Ongoing barriers included the need for more training and the need to select different tests.

CONCLUSIONS

This study found proper selection of outcomes measures is important and attributed the sustainability of the knowledge translation intervention to organizational support, clinician engagement and ongoing training. The clinicians wanted continued training to overcome new barriers. Barriers identified in this study were unique to the typical barriers identified for outcome measure use. Ongoing barrier assessments are needed for continued refinement of knowledge translation interventions to enhance sustainability.

ESSENCE: An Implementation Research Program to Scale Up Depression Care in Rural Communities

BACKGROUND

Task sharing may involve training nonspecialist health workers (NSHWs) to deliver brief mental health interventions. This approach is promising for reducing the global mental health treatment gap. However, capacity is limited for training large cadres of frontline workers in low- and middle-income countries, hindering uptake of these interventions at scale.

METHODS

The ESSENCE (enabling translation of science to service to enhance depression care) project in Madhya Pradesh, India, aims to address these challenges through two sequential randomized controlled trials. First, a training trial will evaluate the effectiveness and cost-effectiveness of digital training, compared with conventional face-to-face training, in achieving clinical competency of NSHWs in delivering an intervention for depression. This initial trial will be followed by an implementation trial aimed at evaluating the effectiveness of a remote enhanced implementation support, compared with routine implementation support, in addressing barriers to delivery of depression care in primary care facilities.

RESULTS

This project involved developing and pilot testing a scalable smartphone-based program for training NSHWs to deliver a brief psychological intervention for depression screening. This initial research guided a randomized trial of a digital training approach with NSHWs to evaluate the effectiveness of this approach. This trial will be followed by a cluster-randomized trial to evaluate the effectiveness of remote implementation support in ensuring efficient delivery of depression care in primary care facilities.

NEXT STEPS

Findings from these trials may inform sustainable training and implementation support models to integrate depression care into primary care for scale-up in resource-constrained settings.

The Opioid Response Project: An Effective Learning Collaborative for Local Communities?

The Opioid Response Project (ORP) was designed as an intensive 2-year health promotion learning collaborative grounded in the Collective Impact Model (CIM) to prepare ten local communities to address the opioid crisis. The purpose of this evaluation was to describe the ORP implementation, provide a summary of the evaluation results, share insights, and discuss implications. Results were informed by multiple data sources, including project documents, surveys, and interviews with members of the ORP and community teams. Based on process evaluation results, 100% of community teams reported being satisfied with the ORP and recommended this experience to others. ORP participation outputs ranged from new opioid response programs, to strengthened community teams, to receipt of additional funding. Based on the outcome evaluation, the ORP was effective at increasing community knowledge and capacity, promoting collaboration, and facilitating sustainability. This initiative is an example of an effective learning collaborative to curb the opioid epidemic at the community level. Participating communities found great value in working together as part of a larger cohort and reported benefits from the peer learning and support provided by the ORP. In particular, access to technical assistance, identification of engagement strategies within and across community teams, and a focus on sustainability are key practice components to be included in learning collaboratives designed to address large-scale public health issues.

Contextual Factors Influencing the Adoption of Physical Activity Direct Education and Policy, Systems, and Environmental Change Initiatives by Virginia EFNEP and SNAP-Ed Staff

OBJECTIVE

To explore factors influencing the adoption of direct education programs and policy, systems, and environmental (PSE) change initiatives focused on physical activity for Supplemental Nutrition Assistance Program-eligible audiences by Virginia Expanded Food and Nutrition Education Program and Supplemental Nutrition Assistance Program-Education (SNAP-Ed) staff.

METHODS

Online survey with Expanded Food and Nutrition Education Program and SNAP-Ed peer (paraprofessional) educators (n = 28) and SNAP-Ed agents (master of science level) (n = 9) in Virginia. Descriptive statistics were computed for sociodemographic characteristics and responses to questions on the basis of Likert-type scales. Exploratory factor analyses were run to identify the underlying structures of the different variables.

RESULTS

The main factors for peer educators were related to substituting nutrition programs or content for physical activity programs. Other factors included staff qualifications and expectations about leading vs teaching physical activities. For PSEs, the top factors were the capacity to reach many community members, attract new partners and stakeholders, and personal interest in the PSE.

CONCLUSIONS AND IMPLICATIONS

The results provide insight into potential barriers and motivators for adopting physical activity education and PSEs within community-based initiatives and can be used to inform program planning and staff training. Additional research is warranted to examine other factors influencing the adoption and implementation of physical activity programs and PSEs.

The effectiveness of community friendship groups on participant social and mental health: a meta-analysis

Introduction

Social disconnectedness and isolation are risk factors for poor mental health. Community-based friendship group interventions have been designed to increase an individual's social capital and consequently their mental wellbeing. Structured and unstructured friendship groups reflect two distinct approaches to friendship group interventions.

Methods

This meta-analysis investigated whether structured or unstructured community friendship groups are more effective for mental health and social capital outcomes. A systematic search of quantitative studies was conducted across seven databases and study quality was assessed using the Effective Public Health Practice Project (EPHPP) tool. Eight studies (2 unstructured and 6 structured friendship groups) were included in the review, published between 2005 and 2020.

Results

Structured friendship groups had a small significant effect on reducing participant depression symptoms. There was not enough available data to compare the effectiveness of structured and unstructured groups for mental health outcomes. There was substantial heterogeneity between studies to calculate pooled effect sizes for any social capital outcomes. Data synthesis indicated mixed reviews for social capital outcomes, likely due to the large heterogeneity and limited studies.

Discussion

This meta-analysis provides limited support for positive mental health outcomes following structured community-based friendship group interventions. There is a need for additional research as a large research gap remains, particularly for unstructured friendship groups.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=260639, CRD42021260639.

Mixed methods evaluation of the inaugural year of the Cancer Prevention and Control Research Network's (CPCRN) scholars program

PURPOSE

A diverse workforce trained in dissemination & implementation (D&I) science is critical for improving cancer outcomes and reducing cancer-related health disparities. This study aims to describe and evaluate impact of the Cancer Prevention and Control Research Network (CPCRN) Scholars Program in preparing scholars for collaborative careers in cancer control and implementation research and practice, and offers evaluation-driven recommendations for program improvements.

METHODS

The CPCRN Scholars Workgroup conducted a sequential, mixed methods evaluation. We collected baseline and follow-up surveys and invited all 20 scholars and ten mentors to participate in an exit interview. We assessed the experience with the Scholar's program, ratings of D&I competences, progress on their project, feedback about the curriculum, and understanding of implementation science.

RESULTS

Over 86% partially or fully completed their project within 9 months; 78% of scholars engaged with a CPCRN workgroup. Scholars rated the following program components as valuable: the Putting Public Health Evidence in Action (PPHEIA) training (88.9%), D&I training modules (83.3%), and webinars (kickoff webinar-88.9% and selecting theories/models-88.9%). There was an increase in D&I competencies from baseline to posttest, with the greatest in community engagement topics. About 78% reported that they were satisfied with format of the activities and increased confidence in ability to discuss D&I concepts. From the qualitative interviews, the benefit of the program was becoming more knowledgeable about D&I research and networking.

CONCLUSION

The inaugural year of the program yielded positive results, particularly related to increasing knowledge about D&I science and cancer control. This program builds the capacity of students, researchers and practitioners in D&I science.

Twenty years of capacity building across the cancer prevention and control research network

PURPOSE

To improve population health, community members need capacity (i.e., knowledge, skills, and tools) to select and implement evidence-based interventions (EBIs) to fit the needs of their local settings. Since 2002, the Centers for Disease Control and Prevention has funded the national Cancer Prevention and Control Research Network (CPCRN) to accelerate the implementation of cancer prevention and control EBIs in communities. The CPCRN has developed multiple strategies to build community members' capacity to implement EBIs. This paper describes the history of CPCRN's experience developing and lessons learned through the use of five capacity-building strategies: (1) mini-grant programs, (2) training, (3) online tools, (4) evidence academies, and (5) evaluation support for partners' capacity-building initiatives.

METHODS

We conducted a narrative review of peer-reviewed publications and grey literature reports on CPCRN capacity-building activities. Guided by the Interactive Systems Framework, we developed histories, case studies, and lessons learned for each strategy. Lessons were organized into themes.

RESULTS

Three themes emerged: the importance of (1) community-engagement prior to and during implementation of capacity-building strategies, (2) establishing and sustaining partnerships, and (3) co-learning at the levels of centers, networks, and beyond.

CONCLUSION

CPCRN activities have increased the ability of community organizations to compete for external funds to support implementation, increased the use of evidence in real-world settings, and promoted the broad-scale implementation of cancer control interventions across more than eight states. Lessons from this narrative review highlight the value of long-term thematic networks and provide useful guidance to other research networks and future capacity-building efforts.

Implementation studio: implementation support program to build the capacity of rural community health educators serving immigrant communities to implement evidence-based cancer prevention and control interventions

PURPOSE

Rural community-based organizations (CBOs) serving immigrant communities are critical settings for implementing evidence-based interventions (EBIs). The Implementation Studio is a training and consultation program focused on facilitating the selection, adaptation, and implementation of cancer prevention and control EBIs. This paper describes implementation and evaluation of the Implementation Studio on CBO's capacity to implement EBIs and their clients' knowledge of colorectal cancer (CRC) screening and intention to screen.

METHODS

Thirteen community health educators (CHEs) from two CBOs participated in the Implementation Studio. Both CBOs selected CRC EBIs during the Studio. The evaluation included two steps. The first step assessed the CHEs' capacity to select, adapt, and implement an EBI. The second step assessed the effect of the CHEs-delivered EBIs on clients' knowledge of CRC and intention to screen (n = 44).

RESULTS

All CHEs were Hispanic and women. Pre/post-evaluation of the Studio showed an increase on CHEs knowledge about EBIs (pre: 23% to post: 75%; p < 0.001). CHEs' ability to select, adapt, and implement EBIs also increased, respectively: select EBI (pre: 21% to post: 92%; p < 0.001), adapt EBI (pre: 21% to post: 92%; p < 0.001), and implement EBI (pre: 29% to post: 75%; p = 0.003). Pre/post-evaluation of the CHE-delivered EBI showed an increase on CRC screening knowledge (p < 0.5) and intention to screen for CRC by their clients.

CONCLUSION

Implementation Studio can address unique needs of low resource rural CBOs. An implementation support program with training and consultation has potential to build the capacity of rural CBOs serving immigrant communities to implementation of cancer prevention and control EBIs.

CLINICAL TRIALS REGISTRATION NUMBER

NCT04208724 registered.

Tailored implementation of the FICUS multicomponent family support intervention in adult intensive care units: findings from a mixed methods contextual analysis

BACKGROUND

The Family in Intensive Care UnitS (FICUS) trial investigates the clinical effectiveness of a multicomponent, nurse-led interprofessional family support intervention (FSI) and explores its implementation in intensive care units (ICUs). The local context of each ICU strongly influences intervention performance in practice. To promote FSI uptake and to reduce variation in intervention delivery, we aimed to develop tailored implementation strategies.

METHODS

A mixed method contextual analysis guided by the Consolidated Framework for Implementation Research (CFIR) was performed from March to June 2022 on eight ICUs assigned to the intervention group. ICU key clinical partners were asked to complete a questionnaire on CFIR inner setting measures (i.e., organizational culture, resources, learning climate and leadership engagement) and the Organizational Readiness for Implementing Change (ORIC) scale prior to group interviews, which were held to discuss barriers and facilitators to FSI implementation. Descriptive analysis and pragmatic rapid thematic analysis were used. Then, tailored implementation strategies were developed for each ICU.

RESULTS

In total, 33 key clinical partners returned the questionnaire and 40 attended eight group interviews. Results showed a supportive environment, with CFIR inner setting and ORIC measures each rated above 3 (scale: 1 low-5 high value), with leadership engagement scoring highest (median 4.00, IQR 0.38). Interview data showed that the ICU teams were highly motivated and committed to implementing the FSI. They reported limited resources, new interprofessional information exchange, and role adoption of nurses as challenging.

CONCLUSION

We found that important pre-conditions for FSI implementation, such as leadership support, a supportive team culture, and a good learning climate were present. Some aspects, such as available resources, interprofessional collaboration and family nurses' role adoption were of concern and needed attention. An initial set of implementation strategies were relevant to all ICUs, but some additions and adaptation to local needs were required. Multi-component interventions are challenging to implement within complex systems, such as ICUs. This pragmatic, theory-guided, mixed methods contextual analysis demonstrated high readiness and commitment to FSI implementation in the context of a clinical trial and enabled the specification of a tailored, multifaceted implementation strategy.

Global implementation research capacity building to address cardiovascular disease: An assessment of efforts in eight countries

Cardiovascular diseases are the leading causes of morbidity and mortality worldwide, but implementation of evidence-based interventions for risk factors such as hypertension is lacking, particularly in low and middle income countries (LMICs). Building implementation research capacity in LMICs is required to overcome this gap. Members of the Global Research on Implementation and Translation Science (GRIT) Consortium have been collaborating in recent years to establish a research and training infrastructure in dissemination and implementation to improve hypertension care. GRIT includes projects in Ghana, Guatemala, India, Kenya, Malawi, Nepal, Rwanda, and Vietnam. We collected data from each site on capacity building activities using the Potter and Brough (2004) model, mapping formal and informal activities to develop (a) structures, systems and roles, (b) staff and infrastructure, (c) skills, and (d) tools. We captured information about sites' needs assessments and metrics plus program adaptations due to the COVID-19 pandemic. All sites reported capacity building activities in each layer of the Capacity Pyramid, with the largest number of activities in the Skills and Tools categories, the more technical and easier to implement categories. All sites included formal and informal training to build Skills. All sites included a baseline needs assessment to guide capacity building activities or assess context and inform intervention design. Sites implementing evidence-based hypertension interventions used common implementation science frameworks to evaluate implementation outcomes. Although the COVID-19 pandemic affected timelines and in-person events, all projects were able to pivot and carry out planned activities. Although variability in the activities and methods used existed, GRIT programs used needs assessments to guide locally appropriate design and implementation of capacity building activities. COVID-19 related changes were necessary, but strong collaborations and relationships with health ministries were maintained. The GRIT Consortium is a model for planning capacity building in LMICs.

Similar skills, different frames: a thematic analysis exploring conceptualizations held by community-based organization practitioners and academics regarding skills to use evidence-based interventions to address cancer inequities

BACKGROUND

Community-based organizations (CBOs) are critical partners in delivering evidence-based interventions (EBIs) to address cancer inequities. However, CBO practitioners do not typically have access to opportunities to build the necessary capacity (skills, knowledge, motivation, and resources) for using EBIs. Although capacity-building interventions can offer a solution, inconsistent definitions and measurements of capacity limit the ability to develop and evaluate such efforts. We explored how and why conceptualizations of core skills for EBI use differ between practitioners and academics addressing cancer and other health inequities. We anchored the inquiry with a commonly used set of target skills for EBI capacity-building efforts.

METHODS

The study was conducted by an interdisciplinary team of academic researchers and CBO practitioners. We gathered data through semi-structured, hour-long interviews with practitioners and academics working to address cancer and other health inequities (n = 19). After hearing a brief vignette about a CBO addressing cervical cancer inequities, participants considered a widely accepted list of skills for EBI use that included assessing needs, engaging stakeholders, and selecting, adapting, implementing, evaluating, and sustaining the EBI. We used a team-based, reflexive thematic analysis approach grounded in critical and constructivist perspectives.

RESULTS

Overall, the original list resonated with practitioners and academics and they added new skills to the list (cultural humility and systems change). Practitioners' responses described skills from the reference point of addressing broader community needs and context and achieving change over the long term, emphasizing aspects of health promotion in their descriptions. Academics offered a mix of perspectives, with some focused on addressing community needs (and related flexibility regarding EBIs) but more emphasized skills needed to deliver a specific EBI to achieve a focused set of health and equity outcomes.

CONCLUSIONS

There is a significant opportunity to leverage complementary expertise and perspectives held by practitioners and academics addressing cancer inequities. However, the different frames utilized suggest proactive efforts will be required to find alignment across groups, particularly in valuing diverse contributions and identifying relevant outcomes of interest for each group. Such alignment is critical to designing effective capacity-building interventions and supporting the routine utilization of EBIs to address cancer inequities.

Priority skills for equity-focused, evidence-based cancer control in community-based organizations: A group concept mapping analysis with academics and practitioners

Introduction

Community-based organizations (CBOs) are important equity-promoting delivery channels for evidence-based interventions (EBIs). However, CBO practitioners often cannot access needed support to build EBI skills. Additionally, the capacity-building literature is hindered by inconsistent definitions, limited use of validated measures, and an emphasis on the perspectives of EBI developers versus implementers. To address these gaps, we explored commonalities and differences between CBO practitioners and academics in conceptualizing and prioritizing core EBI skills.

Methods

We utilized Group Concept Mapping, a mixed-methods approach connecting qualitative data (e.g., regarding the range of critical EBI skills) and quantitative data (e.g., sorting and ranking data regarding unique skills) to create conceptual maps integrating perspectives from diverse participants. A total of 34 practitioners and 30 academics working with cancer inequities participated in the study.

Results

Participants nominated 581 core skills for EBI use, and our team (including practitioners and academics) identified 98 unique skills from this list. Participants sorted them into conceptual groups, yielding five clusters: (1) using data and evaluation, (2) selecting and adapting EBIs, (3) connecting with community members, (4) building diverse and equitable partnerships, and (5) managing EBI implementation. The ordering of importance and presence of skill clusters were similar across groups. Overall, importance was rated higher than presence, suggesting capacity gaps.

Conclusions

There are helpful commonalities between practitioners' and academics' views of core EBI skills in CBOs and apparent capacity gaps. However, underlying patterns suggest that differences between the groups' perceptions warrant further exploration.

Technical Assistance and Training Needs of Comprehensive Cancer Control Programs: a Qualitative Analysis

The National Comprehensive Cancer Control Program (NCCCP) was established in 1998 by the Centers for Disease Control and Prevention (CDC) to advance national cancer control implementation across US states and affiliated tribes and territories. To build capacity of NCCCP recipients, technical assistance and training (TAT) is offered in the form of online trainings, webinars, toolkits, workshops, tip sheets, and other products. To determine TAT needs of NCCCP recipients, the George Washington University (GW) Cancer Center conducted a qualitative evaluation to inform TAT planning and implementation. Data on the utilization, applicability, impact, and dissemination of TAT received were collected from comprehensive cancer control practitioners through semi-structured interviews. Detailed memos of interviewee responses were documented and deductively coded based on three themes: promotion of TAT, use of existing TAT, and recommendations for future TAT. Interviewees reported a need for diverse topics, modalities, and TAT reminders. The most widely used TAT resources were social media toolkits, webinars, newsletters, patient navigation resources, and online trainings. Recommendations for future TAT included a focus on coalition support, adaptation and evaluation of evidence-based cancer control strategies, and health equity. Offering a blend of TAT, including educational webinars and trainings, was preferred by CCC professionals and could increase use. Future TAT will provide new opportunities for coalition capacity building, adaptation of evidence-based strategies for cancer control, and center health equity.

Keep It Up! 3.0: Study protocol for a type III hybrid implementation-effectiveness cluster-randomized trial

BACKGROUND

Despite evidence that eHealth approaches can be effective in reducing HIV risk, their implementation requirements for public health scale up are not well established, and effective strategies to bring these programs into practice are still unknown. Keep It Up! (KIU!) is an online program proven to reduce HIV risk among young men who have sex with men (YMSM) and ideal candidate to develop and evaluate novel strategies for implementing eHealth HIV prevention programs. KIU! 3.0 is a Type III Hybrid Effectiveness-Implementation cluster randomized trial designed to 1) compare two strategies for implementing KIU!: community-based organizations (CBO) versus centralized direct-to-consumer (DTC) recruitment; 2) examine the effect of strategies and determinants on variability in implementation success; and 3) develop materials for sustainment of KIU! after the trial concludes. In this article, we describe the approaches used to achieve these aims.

METHODS

Using county-level population estimates of YMSM, 66 counties were selected and randomized 2:1 to the CBO and DTC approaches. The RE-AIM model was used to drive outcome measurements, which were collected from CBO staff, YMSM, and technology providers. Mixed-methods research mapped onto the domains of the Consolidated Framework for Implementation Research will examine determinants and their relationship with implementation outcomes.

DISCUSSION

In comparing our implementation recruitment models, we are examining two strategies which have shown effectiveness in delivering health technology interventions in the past, yet little is known about their comparative advantages and disadvantages in implementation. The results of the trial will further the understanding of eHealth prevention intervention implementation.

Incorporating multiple data sources to assess changes in organizational capacity in child welfare systems

Three federally funded Child Welfare Capacity Building Centers provide services to build the organizational capacity of public child welfare agencies to help meet federal requirements, improve practice, and improve outcomes for children and families. The aim of this study was to explore capacity outcomes in five dimensions - resources, infrastructure, knowledge and skills, culture and climate, and engagement and partnership - achieved by child welfare jurisdictions who received Center services. Analyses describe the capacities targeted for improvement and the amount and type of services provided by Centers; assess the relationship between services and capacity increase; and explore whether that relationship differs depending on the jurisdiction's level of foundational capacity. Data collected through surveys and a service delivery tracking system reflect the perspectives of service recipients and service providers. Results reveal jurisdictions typically targeted capacity outcomes in the dimensions of knowledge and skills and infrastructure and received an average of 28 hours of direct services to support their capacity-building efforts. Dosage of service was positively associated with achievement of capacity outcomes, though no interaction was found between service dosage and foundational capacity in the effect on outcomes. Methodological lessons learned and implications for future evaluations of organizational capacity building efforts are offered.

A process for converting an in-person training to increase church capacity to implement physical activity and healthy eating practices and policies to an online format

The implementation of evidence-based public health programs into practice is critical for improving health, but trainings for organizational change agents are often not scalable. To describe the process of converting a training that targets faith-based organizational capacity development from an in-person to an online format. We engaged in an iterative process to convert the training delivery mode from in-person to online that included assessing stakeholder support, consulting the literature on best practices, seeking a design team, consolidating content, designing engaging lessons, and building an online site. Feedback from end-users and other audiences was incorporated throughout. Pilot participants with characteristics like intended training users were then recruited via community and faith-based partner networks. They rated their agreement with statements about the effectiveness as well as design and functionality of each lesson and the overall training (1 = strongly disagree, 5 = strongly agree) and participated in a structured follow-up interview. Nine pilot participants (representing 9 churches in 7 states; 6 African American, 5 with health ministries) rated the online lessons favorably (all ratings ≥ 4.5). Most (90.4%) perceived the lesson duration to be "just right" and spent 52.5 ± 9.9 minutes/lesson. Participants evaluated the overall training positively (all ratings ≥ 4.7). Lesson content, resources, multimedia, and program ideas were most-liked aspects of lessons, while content, staff responsiveness, discussion board, and pace were most-liked aspects of the overall training in open-ended and interview responses. This paper shares a replicable process for converting training modalities from in-person to online with the goal of increased scalability.

Getting to implementation: Adaptation of an implementation playbook

Introduction

Implementation strategies supporting the translation of evidence into practice need to be tailored and adapted for maximum effectiveness, yet the field of adapting implementation strategies remains nascent. We aimed to adapt "Getting To Outcomes"® (GTO), a 10-step implementation playbook designed to help community-based organizations plan and evaluate behavioral health programs, into "Getting To Implementation" (GTI) to support the selection, tailoring, and use of implementation strategies in health care settings.

Methods

Our embedded evaluation team partnered with operations, external facilitators, and site implementers to employ participatory methods to co-design and adapt GTO for Veterans Health Administration (VA) outpatient cirrhosis care improvement. The Framework for Reporting Adaptations and Modifications to Evidenced-based Implementation Strategies (FRAME-IS) guided documentation and analysis of changes made pre- and post-implementation of GTI at 12 VA medical centers. Data from multiple sources (interviews, observation, content analysis, and fidelity tracking) were triangulated and analyzed using rapid techniques over a 3-year period.

Results

Adaptations during pre-implementation were planned, proactive, and focused on context and content to improve acceptability, appropriateness, and feasibility of the GTI playbook. Modifications during and after implementation were unplanned and reactive, concentrating on adoption, fidelity, and sustainability. All changes were collaboratively developed, fidelity consistent at the level of the facilitator and/or implementer.

Conclusion

GTO was initially adapted to GTI to support health care teams' selection and use of implementation strategies for improving guideline-concordant medical care. GTI required ongoing modification, particularly in steps regarding team building, context assessment, strategy selection, and sustainability due to difficulties with step clarity and progression. This work also highlights the challenges in pragmatic approaches to collecting and synthesizing implementation, fidelity, and adaptation data.

Trial registration

This study was registered on ClinicalTrials.gov (Identifier: NCT04178096).

Mechanisms of change in external implementation support: A conceptual model and case examples to guide research and practice

Background

External implementation support (EIS) is a well-recognized feature of implementation science and practice, often under related terms such as technical assistance and implementation facilitation. Existing models of EIS have gaps related to addressing practice outcomes at both individual and organizational levels, connecting practice activities to intended outcomes, or grounding in well-established theories of behavior and organization change. Moreover, there have been calls to clarify the mechanisms of change through which EIS influences related outcomes.

Method

In this article, we theorize about mechanisms of change within EIS. Our theorizing process aligns with the approach advocated by Kislov et al. We aim to consolidate prior EIS literature, combining related constructs from previous empirical and conceptual work while drawing on our extensive EIS experience to develop a higher-order, midrange theory of change.

Results

Our theory of change is empirically and practically informed, conceptually situated within an established grand theory of change, and guided by eight practice principles and social cognitive theory. The theory of change proposes 10 core practice components as mechanisms of change within EIS. When used according to underlying theory and principles, they are believed to contribute to favorable practice outcomes at individual, team, organizational, and system levels. The model offers flexibility by recognizing the need for sequential support processes and the demand to practice in dynamic and responsive ways. Case examples are presented to illustrate major themes and patterns of the model in action.

Conclusions

The proposed model is intended to support prospective EIS studies by conceptualizing discernable practice components with hypothesized relationships to proximal and distal practice outcomes. The model can be behaviorally operationalized to compliment and extend competency-based approaches to implementation support practitioner (ISP) training and coaching. Over time, the model should be refined based on new empirical findings and contributions from ISPs across the field.

Use of implementation science to advance family planning programs in low- and middle-income countries: A systematic review

Objective

As environmental and economic pressures converge with demands to achieve sustainability development goals, low- and middle-income countries (LMIC) increasingly require strategies to strengthen and scale-up evidence-based practices (EBP) related to family planning (FP). Implementation science (IS) can help these efforts. The purpose of this article is to elucidate patterns in the use of IS in FP research and identify ways to maximize the potential of IS to advance FP in LMIC.

Design and methods

We conducted a systematic review that describes how IS concepts and principles have been operationalized in LMIC FP research published from 2007-2021. We searched six databases for implementation studies of LMIC FP interventions. Our review synthesizes the characteristics of implementation strategies and research efforts used to enhance the performance of FP-related EBP in these settings, identifying gaps, strengths and lessons learned.

Results

Four-hundred and seventy-two studies were eligible for full-text review. Ninety-two percent of studies were carried out in one region only, whereas 8 percent were multi-country studies that took place across multiple regions. 37 percent of studies were conducted in East Africa, 21 percent in West and Central Africa, 19 percent in Southern Africa and South Asia, respectively, and fewer than 5 percent in other Asian countries, Latin America and Middle East and North Africa, respectively. Fifty-four percent were on strategies that promoted individuals' uptake of FP. Far fewer were on strategies to enhance the coverage, implementation, spread or sustainability of FP programs. Most studies used quantitative methods only and evaluated user-level outcomes over implementation outcomes. Thirty percent measured processes and outcomes of strategies, 15 percent measured changes in implementation outcomes, and 31 percent report on the effect of contextual factors. Eighteen percent reported that they were situated within decision-making processes to address locally identified implementation issues. Fourteen percent of studies described measures to involve stakeholders in the research process. Only 7 percent of studies reported that implementation was led by LMIC delivery systems or implementation partners.

Conclusions

IS has potential to further advance LMIC FP programs, although its impact will be limited unless its concepts and principles are incorporated more systematically. To support this, stakeholders must focus on strategies that address a wider range of implementation outcomes; adapt research designs and blend methods to evaluate outcomes and processes; and establish collaborative research efforts across implementation, policy, and research domains. Doing so will expand opportunities for learning and applying new knowledge in pragmatic research paradigms where research is embedded in usual implementation conditions and addresses critical issues such as scale up and sustainability of evidence-informed FP interventions.Systematic Review Registration: https://www.crd.york.ac.uk/prospero/, identifier: CRD42020199353.

A scoping review of the evaluation and effectiveness of technical assistance

Background

Although the benefits of evidence-based practices (EBPs) for advancing community outcomes are well-recognized, challenges with the uptake of EBPs are considerable. Technical assistance (TA) is a core capacity building strategy that has been widely used to support EBP implementation and other community development and improvement efforts. Yet despite growing reliance on TA, no reviews have systematically examined the evaluation of TA across varying implementation contexts and capacity building aims. This study draws on two decades of peer-reviewed publications to summarize the evidence on the evaluation and effectiveness of TA.

Methods

Guided by Arksey and O’Malley’s six-stage methodological framework, we used a scoping review methodology to map research on TA evaluation. We included peer-reviewed articles published in English between 2000 and 2020. Our search involved five databases: Business Source Complete, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (ERIC), PsycInfo, and PubMed.

Results

A total of 125 evaluation research studies met the study criteria. Findings indicate that publications have increased over the last two decades, signaling a growth in the recognition and reporting of TA. Technical assistance is being implemented across diverse settings, often serving socially vulnerable and under-resourced populations. Most evaluation research studies involved summative evaluations, with TA outcomes mostly reported at the organizational level. Only 5% of the studies examined sustainability of TA outcomes. This review also demonstrates that there is a lack of consistent standards regarding the definition of TA and the level of reporting across relevant TA evaluation categories (e.g., cadence of contact, and directionality).

Conclusions

Advances in the science and practice of TA hinge on understanding what aspects of TA are effective and when, how, and for whom these aspects of TA are effective. Addressing these core questions requires (i) a standard definition for TA; (ii) more robust and rigorous evaluation research designs that involve comparison groups and assessment of direct, indirect, and longitudinal outcomes; (iii) increased use of reliable and objective TA measures; and (iv) development of reporting standards. We view this scoping review as a foundation for improving the state of the science and practice of evaluating TA.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00314-1.

Are Training and Experience Adapting Evidence-Based Interventions Associated With Self-Efficacy and Attitudes? A Cross-Sectional Survey of Students and Practitioners With Varying Levels of Adaptation Experience

Increasing use of evidence-based interventions (EBIs) in local settings will help reduce the research-practice gap and improve health equity. Because adaptation to new settings and populations is essential to effective EBI use, frameworks to guide practice are receiving more attention; most, however, only provide broad guidelines without instructions for making adaptations in practice. Therefore, practitioners may need additional training or technical assistance (TA) to implement and adapt EBIs. This study explores whether practitioners' and students' general EBI training or TA and level of adaptation experience are associated with self-efficacy in adapting EBIs and with attitudes toward EBI use. We analyzed baseline survey data of participants in an evaluation of IM-Adapt Online, a newly developed decision support tool. We asked about previous training on EBIs, general and specific adaptation behaviors, and attitudes toward EBIs and found an association between previous training or TA in using EBIs with higher self-efficacy for using and adapting EBIs. Respondents with prior EBI training were significantly more likely to have higher self-efficacy in EBI behaviors across subdomains and in total than those without training. Respondents reported lowest self-efficacy for planning adaptations (M = 3.35) and assessing fit of EBIs to their local context (M = 3.41). This study suggests the importance of EBI adaptation training and TA to increase adoption and adaptation of EBIs, subsequently. More adaptation-specific training is warranted to assist students, practitioners, and researchers undertaking the adaptation process and implement EBIs. Future training on EBI adaptation can help practitioners tailor EBIs to meet the specific needs of their populations.

Addressing Health Inequities: An Exploratory Assessment of Extension Educators' Perceptions of Program Demand for Diverse Communities

Land grant universities are a key provider of community-based health promotion programs through the Cooperative Extension Service. However, Extension's current approach to addressing systemic social determinants of health is incomplete and inconsistent. The purpose of this study was to explore Extension health educators' perceptions of demand for health promotion programming targeting audiences most likely to experience health inequities. Health educators within 2 state Extension systems were invited to complete an online survey based on a capacity building model. Survey questions included rating perceptions of demand for programming for health disparate populations: low-income; Black and African American; Hispanic, Latino/a, Latinx; persons with disabilities; immigrants and refugees; and lesbian, gay, bisexual, and transgender. Analysis of variance and Bonferroni post hoc testing was used to determine differences in perceived demand between populations. Ninety-six educators completed the survey. Perceived demand for low-income population programming was significantly higher than for other populations. Perceived programming demand for immigrants and refugees and lesbian, gay, bisexual, and transgender people was significantly lower than for other populations. Individual and organizational-level factors, including racism and Extension's historical scope, likely contribute to the results. Engaging historically excluded Extension audiences requires time and resources to improve the Extension system and educator capacity for relationship building, trust building, and communication.

Readiness as a precursor of early implementation outcomes: an exploratory study in specialty clinics

Background

Readiness has been identified as an essential precursor of successful implementation. However, evidence supporting its value is sparse. Empirical studies exploring the relationship between the application of readiness interventions, readiness levels, and implementation outcomes are lacking. The purpose of this study was twofold: (1) to evaluate the effectiveness of a readiness intervention (based on increases in readiness levels, changes in early implementation outcomes (i.e., acceptability, appropriateness, feasibility, and intent to adopt), and qualitative insights into the types of perceived outcomes) and (2) to assess the role of readiness as a predictor of these early implementation outcomes.

Methods

Seven healthcare specialty clinics engaged in a structured process to assess and build readiness for implementing a comprehensive medication management (CMM) service over a 10-month period. A mixed methods approach, which included surveys with healthcare stakeholders at each clinic (N = 27) and interviews with the lead pharmacists (N = 7), was used to evaluate the effectiveness of the readiness intervention (aim 1). Survey data were also used to conduct multiple regression models to assess the role of readiness as a predictor of early acceptability, appropriateness, feasibility, and intent to adopt CMM (aim 2).

Results

Significantly higher readiness levels, as well as higher scores on acceptability, appropriateness, feasibility, and intent to adopt, were reported as a result of engaging in the readiness intervention. However, upon closer examination, the direction of this association seemed to be dependent on the type of clinic. Qualitative data on the types of perceived outcomes resulting from engaging in the readiness intervention provided further insights into the potential reasons for these findings. Furthermore, post-readiness levels predicted between 44 and 68% of the variance in the early implementation outcomes. When accounting for clinic membership, readiness remained critical for service acceptability, feasibility, and intent to adopt but not for appropriateness.

Conclusion

These findings provide insights into the relationship between use of a readiness intervention, readiness levels, and early implementation outcomes. Engaging healthcare settings in a readiness intervention was beneficial in ways more complex than a simple positive linear relationship, highlighting the opportunity to broaden its purpose and expand definitions of readiness success. In addition, the importance of readiness levels in predicting early implementation outcomes, while critical, also seems to be highly dependent on context, particularly for appropriateness (fit).

Using readiness to understand implementation challenges in school mental health research

Schools and research partners are increasingly implementing complex, multicomponent interventions and school-wide frameworks to better meet students' social, emotional, behavioral, and academic needs; however, in the research and real-world contexts, implementation is often fraught with many challenges and barriers to success. This study explores implementation barriers encountered during a randomized controlled trial testing effects of one complex intervention strategy-the Interconnected Systems Framework-from the lens of a practical model for conceptualizing organizational readiness-the Interactive Systems Framework for Dissemination and Implementation. Implementation of the Interconnected Systems Framework was explored via focus group and key informant interviews with school and mental health professionals, and research team members responsible for implementing the intervention in randomly assigned study schools. Results from inductive thematic analysis of verbatim transcripts identified three primary implementation challenges: staff turnover, inadequate leadership buy-in, and insufficient time for training/planning. Each challenge is explored from interview participants' perspectives and the extant literature, then connected to recommendations from implementation science to help others avoid similar challenges in their well-intentioned efforts to address the mounting concern for students' wellbeing.

The Stroke Recovery in Motion Implementation Planner: Mixed Methods User Evaluation

Background

As more people are surviving stroke, there is a growing need for services and programs that support the long-term needs of people living with the effects of stroke. Exercise has many benefits; however, most people with stroke do not have access to specialized exercise programs that meet their needs in their communities. To catalyze the implementation of these programs, our team developed the Stroke Recovery in Motion Implementation Planner, an evidence-informed implementation guide for teams planning a community-based exercise program for people with stroke.

Objective

This study aimed to conduct a user evaluation to elicit user perceptions of the usefulness and acceptability of the Planner to inform revisions.

Methods

This mixed methods study used a concurrent triangulation design. We used purposive sampling to enroll a diverse sample of end users (program managers and coordinators, rehabilitation health partners, and fitness professionals) from three main groups: those who are currently planning a program, those who intend to plan a program in the future, and those who had previously planned a program. Participants reviewed the Planner and completed a questionnaire and interviews to identify positive features, areas of improvement, value, and feasibility. We used descriptive statistics for quantitative data and content analysis for qualitative data. We triangulated the data sources to identify Planner modifications.

Results

A total of 39 people participated in this study. Overall, the feedback was positive, highlighting the value of the Planner’s comprehensiveness, tools and templates, and real-world examples. The identified areas for improvement included clarifying the need for specific steps, refining navigation, and creating more action-oriented content. Most participants reported an increase in knowledge and confidence after reading the Planner and reported that using the resource would improve their planning approach.

Conclusions

We used a rigorous and user-centered process to develop and evaluate the Planner. End users indicated that it is a valuable resource and identified specific changes for improvement. The Planner was subsequently updated and is now publicly available for community planning teams to use in the planning and delivery of evidence-informed, sustainable, community-based exercise programs for people with stroke.

Leveraging academic initiatives to advance implementation practice: a scoping review of capacity building interventions

BACKGROUND

Academic institutions building capacity for implementation scholarship are also well positioned to build capacity in real world health and human service settings. How practitioners and policy makers are included and trained in implementation capacity-building initiatives, and their impact on building implementation practice capacity is unclear. This scoping review identified and examined features of interventions that build implementation practice capacity across researchers and practitioners or practitioners-in-training.

METHODS

Five bibliographic databases were searched. Eligible studies (a) described an implementation capacity building intervention with a connection to an academic institution, (b) targeted researchers and practitioners (including practitioners-in-training, students, or educators), and (c) reported intervention or participant outcomes. Articles that only described capacity building interventions without reporting outcomes were excluded. Consistent with Arksey and O'Malley's framework, key study characteristics were extracted (target participants, core components, and outcomes) and analyzed using open coding and numerical analysis.

RESULTS

Of 1349 studies identified, 64 met eligibility for full-text review, and 14 were included in the final analysis. Half of the studies described implementation capacity building interventions that targeted health or behavioral health researchers, practitioners, and practitioners-in-training together, and half targeted practitioners or practitioners-in-training only. The most common components included structured didactic activities offered in person or online, mentorship and expert consultation to support implementation, and practical application activities (e.g., field placements, case studies). Knowledge sharing activities and technical assistance were less common. All studies reported favorable outcomes related to knowledge attainment, increased ability to implement evidence, productivity, and satisfaction.

CONCLUSIONS

Building implementation capacity among practitioners is critical for integrating insights from implementation science into the field and preventing the "secondary" implementation research-to-practice gap. This scoping review identified several promising implementation practice capacity building interventions that tend to build practitioner capacity via expert led activities which may be relevant for academic institutions seeking to build implementation practice capacity. To avoid widening the implementation research-to-practice gap, implementation capacity building interventions are needed that target policy makers, expand beyond multiple practice settings, and leverage university/community partnerships or on-site academic medical centers. Future studies will also be needed to test the impact on service quality and public health outcomes.

Supporting community overdose response planning in Ontario, Canada: Findings from a situational assessment

BACKGROUND

Many communities across North America are coming together to develop comprehensive plans to address and respond to the escalating overdose crisis, largely driven by an increasingly toxic unregulated drug supply. As there is a need to build capacity for successful implementation, the objective of our mixed methods study was to identify the current planning and implementation practices, needs, and priority areas of support for community overdose response plans in Ontario, Canada.

METHODS

We used a situational assessment methodology to collect data on current planning and implementation practices, needs, and challenges related to community overdose response plans in Ontario, consisting of three components. Between November 2019 to February 2020, we conducted ten semi-structured key informant interviews, three focus groups with 25 participants, and administered an online survey (N = 66). Purposeful sampling was used to identify professionals involved in coordinating, supporting, or partnering on community overdose response plans in jurisdictions with relevant information for Ontario including other Canadian provinces and American states. Key informants included evaluators, representatives involved in centralised supports, as well as coordinators and partners on community overdose response plans. Focus group participants were coordinators or leads of community overdose response plans in Ontario.

RESULTS

Sixty-six professionals participated in the study. The current planning and implementation practices of community overdose response plans varied in Ontario. Our analysis generated four overarching areas for needs and support for the planning and implementation of community overdose response plans: 1) data and information; 2) evidence and practice; 3) implementation/operational factors; and 4) partnership, engagement, and collaboration. Addressing stigma and equity within planning and implementation of community overdose response plans was a cross-cutting theme that included meaningful engagement of people with living and lived expertise and meeting the service needs of different populations and communities.

CONCLUSIONS

Through exploring the needs and related supports for community overdose response plans in Ontario, we have identified key priority areas for building local capacity building to address overdose-related harms. Ongoing development and refinement, community partnership, and evaluation of our project will highlight the influence of our supports to advance the capacity, motivation, and opportunities of community overdose response plans.

Utilizing Causal Loop Diagramming to Explore a Research and Evaluation Capacity Building Partnership

The capacity to engage in research, evaluation and evidence-informed decision-making supports effective public health policy and practice. Little is known about partnership-based approaches that aim to build capacity across a system or how to evaluate them. This study examines the impacts of a research and evaluation capacity building partnership called the Western Australian Sexual Health and Blood-borne Virus Applied Research and Evaluation Network (hereafter, SiREN). SiREN aims to strengthen capacity across a system of clinical and medical services and government and non-government organizations. These organizations are connected through their shared aim of preventing and managing sexually transmissible infections and blood-borne viruses. To examine SiREN, systems concepts and methods were used. Data were collected from SiREN organizational documents (n = 42), a survey tool (n = 104), in-depth interviews (n = 17), a workshop and three meetings with SiREN stakeholders and used to develop two causal loop diagrams. Findings show engagement with SiREN was influenced by a complex interplay of contextual (e.g., organizational capacity) and process (e.g., presence of trusting relationships) factors. SiREN contributed to system level changes, including increased resources for research and evaluation, the development of networks and partnerships that led to more efficient responses to emerging health issues, evidence sharing, and sustainable research and evaluation practice. The use of causal loop diagrams enabled the identification of key leverage points that SiREN can use for continuous improvement or evaluation. The focus on how contextual factors influenced SiREN's ability to create change provides valuable information for researchers, policymakers or practitioners seeking to develop a similar partnership.

M.I.C.A.H. Project HEAL: Sustainability of a Faith-Based Community Health Advisor Training Program in Urban Underserved Communities in the USA

Faith-based organizations (FBOs) can play an important role in improving health outcomes. Lay community health advisors (CHAs) are integral to these efforts. This paper assesses the sustainability of a CHA training program for congregants in African-American and Latino FBOs and subsequent implementation of educational workshops. The program is unique in that a health care chaplain in an academic medical center was central to the program's development and implementation. Forty-eight CHAs in 11 FBOs were trained to teach workshops on cardiovascular health, mental health, diabetes, and smoking cessation. Two thousand four hundred and forty-four participants attended 70 workshops. This program has the potential to be a model to educate individuals and to address health inequities in underserved communities. Health care chaplains in other medical centers may use this as a model for enhancing community engagement and education.

Implementation Strategies to Support Built Environment Approaches in Community Settings

BACKGROUND

Built environment approaches are recommended to improve population physical activity levels. Implementation strategies are needed to improve uptake, but little is known about effective strategies to translate research to practice in community settings.

PURPOSE

Inform implementation strategies through understanding delivery agents' perceptions of (1) built environment approaches, (2) a toolkit developed to support implementation, and (3) other required implementation strategies.

METHOD

A toolkit was developed to detail the process of partnering to change the built environment and provide examples of built environment approaches (e.g., walking paths, traffic calming). Data were collected through focus groups (N = 3) with Extension Agents (n = 46) in 2020. The semi-structured focus group script was based on the Consolidated Framework for Implementation Research and the Technology Acceptance model. Rapid content analysis techniques and a deductive, grounded theory approach were used to interpret the data. Results. Focus groups generated meaning units coded into themes of perceptions of the intervention (subthemes: barriers, resources needed, and facilitators) and perceptions of the toolkit (subthemes: components to add, positive perceptions, and helpful components). The most common resources needed were coalition guidance and funding.

CONCLUSION

Agents experience barriers and facilitators to implementing built environment approaches and have specific needs for support. Based on the results, we created implementation strategies: (1) Places for Physical Activity toolkit, (2) Coalition Coaching, and (3) Mini-Grants. Future work is needed to investigate the effectiveness of these implementation strategies.

Connecting Implementation Science, Community-Engaged Research, and Health Promotion to Address Cancer Inequities in Massachusetts: The UMB/DF-HCC U54 Outreach Core

The Outreach Core of the U54 Partnership between the Dana-Farber/Harvard Cancer Center and the University of Massachusetts Boston created a new model for addressing cancer inequities that integrates implementation science, community-engaged research, and health promotion. Key elements of the approach include engaging a Community Advisory Board, supporting students from underrepresented minority backgrounds to conduct health promotion and community-engaged research, increasing the delivery of evidence-based cancer prevention programs to underserved communities (directly and by training local organizations), supporting research-practice partnerships, and disseminating findings. Our model highlights the need for long-term investments to connect underserved communities with evidence-based cancer prevention.

A pragmatic evaluation of a public health knowledge broker mentoring education program: a convergent mixed methods study

BACKGROUND

Public health professionals are expected to use the best available research and contextual evidence to inform decision-making. The National Collaborating Centre for Methods and Tools developed, implemented, and evaluated a Knowledge Broker mentoring program aimed at facilitating organization-wide evidence-informed decision-making in ten public health units in Ontario, Canada. The purpose of this study was to pragmatically assess the impact of the program.

METHODS

A convergent mixed methods design was used to interpret quantitative results in the context of the qualitative findings. A goal-setting exercise was conducted with senior leadership in each organization prior to implementing the program. Achievement of goals was quantified through deductive coding of post-program interviews with participants and management. Interviews analyzed inductively to qualitatively explain progress toward identified goals and identify key factors related to implementation of EIDM within the organization.

RESULTS

Organizations met their goals for evidence use to varying degrees. The key themes identified that support an organizational shift to EIDM include definitive plans for participants to share knowledge during and after program completion, embedding evidence into decision-making processes, and supportive leadership with organizational investment of time and resources. The location, setting, or size of health units was not associated with attainment of EIDM goals; small, rural health units were not at a disadvantage compared to larger, urban health units.

CONCLUSIONS

The Knowledge Broker mentoring program allowed participants to share their learning and support change at their health units. When paired with organizational supports such as supportive leadership and resource investment, this program holds promise as an innovative knowledge translation strategy for organization wide EIDM among public health organizations.

Supporting Community Partners in Reducing HIV-Related Health Disparities: Technical Assistance Across a Spectrum of Intensity

The HIV epidemic remains a public health threat in the U.S., and the dissemination and implementation of evidence-based prevention and care programs are critical to addressing significant HIV health disparities. The provision of technical assistance (TA) to program providers and evaluators is key for uptake of these programs. The University of California San Francisco Prevention Research Center (UCSF PRC) model for TA delivery uses topics and strategies adapted to address HIV health disparities for a global audience. This model specifically matches TA requests to a TA provider who has expertise in that area upon receiving a request through various communication channels. Areas of expertise include research methods, community engagement strategies, interventions, and Implementation Sciences. Our evaluation of diverse TA services indicates that on-demand TA is effective for light-touch requests and well-suited for moderate to intensive requests. The model is a promising, broad-reaching, and responsive alternative for providing TA to a multitude of HIV workforce recipients.

Moving from Implementation Science to Implementation Practice: The Need to Solve Practical Problems to Improve Behavioral Health Services

It is well recognized that the use of evidence-based practices (EBPs) is critical to improving service outcomes for those receiving behavioral health services. However, EBPs are not easily implemented in behavioral health settings, and there are many challenges to supporting these services over time. Recently, research efforts in implementation science (IS) have greatly expanded our understanding of issues that influence the successful implementation of EBPs. Unfortunately, less effort has been devoted to translating this research theory on a practical level to help individual service entities solve the specific problems of putting programs into place. A process is needed where service organizations and practitioners can build their capacity, informed by IS research, to improve service outcomes. The purpose of this commentary is to describe the IS research base, provide an introduction to implementation practice, describe challenges confronting practitioners, and propose necessary steps in building organizational capacity that enables practitioners to implement the most effective services available.

Measuring capacity to use evidence-based interventions in community-based organizations: A comprehensive, scoping review

Introduction:

Community-based organizations (CBOs) are well-positioned to incorporate research evidence, local expertise, and contextual factors to address health inequities. However, insufficient capacity limits use of evidence-based interventions (EBIs) in these settings. Capacity-building implementation strategies are popular, but a lack of standard models and validated measures hinders progress in the field. To advance the literature, we conducted a comprehensive scoping review.

Methods:

With a reference librarian, we executed a comprehensive search strategy of PubMed/Medline, Web of Science Core Collection, and EBSCO Global Health. We included articles that addressed implementation science, capacity-building, and CBOs. Of 5527 articles, 99 met our inclusion criteria, and we extracted data using a double-coding process

Results:

Of the 99 articles, 47% defined capacity explicitly, 31% defined it indirectly, and 21% did not define it. Common concepts in definitions were skills, knowledge/expertise, and resources. Of the 57 articles with quantitative analysis, 48 (82%) measured capacity, and 11 (23%) offered psychometric data for the capacity measures. Of the 99 studies, 40% focused exclusively on populations experiencing inequities and 22% included those populations to some extent. The bulk of the studies came from high-income countries.

Conclusions:

Implementation scientists should 1) be explicit about models and definitions of capacity and strategies for building capacity, 2) specify expected multi-level implementation outcomes, 3) develop and use validated measures for quantitative work, and 4) integrate equity considerations into the conceptualization and measurement of capacity-building efforts. With these refinements, we can ensure that the necessary supports reach CBO practitioners and critical partners for addressing health inequities.

Capacity building in participatory stakeholder groups: results from a German research consortium on active lifestyles

To implement sustainable health-promoting structures in a setting, various agents must work together. In the Capital4Health research network, participatory stakeholder groups consisting of key persons, stakeholders, representatives of the target group, and facilitating experts are assembled in five settings (child care center, school, company, rural community, nursing home). In a Cooperative Planning process, the various groups meet regularly to plan and implement strategies to promote physical activity across different settings. This study evaluates whether participatory stakeholder groups have been established and also examines the capacity-building processes that took place in these stakeholder groups. For process evaluation, 78 group meetings were documented in 16 different stakeholder groups using a semi-structured protocol based on established capacity-building domains. For outcome evaluation, six semi-structured interviews (1-2 per setting) with facilitating experts were conducted. Data were analyzed by content analysis. Across all settings, capacity-building processes were successful to a certain degree (e.g. problem assessment, resource mobilization). However, in most groups it was difficult to broadly assess problems, to establish sustainable networks, or to find persons with leadership characteristics. Also, irregular participation, lack of motivation to take over responsibility, and minimal institutional readiness for structural and personal changes often hindered the progress of the projects. Stakeholder groups can actively involve setting members in the development of physical activity promotion programs. It seems challenging, however, to sustainably establish such groups that continue working independently without assistance from a facilitating expert.

A knowledge broker facilitated intervention to improve the use of standardized assessment tools by physical therapists: A cluster randomized trial

OBJECTIVE

To compare two methods of knowledge broker support to improve standardized assessment use.

DESIGN

Two-site cluster randomized trial.

SETTING

Acute rehabilitation hospital.

PARTICIPANTS

18 physical therapists.

INTERVENTION

A 10-month intervention was collaboratively designed with an external knowledge broker and physical therapists to compare full and partial implementation support. The knowledge broker provided education and strategies for implementation to the fully supported group and recommended strategies to the partially supported group that they self-implemented.

MEASUREMENT

Chart audit data documenting frequency of use was extracted at four timepoints. Ten focus groups were conducted to describe factors that influenced use. Focus group data were coded using the Consolidated Framework for Implementation Research and rated as barriers and facilitators for standardized assessment use.

RESULTS

For the fully supported group, standardized assessment use at initial examination increased from 0% to 58.3% at month 2 and decreased to 17.6% and 11.8% at months 4 and 8-10. For the partially supported group, standardized assessment use increased from 0% to 46% and 50% at month 2 and 4 and decreased to 2.8% at months 8-10. For both groups, early use was seen multiple facilitators. At month 10, barriers included organizational changes that impacted intervention fit. In addition, the fully supported group didn't value the selected standardized assessment and the partially supported group lacked space.

CONCLUSIONS

Knowledge broker support improved both groups standardized assessment use early on, but it was not sustained. The amount of support could not be isolated as factors that influenced use varied by groups.

Quality improvement studies in nursing homes: a scoping review

BACKGROUND

Quality improvement (QI) is used in nursing homes (NH) to implement and sustain improvements in patient outcomes. Little is known about how QI strategies are used in NHs. This lack of information is a barrier to replicating successful strategies. Guided by the Framework for Implementation Research, the purpose of this study was to map-out the use, evaluation, and reporting of QI strategies in NHs.

METHODS

This scoping review was completed to identify reports published between July 2003 through February 2019. Two reviewers screened articles and included those with (1) the term "quality improvement" to describe their methods, or reported use of a QI model (e.g., Six Sigma) or strategy (e.g., process mapping) (2), findings related to impact on service and/or resident outcomes, and (3) two or more NHs included. Reviewers extracted data on study design, setting, population, problem, solution to address problem, QI strategies, and outcomes (implementation, service, and resident). Vote counting and narrative synthesis were used to describe the use of QI strategies, implementation outcomes, and service and/or resident outcomes.

RESULTS

Of 2302 articles identified, the full text of 77 articles reporting on 59 studies were included. Studies focused on 23 clinical problems, most commonly pressure ulcers, falls, and pain. Studies used an average of 6 to 7 QI strategies. The rate that strategies were used varied substantially, e.g., the rate of in-person training (55%) was more than twice the rate of plan-do-study-act cycles (20%). On average, studies assessed two implementation outcomes; the rate these outcomes were used varied widely, with 37% reporting on staff perceptions (e.g., feasibility) of solutions or QI strategies vs. 8% reporting on fidelity and sustainment. Most studies (n = 49) reported service outcomes and over half (n = 34) reported resident outcomes. In studies with statistical tests of improvement, service outcomes improved more often than resident outcomes.

CONCLUSIONS

This study maps-out the scope of published, peer-reviewed studies of QI in NHs. The findings suggest preliminary guidance for future studies designed to promote the replication and synthesis of promising solutions. The findings also suggest strategies to refine procedures for more effective improvement work in NHs.