A scoping review of the evaluation and effectiveness of technical assistance

Using capacity assessments and tailored technical assistance to advance trauma informed care integration at the organizational level

BACKGROUND

The prevalence of trauma among individuals with HIV has prompted efforts to integrate trauma-informed care (TIC) into HIV care and treatment to improve health outcomes. A TIC Implementation Model, developed by a US capacity-building organization focuses on organizational changes, aligning cultural and physical environments, emphasizing values like safety and trustworthiness, engaging leadership, and training staff in skills-based TIC services. Despite growing research, gaps remain in understanding the relationship between organizational capacity, provider knowledge, and the dosage of technical assistance (TA) required to sustain TIC integration. Researchers investigated how the project team adapted the type and amount of TA based on initial Cultural Assessment scores (measuring core TIC values) and its impact on Implementation Status scores.

METHODS

This study focuses on eight of 20 HIV care agencies in New Jersey that had largely met their TIC implementation goals by Spring 2022. As part of the TIC Implementation Model to measure agency capacity and implementation progress over time, agency staff and clients completed a Cultural Assessment (n = 72) and Physical Assessment (n = 43); staff completed a Pre/Post Training Survey (n = 296); and implementation teams at 8 agencies completed an Implementation Status Assessment Tool. Additionally, TA Logs capturing the details of TA meetings with the eight agencies were recorded by project staff. Data from these tools were analyzed in aggregate by agency using descriptive and correlational analyses.

RESULTS

Results demonstrated responsive TA correlated with agencies' baseline capacity. Agencies with lower capacity received significantly more frequent and extended TA encounters, which were associated with higher implementation scores and improvements in cultural environments for staff and clients (e.g., new protocols for staff response plans).

CONCLUSIONS

These findings underscore the importance of tailored TA in fostering diverse organizational cultures conducive to TIC implementation. For HIV care agencies, successful TIC implementation can impact health behaviors and outcomes for clients impacted by trauma. The TIC Implementation Model significantly advanced organizations' ability to transform their culture and systems, increasing their capacity to implement and sustain TIC integration. These results align with existing research that emphasizes when time is invested to shift organizational culture and develop leadership, new practices can effectively be implemented and scaled-up.

Development of a remote implementation support strategy to enhance integration of depression treatment into primary care settings in rural India

Introduction

Contextually responsive implementation support strategies are needed to enhance the integration of mental health services into primary health care. Technical assistance is widely used as a core "capacity building" strategy, primarily for increasing the motivation and capacity of individuals (e.g., frontline workers) to adopt evidence-based interventions in healthcare settings. This article documents the systematic design of a technical assistance strategy for supporting primary care staff (e.g., nurses) in integrating depression care, from screening to treatment, aligned with a non-communicable disease program across seven health facilities in the Sehore District of Madhya Pradesh, India.

Methods

We conducted a mapping exercise of local health facilities with dedicated staff and a literature review to inform the development of the technical assistance strategy.

Results

Reporting guidelines guided the structure of the strategy protocol. The evidence-supported strategy, called Remote Coaching Support, is tailored to the local setting. It uses quality improvement methods like the Plan-Do-Act-Study cycle and training materials to help coaches deliver support remotely via video/phone-based calls and WhatsApp messaging with the overall goal of increasing uptake and fidelity of depression screening and referral among primary care staff in alignment with an existing non-communicable diseases program.

Conclusion

The development of Remote Coaching Support involved iterative improvements through team meetings and practice-training feedback, though limitations exist due to a lack of systematic implementation standards, especially in this setting. This strategy will be tested in increasing scales to refine its application, with effectiveness and acceptability results to be evaluated in a randomized control trial.

Barriers and Facilitators to Adopting a Systematic, Proactive, Evidence-Informed Technical Assistance System

This article describes (a) key elements of a high-quality technical assistance (TA) system; (b) the operationalization of a high-quality TA system (Getting To Outcomes-Technical Assistance; GTO-TA) being implemented in a training and TA center (TTAC) interested in transforming its support services to include an evidence-informed approach to TA; and (c) key lessons learned in successfully transitioning from "TA-as-usual" to an evidence-informed TA system. GTO-TA is one operationalization of a systematic, proactive, evidence-informed approach to TA. GTO-TA includes best practices and core elements for a comprehensive TA system; it aims to increase the readiness (reduce barriers and increase facilitators) of an organization to deliver an innovation (program, policy, practice, and process new to an organization) with quality. We describe the collaboration between the Wandersman Center and the Geographic Health Equity Alliance team to co-design and implement the GTO-TA system. Data from surveys, interviews, and consensus conversations led to important lessons learned, which are applicable to other TTACs seeking to develop a more proactive and systematic approach to TA. Lessons include: changing internal operations to facilitate TA providers making necessary changes in providing TA and understanding the relative advantage perceptions about a new TA system that influence adoption and must be considered.

Developing a Set of Standardized Core Principles and Methods Across Multiple Training and Technical Assistance Centers

Despite a growing body of research demonstrating the value of using evidence-based programs and practices (EBPPs) to address health and education issues, the gap between research evidence and practice in education and human services continues to be a vexing problem. Technical assistance (TA) is widely accepted as a key strategy to support evidence-based programs and practices (EBPP) uptake and implementation. However, little is known about how TA practices are used in TA delivery. Moreover, little attention has been paid to building the capacity of TA providers and assessing the fidelity of the implementation of TA practices. The case example presented in this article describes one organization's efforts to develop common language and definitions of TA services, core principles, and methods, and to standardize the delivery of TA by enhancing the capacity and retention of TA providers. We conclude with recommendations about how like organizations can employ similar efforts to improve the quality and consistency of TA delivery, thereby establishing a foundation for building a strong evidence base.

Development of the Technical Assistance Engagement Scale: a modified Delphi study

BACKGROUND

Technical assistance (TA) is a tailored approach to capacity building that is commonly used to support implementation of evidence-based interventions. Despite its widespread applications, measurement tools for assessing critical components of TA are scant. In particular, the field lacks an expert-informed measure for examining relationship quality between TA providers and recipients. TA relationships are central to TA and significantly associated with program implementation outcomes. The current study seeks to address the gap in TA measurement tools by providing a scale for assessing TA relationships.

METHODS

We utilized a modified Delphi approach involving two rounds of Delphi surveys and a panel discussion with TA experts to garner feedback and consensus on the domains and items that compose the TA Engagement Scale.

RESULTS

TA experts represented various U.S. organizations and TA roles (e.g., provider, recipient, researcher) with 25 respondents in the first survey and 26 respondents in the second survey. The modified Delphi process resulted in a scale composed of six domains and 22 items relevant and important to TA relationships between providers and recipients.

CONCLUSION

The TA Engagement Scale is a formative evaluation tool intended to offer TA providers the ability to identify strengths and areas for growth in the provider-recipient relationship and to communicate about ongoing needs. As a standard measurement tool, it lends a step toward more systematic collection of TA data, the ability to generate a more coherent body of TA evidence, and enables comparisons of TA relationships across settings.

Feasibility, acceptability, and appropriability of a national whole-school program for reducing school violence and improving school coexistence

Introduction

The increase in school violence following the COVID-19 pandemic underscores the need for schools to adopt a multilevel whole-school approach. This study examines a national program designed by the Chilean Ministry of Education, in collaboration with universities, as part of the Ministry's Educational Reactivation Plan, aimed at improving school climate management across Chile.

Methods

The "Learning to Live Together Program" (LLT) was implemented across all 16 regions of Chile, focusing on establishing school climate networks, providing direct intensive university technical assistance, and enhancing professional development and training. The feasibility, acceptability, and appropriability of the LLT program were assessed through a survey distributed to 1,561 staff members from 783 schools. Participants responded to a comprehensive set of instruments measuring acceptability, appropriability, feasibility, attitudes toward implementation, fidelity, and initial perceived results.

Results

The results indicate high initial adoption rates and significant improvements in the assessed dimensions. The enhancement of school climate practices and strengthening school collaboration networks were of considerable relevance.

Discussion

These findings support the efficacy of the multilevel whole-school approach as a viable strategy for Latin American countries, providing critical data for educational and governmental decision-making. Furthermore, this study provides evidence that these outcomes may be applicable to the implementation of similar policies in different contexts and countries.

Using technical assistance to bridge the gap between policy, research, and implementation

This case study on the Children, Youth, and Families At-Risk (CYFAR) Professional Development and Technical Assistance (PDTA) Center highlights a government-funded entity's efforts to provide technical assistance to federal grantees of the CYFAR Sustainable Community Projects (SCP) grant program. The PDTA Center aligns with and supports components of an evidence-based system for innovation support. Through these components, the system provides targeted tools, training for CYFAR SCP grantees, dedicated technical assistance in the form of coaching, and quality improvement support through the evaluation of available program data.

Technical Assistance for Systemic Change: Lessons Learned From a National Technical Assistance Center

Despite the millions of dollars awarded annually by the United States Department of Education to build implementation capacity through technical assistance (TA), data on TA effectiveness are severely lacking. Foundational to the operationalization and consistent research on TA effectiveness is the development and use of standardized TA core competencies, practices, and structures. Despite advances toward a consistent definition of TA, a gap still exists in understanding how these competencies are used within an operationalized set of TA practices to produce targeted outcomes at both individual and organizational levels to facilitate implementation of evidence-based practices. The current article describes key insights derived from the evaluation of an operationalized set of TA practices used by a nationally funded TA center, the State Implementation & Scaling Up of Evidence Based Practices (SISEP) Center. The TA provided by the Center supports the uptake of evidence-based practices in K-12 education for students with disabilities. Lessons learned include: (1) the need to understand the complexities and dependencies of operationalizing TA both longitudinally and at multiple levels of the system (state, regional, local); (2) the relative importance of building general and innovation-specific capacity for implementation success; (3) the value of using a co-design and participatory approach for effective TA delivery; (4) the need to develop TA providers' educational and implementation fluency across areas and levels of the system receiving TA; and (5) the need to ensure coordination and alignment of TA providers from different centers. Gaining an understanding into optimal TA practices will not only provide clarity of definition fundamental to TA research, but it will also inform the conceptual framing and practice of TA.

Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA.

The Role of Cooperative Extension in Delivering Training and Technical Assistance to Support Evidence-Based Behavioral Health Practices in Rural Communities

The opioid epidemic in the United States continues to disproportionately affect those in rural, compared to urban, areas due to a variety of treatment and recovery barriers. One mechanism to increase capacity of rural-serving providers is through delivery of training and technical assistance (TTA) for evidence-based programs by leveraging the Cooperative Extension System. Guided by the Interactive Systems Framework, the current study evaluates TTA delivered by the Northwest Rural Opioid Technical Assistance Collabroative to opioid prevention, treatment, and recovery providers on short- (satisfaction, anticipated benefit), medium-, (behavioral intention to change current practice), and long-term goals (changes toward adoption of evidence-based practices). We also evaluated differences in short- and medium-term goals by intensity of TTA event and rurality of provider. Surveys of 351 providers who received TTA indicated high levels of satisfaction with TTA events attended, expressed strong agreement that they would benefit from the event, intended to make a professional practice change, and preparation toward implementing changes. Compared to urban-based providers, rural providers reported higher intention to use TTA information to change current practice. We conclude with a review of remaining gaps in the research to practice pipeline and recommendations for moving forward.

Unpacking Technical Assistance (TA) Strategies Within a State-Level Prevention Support System: A Mixed-Method Study in Determining Types and Amount of TA

The research-practice gap between evidence-based intervention efficacy and its uptake in real-world contexts remains a central challenge for prevention and implementation science. Providing technical assistance (TA) is considered a crucial support mechanism that can help narrow the gap. However, empirical measurement of TA strategies and their variation is often lacking. The current study unpacks the black box of TA, highlighting different TA strategies, amounts, and their relation to intervention characteristics. First, we qualitatively categorized interactions between TA providers and implementers. Second, we explored how characteristics of implementing organizations and the intervention related to variations in the amount of TA delivered. Using data spanning six years, we analyzed over 10,000 encounters between TA providers and implementers. Content analysis yielded four distinct strategies: Consultation (27.2%), Coordination Logistics (24.5%), Monitoring (16.5%), and Resource Delivery (28.2%). Organizations with prior experience required less monitoring and resource delivery. Additionally, characteristics of the intervention were significantly associated with the amount of consultation, monitoring, coordination logistics, and resource delivery provided. The specific features of the intervention showed significant variation in their relation to TA strategies. These findings provide initial insights into the implications of intervention characteristics in determining how much of which TA strategies are needed to support implementations in real-world settings.

Supporting Implementation Through Online Learning Communities: Lessons Learned From a National Training and Technical Assistance Network

Recent implementation science frameworks highlight the role of training and technical assistance (TTA) in building workforce capacity to implement evidence-based practices (EBPs). However, evaluation of TTA is limited. We describe three case examples that highlight TTA by three regional centers in the national Mental Health Technology Transfer Center (MHTTC) network. Each MHTTC formed Learning Communities (LCs) to facilitate connections among behavioral health professionals with the goals of sharing implementation strategies, discussing best-practices, and developing problem solving techniques. Data on outcomes were collected through a combination of self-report surveys and qualitative interviews. LC participants reported strong connectedness, gains in knowledge and skills, improvements in implementation capacity, and intentions to advocate for organizational and systems-level change. Furthermore, across the case examples, we identified LC characteristics that are associated with participant perceptions of outcomes, including tailoring LC content to workforce needs, providing culturally relevant information, engaging leaders, forming connections among participants and trainers, and challenging participants' current workplace practices. These findings are interpreted through the lens of the Interactive Systems Framework, which focuses on how TTA, such as LCs, can facilitate connections between the theoretical and empirical foundations of interventions and the practices of implementing interventions in real-world settings to advance workforce capacity.

How do the Substance Abuse and Mental Health Services Administration's Technology Transfer Centers Decide What Evidence-Based Practices to Disseminate and Determine How to Do So? A Cross-Sectional Study of a National Network

It is important to use evidence-based programs and practices (EBPs) to address major public health issues. However, those who use EBPs in real-world settings often require support in bridging the research-to-practice gap. In the US, one of the largest systems that provides such support is the Substance Abuse and Mental Health Services Administration's (SAMHSA's) Technology Transfer Center (TTC) Network. As part of a large external evaluation of the Network, this study examined how TTCs determine which EBPs to promote and how to promote them. Using semi-structured interviews and pre-testing, we developed a "Determinants of Technology Transfer" survey that was completed by 100% of TTCs in the Network. Because the study period overlapped with the onset of the COVID-19 pandemic, we also conducted a retrospective pre/post-pandemic comparison of determinants. TTCs reported relying on a broad group of factors when selecting EBPs to disseminate and the methods to do so. Stakeholder and target audience input and needs were consistently the most important determinant (both before and during COVID-19), while some other determinants fluctuated around the pandemic (e.g., public health mandates, instructions in the funding opportunity announcements). We discuss implications of the findings for technology transfer and frame the analyses in terms of the Interactive Systems Framework for Dissemination and Implementation.

Continuous Quality Improvement in the Substance Abuse and Mental Health Services Administration's Technology Transfer Center Network: A Process Evaluation

In healthcare and related fields, there is often a gap between research and practice. Scholars have developed frameworks to support dissemination and implementation of best practices, such as the Interactive Systems Framework for Dissemination and Implementation, which shows how scientific innovations are conveyed to practitioners through tools, training, and technical assistance (TA). Underpinning those aspects of the model are evaluation and continuous quality improvement (CQI). However, a recent meta-analysis suggests that the approaches to and outcomes from CQI in healthcare vary considerably, and that more evaluative work is needed. Therefore, this paper describes an assessment of CQI processes within the Substance Abuse and Mental Health Services Administration's (SAMHSA) Technology Transfer Center (TTC) Network, a large TA/TTC system in the United States comprised of 39 distinct centers. We conducted key informant interviews (n = 71 representing 28 centers in the Network) and three surveys (100% center response rates) focused on CQI, time/effort allocation, and Government Performance and Results Act (GPRA) measures. We used data from each of these study components to provide a robust picture of CQI within a TA/TTC system, identifying Network-specific concepts, concerns about conflation of the GPRA data with CQI, and principles that might be studied more generally.

Translating global evidence into local implementation through technical assistance: a realist evaluation of the Bloomberg philanthropies initiative for global Road safety

BACKGROUND

Traffic-related crashes are a leading cause of premature death and disability. The safe systems approach is an evidence-informed set of innovations to reduce traffic-related injuries and deaths. First developed in Sweden, global health actors are adapting the model to improve road safety in low- and middle-income countries via technical assistance (TA) programs; however, there is little evidence on road safety TA across contexts. This study investigated how, why, and under what conditions technical assistance influenced evidence-informed road safety in Accra (Ghana), Bogotá (Colombia), and Mumbai (India), using a case study of the Bloomberg Philanthropies Initiative for Global Road Safety (BIGRS).

METHODS

We conducted a realist evaluation with a multiple case study design to construct a program theory. Key informant interviews were conducted with 68 government officials, program staff, and other stakeholders. Documents were utilized to trace the evolution of the program. We used a retroductive analysis approach, drawing on the diffusion of innovation theory and guided by the context-mechanism-outcome approach to realist evaluation.

RESULTS

TA can improve road safety capabilities and increase the uptake of evidence-informed interventions. Hands-on capacity building tailored to specific implementation needs improved implementers' understanding of new approaches. BIGRS generated novel, city-specific analytics that shifted the focus toward vulnerable road users. BIGRS and city officials launched pilots that brought evidence-informed approaches. This built confidence by demonstrating successful implementation and allowing government officials to gauge public perception. But pilots had to scale within existing city and national contexts. City champions, governance structures, existing political prioritization, and socio-cultural norms influenced scale-up.

CONCLUSION

The program theory emphasizes the interaction of trust, credibility, champions and their authority, governance structures, political prioritization, and the implement-ability of international evidence in creating the conditions for road safety change. BIGRS continues to be a vehicle for improving road safety at scale and developing coalitions that assist governments in fulfilling their role as stewards of population well-being. Our findings improve understanding of the complex role of TA in translating evidence-informed interventions to country-level implementation and emphasize the importance of context-sensitive TA to increase impact.

Using implementation mapping to refine strategies to improve implementation of an evidence-based mobile market intervention: a study protocol

Objectives

The Veggie Van model is a mobile market model that is efficacious in increasing fruit and vegetable consumption for lower-income participants. The model is currently being evaluated for its effectiveness in a multi-state trial. Preliminary implementation data, collected through process measures surveys and implementation interviews, indicate that there are several barriers to implementation among partner organizations and implementation fidelity to the Veggie Van model was low. Consideration and planning for implementation ought to occur early and often throughout the research process order to ensure Veggie Van model effectiveness. This paper describes the step-by-step process for creating strategies to enhance implementation of Veggie Van model components.

Methods

Implementation mapping is a systematic process to develop implementation strategies through engagement with key stakeholders. We conducted a series of interviews (n = 31 representatives) with partner organizations (n = 8) to identify facilitators and barriers to Veggie Van model implementation. We then applied interview findings to an Implementation Mapping process to develop theory and practice-driven strategies to be integrated into existing implementation tools and technical assistance.

Results

We identified implementation outcomes (e.g., staff implement the Veggie Van model component of nutrition education with fidelity) and performance objectives (e.g., offer nutrition education, in the form of food lessons and/or food demonstrations, at least bi-weekly) to achieve them. We conducted a secondary qualitative analysis of the findings from implementation interviews with partner organizations to identify behavioral determinants (e.g., attitudinal beliefs, social support) which were combined with the performance objectives to generate change objectives (e.g., view the Veggie Van model as advantageous to an organization and communities served). To achieve the change objectives, we developed implementation strategies that would be integrated into existing Veggie Van training resources including an online toolkit, webinars and trainings, an annual mobile market conference, and technical assistance.

Conclusion

The development of theory and practice-driven implementation strategies will enable us to improve our implementation tools, thereby improving fidelity to the Veggie Van model among organizations and increasing the likelihood of its effectiveness. Detailing the design of a multifaceted implementation strategy using Implementation Mapping also provides a model to design similar strategies for other community-based interventions.

External technical assistance and its contribution to donor transition and long-term sustainability: experience from China and Georgia

External technical assistance has played a vital role in facilitating the transitions of donor-supported health projects/programmes (or their key components) to domestic health systems in China and Georgia. Despite large differences in size and socio-political systems, these two upper-middle-income countries have both undergone similar trajectories of 'graduating' from external assistance for health and gradually established strong national ownership in programme financing and policymaking over the recent decades. Although there have been many documented challenges in achieving effective and sustainable technical assistance, the legacy of technical assistance practices in China and Georgia provides many important lessons for improving technical assistance outcomes and achieving more successful donor transitions with long-term sustainability. In this innovation and practice report, we have selected five projects/programmes in China and Georgia supported by the following external health partners: the World Bank and the UK Department for International Development, Gavi Alliance and the Global Fund to Fight AIDS, Tuberculosis and Malaria. These five projects/programmes covered different health focus areas, ranging from rural health system strengthening to opioid substitution therapy. We discuss three innovative practices of technical assistance identified by the cross-country research teams: (1) talent cultivation for key decision-makers and other important stakeholders in the health system; (2) long-term partnerships between external and domestic experts; and (3) evidence-based policy advocacy nurtured by local experiences. However, the main challenge of implementation is insufficient domestic budgets for capacity building during and post-transition. We further identify two enablers for these practices to facilitate donor transition: (1) a project/programme governance structure integrated into the national health system and (2) a donor-recipient dynamic that enabled deep and far-reaching engagements with external and domestic stakeholders. Our findings shed light on the practices of technical assistance that strengthen long-term post-transition sustainability across multiple settings, particularly in middle-income countries.

Organizational Network Analysis of SAMHSA's Technology Transfer Center (TTC) Network

Technology transfer centers (TTCs) facilitate the movement of evidence-based practices in behavioral healthcare from theory to practice. One of the largest such networks is the Substance Abuse and Mental Health Services Administration's (SAMHSA) TTC Network. This brief report shares findings from an organizational network analysis (ONA) of the network conducted as part of an external evaluation. For non-supervisory TTCs (n = 36) across three focus areas (addiction, prevention, and mental health), the authors computed network density, harmonic closeness, and non-null dyadic reciprocity for five types of interactions (e.g., "collaborated in workgroups"), then, for each interaction type, used Welch's T-test to compare mean harmonic closeness of standalone TTC grantees versus multiple-TTC grantees. ONA identified potentially isolated regional TTCs as well as mismatches between some centers' desired scope and their network centrality and enabled investigation of broader questions around behavioral health support systems. The approach appears useful for evaluating TTCs and similar support networks.

The Opioid Response Project: An Effective Learning Collaborative for Local Communities?

The Opioid Response Project (ORP) was designed as an intensive 2-year health promotion learning collaborative grounded in the Collective Impact Model (CIM) to prepare ten local communities to address the opioid crisis. The purpose of this evaluation was to describe the ORP implementation, provide a summary of the evaluation results, share insights, and discuss implications. Results were informed by multiple data sources, including project documents, surveys, and interviews with members of the ORP and community teams. Based on process evaluation results, 100% of community teams reported being satisfied with the ORP and recommended this experience to others. ORP participation outputs ranged from new opioid response programs, to strengthened community teams, to receipt of additional funding. Based on the outcome evaluation, the ORP was effective at increasing community knowledge and capacity, promoting collaboration, and facilitating sustainability. This initiative is an example of an effective learning collaborative to curb the opioid epidemic at the community level. Participating communities found great value in working together as part of a larger cohort and reported benefits from the peer learning and support provided by the ORP. In particular, access to technical assistance, identification of engagement strategies within and across community teams, and a focus on sustainability are key practice components to be included in learning collaboratives designed to address large-scale public health issues.

Implementation Support for a Social Risk Screening and Referral Process in Community Health Centers

Evidence is needed about how to effectively support health care providers in implementing screening for social risks (adverse social determinants of health) and providing related referrals meant to address identified social risks. This need is greatest in underresourced care settings. The authors tested whether an implementation support intervention (6 months of technical assistance and coaching study clinics through a five-step implementation process) improved adoption of social risk activities in community health centers (CHCs). Thirty-one CHC clinics were block-randomized to six wedges that occurred sequentially. Over the 45-month study period from March 2018 to December 2021, data were collected for 6 or more months preintervention, the 6-month intervention period, and 6 or more months postintervention. The authors calculated clinic-level monthly rates of social risk screening results that were entered at in-person encounters and rates of social risk-related referrals. Secondary analyses measured impacts on diabetes-related outcomes. Intervention impact was assessed by comparing clinic performance based on whether they had versus had not yet received the intervention in the preintervention period compared with the intervention and postintervention periods. In assessing the results, the authors note that five clinics withdrew from the study for various bandwidth-related reasons. Of the remaining 26, a total of 19 fully or partially completed all 5 implementation steps, and 7 fully or partially completed at least the first 3 steps. Social risk screening was 2.45 times (95% confidence interval [CI], 1.32-4.39) higher during the intervention period compared with the preintervention period; this impact was not sustained postintervention (rate ratio, 2.16; 95% CI, 0.64-7.27). No significant difference was seen in social risk referral rates during the intervention or postintervention periods. The intervention was associated with greater blood pressure control among patients with diabetes and lower rates of diabetes biomarker screening postintervention. All results must be interpreted considering that the Covid-19 pandemic began midway through the trial, which affected care delivery generally and patients at CHCs particularly. Finally, the study results show that adaptive implementation support was effective at temporarily increasing social risk screening. It is possible that the intervention did not adequately address barriers to sustained implementation or that 6 months was not long enough to cement this change. Underresourced clinics may struggle to participate in support activities over longer periods without adequate resources, even if lengthier support is needed. As policies start requiring documentation of social risk activities, safety-net clinics may be unable to meet these requirements without adequate financial and coaching/technical support.