Sustainability of Evidence-Based Practices for HIV Prevention among Female Sex Workers in Mexico

Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention

Background

In order to achieve wide-scale impact in community settings, programs must be sustained. Theory and empirical evidence suggest that intervention characteristics, organizational context, capacity for program implementation, and processes related to implementation are associated with continued program delivery. However, few studies examine how combinations of these factors work together in different settings to influence program sustainment.

Methods

Using scales specified in the Program Sustainability Assessment Tool (PSAT), the current cross-sectional study aims to identify the necessary and sufficient conditions for the sustainment of the Strengthening Families Program for Parents and Youth 10-14 (SFP 10-14). Staff (n = 59) at SFP 10-14 implementation sites across Washington State completed an online survey reporting on their current level of SFP 10-14 sustainment. They also completed PSAT, with eight scales designed to assess conditions that consistently produce sustainment. Data were analyzed using qualitative comparative analysis.

Results

Environmental support was the only necessary condition for sustainment success. Four solutions sufficient to achieve sustainment were also identified. These included the combined presence of (1) environmental support, organizational capacity, and funding stability; (2) environmental support, organizational capacity, communication, and program evaluation, in the absence of strategic planning; (3) environmental support, organizational capacity, program evaluation, and partnerships, in the absence of strategic planning; and (4) environmental support, communication, partnerships, and funding stability, in the absence of program evaluation.

Conclusions

Environmental support in combination with organizational capacity appeared to most consistently produce sustainment of SFP 10-14 programs in Washington State. Program providers will benefit from a focusing on enhancing those conditions to increase program sustainment.

Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children's mental health services

BACKGROUND

Although there is increasing investment to implement evidence-based practices (EBPs) in public systems across the USA, continued or sustained use of EBPs after initial implementation remains a challenge. The low integration of EBPs in routine practice severely limits their public health impact, highlighting the need to understand factors that affect the return on costly investments in EBP implementation. This study aims to (1) characterize trajectories of EBP delivery volume through a reimbursement-driven implementation and (2) examine impacts of system-level policy regulatory activity and state-level mental health services funding on the implementation reimbursement strategy.

METHODS

This study involved secondary data analyses. Psychotherapy administrative claims and regulatory site visit data from the Los Angeles County Department of Mental Health and California state mental health expenditures were extracted from 2010 to 2017. Multilevel regression examined EBP claims volume over time with state expenditures and regulatory compliance as predictors.

RESULTS

EBP claims volume trajectories demonstrated a rapid initial increase, followed by a period of decrease, and a small increase in the final year. State mental health expenditures increased across time reflecting increased funding availability. State mental health expenditures and system regulatory compliance were inversely related to EBP claims volume.

CONCLUSIONS

The impact of reimbursement-driven EBP implementation strategy is sensitive to multiple outer-context determinants. At the system level, commitment to fidelity of implementation regulations resulted in reduced use of the reimbursement strategy. Alternative reimbursement streams not tied to EBPs coupled with an expanded array of reimbursable services also impacted the use of the reimbursement strategy to implement EBPs.

Barriers and facilitators to implementing evidence-based health innovations in low- and middle-income countries: A systematic literature review

The unsuccessful implementation of health innovations occurs frequently, leading to missed opportunities where improvements could have been made on various aspects of a health system. The purpose of this study is to identify, assess and synthesise the facilitators and barriers to sustainably implementing evidence-based health innovations in a low- and middle-income country (LMIC) context. To identify the LMIC specific facilitators and barriers, a systematic literature review was conducted. 79 studies were analysed, and the implementation barriers and facilitators identified in each study were extracted. The extracted barriers and facilitators were categorised and synthesized into one of seven concepts: context, innovation, relations and networks, institutions, knowledge, actors or resources. There were no substantial variations between the frequency that each concept was identified as a facilitator or barrier to implementation. However, resources, which includes time, human, financial and physical resources, was the most frequently mentioned concept; emphasising the need to focus on the resource situation in LMICs. This study contributes to the growing literature that aims to inform health system planners and evaluators in LMICs on effectively and sustainably implementing evidence-based health innovations.

Sustainability of the streamlined ART (START-ART) implementation intervention strategy among ART-eligible adult patients in HIV clinics in public health centers in Uganda: a mixed methods study

Background

Despite increasing access to antiretroviral therapy (ART), the proportion of eligible patients initiated on treatment remains suboptimal. Only 64.6% of the people living with HIV (PLHIV) globally were initiated on ART by June 2019. The streamlined ART (START-ART) implementation study was based on the PRECEDE model, which suggests that "predisposing, enabling, and reinforcing" factors are needed to create behavior change. START-ART increased ART initiation within 2 weeks of eligibility by 42%. However, the gains from some implementation interventions erode over time. We evaluated facilitators and barriers to sustainability of this streamlined ART initiation in the year following the implementation period.

Methods

We designed a mixed-methods explanatory sequential study to examine the sustainability of START-ART implementation. Quantitative component consisted of cross-sectional patient chart reviews of routinely collected data; qualitative component consisted of key informant interviews of health workers in START-ART facilities 2 years after conclusion of the implementation period. We analyzed data from 15 public health centers of Mbarara district, where the START-ART implementation was carried out. We included PLHIV aged > 18 years who initiated ART from June 2013 to July 2016. The START-ART implementation took place from June 2013 to June 2015 while the sustainability period was from August 2015 to July 2016.

Results

A total of 863 ART-eligible patients were sampled. The median CD4 count was 348 cells/ml (IQR 215-450). During the intervention, 338 (77.4%) eligible patients initiated on ART within 2 weeks compared with 375 (88.2%) during the sustainability period (risk difference 10.8%; 95% CI 5.9-15.8%). In 14 of the 15 health centers, the intervention was sustained. During key informant interviews, rapid ART initiation sustainability was attributed to counseling skills that were obtained during intervention and availability of point-of-care (POC) CD4 PIMA machine. Failure to sustain the intervention was attributed to three specific barriers: lack of training after the intervention, transfer of trained staff to other health facilities, and shortage of supplies like cartridges for POC CD4 PIMA machine.

Conclusion

Rapid ART initiation was sustained in most health centers. Skills acquired during the intervention and functional POC CD4 machine facilitated while staff transfers and irregular laboratory supplies were barriers to sustainability of rapid ART initiation.

Implementing Evidence-Based HIV Prevention for Female Sex Workers in Mexico: Provider Assessments of Feasibility and Acceptability

This study examined service provider perceptions of feasibility and acceptability of implementing evidence-based practices for preventing HIV/AIDS and STIs in female sex workers (FSWs) in Mexico. Semi-structured interviews were conducted with 124 directors, supervisors and counselors from 12 reproductive health clinics located throughout Mexico participating in a large randomized controlled trial to scale-up the use of a psychoeducational intervention designed to promote FSW condom use and enhance safer sex negotiation skills. Feasibility was based on assessment of personal, organizational and social costs, benefits, and capacity. Costs included anxiety over intervention competency, purchase of condoms and other supplies, expenses of laboratory tests for HIV/STIs, and stigma associated with FSWs. Benefits included increase in personal knowledge and experience, enhanced clinic reputation and service delivery capacity, and increased public health. Capacity was expressed in terms of provider skills to deliver the intervention and additional workload. Acceptability was expressed in terms of provider enthusiasm in delivering these services and FSWs willingness to receive the services. Service provider evaluations of feasibility and acceptability of implementing evidence-based prevention interventions are grounded in local contexts that define costs and benefits of and capacity for implementation and determine features of the intervention and its implementation that are acceptable.

Factors associated with program effectiveness in the implementation of a sexual risk reduction intervention for female sex workers across Mexico: Results from a randomized trial

OBJECTIVE

The overall aim of this paper is to examine effectiveness of an evidence-based intervention in community settings, and the factors associated with effectiveness. Limited research in the area of HIV prevention has focused on evaluating intervention program effectiveness in real-world settings.

METHODS

We implemented an efficacious theory-based sexual risk reduction intervention for female sex workers (FSW) called Mujer Segura across 13 different clinics in 13 sites across Mexico. The overall design was a cluster randomized Type I design simultaneously testing intervention program effectiveness with an observational study of implementation factors. We aimed to examine the effectiveness of Mujer Segura at reducing HIV/STI incidence among FSW participants at each site, and to examine the client-, provider-, organization-, and structure-related factors associated with program effectiveness.

RESULTS

We found lower HIV/STI incidence density in the intervention relative to the control group in 5 sites we labeled as "program effective sites," but not in 8 sites we labeled as "program ineffective sites." Using generalized estimating equations controlling for site and computed mean difference effect sizes, we examined statistically and practically significant differences, respectively, between the two groups of sites along various client-, provider-, organization-, and structure-related characteristics. Results indicated that client-level HIV/AIDS related knowledge, and proficiency and engagement in the organizational social context were associated with program effectiveness.

CONCLUSIONS

Enormous resources are required to systematically and adequately test the role of multilevel factors on program effectiveness. We successfully implemented Mujer Segura in 13 sites in Mexico. Results suggest that other measures may need to be included in future implementation studies than the ones included here. We were able to point to a few specific factors that should be targeted to increase effectiveness of similar evidence-based programs in low- and other middle-income countries like Mexico.

TRIAL REGISTRATION

ClinicalTrials.gov NCT01465607.

The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care

There is strong interest in implementation science to address the gap between research and practice in public health. Research on the sustainability of evidence-based interventions has been growing rapidly. Sustainability has been defined as the continued use of program components at sufficient intensity for the sustained achievement of desirable program goals and population outcomes. This understudied area has been identified as one of the most significant translational research problems. Adding to this challenge is uncertainty regarding the extent to which intervention adaptation and evolution are necessary to address the needs of populations that differ from those in which interventions were originally tested or implemented. This review critically examines and discusses conceptual and methodological issues in studying sustainability, summarizes the multilevel factors that have been found to influence the sustainability of interventions in a range of public health and health care settings, and highlights key areas for future research.

Advancing understanding of the sustainability of lay health advisor (LHA) programs for African-American women in community settings

Lay health advisor (LHA) programs have made strong contributions towards the elimination of health disparities and are increasingly being implemented to promote health and prevent disease. Developed in collaboration with African-American survivors, the National Witness Project (NWP) is an evidence-based, community-led LHA program that improves cancer screening among African-American women. NWP has been successfully disseminated, replicated, and implemented nationally in over 40 sites in 22 states in diverse community settings, reaching over 15,000 women annually. We sought to advance understanding of barriers and facilitators to the long-term implementation and sustainability of LHA programs in community settings from the viewpoint of the LHAs, as well as the broader impact of the program on African-American communities and LHAs. In the context of a mixed-methods study, in-depth telephone interviews were conducted among 76 African-American LHAs at eight NWP sites at baseline and 12-18 months later, between 2010 and 2013. Qualitative data provides insight into inner and outer contextual factors (e.g., community partnerships, site leadership, funding), implementation processes (e.g., training), as well as characteristics of the intervention (e.g., perceived need and fit in African-American community) and LHAs (e.g., motivations, burnout) that are perceived to impact the continued implementation and sustainability of NWP. Factors at the contextual levels and related to motivations of LHAs are critical to the sustainability of LHA programs. We discuss how findings are used to inform (1) the development of the LHA Sustainability Framework and (2) strategies to support the continued implementation and sustainability of evidence-based LHA interventions in community settings.