Results of a cluster randomized trial testing the systems analysis and improvement approach to increase HIV testing in family planning clinics

Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

BACKGROUND

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services. Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

METHODS

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be "scaled up" with delivery by district health supervisors (rather than research staff) and will be "scaled out" via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer's perspective.

DISCUSSION

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05002322 (registered 02/15/2023).

Results of a cluster randomized trial testing the Systems Analysis and Improvement Approach to increase cervical cancer screening in family planning clinics in Mombasa County, Kenya

BACKGROUND

Cervical cancer is the leading cause of cancer death in Kenyan women. Integrating cervical cancer screening into family planning (FP) clinics is a promising strategy to improve health for reproductive-aged women. The objective of this cluster randomized trial was to test the efficacy of an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), as a tool to increase cervical cancer screening in FP clinics in Mombasa County, Kenya.

METHODS

Twenty FP clinics in Mombasa County were randomized 1:1 to SAIA versus usual procedures. SAIA has five steps: (1) cascade analysis tool to understand the cascade and identify inefficiencies, (2) sequential process flow mapping to identify bottlenecks, (3) develop and implement workflow modifications (micro-interventions) to address identified bottlenecks, (4) assess the micro-intervention in the cascade analysis tool, and (5) repeat the cycle. Prevalence ratios were calculated using Poisson regression with robust standard errors to compare the proportion of visits where women were screened for cervical cancer in SAIA clinics compared to control clinics.

RESULTS

In the primary intent-to-treat analysis in the last quarter of the trial, 2.5% (37/1507) of visits with eligible FP clients at intervention facilities included cervical cancer screening compared to 3.7% (66/1793) in control clinics (prevalence ratio [PR] 0.67, 95% CI 0.45-1.00). When adjusted for having at least one provider trained to perform cervical cancer screening at baseline, there was no significant difference between screening in intervention clinics compared to control clinics (adjusted PR 1.14, 95% CI 0.74-1.75).

CONCLUSIONS

The primary analysis did not show an effect on cervical cancer screening. However, the COVID-19 pandemic and a healthcare worker strike likely impacted SAIA's implementation with significant disruptions in FP care delivery during the trial. While SAIA's data-informed decision-making and clinic-derived solutions are likely important, future work should directly study the mechanisms through which SAIA operates and the influence of contextual factors on implementation.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03514459. Registered on April 19, 2018.

The Application of Systems Thinking to the Prevention and Control of Sexually Transmissible Infections among Adolescents and Adults: A Scoping Review

Systems thinking is a mechanism for making sense of complex systems that challenge linear explanations of cause-and-effect. While the prevention and control of sexually transmissible infections (STIs) has been identified as an area that may benefit from systems-level analyses, no review on the subject currently exists. The aim of this study is to conduct a scoping review to identify literature in which systems thinking has been applied to the prevention and control of STIs among adolescent and adult populations. Joanna Briggs Institute guidelines for the conduct of scoping reviews were followed. Five databases were searched for English-language studies published after 2011. A total of n = 6102 studies were screened against inclusion criteria and n = 70 were included in the review. The majority of studies (n = 34) were conducted in African nations. Few studies focused on priority sub-populations, and 93% were focused on HIV (n = 65). The most commonly applied systems thinking method was system dynamics modelling (n = 28). The review highlights areas for future research, including the need for more STI systems thinking studies focused on: (1) migrant and Indigenous populations; (2) conditions such as syphilis; and (3) innovations such as pre-exposure prophylaxis and at-home testing for HIV. The need for conceptual clarity around 'systems thinking' is also highlighted.

The future of HIV testing in eastern and southern Africa: Broader scope, targeted services

In this Policy Forum, Anna Grimsrud and colleagues discuss the future of HIV testing in eastern and southern Africa, using insights gleaned from a 2021 expert consultation.

The Systems Analysis and Improvement Approach: specifying core components of an implementation strategy to optimize care cascades in public health

BACKGROUND

Healthcare systems in low-resource settings need simple, low-cost interventions to improve services and address gaps in care. Though routine data provide opportunities to guide these efforts, frontline providers are rarely engaged in analyzing them for facility-level decision making. The Systems Analysis and Improvement Approach (SAIA) is an evidence-based, multi-component implementation strategy that engages providers in use of facility-level data to promote systems-level thinking and quality improvement (QI) efforts within multi-step care cascades. SAIA was originally developed to address HIV care in resource-limited settings but has since been adapted to a variety of clinical care systems including cervical cancer screening, mental health treatment, and hypertension management, among others; and across a variety of settings in sub-Saharan Africa and the USA. We aimed to extend the growing body of SAIA research by defining the core elements of SAIA using established specification approaches and thus improve reproducibility, guide future adaptations, and lay the groundwork to define its mechanisms of action.

METHODS

Specification of the SAIA strategy was undertaken over 12 months by an expert panel of SAIA-researchers, implementing agents and stakeholders using a three-round, modified nominal group technique approach to match core SAIA components to the Expert Recommendations for Implementing Change (ERIC) list of distinct implementation strategies. Core implementation strategies were then specified according to Proctor's recommendations for specifying and reporting, followed by synthesis of data on related implementation outcomes linked to the SAIA strategy across projects.

RESULTS

Based on this review and clarification of the operational definitions of the components of the SAIA, the four components of SAIA were mapped to 13 ERIC strategies. SAIA strategy meetings encompassed external facilitation, organization of provider implementation meetings, and provision of ongoing consultation. Cascade analysis mapped to three ERIC strategies: facilitating relay of clinical data to providers, use of audit and feedback of routine data with healthcare teams, and modeling and simulation of change. Process mapping matched to local needs assessment, local consensus discussions and assessment of readiness and identification of barriers and facilitators. Finally, continuous quality improvement encompassed tailoring strategies, developing a formal implementation blueprint, cyclical tests of change, and purposefully re-examining the implementation process.

CONCLUSIONS

Specifying the components of SAIA provides improved conceptual clarity to enhance reproducibility for other researchers and practitioners interested in applying the SAIA across novel settings.

The cost of implementing the Systems Analysis and Improvement Approach for a cluster randomized trial integrating HIV testing into family planning services in Mombasa County, Kenya

BACKGROUND

Although HIV testing in family planning (FP) clinics is a promising approach for engaging women in HIV treatment and prevention services, HIV testing rates are low in FP clinics in Kenya. In 2018, a cluster randomized trial was implemented in Mombasa, Kenya applying the Systems Analysis and Improvement Approach (SAIA) to integrate HIV testing into FP services (1K24HD088229-01). We estimated the incremental costs and explored cost drivers of the FP HIV SAIA implementation in Mombasa, Kenya.

METHODS

We conducted a costing evaluation from the payer perspective for the FP HIV SAIA randomized control trial. We identified relevant activities for the intervention including start-up, training, research and FP HIV SAIA. We estimated activity time burden using a time-and motion study. We derived unit costs through staff interviews and programmatic budgets. We present cost estimates for two different scenarios: as-implemented including research and projected costs for a Ministry of Health-supported intervention. All costs are reported in 2018 USD.

RESULTS

For an annual program output of 36,086 HIV tests administered to new FP clients, we estimated the total annual program cost to be $91,994 with an average cost per new FP client served of $2.55. Personnel and HIV rapid testing kits comprised 55% and 21% of programmatic costs, respectively. Assuming no changes to program outputs and with efficiency gains under the MOH scenario, the estimated cost per new FP client served decreased to $1.30 with a programmatic cost reduction of 49%.

CONCLUSION

FP HIV SAIA is a low-cost and flexible implementation strategy for facilitating integrated delivery of HIV testing alongside FP services. Although cost implications of the FP HIV SAIA intervention must continue to be evaluated over time, these findings provide context-specific cost data useful for budget planning and decision-making regarding intervention delivery and expansion.

TRIAL REGISTRATION

The trial was registered on December 15, 2016, with clinicaltrials.gov (NCT02994355).

Assessing the sustainability of the Systems Analysis and Improvement Approach to increase HIV testing in family planning clinics in Mombasa, Kenya: results of a cluster randomized trial

BACKGROUND

In Kenya, HIV incidence is highest among reproductive-age women. A key HIV mitigation strategy is the integration of HIV testing and counseling (HTC) into family planning services, but successful integration remains problematic. We conducted a cluster-randomized trial using the Systems Analysis and Improvement Approach (SAIA) to identify and address bottlenecks in HTC integration in family planning clinics in Mombasa County, Kenya. This trial (1) assessed the efficacy of this approach and (2) examined if SAIA could be sustainably incorporated into the Department of Health Services (DOHS) programmatic activities. In Stage 1, SAIA was effective at increasing HTC uptake. Here, we present Stage 2, which assessed if SAIA delivery would be sustained when implemented by the Mombasa County DOHS and if high HTC performance would continue to be observed.

METHODS

Twenty-four family planning clinics in Mombasa County were randomized to either the SAIA implementation strategy or standard care. In Stage 1, the study staff conducted all study activities. In Stage 2, we transitioned SAIA implementation to DOHS staff and compared HTC in the intervention versus control clinics 1-year post-transition. Study staff provided training and minimal support to DOHS implementers and collected quarterly HTC outcome data. Interviews were conducted with family planning clinic staff to assess barriers and facilitators to sustaining HTC delivery.

RESULTS

Only 39% (56/144) of planned SAIA visits were completed, largely due to the COVID-19 pandemic and a prolonged healthcare worker strike. In the final study quarter, 81.6% (160/196) of new clients at intervention facilities received HIV counseling, compared to 22.4% (55/245) in control facilities (prevalence rate ratio [PRR]=3.64, 95% confidence interval [CI]=2.68-4.94). HIV testing was conducted with 60.5% (118/195) of new family planning clients in intervention clinics, compared to 18.8% (45/240) in control clinics (PRR=3.23, 95% CI=2.29-4.55). Interviews with family planning clinic staff suggested institutionalization contributed to sustained HTC delivery, facilitated by low implementation strategy complexity and continued oversight.

CONCLUSIONS

Intervention clinics demonstrated sustained improvement in HTC after SAIA was transitioned to DOHS leadership despite wide-scale healthcare disruptions and incomplete delivery of the implementation strategy. These findings suggest that system interventions may be sustained when integrated into DOHS programmatic activities.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered on 16 December 2016.

Qualitative evaluation of the Systems Analysis and Improvement Approach as a strategy to increase HIV testing in family planning clinics using the Consolidated Framework for Implementation Research and the Implementation Outcomes Framework

BACKGROUND

Significant gaps remain in HIV testing and counseling (HTC) in family planning (FP) clinics. To address these gaps, our group tested an implementation strategy called the Systems Analysis and Improvement Approach (SAIA), an evidenced-based multi-component implementation strategy focused on improving entire care cascades. In a cluster randomized trial of 24 FP clinics in Mombasa County, Kenya, SAIA led to a significant increase in HTC in intervention clinics compared to control clinics. The objective of this manuscript was to evaluate SAIA using the Consolidated Framework for Implementation Research (CFIR) and assess the Implementation Outcomes Framework outcomes of acceptability, appropriateness, and feasibility.

METHODS

This qualitative assessment was nested within the cluster-randomized trial. Data collection included questionnaires to assess modifiable and non-modifiable health system factors related to HTC and in-depth interviews to query clinic norms, priorities, communication strategies, and readiness for change. The primary outcomes of interest were feasibility, appropriateness, and acceptability of SAIA. Data on inner setting and structural characteristics of FP clinics were collected to inform how context may impact outcomes. All interviews were recorded and analyzed using a rapid assessment approach.

RESULTS

Of the 12 intervention clinics, 6 (50%) were public facilities. Availability of resources varied by clinic. Most clinics had a positive implementation climate, engaged leadership, and access to resources and information. While not all clinics identified HTC as a clinic priority, most reported a strong culture of embracing change and recognition of the importance of HIV testing within FP clinics. Interviews highlighted very high acceptability, appropriateness, and feasibility of SAIA. The implementation strategy was not complicated and fit well into existing clinic processes. In particular, staff appreciated that SAIA allowed clinic staff to generate contextually relevant solutions that they implemented.

CONCLUSIONS

SAIA was implemented in FP clinics of varying sizes, capacity, and management support and was found to be acceptable, appropriate, and feasible. The agency that clinic staff felt in proposing and implementing their own solutions was likely part of SAIA's success. We anticipate this will continue to be a mechanism of SAIA's success when it is scaled up to more clinics in future trials.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered 16 December 2016.