Cascade Analysis: An Adaptable Implementation Strategy Across HIV and Non-HIV Delivery Platforms

Systems analysis and improvement approach to optimize tuberculosis (SAIA-TB) screening, treatment, and prevention in South Africa: a stepped-wedge cluster randomized trial

BACKGROUND

The use of systems engineering tools, including the development and use of care cascades using routinely collected data, process mapping, and continuous quality improvement, is used for frontline healthcare workers to devise systems level change. South Africa experiences high rates of tuberculosis (TB) infection and disease as well as HIV co-infection. The Department of Health has made significant gains in HIV services over the last two decades, reaching their set "90-90-90" targets for HIV. However, TB services, although robust, have lagged in comparison for both disease and infection. The Systems Analysis and Improvement Approach (SAIA) is a five-step implementation science method, drawn from systems engineering, to identify, define, and implement workflow modifications using cascade analysis, process mapping, and repeated quality improvement cycles within healthcare facilities.

METHODS

This stepped-wedge cluster randomized trial will evaluate the effectiveness of SAIA on TB (SAIA-TB) cascade optimization for patients with TB and high-risk contacts across 16 clinics in four local municipalities in the Sarah Baartman district, Eastern Cape, South Africa. We hypothesize that SAIA-TB implementation will lead to a 20% increase in each of: TB screening, TB preventive treatment initiation, and TB disease treatment initiation during the 18-month intervention period. Focus group discussions and key informant interviews with clinic staff will also be conducted to determine drivers of implementation variability across clinics.

DISCUSSION

This study has the potential to improve TB screening, treatment initiation, and completion for both active disease and preventive measures among individuals with and without HIV in a high burden setting. SAIA-TB provides frontline health care workers with a systems-level view of their care delivery system with the aim of sustainable systems-level improvements.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT06314386. Registered 18 March 2024, https://clinicaltrials.gov/study/NCT06314386 . NCT06314386.

Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

BACKGROUND

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services. Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

METHODS

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be "scaled up" with delivery by district health supervisors (rather than research staff) and will be "scaled out" via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer's perspective.

DISCUSSION

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05002322 (registered 02/15/2023).

Facility-Based Indicators to Manage and Scale Up Cervical Cancer Prevention and Care Services for Women Living With HIV in Sub-Saharan Africa: a Three-Round Online Delphi Consensus Method

BACKGROUND

Of women with cervical cancer (CC) and HIV, 85% live in sub-Saharan Africa, where 21% of all CC cases are attributable to HIV infection. We aimed to generate internationally acceptable facility-based indicators to monitor and guide scale up of CC prevention and care services offered on-site or off-site by HIV clinics.

METHODS

We reviewed the literature and extracted relevant indicators, grouping them into domains along the CC control continuum. From February 2021 to March 2022, we conducted a three-round, online Delphi process to reach consensus on indicators. We invited 106 experts to participate. Through an anonymous, iterative process, participants adapted the indicators to their context (round 1), then rated them for 5 criteria on a 5-point Likert-type scale (rounds 2 and 3) and then ranked their importance (round 3).

RESULTS

We reviewed 39 policies from 21 African countries and 7 from international organizations; 72 experts from 15 sub-Saharan Africa countries or international organizations participated in our Delphi process. Response rates were 34% in round 1, 40% in round 2, and 44% in round 3. Experts reached consensus for 17 indicators in the following domains: primary prevention (human papillomavirus prevention, n = 2), secondary prevention (screening, triage, treatment of precancerous lesions, n = 11), tertiary prevention (CC diagnosis and care, n = 2), and long-term impact of the program and linkage to HIV service (n = 2).

CONCLUSION

We recommend that HIV clinics that offer CC control services in sub-Saharan Africa implement the 17 indicators stepwise and adapt them to context to improve monitoring along the CC control cascade.

Results of a cluster randomized trial testing the Systems Analysis and Improvement Approach to increase cervical cancer screening in family planning clinics in Mombasa County, Kenya

BACKGROUND

Cervical cancer is the leading cause of cancer death in Kenyan women. Integrating cervical cancer screening into family planning (FP) clinics is a promising strategy to improve health for reproductive-aged women. The objective of this cluster randomized trial was to test the efficacy of an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), as a tool to increase cervical cancer screening in FP clinics in Mombasa County, Kenya.

METHODS

Twenty FP clinics in Mombasa County were randomized 1:1 to SAIA versus usual procedures. SAIA has five steps: (1) cascade analysis tool to understand the cascade and identify inefficiencies, (2) sequential process flow mapping to identify bottlenecks, (3) develop and implement workflow modifications (micro-interventions) to address identified bottlenecks, (4) assess the micro-intervention in the cascade analysis tool, and (5) repeat the cycle. Prevalence ratios were calculated using Poisson regression with robust standard errors to compare the proportion of visits where women were screened for cervical cancer in SAIA clinics compared to control clinics.

RESULTS

In the primary intent-to-treat analysis in the last quarter of the trial, 2.5% (37/1507) of visits with eligible FP clients at intervention facilities included cervical cancer screening compared to 3.7% (66/1793) in control clinics (prevalence ratio [PR] 0.67, 95% CI 0.45-1.00). When adjusted for having at least one provider trained to perform cervical cancer screening at baseline, there was no significant difference between screening in intervention clinics compared to control clinics (adjusted PR 1.14, 95% CI 0.74-1.75).

CONCLUSIONS

The primary analysis did not show an effect on cervical cancer screening. However, the COVID-19 pandemic and a healthcare worker strike likely impacted SAIA's implementation with significant disruptions in FP care delivery during the trial. While SAIA's data-informed decision-making and clinic-derived solutions are likely important, future work should directly study the mechanisms through which SAIA operates and the influence of contextual factors on implementation.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03514459. Registered on April 19, 2018.

"We should be resourcing their liberation:" a qualitative formative study to guide introduction of a systems engineering intervention at a King County, WA juvenile detention center clinic

BACKGROUND

There are ongoing efforts to eliminate juvenile detention in King County, WA. An essential element of this work is effectively addressing the health needs of youth who are currently detained to improve their wellbeing and reduce further contact with the criminal legal system. This formative study sought to inform adaptation and piloting of an evidence-based systems engineering strategy - the Systems Analysis and Improvement Approach (SAIA) - in a King County juvenile detention center clinic to improve quality and continuity of healthcare services. Our aims were to describe the priority health needs of young people who are involved in Washington's criminal legal system and the current system of healthcare for young people who are detained.

METHODS

We conducted nine individual interviews with providers serving youth. We also obtained de-identified quantitative summary reports of quality improvement discussions held between clinic staff and 13 young people who were detained at the time of data collection. Interview transcripts were analyzed using deductive and inductive coding and quantitative data were used to triangulate emergent themes.

RESULTS

Providers identified three priority healthcare cascades for detention-based health services-mental health, substance use, and primary healthcare-and reported that care for these concerns is often introduced for the first time in detention. Interviewees classified incarceration itself as a health hazard, highlighting the paradox of resourcing healthcare quality improvement interventions in an inherently harmful setting. Fractured communication and collaboration across detention- and community-based entities drives systems-level inefficiencies, obstructs access to health and social services for marginalized youth, and fragments the continuum of care for young people establishing care plans while detained in King County. 31% of youth self-reported receiving episodic healthcare prior to detention, 15% reported never having medical care prior to entering detention, and 46% had concerns about finding healthcare services upon release to the community.

CONCLUSIONS

Systems engineering interventions such as the SAIA may be appropriate and feasible approaches to build systems thinking across and between services, remedy systemic challenges, and ensure necessary information sharing for care continuity. However, more information is needed directly from youth to draw conclusions about effective pathways for healthcare quality improvement.

Assessing drivers of implementing "Scaling-up the Systems Analysis and Improvement Approach" for Prevention of Mother-to-Child HIV Transmission in Mozambique (SAIA-SCALE) over implementation waves

BACKGROUND

The Systems Analysis and Improvement Approach (SAIA) is an evidence-based package of systems engineering tools originally designed to improve patient flow through the prevention of Mother-to-Child transmission of HIV (PMTCT) cascade. SAIA is a potentially scalable model for maximizing the benefits of universal antiretroviral therapy (ART) for mothers and their babies. SAIA-SCALE was a stepped wedge trial implemented in Manica Province, Mozambique, to evaluate SAIA's effectiveness when led by district health managers, rather than by study nurses. We present the results of a qualitative assessment of implementation determinants of the SAIA-SCALE strategy during two intensive and one maintenance phases.

METHODS

We used an extended case study design that embedded the Consolidated Framework for Implementation Research (CFIR) to guide data collection, analysis, and interpretation. From March 2019 to April 2020, we conducted in-depth individual interviews (IDIs) and focus group discussions (FGDs) with district managers, health facility maternal and child health (MCH) managers, and frontline nurses at 21 health facilities and seven districts of Manica Province (Chimoio, Báruè, Gondola, Macate, Manica, Sussundenga, and Vanduzi).

RESULTS

We included 85 participants: 50 through IDIs and 35 from three FGDs. Most study participants were women (98%), frontline nurses (49.4%), and MCH health facility managers (32.5%). An identified facilitator of successful intervention implementation (regardless of intervention phase) was related to SAIA's compatibility with organizational structures, processes, and priorities of Mozambique's health system at the district and health facility levels. Identified barriers to successful implementation included (a) inadequate health facility and road infrastructure preventing mothers from accessing MCH/PMTCT services at study health facilities and preventing nurses from dedicating time to improving service provision, and (b) challenges in managing intervention funds.

CONCLUSIONS

The SAIA-SCALE qualitative evaluation suggests that the scalability of SAIA for PMTCT is enhanced by its fit within organizational structures, processes, and priorities at the primary level of healthcare delivery and health system management in Mozambique. Barriers to implementation that impact the scalability of SAIA include district-level financial management capabilities and lack of infrastructure at the health facility level. SAIA cannot be successfully scaled up to adequately address PMTCT needs without leveraging central-level resources and priorities.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03425136 . Registered on 02/06/2018.

Optimizing naloxone distribution to prevent opioid overdose fatalities: results from piloting the Systems Analysis and Improvement Approach within syringe service programs

BACKGROUND

Opioid overdose fatalities are preventable with timely administration of naloxone, an opioid antagonist, during an opioid overdose event. Syringe service programs have pioneered naloxone distribution for potential bystanders of opioid overdose. The objective of this study was to pilot test a multi-component implementation strategy-the systems analysis and improvement approach for naloxone (SAIA-Naloxone)-with the goal of improving naloxone distribution by syringe service programs.

METHODS

Two syringe service programs participated in a 6-month pilot of SAIA-Naloxone, which included (1) analyzing program data to identify gaps in the naloxone delivery cascade, (2) flow mapping to identify causes of attrition and brainstorm programmatic changes for improvement, and (3) conducting continuous quality improvement to test and assess whether modifications improve the cascade. We conducted an interrupted time series analysis using 52 weeks of data before and 26 weeks of data after initiating SAIA-Naloxone. Poisson regression was used to evaluate the association between SAIA-Naloxone and the weekly number of participants receiving naloxone and number of naloxone doses distributed.

RESULTS

Over the course of the study, 11,107 doses of naloxone were distributed to 6,071 participants. Through SAIA-Naloxone, syringe service programs prioritized testing programmatic modifications to improve data collection procedures, proactively screen and identify naloxone-naïve participants, streamline naloxone refill systems, and allow for secondary naloxone distribution. SAIA-Naloxone was associated with statistically significant increases in the average number of people receiving naloxone per week (37% more SPP participants; 95% CI, 12% to 67%) and average number of naloxone doses distributed per week (105% more naloxone doses; 95% CI, 79% to 136%) beyond the underlying pre-SAIA-Naloxone levels. These initial increases were extended by ongoing positive changes over time (1.6% more SSP participants received naloxone and 0.3% more naloxone doses were distributed in each subsequent week compared to the weekly trend in the pre-SAIA Naloxone period).

CONCLUSIONS

SAIA-Naloxone has strong potential for improving naloxone distribution from syringe service programs. These findings are encouraging in the face of the worsening opioid overdose crisis in the United States and support testing SAIA-Naloxone in a large-scale randomized trial within syringe service programs.

Cascade Analysis for Women Presenting With Breast Concerns to a Zonal Hospital in Mwanza, Tanzania

PURPOSE

In Tanzania, high breast cancer mortality can be attributed to delays in diagnosis and treatment initiation. We adapted the cascade analysis method to depict sequential steps along the breast cancer care pathway in a tertiary hospital in Mwanza, to identify where correction of loss to attrition would have the biggest impact on improving outcomes.

METHODS

This prospective cohort included adult women presenting with breast concerns between February 2020 and January 2022. Five cascade steps beginning with patients' initial clinical breast assessment (CBA) through cancer treatment were identified: (1) CBA, (2) ordering diagnostic test(s), (3) completion of diagnostic test(s), (4) receipt of final diagnosis, and (5) initiating cancer treatment.

RESULTS

Overall, 721 eligible women with a median age of 42.8 years (IQR, 32.5-55.0) were included. Median time from presentation to treatment initiation was 35 days (IQR, 20-63). For step 1, 39.1% (n = 282) of patients were diagnosed with a benign concern and removed from the cascade. Completion rates for steps 2-4 were 95.0%, 90.2%, and 91.0, respectively. There were 156 (45.6%) patients diagnosed with breast cancer, and for step 5, 71.2% of patients initiated cancer treatment. In steps 2, 3, 4, and 5, there was a loss of 22, 41, 34, and 45 patients, respectively. If loss was eliminated at steps 2, 3, 4, or 5, an additional 6, 12, 11, or 45 patients, respectively, would have completed the pathway.

CONCLUSION

Initiating cancer treatment was identified as the step with the biggest loss and, if remedied, would have the biggest impact on improving breast cancer outcomes at Bugando Medical Centre. These results will inform future programs focused on reducing overall loss in the system and supporting patients with breast cancer.

The Systems Analysis and Improvement Approach: specifying core components of an implementation strategy to optimize care cascades in public health

BACKGROUND

Healthcare systems in low-resource settings need simple, low-cost interventions to improve services and address gaps in care. Though routine data provide opportunities to guide these efforts, frontline providers are rarely engaged in analyzing them for facility-level decision making. The Systems Analysis and Improvement Approach (SAIA) is an evidence-based, multi-component implementation strategy that engages providers in use of facility-level data to promote systems-level thinking and quality improvement (QI) efforts within multi-step care cascades. SAIA was originally developed to address HIV care in resource-limited settings but has since been adapted to a variety of clinical care systems including cervical cancer screening, mental health treatment, and hypertension management, among others; and across a variety of settings in sub-Saharan Africa and the USA. We aimed to extend the growing body of SAIA research by defining the core elements of SAIA using established specification approaches and thus improve reproducibility, guide future adaptations, and lay the groundwork to define its mechanisms of action.

METHODS

Specification of the SAIA strategy was undertaken over 12 months by an expert panel of SAIA-researchers, implementing agents and stakeholders using a three-round, modified nominal group technique approach to match core SAIA components to the Expert Recommendations for Implementing Change (ERIC) list of distinct implementation strategies. Core implementation strategies were then specified according to Proctor's recommendations for specifying and reporting, followed by synthesis of data on related implementation outcomes linked to the SAIA strategy across projects.

RESULTS

Based on this review and clarification of the operational definitions of the components of the SAIA, the four components of SAIA were mapped to 13 ERIC strategies. SAIA strategy meetings encompassed external facilitation, organization of provider implementation meetings, and provision of ongoing consultation. Cascade analysis mapped to three ERIC strategies: facilitating relay of clinical data to providers, use of audit and feedback of routine data with healthcare teams, and modeling and simulation of change. Process mapping matched to local needs assessment, local consensus discussions and assessment of readiness and identification of barriers and facilitators. Finally, continuous quality improvement encompassed tailoring strategies, developing a formal implementation blueprint, cyclical tests of change, and purposefully re-examining the implementation process.

CONCLUSIONS

Specifying the components of SAIA provides improved conceptual clarity to enhance reproducibility for other researchers and practitioners interested in applying the SAIA across novel settings.

The cost of implementing the Systems Analysis and Improvement Approach for a cluster randomized trial integrating HIV testing into family planning services in Mombasa County, Kenya

BACKGROUND

Although HIV testing in family planning (FP) clinics is a promising approach for engaging women in HIV treatment and prevention services, HIV testing rates are low in FP clinics in Kenya. In 2018, a cluster randomized trial was implemented in Mombasa, Kenya applying the Systems Analysis and Improvement Approach (SAIA) to integrate HIV testing into FP services (1K24HD088229-01). We estimated the incremental costs and explored cost drivers of the FP HIV SAIA implementation in Mombasa, Kenya.

METHODS

We conducted a costing evaluation from the payer perspective for the FP HIV SAIA randomized control trial. We identified relevant activities for the intervention including start-up, training, research and FP HIV SAIA. We estimated activity time burden using a time-and motion study. We derived unit costs through staff interviews and programmatic budgets. We present cost estimates for two different scenarios: as-implemented including research and projected costs for a Ministry of Health-supported intervention. All costs are reported in 2018 USD.

RESULTS

For an annual program output of 36,086 HIV tests administered to new FP clients, we estimated the total annual program cost to be $91,994 with an average cost per new FP client served of $2.55. Personnel and HIV rapid testing kits comprised 55% and 21% of programmatic costs, respectively. Assuming no changes to program outputs and with efficiency gains under the MOH scenario, the estimated cost per new FP client served decreased to $1.30 with a programmatic cost reduction of 49%.

CONCLUSION

FP HIV SAIA is a low-cost and flexible implementation strategy for facilitating integrated delivery of HIV testing alongside FP services. Although cost implications of the FP HIV SAIA intervention must continue to be evaluated over time, these findings provide context-specific cost data useful for budget planning and decision-making regarding intervention delivery and expansion.

TRIAL REGISTRATION

The trial was registered on December 15, 2016, with clinicaltrials.gov (NCT02994355).

Association between service readiness and PMTCT cascade effectiveness: a 2018 cross-sectional analysis from Manica province, Mozambique

BACKGROUND

Despite high coverage of maternal and child  health services in Mozambique, prevention of mother-to-child transmission of HIV (PMTCT) cascade outcomes remain sub-optimal. Delivery effectiveness is modified by health system preparedness. Identifying modifiable factors that impact quality of care and service uptake can inform strategies to improve the effectiveness of PMTCT programs. We estimated associations between facility-level modifiable health system readiness measures and three PMTCT outcomes: Early infant diagnosis (polymerase chain reaction (PCR) before 8 weeks of life), PCR ever (before or after 8 weeks), and positive PCR test result.

METHODS

A 2018 cross-sectional, facility-level survey was conducted in a sample of 36 health facilities covering all 12 districts in Manica province, central Mozambique, as part of a baseline assessment for the SAIA-SCALE trial (NCT03425136). Data on HIV testing outcomes among 3,427 exposed infants were abstracted from at-risk child service registries. Nine health system readiness measures were included in the analysis. Logistic regressions were used to estimate associations between readiness measures and pediatric HIV testing outcomes. Odds ratios (OR) and 95% confidence intervals (95%CI) are reported.

RESULTS

Forty-eight percent of HIV-exposed infants had a PCR test within 8 weeks of life, 69% had a PCR test ever, and 6% tested positive. Staffing levels, glove stockouts, and distance to the reference laboratory were positively associated with early PCR (OR = 1.02 [95%CI: 1.01-1.02], OR = 1.73 [95%CI: 1.24-2.40] and OR = 1.01 [95%CI: 1.00-1.01], respectively) and ever PCR (OR = 1.02 [95%CI: 1.01-1.02], OR = 1.80 [95%CI: 1.26-2.58] and OR = 1.01 [95%CI: 1.00-1.01], respectively). Catchment area size and multiple NGOs supporting PMTCT services were associated with early PCR testing OR = 1.02 [95%CI: 1.01-1.03] and OR = 0.54 [95%CI: 0.30-0.97], respectively). Facility type, stockout of prophylactic antiretrovirals, the presence of quality improvement programs and mothers' support groups in the health facility were not associated with PCR testing. No significant associations with positive HIV diagnosis were found.

CONCLUSION

Salient modifiable factors associated with HIV testing for exposed infants include staffing levels, NGO support, stockout of essential commodities and accessibility of reference laboratories. Our study provides insights into modifiable factors that could be targeted to improve PMTCT performance, particularly at small and rural facilities.

Assessing the sustainability of the Systems Analysis and Improvement Approach to increase HIV testing in family planning clinics in Mombasa, Kenya: results of a cluster randomized trial

BACKGROUND

In Kenya, HIV incidence is highest among reproductive-age women. A key HIV mitigation strategy is the integration of HIV testing and counseling (HTC) into family planning services, but successful integration remains problematic. We conducted a cluster-randomized trial using the Systems Analysis and Improvement Approach (SAIA) to identify and address bottlenecks in HTC integration in family planning clinics in Mombasa County, Kenya. This trial (1) assessed the efficacy of this approach and (2) examined if SAIA could be sustainably incorporated into the Department of Health Services (DOHS) programmatic activities. In Stage 1, SAIA was effective at increasing HTC uptake. Here, we present Stage 2, which assessed if SAIA delivery would be sustained when implemented by the Mombasa County DOHS and if high HTC performance would continue to be observed.

METHODS

Twenty-four family planning clinics in Mombasa County were randomized to either the SAIA implementation strategy or standard care. In Stage 1, the study staff conducted all study activities. In Stage 2, we transitioned SAIA implementation to DOHS staff and compared HTC in the intervention versus control clinics 1-year post-transition. Study staff provided training and minimal support to DOHS implementers and collected quarterly HTC outcome data. Interviews were conducted with family planning clinic staff to assess barriers and facilitators to sustaining HTC delivery.

RESULTS

Only 39% (56/144) of planned SAIA visits were completed, largely due to the COVID-19 pandemic and a prolonged healthcare worker strike. In the final study quarter, 81.6% (160/196) of new clients at intervention facilities received HIV counseling, compared to 22.4% (55/245) in control facilities (prevalence rate ratio [PRR]=3.64, 95% confidence interval [CI]=2.68-4.94). HIV testing was conducted with 60.5% (118/195) of new family planning clients in intervention clinics, compared to 18.8% (45/240) in control clinics (PRR=3.23, 95% CI=2.29-4.55). Interviews with family planning clinic staff suggested institutionalization contributed to sustained HTC delivery, facilitated by low implementation strategy complexity and continued oversight.

CONCLUSIONS

Intervention clinics demonstrated sustained improvement in HTC after SAIA was transitioned to DOHS leadership despite wide-scale healthcare disruptions and incomplete delivery of the implementation strategy. These findings suggest that system interventions may be sustained when integrated into DOHS programmatic activities.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered on 16 December 2016.

Qualitative evaluation of the Systems Analysis and Improvement Approach as a strategy to increase HIV testing in family planning clinics using the Consolidated Framework for Implementation Research and the Implementation Outcomes Framework

BACKGROUND

Significant gaps remain in HIV testing and counseling (HTC) in family planning (FP) clinics. To address these gaps, our group tested an implementation strategy called the Systems Analysis and Improvement Approach (SAIA), an evidenced-based multi-component implementation strategy focused on improving entire care cascades. In a cluster randomized trial of 24 FP clinics in Mombasa County, Kenya, SAIA led to a significant increase in HTC in intervention clinics compared to control clinics. The objective of this manuscript was to evaluate SAIA using the Consolidated Framework for Implementation Research (CFIR) and assess the Implementation Outcomes Framework outcomes of acceptability, appropriateness, and feasibility.

METHODS

This qualitative assessment was nested within the cluster-randomized trial. Data collection included questionnaires to assess modifiable and non-modifiable health system factors related to HTC and in-depth interviews to query clinic norms, priorities, communication strategies, and readiness for change. The primary outcomes of interest were feasibility, appropriateness, and acceptability of SAIA. Data on inner setting and structural characteristics of FP clinics were collected to inform how context may impact outcomes. All interviews were recorded and analyzed using a rapid assessment approach.

RESULTS

Of the 12 intervention clinics, 6 (50%) were public facilities. Availability of resources varied by clinic. Most clinics had a positive implementation climate, engaged leadership, and access to resources and information. While not all clinics identified HTC as a clinic priority, most reported a strong culture of embracing change and recognition of the importance of HIV testing within FP clinics. Interviews highlighted very high acceptability, appropriateness, and feasibility of SAIA. The implementation strategy was not complicated and fit well into existing clinic processes. In particular, staff appreciated that SAIA allowed clinic staff to generate contextually relevant solutions that they implemented.

CONCLUSIONS

SAIA was implemented in FP clinics of varying sizes, capacity, and management support and was found to be acceptable, appropriate, and feasible. The agency that clinic staff felt in proposing and implementing their own solutions was likely part of SAIA's success. We anticipate this will continue to be a mechanism of SAIA's success when it is scaled up to more clinics in future trials.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered 16 December 2016.

Providing "a beam of light to see the gaps": determinants of implementation of the Systems Analysis and Improvement Approach applied to the pediatric and adolescent HIV cascade in Kenya

Background

Children and adolescents living with HIV have poorer rates of HIV testing, treatment, and virologic suppression than adults. Strategies that use a systems approach to optimize these multiple, linked steps simultaneously are critical to close these gaps.

Methods

The Systems Analysis and Improvement Approach (SAIA) was adapted and piloted for the pediatric and adolescent HIV care and treatment cascade (SAIA-PEDS) at 6 facilities in Kenya. SAIA-PEDS includes three tools: continuous quality improvement (CQI), flow mapping, and pediatric cascade analysis (PedCAT). A predominately qualitative evaluation utilizing focus group discussions (N = 6) and in-depth interviews (N = 19) was conducted with healthcare workers after implementation to identify determinants of implementation. Data collection and analysis were grounded in the Consolidated Framework for Implementation Research (CFIR).

Results

Overall, the adapted SAIA-PEDS strategy was acceptable, and the three tools complemented one another and provided a relative advantage over existing processes. The flow mapping and CQI tools were compatible with existing workflows and resonated with team priorities and goals while providing a structure for group problem solving that transcended a single department’s focus. The PedCAT was overly complex, making it difficult to use. Leadership and hierarchy were complex determinants. All teams reported supportive leadership, with some describing in detail how their leadership was engaged and enthusiastic about the SAIA-PEDS process, by providing recognition, time, and resources. Hierarchy was similarly complex: in some facilities, leadership stifled rapid innovation by insisting on approving each change, while at other facilities, leadership had strong and supportive oversight of processes, checking on the progress frequently and empowering teams to test innovative ideas.

Conclusion

CQI and flow mapping were core components of SAIA-PEDS, with high acceptability and consistent use, but the PedCAT was too complex. Leadership and hierarchy had a nuanced role in implementation. Future SAIA-PEDS testing should address PedCAT complexity and further explore the modifiability of leadership engagement to maximize implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00304-3.

Systems analysis and improvement approach to optimize outpatient mental health treatment cascades in Mozambique (SAIA-MH): study protocol for a cluster randomized trial

BACKGROUND

Significant investments are being made to close the mental health (MH) treatment gap, which often exceeds 90% in many low- and middle-income countries (LMICs). However, limited attention has been paid to patient quality of care in nascent and evolving LMIC MH systems. In system assessments across sub-Saharan Africa, MH loss-to-follow-up often exceeds 50% and sub-optimal medication adherence often exceeds 60%. This study aims to fill a gap of evidence-based implementation strategies targeting the optimization of MH treatment cascades in LMICs by testing a low-cost multicomponent implementation strategy integrated into routine government MH care in Mozambique.

METHODS

Using a cluster-randomized trial design, 16 clinics (8 intervention and 8 control) providing primary MH care will be randomized to the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH) or an attentional placebo control. SAIA-MH is a multicomponent implementation strategy blending external facilitation, clinical consultation, and provider team meetings with system-engineering tools in an overall continuous quality improvement framework. Following a 6-month baseline period, intervention facilities will implement the SAIA-MH strategy for a 2-year intensive implementation period, followed by a 1-year sustainment phase. Primary outcomes will be the proportion of all patients diagnosed with a MH condition and receiving pharmaceutical-based treatment who achieve functional improvement, adherence to medication, and retention in MH care. The Consolidated Framework for Implementation Research (CFIR) will be used to assess determinants of implementation success. Specific Aim 1b will include the evaluation of mechanisms of the SAIA-MH strategy using longitudinal structural equation modeling as well as specific aim 2 estimating cost and cost-effectiveness of scaling-up SAIA-MH in Mozambique to provincial and national levels.

DISCUSSION

This study is innovative in being the first, to our knowledge, to test a multicomponent implementation strategy for MH care cascade optimization in LMICs. By design, SAIA-MH is a low-cost strategy to generate contextually relevant solutions to barriers to effective primary MH care, and thus focuses on system improvements that can be sustained over the long term. Since SAIA-MH is integrated into routine government MH service delivery, this pragmatic trial has the potential to inform potential SAIA-MH scale-up in Mozambique and other similar LMICs.

TRIAL REGISTRATION

ClinicalTrials.gov; NCT05103033 ; 11/2/2021.

Systems Analysis and Improvement Approach to optimize the pediatric and adolescent HIV Cascade (SAIA-PEDS): a pilot study

INTRODUCTION

Children and adolescents lag behind adults in achieving UNAIDS 95-95-95 targets for HIV testing, treatment, and viral suppression. The Systems Analysis and Improvement Approach (SAIA) is a multi-component implementation strategy previously shown to improve the HIV care cascade for pregnant women and infants. SAIA merits adaptation and testing to reduce gaps in the pediatric and adolescent HIV cascade.

METHODS

We adapted the SAIA strategy components to be applicable to the pediatric and adolescent HIV care cascade (SAIA-PEDS) in Nairobi and western Kenya. We tested whether this SAIA-PEDS strategy improved HIV testing, linkage to care, antiretroviral treatment (ART), viral load (VL) testing, and viral load suppression for children and adolescents ages 0-24 years at 5 facilities. We conducted a pre-post analysis with 6 months pre- and 6 months post-implementation strategy (coupled with an interrupted time series sensitivity analysis) using abstracted routine program data to determine changes attributable to SAIA-PEDS.

RESULTS

Baseline levels of HIV testing and care cascade indicators were heterogeneous between facilities. Per facility, the monthly average number of children/adolescents attending outpatient and inpatient services eligible for HIV testing was 842; on average, 253 received HIV testing services, 6 tested positive, 6 were linked to care, and 5 initiated ART. Among those on treatment at the facility, an average of 15 had a VL sample taken and 13 had suppressed VL results returned. Following the SAIA-PEDS training and mentorship, there was no substantial or significant change in the ratio of HIV testing (RR: 0.803 [95% CI: 0.420, 1.532]) and linkage to care (RR: 0.831 [95% CI: 0.546, 1.266]). The ratio of ART initiation increased substantially and trended towards significance (RR: 1.412 [95% CI: 0.999, 1.996]). There were significant and substantial improvements in the ratio of VL tests ordered (RR: 1.939 [95% CI: 1.230, 3.055]) but no substantial or significant change in the ratio of VL results suppressed (RR: 0.851 [95% CI: 0.554, 1.306]).

CONCLUSIONS

The piloted SAIA-PEDS implementation strategy was associated with increases in health system performance for indicators later in the HIV care cascade, but not for HIV testing and treatment indicators. This strategy merits further rigorous testing for effectiveness and sustainment.

Development of a Blended Learning Approach to Delivering HIV-Assisted Contact Tracing in Malawi: Applied Theory and Formative Research

Background

Despite progress toward the Joint United Nations Programme on HIV/AIDS “95-95-95” targets (95% of HIV-positive persons tested, 95% of tested persons on treatment, and 95% of treated persons virally suppressed), a gap remains in achieving the first 95% target. Assisted contact tracing (ACT), in which health workers support HIV-positive index clients to recruit their contacts (sexual partners and children) for HIV testing, efficiently identifies HIV-positive persons in need of treatment. Although many countries, including Malawi, began implementing ACT, testing outcomes in routine settings have been worse than those in trial settings.

Objective

The aim of this paper is to use formative research and frameworks to develop and digitize an implementation package to bridge the gap between ACT research and practice.

Methods

Semistructured qualitative research was conducted in 2019 in Malawi with key informants. Barriers and facilitators to intervention delivery were identified using the Consolidated Framework for Implementation Research. Approaches to digitization were examined using human-centered design principles.

Results

Limited clinic coordination and health worker capacity to address the complexities of ACT were identified as barriers. Ongoing individual training consisting of learning, observing, practicing, and receiving feedback, as well as group problem-solving were identified as facilitators. Important features of digitization included (1) culturally relevant visual content, (2) capability of offline use, and (3) simple designs and basic editing to keep costs low.

Conclusions

Formative research and frameworks played a key role in designing and digitizing an implementation package for ACT delivery in a low-income setting such as Malawi.

Results of a cluster randomized trial testing the systems analysis and improvement approach to increase HIV testing in family planning clinics

OBJECTIVE

The aim of this study was to test an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), to increase rates of HIV testing and counseling (HTC) in family planning clinics in Mombasa, Kenya.

DESIGN

A cluster randomized trial.

METHODS

Twenty-four family planning clinics were randomized 1 : 1 to implementing SAIA versus usual procedures. Study staff implemented monthly SAIA cycles with family planning clinic staff for 12 months. SAIA has five steps. Step 1 uses a "cascade analysis' tool to quantify the number of individuals who complete each step of a process. Step 2 involves sequential process flow mapping to identify modifiable bottlenecks in the system. Step 3 develops and implements workflow modifications to address bottlenecks. Step 4 assesses impact of the modification by recalculating the cascade analysis. Step 5 repeats the cycle. The primary outcome was the proportion of new family planning clients tested for HIV during the last quarter of the trial.

RESULTS

During the last 3 months of the trial, 85% (740/868) of new family planning clients were counseled for HIV in intervention clinics compared with 67% (1036/1542) in control clinics (prevalence rate ratio [PRR] 1.27, 95% confidence interval [CI] 1.15-1.30). Forty-two percent (364/859) of family planning clients were tested for HIV at intervention clinics compared with 32% (485/1521) at control clinics (PRR 1.33, 95% CI 1.16-1.52).

CONCLUSION

SAIA led to a significant increase in HIV testing in family planning clinics in Mombasa. Integrating routine HTC into family planning clinics is a promising strategy to achieve the UNAIDS goal of 95% of people living with HIV being aware of their status.

Optimizing treatment cascades for mental healthcare in Mozambique: preliminary effectiveness of the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH)

Substantial investments are being made to scale-up access to mental healthcare in low- and middle-income countries, but less attention has been paid to quality and performance of nascent public-sector mental healthcare systems. This study tested the initial effectiveness of an implementation strategy to optimize routine outpatient mental healthcare cascade performance in Mozambique [the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH)]. This study employed a pre-post design from September 2018 to August 2019 across four Ministry of Health clinics among 810 patients and 3234 outpatient mental health visits. Effectiveness outcomes evaluated progression through the care cascade, including: (1) initial diagnosis and medication selection; (2) enrolling in follow-up care; (3) returning after initial consultation within 60 days; (4) returning for follow-up visits on time; (5) returning for follow-up visits adherent to medication and (6) achieving function improvement. Clustered generalized linear models evaluated odds of completing cascade steps pre- vs post-intervention. Facilities prioritized improvements focused on the follow-up cascade, with 62.5% (10 of 16) monthly system modifications targeting medication adherence. At baseline, only 4.2% of patient visits achieved function improvement; during the 6 months of SAIA-MH implementation, this improved to 13.1% of patient visits. Multilevel logistic regression found increased odds of returning on time and adherent [aOR = 1.53, 95% CI (1.21, 1.94), P = 0.0004] and returning on time, adherent and with function improvement [aOR = 3.68, 95% CI (2.57, 5.44), P < 0.0001] after SAIA-MH implementation. No significant differences were observed regarding other cascade steps. The SAIA-MH implementation strategy shows promise for rapidly and significantly improving mental healthcare cascade outcomes, including the ultimate goal of patient function improvement. Given poor baseline mental healthcare cascade performance, there is an urgent need for evidence-based implementation strategies to optimize the performance of mental healthcare cascades in low- and middle-income countries.

Mapping the cervical cancer screening cascade among women living with HIV in Johannesburg, South Africaa

OBJECTIVE

To map the cervical cancer screening cascade among women living with HIV attending a public-sector cytology screening program in Johannesburg, South Africa.

METHODS

We conducted a retrospective cohort study of routinely collected clinical data captured in an electronic medical record system. Women (≥18 years) living with HIV with an abnormal Pap result between January 2013 and May 2018 were included. The proportion of women who received follow-up consistent with extant clinical guidelines, stratified by their initial Pap smear result, was examined.

RESULTS

The study included 2072 women: 1384 (66.8%) with a low-risk Pap result, 681 (32.9%) with a high-risk Pap result, and 7 (0.3%) with suspected cancer. Only 174 (25.6%) women with a high-risk Pap result underwent guideline-indicated management within 18 months. Among women with a low-risk Pap result, 375 (27.1%) received follow-up within 1 year; the cumulative incidence of follow-up increased to 63.1% at 3 years. All women with suspected cancer either received a colposcopic biopsy or were referred for further treatment.

CONCLUSION

Attrition among South African women living with HIV who attended cervical screening in an urban public-sector program was high. Developing tailored interventions to address bottlenecks in the care cascade and improve cervical screening outcomes will be central to eliminating cervical cancer.

Systems analysis and improvement approach to optimize the hypertension diagnosis and care cascade for PLHIV individuals (SAIA-HTN): a hybrid type III cluster randomized trial

BACKGROUND

Across sub-Saharan Africa, evidence-based clinical guidelines to screen and manage hypertension exist; however, country level application is low due to lack of service readiness, uneven health worker motivation, weak accountability of health worker performance, and poor integration of hypertension screening and management with chronic care services. The systems analysis and improvement approach (SAIA) is an evidence-based implementation strategy that combines systems engineering tools into a five-step, facility-level package to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). As hypertension screening and management are integrated into chronic care services in sub-Saharan Africa, an opportunity exists to test whether SAIA interventions shown to be effective in improving efficiency and coverage of HIV services can be effective when applied to the non-communicable disease services that leverage the same platform. We hypothesize that SAIA-hypertension (SAIA-HTN) will be effective as an adaptable, scalable model for broad implementation.

METHODS

We will deploy a hybrid type III cluster randomized trial to evaluate the impact of SAIA-HTN on hypertension management in eight intervention and eight control facilities in central Mozambique. Effectiveness outcomes include hypertension cascade flow measures (screening, diagnosis, management, control), as well as hypertension and HIV clinical outcomes among people living with HIV. Cost-effectiveness will be estimated as the incremental costs per additional patient passing through the hypertension cascade steps and the cost per additional disability-adjusted life year averted, from the payer perspective (Ministry of Health). SAIA-HTN implementation fidelity will be measured, and the Consolidated Framework for Implementation Research will guide qualitative evaluation of the implementation process in high- and low-performing facilities to identify determinants of intervention success and failure, and define core and adaptable components of the SAIA-HTN intervention. The Organizational Readiness for Implementing Change scale will measure facility-level readiness for adopting SAIA-HTN.

DISCUSSION

SAIA packages user-friendly systems engineering tools to guide decision-making by front-line health workers to identify low-cost, contextually appropriate chronic care improvement strategies. By integrating SAIA into routine hypertension screening and management structures, this pragmatic trial is designed to test a model for national scale-up.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04088656 (registered 09/13/2019; https://clinicaltrials.gov/ct2/show/NCT04088656).