Optimizing treatment cascades for mental healthcare in Mozambique: preliminary effectiveness of the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH)

Systems analysis and improvement approach to optimize tuberculosis (SAIA-TB) screening, treatment, and prevention in South Africa: a stepped-wedge cluster randomized trial

BACKGROUND

The use of systems engineering tools, including the development and use of care cascades using routinely collected data, process mapping, and continuous quality improvement, is used for frontline healthcare workers to devise systems level change. South Africa experiences high rates of tuberculosis (TB) infection and disease as well as HIV co-infection. The Department of Health has made significant gains in HIV services over the last two decades, reaching their set "90-90-90" targets for HIV. However, TB services, although robust, have lagged in comparison for both disease and infection. The Systems Analysis and Improvement Approach (SAIA) is a five-step implementation science method, drawn from systems engineering, to identify, define, and implement workflow modifications using cascade analysis, process mapping, and repeated quality improvement cycles within healthcare facilities.

METHODS

This stepped-wedge cluster randomized trial will evaluate the effectiveness of SAIA on TB (SAIA-TB) cascade optimization for patients with TB and high-risk contacts across 16 clinics in four local municipalities in the Sarah Baartman district, Eastern Cape, South Africa. We hypothesize that SAIA-TB implementation will lead to a 20% increase in each of: TB screening, TB preventive treatment initiation, and TB disease treatment initiation during the 18-month intervention period. Focus group discussions and key informant interviews with clinic staff will also be conducted to determine drivers of implementation variability across clinics.

DISCUSSION

This study has the potential to improve TB screening, treatment initiation, and completion for both active disease and preventive measures among individuals with and without HIV in a high burden setting. SAIA-TB provides frontline health care workers with a systems-level view of their care delivery system with the aim of sustainable systems-level improvements.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT06314386. Registered 18 March 2024, https://clinicaltrials.gov/study/NCT06314386 . NCT06314386.

Results of a cluster randomized trial testing the Systems Analysis and Improvement Approach to increase cervical cancer screening in family planning clinics in Mombasa County, Kenya

BACKGROUND

Cervical cancer is the leading cause of cancer death in Kenyan women. Integrating cervical cancer screening into family planning (FP) clinics is a promising strategy to improve health for reproductive-aged women. The objective of this cluster randomized trial was to test the efficacy of an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), as a tool to increase cervical cancer screening in FP clinics in Mombasa County, Kenya.

METHODS

Twenty FP clinics in Mombasa County were randomized 1:1 to SAIA versus usual procedures. SAIA has five steps: (1) cascade analysis tool to understand the cascade and identify inefficiencies, (2) sequential process flow mapping to identify bottlenecks, (3) develop and implement workflow modifications (micro-interventions) to address identified bottlenecks, (4) assess the micro-intervention in the cascade analysis tool, and (5) repeat the cycle. Prevalence ratios were calculated using Poisson regression with robust standard errors to compare the proportion of visits where women were screened for cervical cancer in SAIA clinics compared to control clinics.

RESULTS

In the primary intent-to-treat analysis in the last quarter of the trial, 2.5% (37/1507) of visits with eligible FP clients at intervention facilities included cervical cancer screening compared to 3.7% (66/1793) in control clinics (prevalence ratio [PR] 0.67, 95% CI 0.45-1.00). When adjusted for having at least one provider trained to perform cervical cancer screening at baseline, there was no significant difference between screening in intervention clinics compared to control clinics (adjusted PR 1.14, 95% CI 0.74-1.75).

CONCLUSIONS

The primary analysis did not show an effect on cervical cancer screening. However, the COVID-19 pandemic and a healthcare worker strike likely impacted SAIA's implementation with significant disruptions in FP care delivery during the trial. While SAIA's data-informed decision-making and clinic-derived solutions are likely important, future work should directly study the mechanisms through which SAIA operates and the influence of contextual factors on implementation.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03514459. Registered on April 19, 2018.

Correlated depressive symptoms within seroconcordant, expectant partners living with HIV in Zambézia Province, Mozambique: a cross-sectional study

Approximately 15% of people with HIV in sub-Saharan Africa have comorbid depression, which impacts treatment outcomes. We describe predictors of baseline depressive symptoms in 1079 female and 1079 male participants in a cluster-randomized trial in Zambézia Province, Mozambique from November 2017 to December 2020. We modeled each partners' depressive symptoms (Patient Health Questionnaire-9 [PHQ-9]) using proportional odds models adjusted for enrollment date, age, body mass index [BMI], partner's PHQ-9 score, district, relationship status, education, occupation, WHO HIV clinical stage, and antiretroviral therapy use history. A post hoc analysis assessed covariate-adjusted rank correlation between partner depressive symptoms. Females were younger than males (median 23 vs. 28 years) and more likely to report no education (20.7% vs. 7.9%). Approximately 10% screened positive for depression (PHQ-9 score ≥ 10). Partner depressive symptoms were predictive of higher participant PHQ-9 scores. A male partner PHQ-9 score of 10 (versus 5) increased the odds that the female partner would have a higher PHQ-9 score (adjusted odds ratio: 7.25, 95% Confidence Interval [CI]: 5.43-9.67). Partner PHQ-9 scores were highly correlated after covariate adjustment (Spearman's rho 0.65, 95% CI 0.57-0.72). Interventions aimed to reduce depressive symptoms and improve HIV-related outcomes during pregnancy should address both partners' depressive symptoms.

Systems analysis and improvement approach to improve naloxone distribution within syringe service programs: study protocol of a randomized controlled trial

BACKGROUND

More than half a million Americans died of an opioid-related overdose between 1999 and 2020, the majority occurring between 2015 and 2020. The opioid overdose mortality epidemic disproportionately impacts Black, Indigenous, and people of color (BIPOC): since 2015, overdose mortality rates have increased substantially more among Black (114%) and Latinx (97%) populations compared with White populations (32%). This is in part due to disparities in access to naloxone, an opioid antagonist that can effectively reverse opioid overdose to prevent death. Our recent pilot work determined that many barriers to naloxone access can be identified and addressed by syringe service programs (SSPs) using the Systems Analysis and Improvement Approach to Naloxone distribution (SAIA-Naloxone). This randomized controlled trial will test SAIA-Naloxone's ability to improve naloxone distribution in general and among BIPOC specifically.

METHODS

We will conduct a trial with 32 SSPs across California, randomly assigning 16 to the SAIA-Naloxone arm and 16 to receive implementation as usual. SAIA-Naloxone is a multifaceted, multilevel implementation strategy through which trained facilitators work closely with SSPs to (1) assess organization-level barriers, (2) prioritize barriers for improvement, and (3) test solutions through iterative change cycles until achieving and sustaining improvements. SSPs receiving SAIA-Naloxone will work with a trained facilitator for a period of 12 months. We will test SAIA-Naloxone's ability to improve SSPs' naloxone distribution using an interrupted time series approach. Data collection will take place during a 3-month lead-in period, the 12-month active period, and for an additional 6 months afterward to determine whether impacts are sustained. We will use a structured approach to specify SAIA-Naloxone to ensure strategy activities are clearly defined and to assess SAIA-Naloxone fidelity to aid in interpreting study results. We will also assess the costs associated with SAIA-Naloxone and its cost-effectiveness.

DISCUSSION

This trial takes a novel approach to improving equitable distribution of naloxone amid the ongoing epidemic and associated racial disparities. If successful, SAIA-Naloxone represents an important organizational-level solution to the multifaceted and multilevel barriers to equitable naloxone distribution.

The Systems Analysis and Improvement Approach: specifying core components of an implementation strategy to optimize care cascades in public health

BACKGROUND

Healthcare systems in low-resource settings need simple, low-cost interventions to improve services and address gaps in care. Though routine data provide opportunities to guide these efforts, frontline providers are rarely engaged in analyzing them for facility-level decision making. The Systems Analysis and Improvement Approach (SAIA) is an evidence-based, multi-component implementation strategy that engages providers in use of facility-level data to promote systems-level thinking and quality improvement (QI) efforts within multi-step care cascades. SAIA was originally developed to address HIV care in resource-limited settings but has since been adapted to a variety of clinical care systems including cervical cancer screening, mental health treatment, and hypertension management, among others; and across a variety of settings in sub-Saharan Africa and the USA. We aimed to extend the growing body of SAIA research by defining the core elements of SAIA using established specification approaches and thus improve reproducibility, guide future adaptations, and lay the groundwork to define its mechanisms of action.

METHODS

Specification of the SAIA strategy was undertaken over 12 months by an expert panel of SAIA-researchers, implementing agents and stakeholders using a three-round, modified nominal group technique approach to match core SAIA components to the Expert Recommendations for Implementing Change (ERIC) list of distinct implementation strategies. Core implementation strategies were then specified according to Proctor's recommendations for specifying and reporting, followed by synthesis of data on related implementation outcomes linked to the SAIA strategy across projects.

RESULTS

Based on this review and clarification of the operational definitions of the components of the SAIA, the four components of SAIA were mapped to 13 ERIC strategies. SAIA strategy meetings encompassed external facilitation, organization of provider implementation meetings, and provision of ongoing consultation. Cascade analysis mapped to three ERIC strategies: facilitating relay of clinical data to providers, use of audit and feedback of routine data with healthcare teams, and modeling and simulation of change. Process mapping matched to local needs assessment, local consensus discussions and assessment of readiness and identification of barriers and facilitators. Finally, continuous quality improvement encompassed tailoring strategies, developing a formal implementation blueprint, cyclical tests of change, and purposefully re-examining the implementation process.

CONCLUSIONS

Specifying the components of SAIA provides improved conceptual clarity to enhance reproducibility for other researchers and practitioners interested in applying the SAIA across novel settings.

Toward 90-90-90 Goals for Global Mental Health

This Viewpoint discusses the adoption of 90-90-90 goals for global mental health, specifically targeting neurologic and substance use disorders, to prioritize mental health quality improvement within existing health services and destigmatize these conditions to promote treatment.

Assessing the sustainability of the Systems Analysis and Improvement Approach to increase HIV testing in family planning clinics in Mombasa, Kenya: results of a cluster randomized trial

BACKGROUND

In Kenya, HIV incidence is highest among reproductive-age women. A key HIV mitigation strategy is the integration of HIV testing and counseling (HTC) into family planning services, but successful integration remains problematic. We conducted a cluster-randomized trial using the Systems Analysis and Improvement Approach (SAIA) to identify and address bottlenecks in HTC integration in family planning clinics in Mombasa County, Kenya. This trial (1) assessed the efficacy of this approach and (2) examined if SAIA could be sustainably incorporated into the Department of Health Services (DOHS) programmatic activities. In Stage 1, SAIA was effective at increasing HTC uptake. Here, we present Stage 2, which assessed if SAIA delivery would be sustained when implemented by the Mombasa County DOHS and if high HTC performance would continue to be observed.

METHODS

Twenty-four family planning clinics in Mombasa County were randomized to either the SAIA implementation strategy or standard care. In Stage 1, the study staff conducted all study activities. In Stage 2, we transitioned SAIA implementation to DOHS staff and compared HTC in the intervention versus control clinics 1-year post-transition. Study staff provided training and minimal support to DOHS implementers and collected quarterly HTC outcome data. Interviews were conducted with family planning clinic staff to assess barriers and facilitators to sustaining HTC delivery.

RESULTS

Only 39% (56/144) of planned SAIA visits were completed, largely due to the COVID-19 pandemic and a prolonged healthcare worker strike. In the final study quarter, 81.6% (160/196) of new clients at intervention facilities received HIV counseling, compared to 22.4% (55/245) in control facilities (prevalence rate ratio [PRR]=3.64, 95% confidence interval [CI]=2.68-4.94). HIV testing was conducted with 60.5% (118/195) of new family planning clients in intervention clinics, compared to 18.8% (45/240) in control clinics (PRR=3.23, 95% CI=2.29-4.55). Interviews with family planning clinic staff suggested institutionalization contributed to sustained HTC delivery, facilitated by low implementation strategy complexity and continued oversight.

CONCLUSIONS

Intervention clinics demonstrated sustained improvement in HTC after SAIA was transitioned to DOHS leadership despite wide-scale healthcare disruptions and incomplete delivery of the implementation strategy. These findings suggest that system interventions may be sustained when integrated into DOHS programmatic activities.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered on 16 December 2016.

Qualitative evaluation of the Systems Analysis and Improvement Approach as a strategy to increase HIV testing in family planning clinics using the Consolidated Framework for Implementation Research and the Implementation Outcomes Framework

BACKGROUND

Significant gaps remain in HIV testing and counseling (HTC) in family planning (FP) clinics. To address these gaps, our group tested an implementation strategy called the Systems Analysis and Improvement Approach (SAIA), an evidenced-based multi-component implementation strategy focused on improving entire care cascades. In a cluster randomized trial of 24 FP clinics in Mombasa County, Kenya, SAIA led to a significant increase in HTC in intervention clinics compared to control clinics. The objective of this manuscript was to evaluate SAIA using the Consolidated Framework for Implementation Research (CFIR) and assess the Implementation Outcomes Framework outcomes of acceptability, appropriateness, and feasibility.

METHODS

This qualitative assessment was nested within the cluster-randomized trial. Data collection included questionnaires to assess modifiable and non-modifiable health system factors related to HTC and in-depth interviews to query clinic norms, priorities, communication strategies, and readiness for change. The primary outcomes of interest were feasibility, appropriateness, and acceptability of SAIA. Data on inner setting and structural characteristics of FP clinics were collected to inform how context may impact outcomes. All interviews were recorded and analyzed using a rapid assessment approach.

RESULTS

Of the 12 intervention clinics, 6 (50%) were public facilities. Availability of resources varied by clinic. Most clinics had a positive implementation climate, engaged leadership, and access to resources and information. While not all clinics identified HTC as a clinic priority, most reported a strong culture of embracing change and recognition of the importance of HIV testing within FP clinics. Interviews highlighted very high acceptability, appropriateness, and feasibility of SAIA. The implementation strategy was not complicated and fit well into existing clinic processes. In particular, staff appreciated that SAIA allowed clinic staff to generate contextually relevant solutions that they implemented.

CONCLUSIONS

SAIA was implemented in FP clinics of varying sizes, capacity, and management support and was found to be acceptable, appropriate, and feasible. The agency that clinic staff felt in proposing and implementing their own solutions was likely part of SAIA's success. We anticipate this will continue to be a mechanism of SAIA's success when it is scaled up to more clinics in future trials.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered 16 December 2016.

Providing "a beam of light to see the gaps": determinants of implementation of the Systems Analysis and Improvement Approach applied to the pediatric and adolescent HIV cascade in Kenya

Background

Children and adolescents living with HIV have poorer rates of HIV testing, treatment, and virologic suppression than adults. Strategies that use a systems approach to optimize these multiple, linked steps simultaneously are critical to close these gaps.

Methods

The Systems Analysis and Improvement Approach (SAIA) was adapted and piloted for the pediatric and adolescent HIV care and treatment cascade (SAIA-PEDS) at 6 facilities in Kenya. SAIA-PEDS includes three tools: continuous quality improvement (CQI), flow mapping, and pediatric cascade analysis (PedCAT). A predominately qualitative evaluation utilizing focus group discussions (N = 6) and in-depth interviews (N = 19) was conducted with healthcare workers after implementation to identify determinants of implementation. Data collection and analysis were grounded in the Consolidated Framework for Implementation Research (CFIR).

Results

Overall, the adapted SAIA-PEDS strategy was acceptable, and the three tools complemented one another and provided a relative advantage over existing processes. The flow mapping and CQI tools were compatible with existing workflows and resonated with team priorities and goals while providing a structure for group problem solving that transcended a single department’s focus. The PedCAT was overly complex, making it difficult to use. Leadership and hierarchy were complex determinants. All teams reported supportive leadership, with some describing in detail how their leadership was engaged and enthusiastic about the SAIA-PEDS process, by providing recognition, time, and resources. Hierarchy was similarly complex: in some facilities, leadership stifled rapid innovation by insisting on approving each change, while at other facilities, leadership had strong and supportive oversight of processes, checking on the progress frequently and empowering teams to test innovative ideas.

Conclusion

CQI and flow mapping were core components of SAIA-PEDS, with high acceptability and consistent use, but the PedCAT was too complex. Leadership and hierarchy had a nuanced role in implementation. Future SAIA-PEDS testing should address PedCAT complexity and further explore the modifiability of leadership engagement to maximize implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00304-3.

Systems analysis and improvement approach to optimize outpatient mental health treatment cascades in Mozambique (SAIA-MH): study protocol for a cluster randomized trial

BACKGROUND

Significant investments are being made to close the mental health (MH) treatment gap, which often exceeds 90% in many low- and middle-income countries (LMICs). However, limited attention has been paid to patient quality of care in nascent and evolving LMIC MH systems. In system assessments across sub-Saharan Africa, MH loss-to-follow-up often exceeds 50% and sub-optimal medication adherence often exceeds 60%. This study aims to fill a gap of evidence-based implementation strategies targeting the optimization of MH treatment cascades in LMICs by testing a low-cost multicomponent implementation strategy integrated into routine government MH care in Mozambique.

METHODS

Using a cluster-randomized trial design, 16 clinics (8 intervention and 8 control) providing primary MH care will be randomized to the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH) or an attentional placebo control. SAIA-MH is a multicomponent implementation strategy blending external facilitation, clinical consultation, and provider team meetings with system-engineering tools in an overall continuous quality improvement framework. Following a 6-month baseline period, intervention facilities will implement the SAIA-MH strategy for a 2-year intensive implementation period, followed by a 1-year sustainment phase. Primary outcomes will be the proportion of all patients diagnosed with a MH condition and receiving pharmaceutical-based treatment who achieve functional improvement, adherence to medication, and retention in MH care. The Consolidated Framework for Implementation Research (CFIR) will be used to assess determinants of implementation success. Specific Aim 1b will include the evaluation of mechanisms of the SAIA-MH strategy using longitudinal structural equation modeling as well as specific aim 2 estimating cost and cost-effectiveness of scaling-up SAIA-MH in Mozambique to provincial and national levels.

DISCUSSION

This study is innovative in being the first, to our knowledge, to test a multicomponent implementation strategy for MH care cascade optimization in LMICs. By design, SAIA-MH is a low-cost strategy to generate contextually relevant solutions to barriers to effective primary MH care, and thus focuses on system improvements that can be sustained over the long term. Since SAIA-MH is integrated into routine government MH service delivery, this pragmatic trial has the potential to inform potential SAIA-MH scale-up in Mozambique and other similar LMICs.

TRIAL REGISTRATION

ClinicalTrials.gov; NCT05103033 ; 11/2/2021.

Systems Analysis and Improvement Approach to optimize the pediatric and adolescent HIV Cascade (SAIA-PEDS): a pilot study

INTRODUCTION

Children and adolescents lag behind adults in achieving UNAIDS 95-95-95 targets for HIV testing, treatment, and viral suppression. The Systems Analysis and Improvement Approach (SAIA) is a multi-component implementation strategy previously shown to improve the HIV care cascade for pregnant women and infants. SAIA merits adaptation and testing to reduce gaps in the pediatric and adolescent HIV cascade.

METHODS

We adapted the SAIA strategy components to be applicable to the pediatric and adolescent HIV care cascade (SAIA-PEDS) in Nairobi and western Kenya. We tested whether this SAIA-PEDS strategy improved HIV testing, linkage to care, antiretroviral treatment (ART), viral load (VL) testing, and viral load suppression for children and adolescents ages 0-24 years at 5 facilities. We conducted a pre-post analysis with 6 months pre- and 6 months post-implementation strategy (coupled with an interrupted time series sensitivity analysis) using abstracted routine program data to determine changes attributable to SAIA-PEDS.

RESULTS

Baseline levels of HIV testing and care cascade indicators were heterogeneous between facilities. Per facility, the monthly average number of children/adolescents attending outpatient and inpatient services eligible for HIV testing was 842; on average, 253 received HIV testing services, 6 tested positive, 6 were linked to care, and 5 initiated ART. Among those on treatment at the facility, an average of 15 had a VL sample taken and 13 had suppressed VL results returned. Following the SAIA-PEDS training and mentorship, there was no substantial or significant change in the ratio of HIV testing (RR: 0.803 [95% CI: 0.420, 1.532]) and linkage to care (RR: 0.831 [95% CI: 0.546, 1.266]). The ratio of ART initiation increased substantially and trended towards significance (RR: 1.412 [95% CI: 0.999, 1.996]). There were significant and substantial improvements in the ratio of VL tests ordered (RR: 1.939 [95% CI: 1.230, 3.055]) but no substantial or significant change in the ratio of VL results suppressed (RR: 0.851 [95% CI: 0.554, 1.306]).

CONCLUSIONS

The piloted SAIA-PEDS implementation strategy was associated with increases in health system performance for indicators later in the HIV care cascade, but not for HIV testing and treatment indicators. This strategy merits further rigorous testing for effectiveness and sustainment.

Results of a cluster randomized trial testing the systems analysis and improvement approach to increase HIV testing in family planning clinics

OBJECTIVE

The aim of this study was to test an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), to increase rates of HIV testing and counseling (HTC) in family planning clinics in Mombasa, Kenya.

DESIGN

A cluster randomized trial.

METHODS

Twenty-four family planning clinics were randomized 1 : 1 to implementing SAIA versus usual procedures. Study staff implemented monthly SAIA cycles with family planning clinic staff for 12 months. SAIA has five steps. Step 1 uses a "cascade analysis' tool to quantify the number of individuals who complete each step of a process. Step 2 involves sequential process flow mapping to identify modifiable bottlenecks in the system. Step 3 develops and implements workflow modifications to address bottlenecks. Step 4 assesses impact of the modification by recalculating the cascade analysis. Step 5 repeats the cycle. The primary outcome was the proportion of new family planning clients tested for HIV during the last quarter of the trial.

RESULTS

During the last 3 months of the trial, 85% (740/868) of new family planning clients were counseled for HIV in intervention clinics compared with 67% (1036/1542) in control clinics (prevalence rate ratio [PRR] 1.27, 95% confidence interval [CI] 1.15-1.30). Forty-two percent (364/859) of family planning clients were tested for HIV at intervention clinics compared with 32% (485/1521) at control clinics (PRR 1.33, 95% CI 1.16-1.52).

CONCLUSION

SAIA led to a significant increase in HIV testing in family planning clinics in Mombasa. Integrating routine HTC into family planning clinics is a promising strategy to achieve the UNAIDS goal of 95% of people living with HIV being aware of their status.