Systems Analysis and Improvement Approach to optimize the pediatric and adolescent HIV Cascade (SAIA-PEDS): a pilot study

Systems analysis and improvement to optimize opioid use disorder care quality and continuity for patients exiting jail (SAIA-MOUD)

BACKGROUND

Between 2012-2022 opioid-related overdose deaths in the United States, including Washington State, have risen dramatically. Opioid use disorder (OUD) is a complex, chronic, and criminalized illness with biological, environmental, and social causes. One-fifth of people with OUD have recent criminal-legal system involvement; > 50% pass through WA jails annually. Medications for Opioid Use Disorder (MOUD) can effectively treat OUD. WA has prioritized improving access to MOUD, including for those in jails. As patients in jail settings are systematically marginalized due to incarceration, it is critical to foster connections to MOUD services upon release, an acknowledged period of high overdose risk. Currently, there is insufficient focus on developing strategies to foster linkages between jail-based MOUD and referral services. The Systems Analysis and Improvement Approach (SAIA), an evidence-based implementation strategy, may optimize complex care cascades like MOUD provision and improve linkages between jail- and community-based providers. SAIA bundles systems engineering tools into an iterative process to guide care teams to visualize cascade drop-offs and prioritize steps for improvement; identify modifiable organization-level bottlenecks; and propose, implement, and evaluate modifications to overall cascade performance. The SAIA-MOUD study aims to strengthen the quality and continuity of MOUD care across jail and referral clinics in King County, WA, and ultimately reduce recidivism and mortality.

METHODS

We will conduct a quasi-experimental evaluation of SAIA effectiveness on improving MOUD care cascade quality and continuity for patients receiving care in jail and exiting to referral clinics; examine determinants of SAIA-MOUD adoption, implementation, and sustainment; and determine SAIA-MOUD's cost and cost-effectiveness. Clinic teams with study team support will deliver the SAIA-MOUD intervention at the jail-based MOUD program and three referral clinics over a two-year intensive phase, followed by a one-year sustainment phase where SAIA implementation will be led by King County Jail MOUD staff without study support to enable pragmatic evaluation of sustained implementation.

DISCUSSION

SAIA packages user-friendly systems engineering tools to guide decision-making by front-line care providers to identify low-cost, contextually appropriate health care improvement strategies. By integrating SAIA into MOUD care provision in jail and linked services, this pragmatic trial is designed to test a model for national scale-up.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06593353 (registered 09/06/2024; https://register.

CLINICALTRIALS

gov/prs/beta/studies/S000EVJR00000029/recordSummary ).

Posttrial Experiences in Sustainment of a Scaled Model of the Systems Analysis and Improvement Approach (SAIA-SCALE) in the Absence of External Funding in Manica Province, Mozambique

BACKGROUND

Following the conclusion of a stepped-wedge cluster randomized trial of the Systems Analysis and Improvement Approach (SAIA) to optimize the prevention of mother-to-child HIV transmission cascade in Manica Province, Mozambique, we conducted a natural experiment to test the sustainability of the delivery model with limited financial inputs.

METHODS

District nurse supervisors were encouraged to continue to facilitate SAIA cycles in subordinate health facilities and provided phone credit and tablet access to upload implementation data. No additional resources (eg, funds for transport, refreshments, or supplies) were provided. Barriers to implementation were collected via conversations with district supervisors.

RESULTS

Monthly facilitation of SAIA cycles continued in 11 of 12 (92%) districts and 13 of 36 (36%) facilities through 12 months posttrial, which declined to 10 districts and 10 facilities by the end of the 15-month posttrial period. Despite interest among district supervisors to continue implementation, logistical and financial barriers prevented visits to facilities not in close proximity to district management offices. Turnover of district supervisors resulted in replacements not having knowledge and experience facilitating SAIA. The lack of refreshments for facility staff and limited supplies (pens and papers) were cited as additional barriers.

CONCLUSION

Despite the scalability of the SAIA model, it is susceptible to implementation decay without sufficient health system resources. Additional research is needed to test sustainment strategies that address identified barriers and enable continued delivery of the implementation strategy core components at a sufficient level of fidelity to maintain desired health system improvements and patient-level outcomes.

Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

BACKGROUND

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services. Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

METHODS

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be "scaled up" with delivery by district health supervisors (rather than research staff) and will be "scaled out" via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer's perspective.

DISCUSSION

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05002322 (registered 02/15/2023).

Results of a cluster randomized trial testing the Systems Analysis and Improvement Approach to increase cervical cancer screening in family planning clinics in Mombasa County, Kenya

BACKGROUND

Cervical cancer is the leading cause of cancer death in Kenyan women. Integrating cervical cancer screening into family planning (FP) clinics is a promising strategy to improve health for reproductive-aged women. The objective of this cluster randomized trial was to test the efficacy of an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), as a tool to increase cervical cancer screening in FP clinics in Mombasa County, Kenya.

METHODS

Twenty FP clinics in Mombasa County were randomized 1:1 to SAIA versus usual procedures. SAIA has five steps: (1) cascade analysis tool to understand the cascade and identify inefficiencies, (2) sequential process flow mapping to identify bottlenecks, (3) develop and implement workflow modifications (micro-interventions) to address identified bottlenecks, (4) assess the micro-intervention in the cascade analysis tool, and (5) repeat the cycle. Prevalence ratios were calculated using Poisson regression with robust standard errors to compare the proportion of visits where women were screened for cervical cancer in SAIA clinics compared to control clinics.

RESULTS

In the primary intent-to-treat analysis in the last quarter of the trial, 2.5% (37/1507) of visits with eligible FP clients at intervention facilities included cervical cancer screening compared to 3.7% (66/1793) in control clinics (prevalence ratio [PR] 0.67, 95% CI 0.45-1.00). When adjusted for having at least one provider trained to perform cervical cancer screening at baseline, there was no significant difference between screening in intervention clinics compared to control clinics (adjusted PR 1.14, 95% CI 0.74-1.75).

CONCLUSIONS

The primary analysis did not show an effect on cervical cancer screening. However, the COVID-19 pandemic and a healthcare worker strike likely impacted SAIA's implementation with significant disruptions in FP care delivery during the trial. While SAIA's data-informed decision-making and clinic-derived solutions are likely important, future work should directly study the mechanisms through which SAIA operates and the influence of contextual factors on implementation.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03514459. Registered on April 19, 2018.

Systems analysis and improvement approach to improve naloxone distribution within syringe service programs: study protocol of a randomized controlled trial

BACKGROUND

More than half a million Americans died of an opioid-related overdose between 1999 and 2020, the majority occurring between 2015 and 2020. The opioid overdose mortality epidemic disproportionately impacts Black, Indigenous, and people of color (BIPOC): since 2015, overdose mortality rates have increased substantially more among Black (114%) and Latinx (97%) populations compared with White populations (32%). This is in part due to disparities in access to naloxone, an opioid antagonist that can effectively reverse opioid overdose to prevent death. Our recent pilot work determined that many barriers to naloxone access can be identified and addressed by syringe service programs (SSPs) using the Systems Analysis and Improvement Approach to Naloxone distribution (SAIA-Naloxone). This randomized controlled trial will test SAIA-Naloxone's ability to improve naloxone distribution in general and among BIPOC specifically.

METHODS

We will conduct a trial with 32 SSPs across California, randomly assigning 16 to the SAIA-Naloxone arm and 16 to receive implementation as usual. SAIA-Naloxone is a multifaceted, multilevel implementation strategy through which trained facilitators work closely with SSPs to (1) assess organization-level barriers, (2) prioritize barriers for improvement, and (3) test solutions through iterative change cycles until achieving and sustaining improvements. SSPs receiving SAIA-Naloxone will work with a trained facilitator for a period of 12 months. We will test SAIA-Naloxone's ability to improve SSPs' naloxone distribution using an interrupted time series approach. Data collection will take place during a 3-month lead-in period, the 12-month active period, and for an additional 6 months afterward to determine whether impacts are sustained. We will use a structured approach to specify SAIA-Naloxone to ensure strategy activities are clearly defined and to assess SAIA-Naloxone fidelity to aid in interpreting study results. We will also assess the costs associated with SAIA-Naloxone and its cost-effectiveness.

DISCUSSION

This trial takes a novel approach to improving equitable distribution of naloxone amid the ongoing epidemic and associated racial disparities. If successful, SAIA-Naloxone represents an important organizational-level solution to the multifaceted and multilevel barriers to equitable naloxone distribution.

Assessing drivers of implementing "Scaling-up the Systems Analysis and Improvement Approach" for Prevention of Mother-to-Child HIV Transmission in Mozambique (SAIA-SCALE) over implementation waves

BACKGROUND

The Systems Analysis and Improvement Approach (SAIA) is an evidence-based package of systems engineering tools originally designed to improve patient flow through the prevention of Mother-to-Child transmission of HIV (PMTCT) cascade. SAIA is a potentially scalable model for maximizing the benefits of universal antiretroviral therapy (ART) for mothers and their babies. SAIA-SCALE was a stepped wedge trial implemented in Manica Province, Mozambique, to evaluate SAIA's effectiveness when led by district health managers, rather than by study nurses. We present the results of a qualitative assessment of implementation determinants of the SAIA-SCALE strategy during two intensive and one maintenance phases.

METHODS

We used an extended case study design that embedded the Consolidated Framework for Implementation Research (CFIR) to guide data collection, analysis, and interpretation. From March 2019 to April 2020, we conducted in-depth individual interviews (IDIs) and focus group discussions (FGDs) with district managers, health facility maternal and child health (MCH) managers, and frontline nurses at 21 health facilities and seven districts of Manica Province (Chimoio, Báruè, Gondola, Macate, Manica, Sussundenga, and Vanduzi).

RESULTS

We included 85 participants: 50 through IDIs and 35 from three FGDs. Most study participants were women (98%), frontline nurses (49.4%), and MCH health facility managers (32.5%). An identified facilitator of successful intervention implementation (regardless of intervention phase) was related to SAIA's compatibility with organizational structures, processes, and priorities of Mozambique's health system at the district and health facility levels. Identified barriers to successful implementation included (a) inadequate health facility and road infrastructure preventing mothers from accessing MCH/PMTCT services at study health facilities and preventing nurses from dedicating time to improving service provision, and (b) challenges in managing intervention funds.

CONCLUSIONS

The SAIA-SCALE qualitative evaluation suggests that the scalability of SAIA for PMTCT is enhanced by its fit within organizational structures, processes, and priorities at the primary level of healthcare delivery and health system management in Mozambique. Barriers to implementation that impact the scalability of SAIA include district-level financial management capabilities and lack of infrastructure at the health facility level. SAIA cannot be successfully scaled up to adequately address PMTCT needs without leveraging central-level resources and priorities.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03425136 . Registered on 02/06/2018.

The Application of Systems Thinking to the Prevention and Control of Sexually Transmissible Infections among Adolescents and Adults: A Scoping Review

Systems thinking is a mechanism for making sense of complex systems that challenge linear explanations of cause-and-effect. While the prevention and control of sexually transmissible infections (STIs) has been identified as an area that may benefit from systems-level analyses, no review on the subject currently exists. The aim of this study is to conduct a scoping review to identify literature in which systems thinking has been applied to the prevention and control of STIs among adolescent and adult populations. Joanna Briggs Institute guidelines for the conduct of scoping reviews were followed. Five databases were searched for English-language studies published after 2011. A total of n = 6102 studies were screened against inclusion criteria and n = 70 were included in the review. The majority of studies (n = 34) were conducted in African nations. Few studies focused on priority sub-populations, and 93% were focused on HIV (n = 65). The most commonly applied systems thinking method was system dynamics modelling (n = 28). The review highlights areas for future research, including the need for more STI systems thinking studies focused on: (1) migrant and Indigenous populations; (2) conditions such as syphilis; and (3) innovations such as pre-exposure prophylaxis and at-home testing for HIV. The need for conceptual clarity around 'systems thinking' is also highlighted.

The Systems Analysis and Improvement Approach: specifying core components of an implementation strategy to optimize care cascades in public health

BACKGROUND

Healthcare systems in low-resource settings need simple, low-cost interventions to improve services and address gaps in care. Though routine data provide opportunities to guide these efforts, frontline providers are rarely engaged in analyzing them for facility-level decision making. The Systems Analysis and Improvement Approach (SAIA) is an evidence-based, multi-component implementation strategy that engages providers in use of facility-level data to promote systems-level thinking and quality improvement (QI) efforts within multi-step care cascades. SAIA was originally developed to address HIV care in resource-limited settings but has since been adapted to a variety of clinical care systems including cervical cancer screening, mental health treatment, and hypertension management, among others; and across a variety of settings in sub-Saharan Africa and the USA. We aimed to extend the growing body of SAIA research by defining the core elements of SAIA using established specification approaches and thus improve reproducibility, guide future adaptations, and lay the groundwork to define its mechanisms of action.

METHODS

Specification of the SAIA strategy was undertaken over 12 months by an expert panel of SAIA-researchers, implementing agents and stakeholders using a three-round, modified nominal group technique approach to match core SAIA components to the Expert Recommendations for Implementing Change (ERIC) list of distinct implementation strategies. Core implementation strategies were then specified according to Proctor's recommendations for specifying and reporting, followed by synthesis of data on related implementation outcomes linked to the SAIA strategy across projects.

RESULTS

Based on this review and clarification of the operational definitions of the components of the SAIA, the four components of SAIA were mapped to 13 ERIC strategies. SAIA strategy meetings encompassed external facilitation, organization of provider implementation meetings, and provision of ongoing consultation. Cascade analysis mapped to three ERIC strategies: facilitating relay of clinical data to providers, use of audit and feedback of routine data with healthcare teams, and modeling and simulation of change. Process mapping matched to local needs assessment, local consensus discussions and assessment of readiness and identification of barriers and facilitators. Finally, continuous quality improvement encompassed tailoring strategies, developing a formal implementation blueprint, cyclical tests of change, and purposefully re-examining the implementation process.

CONCLUSIONS

Specifying the components of SAIA provides improved conceptual clarity to enhance reproducibility for other researchers and practitioners interested in applying the SAIA across novel settings.

Providing "a beam of light to see the gaps": determinants of implementation of the Systems Analysis and Improvement Approach applied to the pediatric and adolescent HIV cascade in Kenya

Background

Children and adolescents living with HIV have poorer rates of HIV testing, treatment, and virologic suppression than adults. Strategies that use a systems approach to optimize these multiple, linked steps simultaneously are critical to close these gaps.

Methods

The Systems Analysis and Improvement Approach (SAIA) was adapted and piloted for the pediatric and adolescent HIV care and treatment cascade (SAIA-PEDS) at 6 facilities in Kenya. SAIA-PEDS includes three tools: continuous quality improvement (CQI), flow mapping, and pediatric cascade analysis (PedCAT). A predominately qualitative evaluation utilizing focus group discussions (N = 6) and in-depth interviews (N = 19) was conducted with healthcare workers after implementation to identify determinants of implementation. Data collection and analysis were grounded in the Consolidated Framework for Implementation Research (CFIR).

Results

Overall, the adapted SAIA-PEDS strategy was acceptable, and the three tools complemented one another and provided a relative advantage over existing processes. The flow mapping and CQI tools were compatible with existing workflows and resonated with team priorities and goals while providing a structure for group problem solving that transcended a single department’s focus. The PedCAT was overly complex, making it difficult to use. Leadership and hierarchy were complex determinants. All teams reported supportive leadership, with some describing in detail how their leadership was engaged and enthusiastic about the SAIA-PEDS process, by providing recognition, time, and resources. Hierarchy was similarly complex: in some facilities, leadership stifled rapid innovation by insisting on approving each change, while at other facilities, leadership had strong and supportive oversight of processes, checking on the progress frequently and empowering teams to test innovative ideas.

Conclusion

CQI and flow mapping were core components of SAIA-PEDS, with high acceptability and consistent use, but the PedCAT was too complex. Leadership and hierarchy had a nuanced role in implementation. Future SAIA-PEDS testing should address PedCAT complexity and further explore the modifiability of leadership engagement to maximize implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00304-3.