Assessing the level of institutionalization of donor-funded anti-retroviral therapy (ART) programs in health facilities in Uganda: implications for program sustainability

Built to last? Barriers and facilitators of healthcare program sustainability: a systematic integrative review

OBJECTIVE

To identify barriers and facilitators associated with the sustainability of implemented and evaluated improvement programs in healthcare delivery systems.

DATA SOURCES AND STUDY SETTING

Six academic databases were searched to identify relevant peer-reviewed journal articles published in English between July 2011 and June 2022. Studies were included if they reported on healthcare program sustainability and explicitly identified barriers to, and facilitators of, sustainability.

STUDY DESIGN

A systematic integrative review guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. Study quality was appraised using Hawker's Quality Assessment Tool.

DATA COLLECTION/EXTRACTION METHODS

A team of reviewers screened eligible studies against the inclusion criteria and extracted the data independently using a purpose-designed Excel spreadsheet. Barriers and facilitators were extracted and mapped to the Integrated Sustainability Framework (ISF). Frequency counts of reported barriers/facilitators were performed across the included studies.

RESULTS

Of the 124 studies included in this review, almost half utilised qualitative designs (n = 52; 41.9%) and roughly one third were conducted in the USA (n = 43; 34.7%). Few studies (n = 29; 23.4%) reported on program sustainability beyond 5 years of program implementation and only 16 of them (55.2%) defined sustainability. Factors related to the ISF categories of inner setting (n = 99; 79.8%), process (n = 99; 79.8%) and intervention characteristics (n = 72; 58.1%) were most frequently reported. Leadership/support (n = 61; 49.2%), training/support/supervision (n = 54; 43.5%) and staffing/turnover (n = 50; 40.3%) were commonly identified barriers or facilitators of sustainability across included studies. Forty-six (37.1%) studies reported on the outer setting category: funding (n = 26; 56.5%), external leadership by stakeholders (n = 16; 34.8%), and socio-political context (n = 14; 30.4%). Eight studies (6.5%) reported on discontinued programs, with factors including funding and resourcing, poor fit, limited planning, and intervention complexity contributing to discontinuation.

CONCLUSIONS

This review highlights the importance of taking into consideration the inner setting, processes, intervention characteristics and outer setting factors when sustaining healthcare programs, and the need for long-term program evaluations. There is a need to apply consistent definitions and implementation frameworks across studies to strengthen evidence in this area.

TRIAL REGISTRATION

https://bmjopen.bmj.com/content/7/11/e018568 .

Sustainment of diverse evidence-informed practices disseminated in the Veterans Health Administration (VHA): initial development and piloting of a pragmatic survey tool

BACKGROUND

There are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors "Shark Tank" competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices.

METHODS

In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses.

RESULTS

A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1-4.

CONCLUSIONS

The initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field.

Training Exposure and Self-Rated Competence among HIV Care Providers Working with Adolescents in Kenya

Lack of health care worker (HCW) training is a barrier to implementing youth-friendly services. We examined training coverage and self-reported competence, defined as knowledge, abilities, and attitudes, of HCWs caring for adolescents living with HIV (ALWH) in Kenya. Surveys were conducted with 24 managers and 142 HCWs. Competence measures were guided by expert input and Kalamazoo II Consensus items. Health care workers had a median of 3 (interquartile range [IQR]: 1-6) years of experience working with ALWH, and 40.1% reported exposure to any ALWH training. Median overall competence was 78.1% (IQR: 68.8-84.4). In multivariable linear regression analyses, more years caring for ALWH and any prior training in adolescent HIV care were associated with significantly higher self-rated competence. Training coverage for adolescent HIV care remains suboptimal. Targeting HCWs with less work experience and training exposure may be a useful and efficient approach to improve quality of youth-friendly HIV services.

"The number of clients is increasing but the supplies are reducing": provider strategies for responding to chronic antiretroviral (ARV) medicines stock-outs in resource-limited settings: a qualitative study from Uganda

Background

Despite the increasing frequency of ARV medicines stock-outs in Sub-Saharan Africa, there is little research inquiring into the mitigation strategies devised by frontline health facilities. Many previous studies have focused on ‘upstream’ or national-level drivers of ARVs stock-outs with less empirical attention devoted ‘down-stream’ or at the facility-level. The objective of this study was to examine the strategies devised by health facilities in Uganda to respond to the chronic stock-outs of ARVs.

Methods

This was a qualitative research design nested within a larger mixed-methods study. We purposively selected 16 health facilities from across Uganda (to achieve diversity with regard to; level of care (primary/ tertiary), setting (rural/urban) and geographic sub-region (northern/ central/western). We conducted 76 Semi-structured interviews with ART clinic managers, clinicians and pharmacists in the selected health facilities supplemented by on-site observations and documentary reviews. Data were analyzed by coding and thematic analyses.

Results

Participants reported that facility-level contributors to stock-outs include untimely orders of drugs from suppliers and inaccurate quantification of ARV medicine needs due to a paucity of ART program data. Internal stock management solutions for mitigating stock-outs which emerged include the substitution of ARV medicines which were out of stock, overstocking selected medicines and the use of recently expired drugs. The external solutions for mitigating stock-outs which were identified include ‘borrowing’ of ARVs from peer-providers, re-distributing stock across regions and upward referrals of patients. Systemic drivers of stock-outs were identified. These include the supply of drugs with a short shelf life, oversupply and undersupply of ARV medicines and migration pressures on the available ARVs stock at case-study facilities.

Conclusion

Health facilities devised internal stock management strategies and relied on peer-provider networks for ARV medicines during stock-out events. Our study underscores the importance of devising interventions aimed at improving Uganda’s medicines supply chain systems in the quest to reduce the frequency of ARV medicines stock-outs at the front-line level of service delivery. Further research is recommended on the effect of substituting ARV medicines on patient outcomes.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4137-7) contains supplementary material, which is available to authorized users.