Identifying perceived barriers to monitoring service quality among substance abuse treatment providers in South Africa

Residential and inpatient treatment of substance use disorders in Sub-Saharan Africa: a scoping review

BACKGROUND

With substance use rates increasing in Sub-Saharan Africa (SSA), an understanding of the accessibility and effectiveness of rehabilitative services for people who use alcohol and other drugs (AOD) is critical in the global efforts to diagnose and treat substance use disorders (SUD). This scoping review seeks to address the gaps in knowledge related to the types of research that have been conducted regarding inpatient or residential SUD treatment in SSA, the settings in which the research was conducted, and the study countries.

METHODS

A search of three databases, PubMED, Scopus, and African Index Medicus, was conducted for publications related to the treatment of SUD in inpatient or residential settings in SSA. Articles were screened at the title/abstract level and at full text by two reviewers. Articles eligible for inclusion were original research, conducted in SSA, published in English, included populations who received or were currently receiving treatment for SUD in inpatient or residential settings, or documented demand for SUD services.

RESULTS

This scoping review included 82 studies originating from 6 countries in SSA. Three themes emerged within the literature: access and demand for inpatient and residential SUD treatment, quality and outcomes of SUD treatment, and descriptions of the services offered and staffing of these facilities. Barriers to access include financial barriers, limited availability of services, and geographic concentration in cities. Women were shown to access residential and inpatient SUD treatment at lower rates than men, and certain racial groups face unique language and financial barriers in accessing services. Studies indicate mixed success of inpatient and residential SUD treatment in sustained SUD remission for patients.

CONCLUSION

There are significant gaps in the literature, driven by a lack of longitudinal studies focused on patient outcomes following treatment and the use of a narrow definition of treatment success. Both structural and non-structural barriers, such as stigma and discrimination, are barriers to access. Further research is needed to evaluate approaches to mitigate these barriers and expand access to residential and inpatient SUD treatment.

Factors associated with patient-reported experiences and outcomes of substance use disorder treatment in Cape Town, South Africa

Background

Interventions are needed to improve the quality of South Africa’s substance use disorder (SUD) treatment system. This study aimed to identify factors associated with patient-reported suboptimal access, quality, and outcomes of SUD treatment to guide the design of targeted quality improvement initiatives.

Method

We analysed clinical record and patient survey data routinely collected by SUD services in the Western Cape Province, South Africa. The sample included 1097 treatment episodes, representing 32% of all episodes in 2019. Using multivariate logistic regression, we modelled socio-demographic, substance use and treatment correlates of patient-reported suboptimal access to, quality and outcomes of SUD treatment.

Results

Overall, 37.9% of patients reported substantial difficulties in accessing treatment, 28.8% reported suboptimal quality treatment, and 31.1% reported suboptimal SUD outcomes. The odds of reporting poor access were elevated for patients identifying as Black/African, in residential treatment, with comorbid mental health problems, and longer histories of substance use. Length of substance use, comorbid mental health problems, and prior SUD treatment were associated with greater likelihood of reporting suboptimal quality treatment. Patients with comorbid mental health problems, polysubstance use, who did not complete treatment, and who perceived treatment to be of poor quality were more likely to report suboptimal outcomes.

Conclusion

This study is among the first to use patient-reported experiences and outcome measures to identify targets for SUD treatment improvement. Findings suggest substantial room to improve South African SUD treatment services, with targeted efforts needed to reduce disparities in outcomes for patients of Black/African descent, for those with comorbid mental health problems, and for patients who have chronic substance use difficulties. Interventions to enhance the relevance, appropriateness, and acceptability of SUD services for these patient sub-groups are needed to improve system performance.

South African service users' perceptions of patient-reported outcome and experience measures for adolescent substance use treatment: A qualitative study

INTRODUCTION AND AIMS

Patient-reported outcome measures (PROM) and experience measures (PREM) for substance use disorder (SUD) treatment exist for adults but have unknown relevance for adolescents. This study aimed to explore adolescents' perceptions of effective SUD treatment and possible barriers to completing PROMs and PREMs to guide efforts to adapt the South African Addiction Treatment Services Assessment (SAATSA) for adolescents.

DESIGN AND METHODS

Five focus groups were conducted with 38 adolescent service users recruited from residential and outpatient SUD treatment facilities in South Africa. Group discussions explored perceptions of treatment components necessary for desired SUD treatment outcomes, treatment experiences that support engagement in care, and perceptions of PROM and PREM completion.

RESULTS

Participants viewed treatment elements that enhance motivation for change, coping and emotional regulation; provide recreational alternatives to substance use; and improve family relationships and home environments as critical to positive treatment outcomes. They reflected that provider characteristics and developmentally and culturally appropriate services facilitated engagement in treatment. PROM and PREM completion seemed acceptable, with participants suggesting ways to enhance their appeal.

DISCUSSION AND CONCLUSION

Findings confirm that adult-oriented PROMs and PREMs require adaptation for adolescents. Service user inputs identified ways to expand the content of the SAATSA to better reflect adolescents' treatment priorities. These inputs have also guided changes to item formulation and administration procedures to enhance the SAATSA's acceptability for adolescents. Ensuring the SAATSA addresses treatment outcomes and experiences that matter to adolescents is vital for generating information to guide improvements to adolescent SUD services.

Performance Measurement in Mental Health and Addictions Systems: A Scoping Review

OBJECTIVE

The purpose of this study was to evaluate how performance is defined, conceptualized, and measured in mental health and addiction service systems around the world.

METHOD

We conducted a systematic scoping review of English-language scientific and gray literature published from 2005 to 2015. Eligible documents (n = 222) described performance measurement systems and outlined the theory or empirical evidence for indicators. We used a structured approach for data extraction and descriptive and thematic analysis, supplemented with stakeholder consultation.

RESULTS

We identified seven themes in the literature: similarity in performance domains across frameworks; the ability of frameworks to inform care quality at client, program/facility, and system levels; the predominance of indicators of process and outcome, over structure; the lack of evidence on the links between domains and/or indicators; common, but limited, evaluation of family/caregiver involvement; equity as a cross-cutting domain of performance; and limited attention to performance measurement in peer support services.

CONCLUSIONS

The literature on performance measurement in mental health and addictions services is vast, and a wide variety of indicators is available to those designing a measurement system. Evaluations of commonly used performance indicators have yielded mixed evidence on their ability to discriminate high- and low-performing service providers, and their sensitivity to changes in policies and practices. As performance measurement efforts grow in scope and complexity, work will be needed to ensure that indicators are fair, appropriate, and suited to support quality improvement in services of different types.

A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services

OBJECTIVE

Minimal knowledge exists on the factors that affect implementation of performance measurement systems, particularly in low- and middle-income countries (LMICs). To address this, we describe the implementation of a performance measurement system for South Africa's substance abuse treatment services known as the Service Quality Measures (SQM) initiative.

METHOD

We conducted a mixed-methods evaluation of system implementation. We surveyed 81 providers about the extent of system implementation within their agencies and the factors that facilitated implementation. We conducted 26 in-depth interviews of providers' perceived barriers and facilitators to implementation.

RESULTS

The overall penetration of this system was high. Almost all providers viewed the system as feasible to implement, acceptable, appropriate for use in their context, and useful for guiding service improvements. However, the extent of implementation varied significantly across sites (p < .05). Leadership support (p < .05) was associated with increased implementation in multivariable analyses. Providers reflected that high rates of patient attrition, variability in willingness to implement the system, and limited capacity for interpreting performance feedback affected the extent of system implementation.

CONCLUSIONS

It is feasible to implement a performance measurement system in LMICs if the system is acceptable, appropriate, and useful to providers. To ensure the utility of this system for treatment service strengthening, system implementation must be optimized. Efforts to enhance target population coverage, strengthen leadership support for performance measurement, and build capacity for performance feedback utilization may enhance the implementation of this performance measurement system.

Protocol for development and validation of a context-appropriate tool for assessing organisational readiness for change in primary health clinics in South Africa

INTRODUCTION

A large treatment gap for common mental disorders (such as depression) exists in South Africa. Comorbidity with other chronic diseases, including HIV and diseases of lifestyle, is an increasing public health concern globally. Currently, primary health facilities as points of care for those with chronic disease provide limited services for common mental disorders. Assessing organisational readiness for change (ORC) towards adopting health innovations (such as mental health services) using contextually appropriate measures is needed to facilitate implementation of these services. This study aims to investigate the validity of the Texas Christian University Organisational Readiness for Change (TCU-ORC) scale in the South African context. Subsequently, we will develop a shortened version of this scale. This study is nested within Project MIND, a multiyear randomised controlled trial that is testing two different approaches for integrating counselling for common mental disorders into chronic disease care. Although the modified, contextually appropriate ORC measure resulting from the proposed study will be developed in the context of integrating mental health into primary healthcare services, the potential for the tool to be generalised to further understanding barriers to any change being implemented in primary care settings is high.

METHODS AND ANALYSIS

We will establish internal consistency (Cronbach's alpha coefficients), test-retest reliability (intraclass correlation coefficient) and construct validity of the long-form TCU-ORC questionnaire. Survey data will be collected from 288 clinical, management and operational staff from 24 primary health facilities where the Project MIND trial is implemented. A modified Delphi approach will assess the content validity of the TCU-ORC items and identify areas for potential adaptation and item reduction.

ETHICS AND DISSEMINATION

Ethical approval has been granted by the South African Medical Research Council (Protocol ID EC004-2-2015, amendment of 20 August 2017). Results will be submitted to peer-reviewed journals relevant to implementation and health systems strengthening.

Substance abuse treatment engagement, completion and short-term outcomes in the Western Cape province, South Africa: Findings from the Service Quality Measures Initiative

BACKGROUND

Optimizing the effectiveness of substance use disorder (SUD) treatment is critical in low-and middle-income countries (LMICs) with limited opportunities for SUD treatment. This is the first study to identify targets for interventions to improve the quality of SUD treatment in a LMIC.

METHOD

We explored correlates of three indicators of treatment quality (treatment engagement, completion and abstinence at treatment exit) using data from a SUD performance measurement system implemented in the Western Cape Province of South Africa. The sample included data from 1094 adult treatment episodes representing 53% of the treatment episodes in 2016. Using multivariate logistic regression analyses, we modeled socio-demographic, substance use and program correlates of treatment engagement, completion, and abstinence at treatment exit.

RESULTS

Overall, 59% of patients completed treatment (48% of patients from outpatient services). Treatment completion was associated with greater likelihood of abstinence at treatment exit. Patients were more likely to complete treatment if they engaged in treatment, were older, and had more severe drug problems (characterized by daily drug use and heroin problems) and attended programs of shorter duration. Residential treatment was associated with greater likelihood of treatment engagement, completion, and abstinence at treatment exit.

CONCLUSION

Improving rates of outpatient treatment completion will enhance the effectiveness of South Africa's SUD treatment system. Interventions that promote engagement in treatment, particularly among younger patients; reduce program length through referral to step-down continuing care; and ensure better matching of drug problem to treatment level and type could improve rates of treatment completion.

Barriers and facilitators to implementing an evidence-based woman-focused intervention in South African health services

BACKGROUND

Since the beginning of the HIV epidemic, numerous behavior change, risk-reduction, and biomedical interventions have been developed and tested. While some of these interventions have shown to be efficacious in randomized trials, it often takes almost two decades for an intervention to be translated into practice. Meanwhile, South Africa continues to have among the highest prevalence of HIV globally, with women of childbearing age bearing the burden of the epidemic. Given the urgency of the HIV epidemic among vulnerable women in South Africa, it is imperative that evidence-based interventions be implemented rapidly into practice. This study presents a first step toward examining the acceptability and feasibility of implementing the Women's Health CoOp (WHC) in clinics and substance abuse rehab settings in Cape Town, South Africa.

METHODS

We conducted focus group discussions with women who use substances and with service providers, we also conducted in-depth interviews with health service planners. Our goal was to examine implementation and clinical outcomes associated with delivery of the WHC across clinics and substance abuse rehab programs.

RESULTS

All participants agreed on the need for the WHC. Perceived facilitators to implementing the WHC included the recognizable need for programs to empower women and to build the capacity of staff to address issues of substance use, sexual risk, and intimate partner violence. Participants also identified potential barriers to women engaging with this program, including the stigma women experience when seeking services and the lack of person-centered care at healthcare facilities.

CONCLUSIONS

In a country with the largest number of women of childbearing age living with HIV, an evidence-based woman-focused intervention that comprehensively addresses women's risk for suboptimal antiretroviral adherence may be essential for reducing HIV incidence. However, potential barriers to implementing the WHC successfully must be addressed before the program can be fully integrated into the services delivered by healthcare facilities.

TRIAL REGISTRATION

Clinical trials NCT02733003 . Date of Registration: January 21, 2016, registered retroactively after participant enrollment.

Openness to adopting evidence-based practice in public substance use treatment in South Africa using task shifting: Caseload size matters

BACKGROUND

In response to the lack of coverage for substance use treatment in the Western Cape province of South Africa, the local government expanded funding for evidence-based practices (EBPs) for treating substance use. Yet, little is known about provider and staff attitudes towards adopting EBPs in this setting, which is particularly relevant in this context where task shifting clinical care increases demands on paraprofessional providers. This study aimed to (1) assess attitudes towards adopting EBPs among a range of staff working in substance use treatment in Cape Town using a task shifting model; and (2) evaluate factors associated with openness towards adopting EBPs in this setting.

METHODS

Staff (n = 87) were recruited from 11 substance use treatment clinics. Demographics and job-related characteristics were assessed. Staff perceptions of organizational factors were assessed using the TCU Organizational Readiness for Change (ORC) scale. The dependent variable, attitudes towards adopting EBPs, was assessed using the Evidence-Based Practice Attitude Scale (EBPAS).

RESULTS

This study is one of the first to administer the EBPAS in South Africa and found good internal consistency (total score: α = .82). In a multivariable model adjusting for site and factors associated with EBPAS total score at the bivariate level, only smaller caseload size was associated with greater openness to adopting EBPs (B = 1.61, SE = .73; t = 2.21; p<.05).

CONCLUSIONS

As pressure to scale up implementation of EBPs in South African substance use treatment services intensifies, additional efforts are needed to understand barriers to adopt EBPs in this setting. Supporting staff adoption of EBPs in resource-limited settings may require additional resources to limit staff caseloads in the context of task shifting.

Development and psychometric validation of a novel patient survey to assess perceived quality of substance abuse treatment in South Africa

BACKGROUND

A hybrid performance measurement system that combines patient-reported outcome data with administrative data has been developed for South African substance abuse treatment services. This paper describes the development and psychometric validation of one component of this system, the South African Addiction Treatment Services Assessment (SAATSA).

METHODS

First, a national steering committee identified five domains and corresponding indicators on which treatment quality should be assessed. A decision was made to develop a patient survey to assess several of these indicators. A stakeholder work group sourced survey items and generated additional items where appropriate. The feasibility and face validity of these items were examined during cognitive response testing with 16 patients. This led to the elimination of several items. Next, we conducted an initial psychometric validation of the SAATSA with 364 patients from residential and outpatient services. Exploratory (EFA) and confirmatory factor analyses (CFA) were conducted to assess the latent structure of the SAATSA. Findings highlighted areas where the SAATSA required revision. Following revision, we conducted another psychometric validation with an additional sample of 285 patients. We used EFA and CFA to assess construct validity and we assessed reliability using Cronbach's measure of internal consistency.

RESULTS

The final version of the SAATSA comprised 31 items (rated on a four-point response scale) that correspond to six scales. Four of these scales are patient-reported outcome measures (substance use, quality of life, social connectedness and HIV risk outcomes) that together assess the perceived effectiveness of treatment. The remaining two scales assess patients' perceptions of access to and quality of care. The models for the final revised scales had good fit and the internal reliability of these scales was good to excellent, with Cronbach's α ranging from 0.72 to 0.89.

CONCLUSION

A lack of adequate measurement tools hampers efforts to improve the quality of substance abuse treatment. Our preliminary evidence suggests that the SAATSA, a novel patient survey that assesses patients' perceptions of the outcomes and quality of substance abuse treatment, is a psychometrically robust tool that can help fill this void.

Addiction and treatment experiences among active methamphetamine users recruited from a township community in Cape Town, South Africa: A mixed-methods study

BACKGROUND

Since 2000, there has been a dramatic increase in methamphetamine use in South Africa, but little is known about the experiences of out-of-treatment users. This mixed-methods study describes the substance use histories, addiction symptoms, and treatment experiences of a community-recruited sample of methamphetamine users in Cape Town.

METHODS

Using respondent driven sampling, 360 methamphetamine users (44% female) completed structured clinical interviews to assess substance abuse and treatment history and computerized surveys to assess drug-related risks. A sub-sample of 30 participants completed in-depth interviews to qualitatively explore experiences with methamphetamine use and drug treatment.

RESULTS

Participants had used methamphetamine for an average of 7.06 years (SD=3.64). They reported using methamphetamine on an average of 23.49 of the past 30 days (SD=8.90); 60% used daily. The majority (90%) met ICD-10 criteria for dependence, and many reported severe social, financial, and legal consequences. While only 10% had ever received drug treatment, 90% reported that they wanted treatment. In the qualitative interviews, participants reported multiple barriers to treatment, including beliefs that treatment is ineffective and relapse is inevitable in their social context. They also identified important motivators, including desires to be drug free and improve family functioning.

CONCLUSION

This study yields valuable information to more effectively respond to emerging methamphetamine epidemics in South Africa and other low- and middle-income countries. Interventions to increase uptake of evidence-based services must actively seek out drug users and build motivation for treatment, and offer continuing care services to prevent relapse. Community education campaigns are also needed.