The impact of paying treatment providers for outcomes: difference-in-differences analysis of the 'payment by results for drugs recovery' pilot

'You Can Die With Me But I Won't Let You Live With Me', Exploring Social Influences on the Continuation of Heroin Use in Men Who Use Heroin

Background

Heroin is a substance with a unique social profile in that it is commonly used by individuals alone but there is a paucity of qualitative research exploring how social influences impact the continuation of heroin use, particularly when people are trying to stop using heroin. This study explored social determinants which influence the continuation of heroin use in males in UK community treatment who use illicit heroin alongside opioid replacement therapy.

Design

Participants were self-selecting from an initial purposively recruited sample. Using Janis (1972) 8 symptoms of Groupthink as an a priori framework for analysis, the study method utilised qualitative interviews with fourteen males. The discussions were digitally-recorded, transcribed verbatim, and analysed thematically.

Findings

Contrasting with the evidence base, the sample included people who transitioned from recreational drug use to dependent heroin use without experiencing trauma of any kind. Far from becoming socially isolated when actively using heroin, interviews identified a shift in social networks from networks built on shared moments to networks underpinned by transactional exchange. Components of Groupthink were identified when participants described belonging to heroin using networks and continued to use heroin whilst trying to abstain though individual accountability was central to the decision to continue to use heroin.

Conclusions

The conflict between the individual goal of abstinence and the group goal of continuation suggests that social network interventions could be more successful if delivered to cohorts of people who buy heroin together.

Approaches to enabling rapid evaluation of innovations in health and social care: a scoping review of evidence from high-income countries

OBJECTIVE

The COVID-19 pandemic increased the demand for rapid evaluation of innovation in health and social care. Assessment of rapid methodologies is lacking although challenges in ensuring rigour and effective use of resources are known. We mapped reports of rapid evaluations of health and social care innovations, categorised different approaches to rapid evaluation, explored comparative benefits of rapid evaluation, and identified knowledge gaps.

DESIGN

Scoping review.

DATA SOURCES

MEDLINE, EMBASE and Health Management Information Consortium (HMIC) databases were searched through 13 September 2022.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

We included publications reporting primary research or methods for rapid evaluation of interventions or services in health and social care in high-income countries.

DATA EXTRACTION AND SYNTHESIS

Two reviewers developed and piloted a data extraction form. One reviewer extracted data, a second reviewer checked 10% of the studies; disagreements and uncertainty were resolved through consensus. We used narrative synthesis to map different approaches to conducting rapid evaluation.

RESULTS

We identified 16 759 records and included 162 which met inclusion criteria.We identified four main approaches for rapid evaluation: (1) Using methodology designed specifically for rapid evaluation; (2) Increasing rapidity by doing less or using less time-intensive methodology; (3) Using alternative technologies and/or data to increase speed of existing evaluation method; (4) Adapting part of non-rapid evaluation.The COVID-19 pandemic resulted in an increase in publications and some limited changes in identified methods. We found little research comparing rapid and non-rapid evaluation.

CONCLUSIONS

We found a lack of clarity about what 'rapid evaluation' means but identified some useful preliminary categories. There is a need for clarity and consistency about what constitutes rapid evaluation; consistent terminology in reporting evaluations as rapid; development of specific methodologies for making evaluation more rapid; and assessment of advantages and disadvantages of rapid methodology in terms of rigour, cost and impact.

Incentivizing performance in health care: a rapid review, typology and qualitative study of unintended consequences

BACKGROUND

Health systems are increasingly implementing policy-driven programs to incentivize performance using contracts, scorecards, rankings, rewards, and penalties. Studies of these "Performance Management" (PM) programs have identified unintended negative consequences. However, no single comprehensive typology of the negative and positive unintended consequences of PM in healthcare exists and most studies of unintended consequences were conducted in England or the United States. The aims of this study were: (1) To develop a comprehensive typology of unintended consequences of PM in healthcare, and (2) To describe multiple stakeholder perspectives of the unintended consequences of PM in cancer and renal care in Ontario, Canada.

METHODS

We conducted a rapid review of unintended consequences of PM in healthcare (n = 41 papers) to develop a typology of unintended consequences. We then conducted a secondary analysis of data from a qualitative study involving semi-structured interviews with 147 participants involved with or impacted by a PM system used to oversee 40 care delivery networks in Ontario, Canada. Participants included administrators and clinical leads from the networks and the government agency managing the PM system. We undertook a hybrid inductive and deductive coding approach using the typology we developed from the rapid review.

RESULTS

We present a comprehensive typology of 48 negative and positive unintended consequences of PM in healthcare, including five novel unintended consequences not previously identified or well-described in the literature. The typology is organized into two broad categories: unintended consequences on (1) organizations and providers and on (2) patients and patient care. The most common unintended consequences of PM identified in the literature were measure fixation, tunnel vision, and misrepresentation or gaming, while those most prominent in the qualitative data were administrative burden, insensitivity, reduced morale, and systemic dysfunction. We also found that unintended consequences of PM are often mutually reinforcing.

CONCLUSIONS

Our comprehensive typology provides a common language for discourse on unintended consequences and supports systematic, comparable analyses of unintended consequences across PM regimes and healthcare systems. Healthcare policymakers and managers can use the results of this study to inform the (re-)design and implementation of evidence-informed PM programs.

Economic evaluation of a complex intervention (Engager) for prisoners with common mental health problems, near to and after release: a cost-utility and cost-consequences analysis

BACKGROUND

People in prison experience a range of physical and mental health problems. Evaluating the effectiveness and efficiency of prison-based interventions presents a number of methodological challenges. We present a case study of an economic evaluation of a prison-based intervention ("Engager") to address common mental health problems.

METHODS

Two hundred and eighty people were recruited from prisons in England and randomised to Engager plus usual care or usual care. Participants were followed up for 12 months following release from prison. The primary analysis is the cost per quality-adjusted life year (QALY) gained of Engager compared to usual care from a National Health Service (NHS) perspective with QALYs calculated using the CORE 6 Dimension. A cost-consequences analysis evaluated cross-sectoral costs and a range of outcomes.

RESULTS

From an NHS perspective, Engager cost an additional £2737 per participant (95% of iterations between £1029 and £4718) with a mean QALY difference of - 0.014 (95% of iterations between - 0.045 and 0.017). For the cost-consequences, there was evidence of improved access to substance misuse services 12 months post-release (odds ratio 2.244, 95% confidence Interval 1.304-3.861).

CONCLUSION

Engager provides a rare example of a cost-utility analysis conducted in prisons and the community using patient-completed measures. Although the results from this trial show no evidence that Engager is cost-effective, the results of the cost-consequences analysis suggest that follow-up beyond 12 months post-release using routine data may provide additional insights into the effectiveness of the intervention and the importance of including a wide range of costs and outcomes in prison-based economic evaluations.

TRIAL REGISTRATION

(ISRCTN11707331).

Did paying drugs misuse treatment providers for outcomes lead to unintended consequences for hospital admissions? Difference-in-differences analysis of a pay-for-performance scheme in England

AIMS

To estimate how a scheme to pay substance misuse treatment service providers according to treatment outcomes affected hospital admissions.

DESIGN

A controlled, quasi-experimental (difference-in-differences) observational study using negative binomial regression.

SETTING

Hospitals in all 149 organisational areas in England for the period 2009-2010 to 2015-2016.

PARTICIPANTS

572 545 patients admitted to hospital with a diagnosis indicating drug misuse, defined based on International Classification of Diseases 10th Revision (ICD-10) diagnosis codes (37 964 patients in 8 intervention areas and 534 581 in 141 comparison areas).

INTERVENTION AND COMPARATORS

Linkage of provider payments to recovery outcome indicators in 8 intervention organisational areas compared with all 141 comparison organisational areas in England. Outcome indicators included: abstinence from presenting substance, abstinent completion of treatment and non-re-presentation to treatment in the 12 months following completion.

MEASUREMENTS

Annual counts of hospital admissions, emergency admissions and admissions including a diagnosis indicating drugs misuse. Covariates included age, sex, ethnic origin and deprivation.

FINDINGS

For 37 245 patients in the intervention areas, annual emergency admissions were 1.073 times higher during the operation of the scheme compared with non-intervention areas (95% CI = 1.049; 1.097). There were an estimated additional 3 352 emergency admissions in intervention areas during the scheme. These findings were robust to a range of secondary analyses.

CONCLUSION

A programme in England from 2012 to 2014 to pay substance misuse treatment service providers according to treatment outcomes appeared to increase emergency hospital admissions.

Role of community drug and alcohol services in physical healthcare for people who use illicit opioids: a qualitative study of clinical staff in the UK

OBJECTIVES

To understand how clinicians working in addiction services perceive their responsibilities for physical healthcare of clients who use opioids, and how physical healthcare could be improved for this group.

DESIGN

Qualitative study comprising semistructured interviews.

PARTICIPANTS

16 clinicians, including nurses and nurse practitioners, nurse consultants, addiction psychiatrists, specialist general practitioners and psychiatry specialty registrars.

SETTING

Community-based drug and alcohol treatment services in the UK, with services including outpatient opioid agonist therapy.

RESULTS

We identified three overarching themes. First, clients have unmet physical health needs that are often first identified in community drug and alcohol services. Participants reported attempts to improve their clients' access to healthcare by liaising directly with health services and undertaking other forms of health advocacy, but report limited success, with many referrals ending in non-attendance. Second, most participants saw their role as supporting access to mainstream health services rather than providing physical healthcare directly, though sometimes reported frustration at being unable to provide certain treatments such as antibiotics for a respiratory infection. A minority of participants felt that people who use illicit opioids would be best served by an integrated 'one-stop-shop' model, but felt this model is currently unlikely to receive funding. Third, participants felt isolated from other health services, in part due to commissioning arrangements in which funding is provided through local government rather than the National Health Service.

CONCLUSIONS

Clinicians participating in this study serve a patient group with unmet physical health needs, but lack the resources to respond effectively to these needs.

Pay for Performance and Treatment Outcome in Agonist Treatment for Opioid Use Disorder

BACKGROUND AND OBJECTIVES

Pay for performance (P4P) models have become more popular in reimbursement for medical services, including treatment for substance use disorders. However, studies have not examined whether P4P has an impact on treatment outcome in the individual in opioid agonist treatment (OAT). Thus, the present study was conducted at the individual level, rather than the programmatic level, to determine whether meeting the P4P early engagement criteria (four services in the initial 14 days of treatment and/or eight services within the initial 30 days of treatment) resulted in reduced opioid, benzodiazepine, and cocaine use.

METHODS

We performed a retrospective study of 63 patients enrolled in OAT for opioid use disorder. χ² analyses were conducted crossing P4P early engagement criteria status and urine drug screen (UDS) results for opioid, cocaine, and/or benzodiazepine use at 6 and 12 months postadmission. Methadone dosage and treatment retention were also considered. The odds ratio was used to determine the directionality of significant results.

RESULTS

Significant relationships were revealed between patients meeting 30-day P4P early engagement criteria and opioid negative UDS, and with retention in treatment at 6 and 12 months. Methadone dosage was significant at a 6-month follow-up.

DISCUSSION AND CONCLUSIONS

Since significant associations between opioid use and P4P as well as opioid use and methadone dose were revealed, findings partially supported hypothesis.

SCIENTIFIC SIGNIFICANCE

P4P and methadone dosage may have some benefit to individuals in OAT in attaining short-term abstinence from opioids. P4P may be less useful in helping individuals achieve abstinence from other substances of abuse. (Am J Addict 2020;00:00-00).

Balancing welfare and market logics: Procurement regulations for social and health services in four Nordic welfare states

Aim:

In increasingly market-oriented welfare regimes, public procurement is one of the most important instruments for influencing who produces which services. This article analyses recent procurement regulations in four Nordic countries from the point of view of addiction treatment. The implementation of public procurement in this field can be viewed as a domain struggle between the market logic and the welfare logic. By comparing the revision of the regulations after the 2014 EU directives in Denmark, Finland, Norway, and Sweden, we identify factors affecting the protection of a welfare logic in procurement. We discuss the possible effects of different procurement regulations for population welfare and health.

Data and theoretical perspective:

The study is based on the recently revised procurement laws in the four countries, and adherent guidelines. The analysis is inspired by institutional logics, looking at patterns of practices, interests, actors, and procurement as rules for practices.

Results:

Procurement regulations are today markedly different in the four countries. The protection of welfare and public health aspects in procurement – strongest in Norway – is not solely dependent on party political support. Existing service providers and established steering practices play a crucial role.

Conclusion:

In a situation where market steering has become an established practice and private providers are strongly present, it can be difficult to introduce strong requirements for protection of welfare and population health in procurement of social services.

Is it feasible to pay specialty substance use disorder treatment programs based on patient outcomes?

BACKGROUND

Some US payers are starting to vary payment to providers depending on patient outcomes, but this approach is rarely used in substance use disorder (SUD) treatment.

PURPOSE

We examine the feasibility of applying a pay-for-outcomes approach to SUD treatment.

METHODS

We reviewed several relevant literatures: (1) economic theory papers that describe the conditions under which pay-for-outcomes is feasible in principle; (2) description of the key outcomes expected from SUD treatment, and the measures of these outcomes that are available in administrative data systems; and (3) reports on actual experiences of paying SUD treatment providers based on patient outcomes.

RESULTS

The economics literature notes that when patient outcomes are strongly influenced by factors beyond provider control and when risk adjustment performs poorly, pay-for-outcomes will increase provider financial risk. This is relevant to SUD treatment. The literature on SUD outcome measurement shows disagreement on whether to include broader outcomes beyond abstinence from substance use. Good measures are available for some of these broader constructs, but the need for risk adjustment still brings many challenges. Results from two past payment experiments in SUD treatment reinforce some of the concerns raised in the more conceptual literature.

CONCLUSION

There are special challenges in applying pay-for-outcomes to SUD treatment, not all of which could be overcome by developing better measures. For SUD treatment it may be necessary to define outcomes more broadly than for general medical care, and to continue conditioning a sizeable portion of payment on process measures.

Incentives in a public addiction treatment system: Effects on waiting time and selection

Program-level financial incentives are used by some payers as a tool to improve quality of substance use treatment. However, evidence of effectiveness is mixed and performance contracts may have unintended consequences such as creating barriers for more challenging clients who are less likely to meet benchmarks. This study investigates the impact of a performance contract on waiting time for substance use treatment and client selection. Admission and discharge data from publicly funded Maine outpatient (OP) and intensive outpatient (IOP) substance use treatment programs (N = 38,932 clients) were used. In a quasi-experimental pre-post design, pre-period (FY 2005-2007) admission data from incentivized (IC) and non-incentivized (non-IC) programs were compared to post-period (FY 2008-2012) using propensity score matching and multivariate difference-in-difference regression. Dependent variables were waiting time (incentivized) and client selection (severity: history of mental disorders and substance use severity, not incentivized). Despite financial incentives designed to reduce waiting time for substance use treatment among state-funded outpatient programs, average waiting time for treatment increased in the post period for both IC and non-IC groups, as did client severity. There were no significant differences in waiting time between IC and non-IC groups over time. Increases in client severity over time, with no group differences, indicate that programs did not restrict access for more challenging clients. Adequate funding and other approaches to improve quality may be beneficial.

Does paying service providers by results improve recovery outcomes for drug misusers in treatment in England?

AIM

To compare drug recovery outcomes in commissioning areas included in a 'payment by results' scheme with all other areas.

DESIGN

Observational and data linkage study of the National Drug Treatment Monitoring System, Office for National Statistics mortality database and Police National Computer criminal records, for 2 years before and after introduction of the scheme. Pre-post controlled comparison compared outcomes in participating versus non-participating areas following adjustment for drug use, functioning and drug treatment status.

SETTING

Drug services in England providing publicly funded, structured treatment.

PARTICIPANTS

Adults in treatment (between 2010 and 2014): 154 175 (10 716 in participating areas, 143 459 non-participating) treatment journeys in the 2 years before and 148 941 (10 012 participating, 138 929 non-participating) after the introduction of the scheme.

INTERVENTION

Scheme participation, with payment to treatment providers based on patient outcomes versus all other areas.

MEASUREMENTS

Rate of treatment initiation; waiting time (> or < 3 weeks); treatment completion; and re-presentation; substance use; injecting; housing status; fatal overdose; and acquisitive crime.

FINDINGS

In participating areas, there were relative decreases in rates of: treatment initiation [difference-in-differences odds ratio (DID OR) = 0.17, 95% confidence interval (CI) = 0.14, 0.21]; treatment completion (DID OR = 0.60, 95% CI = 0.53, 0.67); and treatment completion without re-presentation (DID OR = 0.63, 95% CI = 0.52, 0.77) compared with non-participating areas. Within treatment, relative abstinence (DID OR = 1.50, 95% CI = 1.30, 1.72) and non-injecting (DID OR = 1.32, 95% CI = 1.10, 1.59) rates were improved in participating areas. No significant changes in mortality, recorded crime or housing status were associated with the scheme.

CONCLUSION

Drug addiction recovery services in England that are commissioned on a payment-by-results basis tend to have lower rates of treatment initiation and completion but higher rates of in-treatment abstinence and non-injecting than other services.

Monitoring quality and coverage of harm reduction services for people who use drugs: a consensus study

BACKGROUND AND AIMS

Despite advances in our knowledge of effective services for people who use drugs over the last decades globally, coverage remains poor in most countries, while quality is often unknown. This paper aims to discuss the historical development of successful epidemiological indicators and to present a framework for extending them with additional indicators of coverage and quality of harm reduction services, for monitoring and evaluation at international, national or subnational levels. The ultimate aim is to improve these services in order to reduce health and social problems among people who use drugs, such as human immunodeficiency virus (HIV) and hepatitis C virus (HCV) infection, crime and legal problems, overdose (death) and other morbidity and mortality.

METHODS AND RESULTS

The framework was developed collaboratively using consensus methods involving nominal group meetings, review of existing quality standards, repeated email commenting rounds and qualitative analysis of opinions/experiences from a broad range of professionals/experts, including members of civil society and organisations representing people who use drugs. Twelve priority candidate indicators are proposed for opioid agonist therapy (OAT), needle and syringe programmes (NSP) and generic cross-cutting aspects of harm reduction (and potentially other drug) services. Under the specific OAT indicators, priority indicators included 'coverage', 'waiting list time', 'dosage' and 'availability in prisons'. For the specific NSP indicators, the priority indicators included 'coverage', 'number of needles/syringes distributed/collected', 'provision of other drug use paraphernalia' and 'availability in prisons'. Among the generic or cross-cutting indicators the priority indicators were 'infectious diseases counselling and care', 'take away naloxone', 'information on safe use/sex' and 'condoms'. We discuss conditions for the successful development of the suggested indicators and constraints (e.g. funding, ideology). We propose conducting a pilot study to test the feasibility and applicability of the proposed indicators before their scaling up and routine implementation, to evaluate their effectiveness in comparing service coverage and quality across countries.

CONCLUSIONS

The establishment of an improved set of validated and internationally agreed upon best practice indicators for monitoring harm reduction service will provide a structural basis for public health and epidemiological studies and support evidence and human rights-based health policies, services and interventions.

Impact of Louisiana's HPV Vaccine Awareness Policy on HPV Vaccination Among 13- to 17-Year-Old Females

The Advisory Committee on Immunization Practices recommends routine human papillomavirus (HPV) immunization for 11- to 12-year-old adolescents. In 2008, Louisiana required the school boards to distribute HPV vaccine information to parents or guardian of students in Grades 6 to 12. This article investigates the impact of this policy on HPV vaccination among 13- to 17-year-old female adolescents using National Immunization Survey-Teen (NIS-Teen) data. Drawing on the data from the 2008 to 2012 NIS-Teen, we compared the difference in proportions of females who have been vaccinated before and after the policy. Using difference-indifference estimation, we explored the change in vaccination rates before and after the policy implementation in Louisiana compared with Alabama and Mississippi, two states that did not have such a policy in place. The difference-in-differences estimates for HPV vaccination were not significant. Physician recommendation for HPV vaccination was significantly associated with vaccination among females in Louisiana and Alabama (adjusted odds ratio [aOR] = 7.74; 95% confidence interval [CI; 5.22, 11.5]), and for those in Louisiana and Mississippi (aOR = 7.05; 95% CI [4.6, 10.5]). Compared to the proportion of female adolescents who had received physician recommendation in Alabama or Mississippi, the proportion in Louisiana did not increase significantly in the postpolicy period. HPV vaccination rates did not increase significantly in Louisiana compared to Alabama or Mississippi following the implementation of the policy. Despite Louisiana's policy, physician recommendation remains the key determinant of HPV vaccination. HPV vaccine awareness does not necessarily result in HPV vaccination.

Effects of accountable care and payment reform on substance use disorder treatment: evidence from the initial 3 years of the alternative quality contract

BACKGROUND AND AIMS

Global payment and accountable care reform efforts in the United States may connect more individuals with substance use disorders (SUD) to treatment. We tested whether such changes instituted under an Alternative Quality Contract (AQC) model within the Blue Cross Blue Shield of Massachusetts' (BCBSMA) insurer increased care for individuals with SUD.

DESIGN

Difference-in-differences design comparing enrollees in AQC organizations with a comparison group of enrollees in organizations not participating in the AQC.

SETTING

Massachusetts, USA.

PARTICIPANTS

BCBSMA enrollees aged 13-64 years from 2006 to 2011 (3 years prior to and after implementation) representing 1 333 534 enrollees and 42 801 SUD service users.

MEASUREMENTS

Outcomes were SUD service use and spending and SUD performance metrics. Primary exposures were enrollment into an AQC provider organization and whether the AQC organization did or did not face risk for behavioral health costs.

FINDINGS

Enrollees in AQC organizations facing behavioral health risk experienced no change in the probability of using SUD services (1.64 versus 1.66%; P = 0.63), SUD spending ($2807 versus $2700; P = 0.34) or total spending ($12 631 versus $12 849; P = 0.53), or SUD performance metrics (identification: 1.73 versus 1.76%, P = 0.57; initiation: 27.86 versus 27.02%, P = 0.50; engagement: 11.19 versus 10.97%, P = 0.79). Enrollees in AQC organizations not at risk for behavioral health spending experienced a small increase in the probability of using SUD services (1.83 versus 1.66%; P = 0.003) and the identification performance metric (1.92 versus 1.76%; P = 0.007) and a reduction in SUD medication use (11.84 versus 14.03%; P = 0.03) and the initiation performance metric (23.76 versus 27.02%; P = 0.005).

CONCLUSIONS

A global payment and accountable care model introduced in Massachusetts, USA (in which a health insurer provided care providers with fixed prepayments to cover most or all of their patients' care during a specified time-period, incentivizing providers to keep their patients healthy and reduce costs) did not lead to sizable changes in substance use disorder service use during the first 3 years following its implementation.

A conceptual schema for government purchasing arrangements for Australian alcohol and other drug treatment

AIM

The aim of this study was to establish a conceptual schema for government purchasing of alcohol and other drug treatment in Australia which could encompass the diversity and variety in purchasing arrangements, and facilitate better decision-maker by purchasers. There is a limited evidence base on purchasing arrangements in alcohol and drug treatment despite the clear impact of purchasing arrangements on both treatment processes and treatment outcomes.

METHODS

The relevant health and social welfare literature on purchasing arrangements was reviewed; data were collected from Australian purchasers and providers of treatment giving detailed descriptions of the array of purchasing arrangements. Combined analysis of the literature and the Australian purchasing data resulted in a draft schema which was then reviewed by an expert committee and subsequently finalised.

RESULTS

The conceptual schema presented here was purpose-built for alcohol and other drug treatment, with its overlap between health and social welfare services. It has three dimensions: 1. The ways in which providers are chosen; 2. The ways in which services are paid for; and 3. How price is managed. Distinguishing between the methods for choosing providers (such as competitive or individually negotiated processes) from the way in which organisations are paid for their provision of treatment (such as via a block grant or payment for activity) provides conceptual clarity and enables closer analysis of each mechanism.

CONCLUSIONS

Governments can improve health and wellbeing by making informed decisions about the way they purchase and fund alcohol and other drug treatment. Research comparing different purchasing arrangements can provide a vital evidence-base to inform funders; however a first step is to accurately and consistently categorise current approaches against a typology or conceptual schema.