Quality Indicators Targeting Low-Value Clinical Practices in Trauma Care

Implementation of an audit and feedback module targeting low-value clinical practices in a provincial trauma quality assurance program: a cost-effectiveness study

BACKGROUND

Audit and Feedback (A&F) interventions based on quality indicators have been shown to lead to significant improvements in compliance with evidence-based care including de-adoption of low-value practices (LVPs). Our primary aim was to evaluate the cost-effectiveness of adding a hypothetical A&F module targeting LVPs for trauma admissions to an existing quality assurance intervention targeting high-value care and risk-adjusted outcomes. A secondary aim was to assess how certain A&F characteristics might influence its cost-effectiveness.

METHODS

We conducted a cost-effectiveness analysis using a probabilistic static decision analytic model in the Québec trauma care continuum. We considered the Québec Ministry of Health perspective. Our economic evaluation compared a hypothetical scenario in which the A&F module targeting LVPs is implemented in a Canadian provincial trauma quality assurance program to a status quo scenario in which the A&F module is not implemented. In scenarios analyses we assessed the impact of A&F characteristics on its cost-effectiveness. Results are presented in terms of incremental costs per LVP avoided.

RESULTS

Results suggest that the implementation of A&F module (Cost = $1,480,850; Number of LVPs = 6,005) is associated with higher costs and higher effectiveness compared to status quo (Cost = $1,124,661; Number of LVPs = 8,228). The A&F module would cost $160 per LVP avoided compared to status quo. The A&F module becomes more cost-effective with the addition of facilitation visits; more frequent evaluation; and when only high-volume trauma centers are considered.

CONCLUSION

A&F module targeting LVPs is associated with higher costs and higher effectiveness than status quo and has the potential to be cost-effective if the decision-makers' willingness-to-pay is at least $160 per LVP avoided. This likely represents an underestimate of true ICER due to underestimated costs or missed opportunity costs. Results suggest that virtual facilitation visits, frequent evaluation, and implementing the module in high-volume centers can improve cost-effectiveness.

Clinical Practice Guideline Recommendations in Pediatric Mild Traumatic Brain Injury: A Systematic Review

STUDY OBJECTIVE

Our primary objectives were to identify clinical practice guideline recommendations for children with acute mild traumatic brain injury (mTBI) presenting to an emergency department (ED), appraise their overall quality, and synthesize the quality of evidence and the strength of included recommendations.

METHODS

We searched MEDLINE, EMBASE, Cochrane Central, Web of Science, and medical association websites from January 2012 to May 2023 for clinical practice guidelines with at least 1 recommendation targeting pediatric mTBI populations presenting to the ED within 48 hours of injury for any diagnostic or therapeutic intervention in the acute phase of care (ED and inhospital). Pairs of reviewers independently assessed overall clinical practice guideline quality using the Appraisal of Guidelines Research and Evaluation (AGREE) II tool. The quality of evidence on recommendations was synthesized using a matrix based on the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) Evidence-to-Decision framework.

RESULTS

We included 11 clinical practice guidelines, of which 6 (55%) were rated high quality. These included 101 recommendations, of which 34 (34%) were based on moderate- to high-quality evidence, covering initial assessment, initial diagnostic imaging, monitoring/observation, therapeutic interventions, discharge advice, follow-up, and patient and family support. We did not identify any evidence-based recommendations in high-quality clinical practice guidelines for repeat imaging, neurosurgical consultation, or hospital admission. Lack of strategies and tools to aid implementation and editorial independence were the most common methodological weaknesses.

CONCLUSIONS

We identified 34 recommendations based on moderate- to high-quality evidence that may be considered for implementation in clinical settings. Our review highlights important areas for future research. This review also underlines the importance of providing strategies to facilitate the implementation of clinical practice guideline recommendations for pediatric mTBI.

Potential Avoidable Costs of Low-Value Clinical Practices in Acute Injury Care in an Integrated Canadian Provincial Trauma System

This economic evaluation estimated the direct health care costs associated with 11 low-value clinical practices in acute trauma care in the integrated health care system of Quebec, Canada.

Evaluating the effectiveness of a multifaceted intervention to reduce low-value care in adults hospitalized following trauma: a protocol for a pragmatic cluster randomized controlled trial

BACKGROUND

While simple Audit & Feedback (A&F) has shown modest effectiveness in reducing low-value care, there is a knowledge gap on the effectiveness of multifaceted interventions to support de-implementation efforts. Given the need to make rapid decisions in a context of multiple diagnostic and therapeutic options, trauma is a high-risk setting for low-value care. Furthermore, trauma systems are a favorable setting for de-implementation interventions as they have quality improvement teams with medical leadership, routinely collected clinical data, and performance-linked to accreditation. We aim to evaluate the effectiveness of a multifaceted intervention for reducing low-value clinical practices in acute adult trauma care.

METHODS

We will conduct a pragmatic cluster randomized controlled trial (cRCT) embedded in a Canadian provincial quality assurance program. Level I-III trauma centers (n = 30) will be randomized (1:1) to receive simple A&F (control) or a multifaceted intervention (intervention). The intervention, developed using extensive background work and UK Medical Research Council guidelines, includes an A&F report, educational meetings, and facilitation visits. The primary outcome will be the use of low-value initial diagnostic imaging, assessed at the patient level using routinely collected trauma registry data. Secondary outcomes will be low-value specialist consultation, low-value repeat imaging after a patient transfer, unintended consequences, determinants for successful implementation, and incremental cost-effectiveness ratios.

DISCUSSION

On completion of the cRCT, if the intervention is effective and cost-effective, the multifaceted intervention will be integrated into trauma systems across Canada. Medium and long-term benefits may include a reduction in adverse events for patients and an increase in resource availability. The proposed intervention targets a problem identified by stakeholders, is based on extensive background work, was developed using a partnership approach, is low-cost, and is linked to accreditation. There will be no attrition, identification, or recruitment bias as the intervention is mandatory in line with trauma center designation requirements, and all outcomes will be assessed with routinely collected data. However, investigators cannot be blinded to group allocation and there is a possibility of contamination bias that will be minimized by conducting intervention refinement only with participants in the intervention arm.

TRIAL REGISTRATION

This protocol has been registered on ClinicalTrials.gov (February 24, 2023, # NCT05744154 ).

Validation of Quality Indicators Targeting Low-Value Trauma Care

Importance

Reducing low-value care has the potential to improve patient experiences and outcomes and free up health care resources. Sixteen quality indicators were recently developed targeting reductions in low-value trauma care based on a synthesis of the best available evidence, expert consensus, and patient preferences.

Objective

To assess the validity of quality indicators on low-value trauma care using trauma registry data.

Design, Setting, and Participants

Data from an inclusive Canadian provincial trauma system were used in this analysis. Included were all admissions for injury to any of the 57 provincial adult trauma centers between April 1, 2013, and March 31, 2020. Metrics for quality indicators were developed iteratively with clinical experts.

Main Outcomes and Measures

Validity was assessed using a priori criteria based on 5 parameters: frequency (incidence and case volume), discrimination (interhospital variation), construct validity (correlation with quality indicators on high-value care), predictive validity (correlation with quality indicators on risk-adjusted outcomes), and forecasting (correlation over time).

Results

The study sample included 136 783 patient admissions (mean [SD] age, 63 [22] years; 68 428 men [50%]). Metrics were developed for 12 of the 16 quality indicators. Six quality indicators showed moderate or high validity on all measurable parameters: initial head, cervical spine, or whole-body computed tomography for low-risk patients; posttransfer repeated computed tomography; neurosurgical consultation for mild complicated traumatic brain injury; and spine service consultation for isolated thoracolumbar process fractures. Red blood cell transfusion in low-risk patients had low frequency but had moderate or high validity on all other parameters. Five quality indicators had low validity on at least 2 parameters: repeated head CT and intensive care unit admission for mild complicated traumatic brain injury, hospital admission for minor blunt abdominal trauma, orthosis for thoracolumbar burst fractures, and surgical exploration in penetrating neck injury without hard signs.

Conclusions and Relevance

This cohort study shows the feasibility of assessing low-value trauma care using routinely collected data. It provided data on quality indicators properties that can be used to decide which quality indicators are most appropriate in a given system. Results suggest that 6 quality indicators have moderate to high validity. Their implementation now needs to be tested.