Impact of IT-enabled intervention on MRI use for back pain

Standardized Patient Communication and Low-Value Spinal Imaging: A Randomized Clinical Trial

Importance

Acute back pain is a common reason for primary care visits and often results in low-value spinal imaging.

Objective

To evaluate the effect of a standardized patient-delivered intervention on rates of low-value spinal imaging among primary care patients with acute low back pain.

Design, Setting, and Participants

In this randomized clinical trial, physicians or advanced practice clinicians were recruited from March 22 to August 5, 2021, from 10 adult primary care or urgent care clinics in Sacramento, California. The intervention period was from May 1, 2021, to March 30, 2022, with follow-up from October 28, 2021, to June 30, 2023. Analyses were performed from April 1 to June 25, 2024.

Intervention

Clinicians were randomized 1:1 to intervention or control. Intervention clinicians received 3 simulated office visits, each with a standardized patient instructor (SPI) portraying a patient with acute uncomplicated back pain. At each visit, SPIs provided clinician feedback guided by a 3-step model: (1) set the stage for deferred imaging by building trust, (2) convey empathy, and (3) communicate optimism while advocating watchful waiting without imaging. Control clinicians received no intervention.

Main Outcomes and Measures

The primary outcome was lumbar spinal imaging completion within 90 days of acute low back pain visits, with study clinicians assessed up to 18 months of follow-up. Secondary outcomes were cervical spine imaging completion after acute neck pain visits, any imaging completion after an adult visit, patient experience ratings of clinicians (scale range, 0-100), and use of targeted communication skills during an audio-recorded standardized patient evaluation visit at median follow-up of 16.8 months (range, 14.1-18.0 months).

Results

The analysis included 53 clinicians; mean (SD) age was 46.7 (1.0) years, and 35 (66.0%) reported female gender. A total of 25 were in the intervention group and 28 in the control group. After adjustment for prerandomization rates, patients with acute low back pain who saw intervention and control clinicians during follow-up had similar rates of lumbar imaging (194 of 1234 clinic visits [15.7%] vs 226 of 1306 clinic visits [17.3%]; adjusted ratio of postintervention vs preintervention odds ratios [AORR], 1.00; 95% CI, 0.72-1.40). Adjusted follow-up rates of imaging for acute neck pain (AORR, 1.16; 95% CI, 0.83-1.63) and overall imaging (AORR, 1.07; 95% CI, 0.97-1.19) were not significantly different among patients of intervention and control clinicians. Intervention and control clinicians had similar mean (SD) patient experience ratings during follow-up (88.6 [28.7] vs 88.8 [28.3]; adjusted mean difference-in-differences, -1.0; 95% CI, -3.0 to 0.9). During audio-recorded standardized patient visits, intervention clinicians had significantly better ratings than controls on eliciting the patient's perspective (adjusted standardized difference [ASD], 0.62; 95% CI, 0.05-1.19) and conveying empathy (ASD, 1.16; 95% CI, 0.55-1.77).

Conclusions and Relevance

In this randomized clinical trial of an educational intervention using simulated office visits to encourage a watchful waiting approach for acute low back pain, the intervention had no significant effect on low-value spinal imaging rates or patient experience ratings.

Trial Registration

ClinicalTrials.gov Identifier: NCT04255199.

Systematic review of interventions aimed at improving the quality of referrals to radiology

Despite ubiquitous use of medical imaging in daily medical practice, the quality of referrals varies significantly across a variety of practice types and locations. This systematic review summarises studies in the literature that have employed interventions aimed at improving radiology referrals, excluding clinical decision support software. A systematic review of literature was conducted in PubMed, EMBASE, Scopus, and Cochrane. Two reviewers independently identified studies for inclusion. All studies that included interventions with any outcome measure were included. Any irrelevant studies, non-English studies or not retrievable studies were excluded. Studies were grouped into Education, Feedback, Rationing, Penalties, and Other. The outcomes of the studies were summarised and qualitatively analysed due to anticipated heterogeneity. Four thousand six hundred and forty-two studies were identified throughout PubMed, EMBASE, Scopus, and Cochrane. One hundred and eighty-seven duplicates were removed and 4436 abstracts were screened. Two hundred and forty were identified on the first phase of the screening with 167 then excluded for non-relevancy. Seventy-five full studies were included in the final analysis following the addition of 2 additional studies. Fifty-seven studies were grouped into Education, 10 into Feedback, 4 into Rationing, 8 into Penalties, 9 into Other and 11 containing multiple. Eighty-four percent of the studies reported an improvement in the quality of the referrals. Despite a variable rate of quality referrals, there are many interventions that radiology departments across the world can utilise to improve the referral process.

CT Pulmonary Angiogram Clinical Pretest Probability Tool: Impact on Emergency Department Utilization

OBJECTIVE

Currently, CT pulmonary angiogram (CTPA) for evaluating acute pulmonary embolism (PE) in emergency departments (EDs) is overused and with low yields. The goal of this study is to assess the impact of an evidence-based clinical decision support (CDS) tool, aimed at optimizing appropriate use of CTPA for evaluating PE.

METHODS

The study was performed at EDs in a large health care system and included nine academic and community hospitals. The primary outcome was the percent difference in utilization (number of CTPAs performed per number of ED visits) and secondary outcome was yield (percentage of CTPAs positive for acute PE), comparing 12 months before (June 1, 2021, to May 31, 2022) versus 12 months after (June 1, 2022, to May 31, 2023) a systemwide implementation of the CDS. Univariate and multivariable analyses using logistic regression were performed to assess factors associated with diagnosis of acute PE. Statistical process control charts were used to assess monthly trends in utilization and yield.

RESULTS

Among 931,677 visits to EDs, 28,101 CTPAs were performed on 24,675 patients. In all, 14,825 CTPAs were performed among 455,038 visits (3.26%) pre-intervention and 13,276 among 476,639 visits (2.79%) postintervention, a 14.51% relative decrease in CTPA utilization (χ2, P < .001). CTPA yield remained unchanged (1,371 of 14,825 = 9.25% pre- versus 1,184 of 13,276 = 8.92% postintervention; χ2, P = .34). Patients with coronavirus disease of 2019 diagnosis before CTPA had higher probability of acute PE. Statistical process control charts demonstrated seasonal variation in utilization (Friedman test, P = .047).

DISCUSSION

Implementing a CDS based on validated decision rules was associated with a significant reduction in CTPA utilization. The change was immediate and sustained for 12 months postintervention.

Clinical Decision Support System Used in Spinal Disorders: Scoping Review

BACKGROUND

Spinal disorders are highly prevalent worldwide with high socioeconomic costs. This cost is associated with the demand for treatment and productivity loss, prompting the exploration of technologies to improve patient outcomes. Clinical decision support systems (CDSSs) are computerized systems that are increasingly used to facilitate safe and efficient health care. Their applications range in depth and can be found across health care specialties.

OBJECTIVE

This scoping review aims to explore the use of CDSSs in patients with spinal disorders.

METHODS

We used the Joanna Briggs Institute methodological guidance for this scoping review and reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) statement. Databases, including PubMed, Embase, Cochrane, CINAHL, Web of Science, Scopus, ProQuest, and PsycINFO, were searched from inception until October 11, 2022. The included studies examined the use of digitalized CDSSs in patients with spinal disorders.

RESULTS

A total of 4 major CDSS functions were identified from 31 studies: preventing unnecessary imaging (n=8, 26%), aiding diagnosis (n=6, 19%), aiding prognosis (n=11, 35%), and recommending treatment options (n=6, 20%). Most studies used the knowledge-based system. Logistic regression was the most commonly used method, followed by decision tree algorithms. The use of CDSSs to aid in the management of spinal disorders was generally accepted over the threat to physicians' clinical decision-making autonomy.

CONCLUSIONS

Although the effectiveness was frequently evaluated by examining the agreement between the decisions made by the CDSSs and the health care providers, comparing the CDSS recommendations with actual clinical outcomes would be preferable. In addition, future studies on CDSS development should focus on system integration, considering end user's needs and preferences, and external validation and impact studies to assess effectiveness and generalizability.

TRIAL REGISTRATION

OSF Registries osf.io/dyz3f; https://osf.io/dyz3f.

Features and functions of decision support systems for appropriate diagnostic imaging: a scoping review

BACKGROUND

Diagnostic imaging decision support (DI-DS) systems could be effective tools for reducing inappropriate diagnostic imaging examinations. Since effective design and evaluation of these systems requires in-depth understanding of their features and functions, the present study aims to map the existing literature on DI-DS systems to identify features and functions of these systems.

METHODS

The search was performed using Scopus, Embase, PubMed, Web of Science, and Cochrane Central Registry of Controlled Trials (CENTRAL) and was limited to 2000 to 2021. Analytical studies, descriptive studies, reviews and book chapters that explicitly addressed the functions or features of DI-DS systems were included.

RESULTS

A total of 6,046 studies were identified. Out of these, 55 studies met the inclusion criteria. From these, 22 functions and 22 features were identified. Some of the identified features were: visibility, content chunking/grouping, deployed as a multidisciplinary program, clinically valid and relevant feedback, embedding current evidence, and targeted recommendations. And, some of the identified functions were: displaying an appropriateness score, recommending alternative or more appropriate imaging examination(s), providing recommendations for next diagnostic steps, and providing safety alerts.

CONCLUSIONS

The set of features and functions obtained in the present study can provide a basis for developing well-designed DI-DS systems, which could help to improve adherence to diagnostic imaging guidelines, minimize unnecessary costs, and improve the outcome of care through appropriate diagnosis and on-time care delivery.

The environmental cost of unwarranted variation in the use of magnetic resonance imaging and computed tomography scans

BACKGROUND

Pollution is a major threat to global health, and there is growing interest on strategies to reduce emissions caused by health care systems. Unwarranted clinical variation, i.e. variation in the utilization of health services unexplained by differences in patient illness or preferences, may be an avoidable source of CO2 when related to overuse. Our objective was to evaluate the CO2 emissions attributable to unwarranted variation in the use of MRI and CT scans among countries of the G20-area.

METHODS

We selected seven countries of the G20-area with available data on the use of CT and MRI scans from the organization for Economic Co-operation and Development repository. Each nation's annual electric energy expenditure per 1000 inhabitants for such exams (T-En_ex-1000) was calculated and compared with the median and lowest value. Based on such differences we estimated the national energy and corresponding tons of CO2 that could be potentially avoided each year.

RESULTS

With available data we found a significant variation in T-En_ex-1000 (median value 1782 kWh, range 1200-3079 kWh) and estimated a significant amount of potentially avoidable emissions each year (range 2046-175120 tons of CO2). In practical terms such emissions would need, in the case of Germany, 71900 and 104210 acres of forest to be cleared from the atmosphere, which is 1.2 and 1.7 times the size of the largest German forest (Bavarian National Forest).

CONCLUSION

Among countries with a similar rate of development, unwarranted clinical variation in the use of MRI and CT scan causes significant emissions of CO2.

Strategies for de-implementation of low-value care-a scoping review

BACKGROUND

The use of low-value care (LVC) is a persistent problem that calls for knowledge about strategies for de-implementation. However, studies are dispersed across many clinical fields, and there is no overview of strategies that can be used to support the de-implementation of LVC. The extent to which strategies used for implementation are also used in de-implementing LVC is unknown. The aim of this scoping review is to (1) identify strategies for the de-implementation of LVC described in the scientific literature and (2) compare de-implementation strategies to implementation strategies as specified in the Expert Recommendation for Implementing Change (ERIC) and strategies added by Perry et al. METHOD: A scoping review was conducted according to recommendations outlined by Arksey and O'Malley. Four scientific databases were searched, relevant articles were snowball searched, and the journal Implementation Science was searched manually for peer-reviewed journal articles in English. Articles were included if they were empirical studies of strategies designed to reduce the use of LVC. Two reviewers conducted all abstract and full-text reviews, and conflicting decisions were discussed until consensus was reached. Data were charted using a piloted data-charting form. The strategies were first coded inductively and then mapped onto the ERIC compilation of implementation strategies.

RESULTS

The scoping review identified a total of 71 unique de-implementation strategies described in the literature. Of these, 62 strategies could be mapped onto ERIC strategies, and four strategies onto one added category. Half (50%) of the 73 ERIC implementation strategies were used for de-implementation purposes. Five identified de-implementation strategies could not be mapped onto any of the existing strategies in ERIC.

CONCLUSIONS

Similar strategies are used for de-implementation and implementation. However, only a half of the implementation strategies included in the ERIC compilation were represented in the de-implementation studies, which may imply that some strategies are being underused or that they are not applicable for de-implementation purposes. The strategies assess and redesign workflow (a strategy previously suggested to be added to ERIC), accountability tool, and communication tool (unique new strategies for de-implementation) could complement the existing ERIC compilation when used for de-implementation purposes.

Guideline-concordant utilization of magnetic resonance imaging in adults receiving chiropractic manipulative therapy vs other care for radicular low back pain: a retrospective cohort study

BACKGROUND

Lumbar magnetic resonance imaging (LMRI) is often performed early in the course of care, which can be discordant with guidelines for non-serious low back pain. Our primary hypothesis was that adults receiving chiropractic spinal manipulative therapy (CSMT) for incident radicular low back pain (rLBP) would have reduced odds of early LMRI over 6-weeks' follow-up compared to those receiving other care (a range of medical care, excluding CSMT). As a secondary hypothesis, CSMT recipients were also expected to have reduced odds of LMRI over 6-months' and 1-years' follow-up.

METHODS

A national 84-million-patient health records database including large academic healthcare organizations (TriNetX) was queried for adults age 20-70 with rLBP newly-diagnosed between January 31, 2012 and January 31, 2022. Receipt or non-receipt of CSMT determined cohort allocation. Patients with prior lumbar imaging and serious pathology within 90 days of diagnosis were excluded. Propensity score matching controlled for variables associated with LMRI utilization (e.g., demographics). Odds ratios (ORs) of LMRI over 6-weeks', 6-months', and 1-years' follow-up after rLBP diagnosis were calculated.

RESULTS

After matching, there were 12,353 patients per cohort (mean age 50 years, 56% female), with a small but statistically significant reduction in odds of early LMRI in the CSMT compared to other care cohort over 6-weeks' follow-up (9%, 10%, OR [95% CI] 0.88 [0.81-0.96] P = 0.0046). There was a small but statistically significant increase in odds of LMRI among patients in the CSMT relative to the other care cohort over 6-months' (12%, 11%, OR [95% CI] 1.10 [1.02-1.19], P < 0.0174) and 1-years' follow-up (14%, 12%, OR [95% CI] 1.21 [1.13-1.31], P < 0.0001).

CONCLUSIONS

These results suggest that patients receiving CSMT for newly-diagnosed rLBP are less likely to receive early LMRI than patients receiving other care. However, CSMT recipients have a small increase in odds of LMRI over the long-term. Both cohorts in this study had a relatively low rate of early LMRI, possibly because the data were derived from academic healthcare organizations. The relationship of these findings to other patient care outcomes and cost should be explored in a future randomized controlled trial.

REGISTRATION

Open Science Framework ( https://osf.io/t9myp ).

Translating Data Analytics Into Improved Spine Surgery Outcomes: A Roadmap for Biomedical Informatics Research in 2021

STUDY DESIGN

Narrative review.

OBJECTIVES

There is growing interest in the use of biomedical informatics and data analytics tools in spine surgery. Yet despite the rapid growth in research on these topics, few analytic tools have been implemented in routine spine practice. The purpose of this review is to provide a health information technology (HIT) roadmap to help translate data assets and analytics tools into measurable advances in spine surgical care.

METHODS

We conducted a narrative review of PubMed and Google Scholar to identify publications discussing data assets, analytical approaches, and implementation strategies relevant to spine surgery practice.

RESULTS

A variety of data assets are available for spine research, ranging from commonly used datasets, such as administrative billing data, to emerging resources, such as mobile health and biobanks. Both regression and machine learning techniques are valuable for analyzing these assets, and researchers should recognize the particular strengths and weaknesses of each approach. Few studies have focused on the implementation of HIT, and a variety of methods exist to help translate analytic tools into clinically useful interventions. Finally, a number of HIT-related challenges must be recognized and addressed, including stakeholder acceptance, regulatory oversight, and ethical considerations.

CONCLUSIONS

Biomedical informatics has the potential to support the development of new HIT that can improve spine surgery quality and outcomes. By understanding the development life-cycle that includes identifying an appropriate data asset, selecting an analytic approach, and leveraging an effective implementation strategy, spine researchers can translate this potential into measurable advances in patient care.

Representing narrative evidence as clinical evidence logic statements

Objective

Clinical evidence logic statements (CELS) are shareable knowledge artifacts in a semistructured “If-Then” format that can be used for clinical decision support systems. This project aimed to assess factors facilitating CELS representation.

Materials and Methods

We described CELS representation of clinical evidence. We assessed factors that facilitate representation, including authoring instruction, evidence structure, and educational level of CELS authors. Five researchers were tasked with representing CELS from published evidence. Represented CELS were compared with the formal representation. After an authoring instruction intervention, the same researchers were asked to represent the same CELS and accuracy was compared with that preintervention using McNemar’s test. Moreover, CELS representation accuracy was compared between evidence that is structured versus semistructured, and between CELS authored by specialty-trained versus nonspecialty-trained researchers, using χ2 analysis.

Results

261 CELS were represented from 10 different pieces of published evidence by the researchers pre- and postintervention. CELS representation accuracy significantly increased post-intervention, from 20/261 (8%) to 63/261 (24%, P value &lt; .00001). More CELS were assigned for representation with 379 total CELS subsequently included in the analysis (278 structured and 101 semistructured) postintervention. Representing CELS from structured evidence was associated with significantly higher CELS representation accuracy (P = .002), as well as CELS representation by specialty-trained authors (P = .0004).

Discussion

CELS represented from structured evidence had a higher representation accuracy compared with semistructured evidence. Similarly, specialty-trained authors had higher accuracy when representing structured evidence.

Conclusion

Authoring instructions significantly improved CELS representation with a 3-fold increase in accuracy. However, CELS representation remains a challenging task.

Reducing Low-Value Imaging for Low Back Pain: Systematic Review With Meta-analysis

OBJECTIVE

To examine the effectiveness of implementing interventions to improve guideline-recommended imaging referrals in low back pain.

DESIGN

Systematic review with meta-analysis.

LITERATURE SEARCH

We searched MEDLINE, EMBASE, the Cumulative Index to Nursing and Allied Health Literature, Web of Science Core Collection, and the Cochrane Central Register of Controlled Trials from inception to June 14, 2021, as well as Google Scholar and reference lists of relevant systematic reviews published in the last 10 years. We conducted forward and backward citation tracking.

STUDY SELECTION CRITERIA

Randomized controlled or clinical trials in adults with low back pain to improve imaging referrals.

DATA SYNTHESIS

Bias was assessed using the Cochrane Risk of Bias 2 tool. Data were synthesized using narrative synthesis and random-effects meta-analysis (Hartung-Knapp-Sidik-Jonkman method). We assessed the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation approach.

RESULTS

Of the 2719 identified records, 8 trials were included, with 6 studies eligible for meta-analysis (participants: N = 170 460). All trials incorporated clinician education; 4 included audit and/or feedback components. Comparators were no-intervention control and passive dissemination of guidelines. Five trials were rated as low risk of bias, and 2 trials were rated as having some concerns. There was low-certainty evidence that implementing interventions to improve guideline-recommended imaging referrals had no effect (odds ratio [95% confidence interval]: 0.87 [0.72, 1.05]; I² = 0%; studies: n = 6). The main finding was robust to sensitivity analyses.

CONCLUSION

We found low-certainty evidence that interventions to reduce imaging referrals or use in low back pain had no effect. Education interventions are unlikely to be effective. Organizational- and policy-level interventions are more likely to be effective. J Orthop Sports Phys Ther 2022;52(4):175-191. Epub 05 Feb 2022. doi:10.2519/jospt.2022.10731.

Effectiveness of Clinical Decision Support Systems on the Appropriate Use of Imaging for Central Nervous System Injuries: A Systematic Review

BACKGROUND

One of the best practices for timely and efficient diagnoses of central nervous system (CNS) trauma and complex diseases is imaging. However, rates of imaging for CNS are high and impose a lot of costs to health care facilities in addition to exposing patients with negative impact of ionizing radiation.

OBJECTIVES

This study aimed to systematically review the effects and features of clinical decision support systems (CDSSs) for the appropriate use of imaging for CNS injuries.

METHOD

We searched MEDLINE, SCOPUS, Web of Science, and Cochrane without time period restriction. We included experimental and quasiexperimental studies that assessed the effectiveness of CDSSs designed for the appropriate use of imaging for CNS injuries in any clinical setting, including primary, emergency, and specialist care. The outcomes were categorized based on imaging-related, physician-related, and patient-related groups.

RESULT

A total of 3,223 records were identified through the online literature search. Of the 55 potential papers for the full-text review, 11 eligible studies were included. Reduction of CNS imaging proportion varied from 2.6 to 40% among the included studies. Physician-related outcomes, including guideline adherence, diagnostic yield, and knowledge, were reported in five studies, and all demonstrated positive impact of CDSSs. Four studies had addressed patient-related outcomes, including missed or delayed diagnosis, as well as length of stay. These studies reported a very low rate of missed diagnosis due to the cancellation of computed tomography (CT) examine according to the CDSS recommendations.

CONCLUSION

This systematic review reports that CDSSs decrease the utilization of CNS CT scan, while increasing physicians' adherence to the rules. However, the possible harm of CDSSs to patients was not well addressed by the included studies and needs additional investigation. The actual effect of CDSSs on appropriate imaging would be realized when the saved cost of examinations is compared with the cost of missed diagnosis.

Interventions to reduce low-value imaging - a systematic review of interventions and outcomes

BACKGROUND

It is estimated that 20-50% of all radiological examinations are of low value. Many attempts have been made to reduce the use of low-value imaging. However, the comparative effectiveness of interventions to reduce low-value imaging is unclear. Thus, the objective of this systematic review was to provide an overview and evaluate the outcomes of interventions aimed at reducing low-value imaging.

METHODS

An electronic database search was completed in Medline - Ovid, Embase-Ovid, Scopus, and Cochrane Library for citations between 2010 and 2020. The search was built from medical subject headings for Diagnostic imaging/Radiology, Health service misuse or medical overuse, and Health planning. Keywords were used for the concept of reduction and avoidance. Reference lists of included articles were also hand-searched for relevant citations. Only articles written in English, German, Danish, Norwegian, Dutch, and Swedish were included. The Mixed Methods Appraisal Tool was used to appraise the quality of the included articles. A narrative synthesis of the final included articles was completed.

RESULTS

The search identified 15,659 records. After abstract and full-text screening, 95 studies of varying quality were included in the final analysis, containing 45 studies found through hand-searching techniques. Both controlled and uncontrolled before-and-after studies, time series, chart reviews, and cohort studies were included. Most interventions were aimed at referring physicians. Clinical practice guidelines (n = 28) and education (n = 28) were most commonly evaluated interventions, either alone or in combination with other components. Multi-component interventions were often more effective than single-component interventions showing a reduction in the use of low-value imaging in 94 and 74% of the studies, respectively. The most addressed types of imaging were musculoskeletal (n = 26), neurological (n = 23) and vascular (n = 16) imaging. Seventy-seven studies reported reduced low-value imaging, while 3 studies reported an increase.

CONCLUSIONS

Multi-component interventions that include education were often more effective than single-component interventions. The contextual and cultural factors in the health care systems seem to be vital for successful reduction of low-value imaging. Further research should focus on assessing the impact of the context in interventions reducing low-value imaging and how interventions can be adapted to different contexts.

What behaviour change techniques have been used to improve adherence to evidence-based low back pain imaging?

Background

Despite international guideline recommendations, low back pain (LBP) imaging rates have been increasing over the last 20 years. Previous systematic reviews report limited effectiveness of implementation interventions aimed at reducing unnecessary LBP imaging. No previous reviews have analysed these implementation interventions to ascertain what behaviour change techniques (BCTs) have been used in this field. Understanding what techniques have been implemented in this field is an essential first step before exploring intervention effectiveness.

Methods

We searched EMBASE, Ovid (Medline), CINAHL and Cochrane CENTRAL from inception to February 1, 2021, as well as and hand-searched 6 relevant systematic reviews and conducted citation tracking of included studies. Two authors independently screened titles, abstracts, and full texts for eligibility and extracted data on study and intervention characteristics. Study interventions were qualitatively analysed by three coders to identify BCTs, which were mapped to mechanisms of action from the theoretical domains framework (TDF) using the Theory and Techniques Tool.

Results

We identified 36 eligible studies from 1984 citations in our electronic search and a further 2 studies from hand-searching resulting in 38 studies that targeted physician behaviour to reduce unnecessary LBP imaging. The studies were conducted in 6 countries in primary (n = 31) or emergency care (n = 7) settings. Thirty-four studies were included in our BCT synthesis which found the most frequently used BCTs were ‘4.1 instruction on how to perform the behaviour’ (e.g. Active/passive guideline dissemination and/or educational seminars/workshops), followed by ‘9.1 credible source’, ‘2.2 feedback on behaviour’ (e.g. electronic feedback reports on physicians’ image ordering) and 7.1 prompts and cues (electronic decision support or hard-copy posters/booklets for the office). This review highlighted that the majority of studies used education and/or feedback on behaviour to target the domains of knowledge and in some cases also skills and beliefs about capabilities to bring about a change in LBP imaging behaviour. Additionally, we found there to be a growing use of electronic or hard copy reminders to target the domains of memory and environmental context and resources.

Conclusions

This is the first study to identify what BCTs have been used to target a reduction in physician image ordering behaviour. The majority of included studies lacked the use of theory to inform their intervention design and failed to target known physician-reported barriers to following LBP imaging guidelines.

Protocol Registation

PROSPERO CRD42017072518

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01136-w.

Unintended consequences: quantifying the benefits, iatrogenic harms and downstream cascade costs of musculoskeletal MRI in UK primary care

OBJECTIVES

The largest proportion of general practitioner (GP) magnetic resonance imaging (MRI) is musculoskeletal (MSK), with consistent annual growth. With limited supporting evidence and potential harms from early imaging overuse, we evaluated practice to improve pathways and patient safety.

METHODS

Cohort evaluation of routinely collected diagnostic and general practice data across a UK metropolitan primary care population. We reviewed patient characteristics, results and healthcare utilisation.

RESULTS

Of 306 MSK-MRIs requested by 107 clinicians across 29 practices, only 4.9% (95% CI ±2.4%) appeared clearly indicated and only 16.0% (95% CI ±4.1%) received appropriate prior therapy. 37.0% (95% CI ±5.5%) documented patient imaging request. Most had chronic symptoms and half had psychosocial flags. Mental health was addressed in only 11.8% (95% CI ±6.3%) of chronic sufferers with psychiatric illness, suggesting a solely pathoanatomical approach to MSK care. Only 7.8% (95% CI ±3.0%) of all patients were appropriately managed without additional referral. 1.3% (95% CI ±1.3%) of scans revealed diagnoses leading to change in treatment (therapeutic yield). Most imaged patients received pathoanatomical explanations to their symptoms, often based on expected age or activity-related changes. Only 16.7% (95% CI ±4.2%) of results appeared correctly interpreted by GPs, with spurious overperception of surgical targets in 65.4% (95% CI ±5.3%) who suffered 'low-value' (ineffective, harmful or wasteful) post-MRI referral cascades due to misdiagnosis and overdiagnosis. Typically, 20%-30% of GP specialist referrals convert to a procedure, whereas MRI-triggered referrals showed near-zero conversion rate. Imaged patients experienced considerable delay to appropriate care. Cascade costs exceeded direct-MRI costs and GP-MSK-MRI potentially more than doubles expenditure compared with physiotherapist-led assessment services, for little-to-no added therapeutic yield, unjustifiable by cost-consequence or cost-utility analysis.

CONCLUSION

Unfettered GP-MSK-MRI use has reached unaccceptable indication creep and disutility. Considerable avoidable harm occurs through ubiquitous misinterpretation and salient low-value referral cascades for two-thirds of imaged patients, for almost no change in treatment. Any marginally earlier procedural intervention for a tiny fraction of patients is eclipsed by negative consequences for the vast majority. Only 1-2 patients need to be scanned for one to suffer mismanagement. Direct-access imaging is neither clinically, nor cost-effective and deimplementation could be considered in this setting. GP-MSK-MRI fuels unnecessary healthcare utilisation, generating nocebic patient beliefs and expectations, whilst appropriate care is delayed and a high burden of psychosocial barriers to recovery appear neglected.

Radiology Patient Outcome Measures: Impact of a Departmental Pay-for-Performance Initiative on Key Quality and Safety Measures

OBJECTIVE

Assess impact of a multifaceted pay-for-performance (PFP) initiative on radiologists' behavior regarding key quality and safety measures.

METHODS

This institutional review board-approved prospective study was performed at a large, 12-division urban academic radiology department. Radiology patient outcome measures were implemented October 1, 2017, measuring report signature timeliness, critical results communication, and generation of peer-learning communications between radiologists. Subspecialty division-wide and individual radiologist targets were specified, performance was transparently communicated on an intranet dashboard updated daily, and performance was financially incentivized (5% of salary) quarterly. We compared outcomes 12 months pre- versus 12 months post-PFP implementation. Primary outcome was monthly 90th percentile time from scan completion to final report signature (CtoF). Secondary outcomes were percentage timely closed-loop communication of critical results and number of division-wide peer-learning communications. Statistical process control analysis and parallel coordinates charts were used to assess for temporal trends.

RESULTS

In all, 144 radiologists generated 1,255,771 reports (613,273 pre-PFP) during the study period. Monthly 90th percentile CtoF exhibited an absolute decrease of 4.4 hours (from 21.1 to 16.7 hours) and a 20.9% relative decrease post-PFP. Statistical process control analysis demonstrated significant decreases in 90th percentile CtoF post-PFP, sustained throughout the study period (P < .003). Between 95% (119 of 125, July 1, 2018, to September 30, 2018) and 98.4% (126 of 128, October 1, 2017, to December 31, 2017) of radiologists achieved >90% timely closure of critical alerts; all divisions exceeded the target of 90 peer-learning communications each quarter (range: 97-472) after January 1, 2018.

DISCUSSION

Implementation of a multifaceted PFP initiative using well-defined radiology patient outcome measures correlated with measurable improvements in radiologist behavior regarding key quality and safety parameters.

Can feedback approaches reduce unwarranted clinical variation? A systematic rapid evidence synthesis

Background

Assessment of clinical variation has attracted increasing interest in health systems internationally due to growing awareness about better value and appropriate health care as a mechanism for enhancing efficient, effective and timely care. Feedback using administrative databases to provide benchmarking data has been utilised in several countries to explore clinical care variation and to enhance guideline adherent care. Whilst methods for detecting variation are well-established, methods for determining variation that is unwarranted and addressing this are strongly debated. This study aimed to synthesize published evidence of the use of feedback approaches to address unwarranted clinical variation (UCV).

Methods

A rapid review and narrative evidence synthesis was undertaken as a policy-focused review to understand how feedback approaches have been applied to address UCV specifically. Key words, synonyms and subject headings were used to search the major electronic databases Medline and PubMed between 2000 and 2018. Titles and abstracts of publications were screened by two reviewers and independently checked by a third reviewer. Full text articles were screened against the eligibility criteria. Key findings were extracted and integrated in a narrative synthesis.

Results

Feedback approaches that occurred over a duration of 1 month to 9 years to address clinical variation emerged from 27 publications with quantitative (20), theoretical/conceptual/descriptive work (4) and mixed or multi-method studies (3). Approaches ranged from presenting evidence to individuals, teams and organisations, to providing facilitated tailored feedback supported by a process of ongoing dialogue to enable change. Feedback approaches identified primarily focused on changing clinician decision-making and behaviour. Providing feedback to clinicians was identified, in a range of a settings, as associated with changes in variation such as reducing overuse of tests and treatments, reducing variations in optimal patient clinical outcomes and increasing guideline or protocol adherence.

Conclusions

The review findings suggest value in the use of feedback approaches to respond to clinical variation and understand when action is warranted. Evaluation of the effectiveness of particular feedback approaches is now required to determine if there is an optimal approach to create change where needed.

Unscheduled Radiologic Examination Orders in the Electronic Health Record: A Novel Resource for Targeting Ambulatory Diagnostic Errors in Radiology

PURPOSE

The aim of this study was to assess the prevalence of unscheduled radiologic examination orders in an electronic health record, and the proportion of unscheduled orders that are clinically necessary, by modality.

METHODS

This retrospective study was conducted from January to October 2016 at an academic institution. All unscheduled radiologic examination orders were retrieved for seven modalities (CT, MR, ultrasound, obstetric ultrasound, bone densitometry, mammography, and fluoroscopy). After excluding duplicates, 100 randomly selected orders from each modality were assigned to two physician reviewers who classified their clinical necessity, with 10% overlap. Interannotator agreement was assessed using κ statistics, the percentage of clinically necessary unscheduled orders was compared, and χ² analysis was used to assess differences by modality.

RESULTS

A total 494,503 radiologic examination orders were placed during the study period. After exclusions, 33,546 unscheduled orders were identified, 7% of all radiologic examination orders. Among 700 reviewed unscheduled orders, agreement was substantial (κ = 0.63). Eighty-seven percent of bone densitometric examinations and sixty-five percent of mammographic studies were considered clinically necessary, primarily for follow-up management. The majority of orders in each modality were clinically necessary, except for CT, obstetric ultrasound, and fluoroscopy (P < .0001).

CONCLUSIONS

Large numbers of radiologic examination orders remain unscheduled in the electronic health record. A substantial portion are clinically necessary, representing potential delays in executing documented provider care plans. Clinically unnecessary unscheduled orders may inadvertently be scheduled and performed. Identifying and performing clinically necessary unscheduled radiologic examination orders may help reduce diagnostic errors related to diagnosis and treatment delays and enhance patient safety, while eliminating clinically unnecessary unscheduled orders will help avoid unneeded testing.

Defining and measuring imaging appropriateness in low back pain studies: a scoping review

PURPOSE

Patients with low back pain (LBP) rarely have serious underlying pathology but frequently undergo inappropriate imaging. A range of guidelines and red flag features are utilised to characterise appropriate imaging. This scoping review explores how LBP imaging appropriateness is determined and calculated in studies of primary care practice.

METHODS

This scoping review builds upon a previous meta-analysis, incorporating articles identified that were published since 2014, with an updated search to capture articles published since the original search. Electronic databases were searched, and citation lists of included papers were reviewed. Inclusion criteria were studies assessing adult LBP imaging appropriateness in a primary care setting. Twenty-three eligible studies were identified.

RESULTS

A range of red flag features were utilised to determine imaging appropriateness. Most studies considered appropriateness in a binary manner, by the presence of any red flag feature. Ten guidelines were referenced, with 7/23 (30%) included studies amending or not referencing any guideline. The method for calculating the proportion of inappropriate imaging varied. Ten per cent of the studies used the total number of patients presenting with LBP as the denominator, suggesting most studies overestimated the rate of inappropriate imaging, and did not capture where imaging is not performed for clinically suspicious LBP.

CONCLUSION

Greater clarity is needed on how we define and measure imaging appropriateness for LBP, which also accounts for the problem of failing to image when indicated. An internationally agreed methodology for imaging appropriateness studies would ultimately lead to an improvement in the care delivered to patients. These slides can be retrieved under Electronic Supplementary Material.

Efficacy and unintended consequences of hard-stop alerts in electronic health record systems: a systematic review

Objective

Clinical decision support (CDS) hard-stop alerts-those in which the user is either prevented from taking an action altogether or allowed to proceed only with the external override of a third party-are increasingly common but can be problematic. To understand their appropriate application, we asked 3 key questions: (1) To what extent are hard-stop alerts effective in improving patient health and healthcare delivery outcomes? (2) What are the adverse events and unintended consequences of hard-stop alerts? (3) How do hard-stop alerts compare to soft-stop alerts?

Methods and Materials

Studies evaluating computerized hard-stop alerts in healthcare settings were identified from biomedical and computer science databases, gray literature sites, reference lists, and reviews. Articles were extracted for process outcomes, health outcomes, unintended consequences, user experience, and technical details.

Results

Of 32 studies, 15 evaluated health outcomes, 16 process outcomes only, 10 user experience, and 4 compared hard and soft stops. Seventy-nine percent showed improvement in health outcomes and 88% in process outcomes. Studies reporting good user experience cited heavy user involvement and iterative design. Eleven studies reported on unintended consequences including avoidance of hard-stopped workflow, increased alert frequency, and delay to care. Hard stops were superior to soft stops in 3 of 4 studies.

Conclusions

Hard stops can be effective and powerful tools in the CDS armamentarium, but they must be implemented judiciously with continuous user feedback informing rapid, iterative design. Investigators must report on associated health outcomes and unintended consequences when implementing IT solutions to clinical problems.

Clinical Decision Support: Opportunity or Armageddon?

OBJECTIVE. The objective of this article is to discuss clinical decision support (CDS) and the article by Palen and colleagues in this issue of AJR. CONCLUSION. The Palen et al. study provides strong evidence to date that CDS can lead to improvement in imaging appropriateness scores. However, the relevance of appropriateness scores in clinical practice is unknown and CDS is potentially highly disruptive to workflow, and therefore research into its true impact on clinical care is essential.

What Physicians and Health Organizations Should Know About Mandated Imaging Appropriate Use Criteria

The Appropriate Use Criteria Program, enacted by the Centers for Medicare & Medicaid Services in response to the Protecting Access to Medicare Act of 2014 (PAMA), aims to reduce inappropriate and unnecessary imaging by mandating use of clinical decision support (CDS) by all providers who order advanced imaging examinations (magnetic resonance imaging; computed tomography; and nuclear medicine studies, including positron emission tomography). Beginning 1 January 2020, documentation of an interaction with a certified CDS system using approved appropriate use criteria will be required on all Medicare claims for advanced imaging in all emergency department patients and outpatients as a prerequisite for payment. The Appropriate Use Criteria Program will initially cover 8 priority clinical areas, including several (such as headache and low back pain) commonly encountered by internal medicine providers. All providers and organizations that order and provide advanced imaging must understand program requirements and their options for compliance strategies. Substantial resources and planning will be needed to comply with PAMA regulations and avoid unintended negative consequences on workflow and payments. However, robust evidence supporting the desired outcome of reducing inappropriate use of advanced imaging is lacking.

Trends in Hospital Performance on the Medicare National Outpatient Imaging Metrics: A 5-Year Longitudinal Cohort Analysis

PURPOSE

Medicare established its Hospital Outpatient Quality Reporting Program (HOQRP) to promote and incentivize quality care and appropriate utilization in the hospital outpatient setting. The program includes "imaging efficiency" metrics evaluating appropriate utilization of imaging examinations. Our purpose was to evaluate the longitudinal performance of the nation's hospitals on the HOQPR's imaging efficiency metrics.

METHODS

Data were obtained from CMS Hospital Compare for hospitals participating in the Medicare HOQRP during both initial (January 1, 2011, to December 31, 2011) and follow-up (July 1, 2015, to June 30, 2016) periods. The six reported imaging efficiency metrics were: MRI lumbar spine for low back pain, mammography follow-up rates, abdomen and chest CT double scans (imaging with and without intravenous contrast), cardiac imaging for preoperative risk assessment for low-risk surgery, and simultaneous use of brain and sinus CT. Differences in imaging efficiency metrics were calculated using fixed effects linear regression models.

RESULTS

Baseline and follow-up data were available for 3,960 hospitals. Median changes were MRI lumbar spine for low back pain: +3.6% (range: -27.9% to +31.4%; P < .001); mammography follow-up: -0.3% (range: -69.5% to +62.6%; P = .03); double scan abdomen CT: -1.9% (range: -73.5% to +32.3%; P < .001); double scan chest CT: -0.4% (range: -73.2% to +28.0%; P < .001); preoperative cardiac imaging: -0.7% (range: -10.0% to +9.9%; P < .001); simultaneous brain and sinus CT: -0.9% (range: -11.8% to +7.8%; P < .001).

CONCLUSION

Medicare's nationwide hospital outpatient imaging efficiency reporting initiative was associating with worse performance in lumbar spine MRI utilization and small improvements in double CT scans. Because quality metrics are increasingly imposed on health care providers, health service researchers will need to rigorously evaluate their effectiveness before and during early implementation.

Physician-reported barriers to using evidence-based recommendations for low back pain in clinical practice: a systematic review and synthesis of qualitative studies using the Theoretical Domains Framework

BACKGROUND

Adoption of low back pain guidelines is a well-documented problem. Information to guide the development of behaviour change interventions is needed. The review is the first to synthesise the evidence regarding physicians' barriers to providing evidence-based care for LBP using the Theoretical Domains Framework (TDF). Using the TDF allowed us to map specific physician-reported barriers to individual guideline recommendations. Therefore, the results can provide direction to future interventions to increase physician compliance with evidence-based care for LBP.

METHODS

We searched the literature for qualitative studies from inception to July 2018. Two authors independently screened titles, abstracts, and full texts for eligibility and extracted data on study characteristics, reporting quality, and methodological rigour. Guided by a TDF coding manual, two reviewers independently coded the individual study themes using NVivo. After coding, we assessed confidence in the findings using the GRADE-CERQual approach.

RESULTS

Fourteen studies (n = 318 physicians) from 9 countries reported barriers to adopting one of the 5 guideline-recommended behaviours regarding in-clinic diagnostic assessments (9 studies, n = 198), advice on activity (7 studies, n = 194), medication prescription (2 studies, n = 39), imaging referrals (11 studies, n = 270), and treatment/specialist referrals (8 studies, n = 193). Imaging behaviour is influenced by (1) social influence-from patients requesting an image or wanting a diagnosis (n = 252, 9 studies), (2) beliefs about consequence-physicians believe that providing a scan will reassure patients (n = 175, 6 studies), and (3) environmental context and resources-physicians report a lack of time to have a conversation with patients about diagnosis and why a scan is not needed (n = 179, 6 studies). Referrals to conservative care is influenced by environmental context and resources-long wait-times or a complete lack of access to adjunct services prevented physicians from referring to these services (n = 82, 5 studies).

CONCLUSIONS

Physicians face numerous barriers to providing evidence-based LBP care which we have mapped onto 7 TDF domains. Two to five TDF domains are involved in determining physician behaviour, confirming the complexity of this problem. This is important as interventions often target a single domain where multiple domains are involved. Interventions designed to address all the domains involved while considering context-specific factors may prove most successful in increasing guideline adoption.

REGISTRATION

PROSPERO 2017, CRD42017070703.

Impact of a Multifaceted Information Technology-Enabled Intervention on the Adoption of ACR White Paper Follow-Up Recommendations for Incidental Adnexal Lesions Detected on CT

OBJECTIVE. The objective of our study was to improve adherence to American College of Radiology (ACR) white paper follow-up imaging recommendations for incidental adnexal lesions seen on pelvic CT (herein referred to as "adherence rate to recommendations"). MATERIALS AND METHODS. This quality improvement project was conducted at a large academic teaching hospital. The baseline adherence rate to recommendations was assessed by screening all pelvic CT reports for the period from October 22, 2016, through December 22, 2016, for incidental adnexal findings, followed by manual review. Forty abdominal and cancer imaging radiologists were surveyed to understand the barriers to adoption of the recommendations. Interventions to address the most common identified barriers were implemented on December 23, 2016. The postintervention adherence rate was assessed from December 23, 2016, through February 15, 2017, by again screening CT pelvis reports for incidental adnexal lesions followed by manual review. The change in pre- and postintervention adherence rates was assessed using the Fisher exact test and statistical process control (SPC) p-chart with 3-sigma control limits. RESULTS. The adherence rate to recommendations at baseline was 67% (121/181). Of the 28 of 40 (70%) radiologists who completed the survey, only 29% (8/28) often or consistently used the recommendations. Not remembering the details of the recommendations or not having time to look them up accounted for 83.3% of the barriers cited by radiologists. Interventions consisted of radiologist education and creation of an easily accessible clinical decision support tool incorporated into radiology reporting workflow. The adherence rate to recommendations after the intervention increased to 87% (129/148; p < 0.0001), as also shown by the SPC chart. CONCLUSION. The rate of adherence to follow-up imaging recommendations significantly increased after radiologist education and incorporation of recommendations into the radiologist workflow.

Imaging for low back pain: is clinical use consistent with guidelines? A systematic review and meta-analysis

BACKGROUND CONTEXT

The problem of imaging patients with low back pain (LBP) when it is not indicated is well recognized. The converse is also possible, although rarely considered. The extent of these two problems is presently unclear.

PURPOSE

This study aimed to estimate how commonly overuse, and also underuse, of imaging occurs in the management of LBP, and how appropriate use of imaging is assessed.

DESIGN

This is a systematic review and meta-analysis.

PATIENT SAMPLE

The sample comprised patients with LBP presenting to primary care.

OUTCOME MEASURES

Proportions of inappropriate referral, and inappropriate non-referral, for diagnostic imaging for LBP were the outcome measures.

METHODS

MEDLINE, EMBASE, and CINAHL were searched from January 1, 1995 to December 17, 2017. Two authors independently assessed study quality and extracted data. Meta-analyses were performed where appropriate, and strength of evidence was assessed using the Grading of Recommendations, Assessment, Development and Evaluation system.

RESULTS

Thirty-three studies were included. In patients referred for lumbar imaging, 34.8% (95% confidence interval [CI]: 27.1, 43.3) were judged inappropriate by the absence of red flags for serious pathology and 31.6% (95% CI: 28.3, 35.1) were judged inappropriate by the criteria of no clinical suspicion of pathology. In patients presenting for care, imaging was inappropriately performed in 27.7% of cases (95% CI: 21.3, 35.1) when judged by duration of episode, 9.0% of cases (95% CI: 7.4, 11.0) when judged by absence of red flags, and 7.0% (95% CI: 1.8, 23.3) when judged by no clinical suspicion of pathology. In patients presenting for care, imaging was not performed where appropriately indicated in 65.6% (95% CI: 51.8, 77.2) of patients who presented with red flags, and 60.8% (95% CI: 42.0, 76.8) with clinical suspicion of serious pathology.

CONCLUSIONS

Inappropriate imaging is common in LBP management, including both overuse in those where imaging is not indicated and underuse of imaging when it is indicated. Appreciating that both underuse and overuse can occur is fundamental to efforts to improve imaging practice to align with current guidelines and best evidence.

Variation in costs among surgeons for lumbar spinal stenosis

BACKGROUND CONTEXT

Lumbar spinal stenosis is a common condition in the elderly for which costs vary substantially by region. Comparing differences between surgeons from a single institution, thereby omitting regional variation, could aid in identifying factors associated with higher costs and individual drivers of costs. The use of decision aids (DAs) has been suggested as one of the possible tools for diminishing costs and cost variation.

PURPOSE

(1) To determine factors associated with higher costs for treatment of spinal stenosis in the first year after diagnosis in a single institution; (2) to find individual drivers of costs for providers with higher costs; and (3) to determine if the use of DAs can decrease costs and cost variability.

STUDY DESIGN

Retrospective cohort study.

PATIENT SAMPLE

A total of 10,858 patients in 18 different practices diagnosed with lumbar spinal stenosis between January 2003 and July 2015 in three associated hospitals of a single institution.

OUTCOME MEASURES

Mean cost for a patient per provider in US dollars within 1 year after diagnosis of lumbar spinal stenosis.

METHODS

We collected all diagnostic testing, office visits, injections, surgery, and occupational or physical therapy related to lumbar spinal stenosis within 1 year after initial diagnosis. We used multivariable linear regression to determine independent predictors for costs. Providers were grouped in tiers based on mean total costs per patient to find drivers of costs. To assess the DAs effect on costs and cost variability, we matched DA patients one-to-one with non-DA patients.

RESULTS

Male gender (β 0.10, 95% confidence interval [CI] 0.05-0.15, p<.001), seeing an additional provider (β 0.77, 95% CI 0.69-0.86, p<.001), and having an additional spine diagnosis (β 0.79, 95% CI 0.74-0.84, p<.001) were associated with higher costs. Providers in the high cost tier had more office visits (p<.001), more imaging procedures (p<.001), less occupational or physical therapy (p=.002), and less surgery (p=.001) compared with the middle tier. Eighty-two patients (0.76%) received a DA as part of their care; there was no statistically significant difference between the DA group and the matched group in costs (p=.975).

CONCLUSIONS

Male gender, seeing an additional provider, and having an additional spine diagnosis were independently associated with higher costs. The main targets for cost reduction we found are imaging procedures and number of office visits. Decision aids were not found to affect cost.

Radiologist involvement is associated with reduced use of MRI in the acute period of low back pain in a non-elderly population

PURPOSE

To test the hypothesis that "acute-period" lumbar MRI in non-elderly patients with low back pain is less frequently performed at clinics/hospitals with greater involvement of full-time radiologists in the imaging workflow.

METHODS

In a national-level claims database, we identified 14,819 non-elderly patients (mean age: 38.7±8.0 years) who visited clinics/hospitals for low back pain in 2013-2015. We classified the clinics/hospitals into four groups based on the level of full-time radiologist involvement and MRI ownership, and compared the frequency of acute-period lumbar MRI using hierarchical logistic regression analysis.

RESULTS

Patients visiting facilities without a full-time radiologist (n=2105) were significantly (p<0.001) more likely to undergo acute-period MRI than those visiting facilities with ≥1 radiologist partially managing imaging workflow (level-1, n=491) or ≥1 radiologist intensively involved in imaging workflow (level-2, n=1190) (15.7% vs. 6.9% and 7.3%; adjusted odds ratio of no-radiologist versus level-2: 2.93, p=0.018). No difference was observed between level-1 and level-2 involvement.

CONCLUSIONS

Facilities with no full-time radiologist were more likely to perform acute-period MRI to assess for low back pain, while no difference was seen between facilities with varying levels of radiologist involvement in the imaging workflow. Radiologist involvement may contribute to optimal utilisation of medical imaging.

KEY POINTS

• Lumbar MRI was more frequently performed at facilities without full-time radiologists. • Full-time radiologists may play an important role in appropriate utilisation of imaging. • Frequency of MRI was similar between moderate and intensive radiologist involvement.

Early Abdominal Imaging Remains Over-Utilized in Acute Pancreatitis

BACKGROUND

Early abdominal computed tomography (CT) or magnetic resonance (MR) imaging is common in acute pancreatitis (AP). Guidelines (2007-2013) indicate routine use is unwarranted.

AIMS

To compare the frequency and evaluate the predictors of early CT/MR utilization for AP between September 2006-2007 (period A) and September 2014-2015 (period B).

METHODS

AP patients presenting directly to a large academic emergency department were prospectively enrolled during each period. Cases requiring imaging to fulfill diagnostic criteria were excluded. Early CT/MR (within 24 h of presentation) utilization rates were compared using Fisher's exact test. Predictors of early imaging usage were assessed with multivariate logistic regression.

RESULTS

The cohort included 96 AP cases in period A and 97 in period B. There were no significant differences in patient demographics, comorbidity scores, or AP severity. Period B cases manifested decreased rates of the systemic inflammatory response syndrome (SIRS) during the first 24 h of hospitalization (67% period A vs. 43% period B, p = 0.001). Independent predictors of early imaging included age >60 and SIRS or organ failure on day 1. No significant decrease in early CT/MR usage was observed from period A to B on both univariate (49% period A vs. 40% period B, p = 0.25) and multivariate (OR 1.0 for period B vs. A, 95% CI 0.5-1.9) analysis.

CONCLUSIONS

In a comparison of imaging practices for AP, there was no significant decrease in early abdominal CT/MR utilization from 2007 to 2015. Quality improvement initiatives specifically targeting early imaging overuse are needed.

Medicare Imaging Demonstration: Assessing Attributes of Appropriate Use Criteria and Their Influence on Ordering Behavior

OBJECTIVE

Persistent concern exists about the variable and possibly inappropriate utilization of high-cost imaging tests. The purpose of this study is to assess the influence of appropriate use criteria attributes on altering ambulatory imaging orders deemed inappropriate.

MATERIALS AND METHODS

This secondary analysis included Medicare Imaging Demonstration data collected from three health care systems in 2011-2013 via the use of clinical decision support (CDS) during ambulatory imaging order entry. The CDS system captured whether orders were inappropriate per the appropriate use criteria of professional societies and provided advice during the intervention period. For orders deemed inappropriate, we assessed the impact of the availability of alternative test recommendations, conflicts with local best practices, and the strength of evidence for appropriate use criteria on the primary outcome of cancellation or modification of inappropriate orders. Expert review determined conflicts with local best practices for 250 recommendations for abdominal and thoracic CT orders. Strength of evidence was assessed for the 15 most commonly triggered recommendations that were deemed inappropriate. A chi-square test was used for univariate analysis.

RESULTS

A total of 1691 of 63,222 imaging test orders (2.7%) were deemed inappropriate during the intervention period; this amount decreased from 364 of 11,675 test orders (3.1%) in the baseline period (p < 0.00001). Of 270 inappropriate recommendations with alternative test recommendations, 28 (10.4%) were modified, compared with four of 1024 inappropriate recommendations without alternatives (0.4%) (p < 0.0001). Seventy-eight of 250 recommendations (31%) conflicted with local best practices, but only six of 69 inappropriate recommendations (9%) conflicted (p < 0.001). No inappropriate recommendations that conflicted with local best practices were modified. All 15 commonly triggered recommendations had an Oxford Centre for Evidence-Based Medicine level of evidence of 5 (i.e., expert opinion).

CONCLUSION

Orders for imaging tests that were deemed inappropriate were modified infrequently, more often with alternative recommendations present and only for appropriate use criteria consistent with local best practices.

Impact of Clinical Decision Support on Radiography for Acute Ankle Injuries: A Randomized Trial

Introduction

While only 15–20% of patients with foot and ankle injuries presenting to urgent care centers have clinically significant fractures, most undergo radiography. We examined the impact of electronic point-of-care clinical decision support (CDS) on adherence to the Ottawa Ankle Rules (OAR), as well as use and yield of foot and ankle radiographs in patients with acute ankle injury.

Methods

We obtained institutional review board approval for this randomized controlled study performed April 18, 2012—December 15, 2013. All ordering providers credentialed at an urgent care affiliated with a quaternary care academic hospital were randomized to either receive or not receive CDS, based on the OAR and integrated into the physician order-entry system, with feedback at the time of imaging order. If the patient met OAR low-risk criteria, providers were advised against imaging and could either cancel the order or ignore the alert. We identified patients with foot and ankle complaints via ICD-9 billing codes and electronic health records and radiology reports reviewed for those who were eligible. Chi-square was used to compare adherence to the OAR (primary outcome), radiography utilization rate and radiography yield of foot and ankle imaging (secondary outcomes) between the intervention and control groups.

Results

Of 14,642 patients seen at urgent care during the study period, 613 (4.2%, representing 632 visits) presented with acute ankle injury and were eligible for application of the OAR; 374 (59.2%) of these were seen by control-group providers. In the intervention group, CDS adherence was higher for both ankle (239/258=92.6% vs. 231/374=61.8%, p=0.02) and foot radiography (209/258=81.0% vs. 238/374=63.6%; p<0.01). However, ankle radiography use was higher in the intervention group (166/258=64.3% vs. 183/374=48.9%; p<0.01), while foot radiography use (141/258=54.6% vs. 202/374=54.0%; p=0.95) was not. Radiography yield was also higher in the intervention group (26/307=8.5% vs. 18/385=4.7%; p=0.04).

Conclusion

Clinical decision support, previously demonstrated to improve guideline adherence for high-cost imaging, can also improve guideline adherence for radiography – as demonstrated by increased OAR adherence and increased imaging yield.

JOURNAL CLUB: Predictors of Provider Response to Clinical Decision Support: Lessons Learned From the Medicare Imaging Demonstration

OBJECTIVE

The efficacy of imaging clinical decision support (CDS) varies. Our objective was to identify CDS factors contributing to imaging order cancellation or modification.

SUBJECTS AND METHODS

This pre-post study was performed across four institutions participating in the Medicare Imaging Demonstration. The intervention was CDS at order entry for selected outpatient imaging procedures. On the basis of the information entered, computerized alerts indicated to providers whether orders were not covered by guidelines, appropriate, of uncertain appropriateness, or inappropriate according to professional society guidelines. Ordering providers could override or accept CDS. We considered actionable alerts to be those that could generate an immediate order behavior change in the ordering physician (i.e., cancellation of inappropriate orders or modification of orders of uncertain appropriateness that had a recommended alternative). Chi-square and logistic regression identified predictors of order cancellation or modification after an alert.

RESULTS

A total of 98,894 radiology orders were entered (83,114 after the intervention). Providers ignored 98.9%, modified 1.1%, and cancelled 0.03% of orders in response to alerts. Actionable alerts had a 10 fold higher rate of modification (8.1% vs 0.7%; p < 0.0001) or cancellation (0.2% vs 0.02%; p < 0.0001) orders compared with nonactionable alerts. Orders from institutions with preexisting imaging CDS had a sevenfold lower rate of cancellation or modification than was seen at sites with newly implemented CDS (1.4% vs 0.2%; p < 0.0001). In multivariate analysis, actionable alerts were 12 times more likely to result in order cancellation or modification. Orders at sites with preexisting CDS were 7.7 times less likely to be cancelled or modified (p < 0.0001).

CONCLUSION

Using results from the Medicare Imaging Demonstration project, we identified potential factors that were associated with CDS effect on provider imaging ordering; these findings may have implications for future design of such computerized systems.

A multifaceted implementation strategy versus passive implementation of low back pain guidelines in general practice: a cluster randomised controlled trial

Background

Guidelines are often slowly adapted into clinical practice. However, actively supporting healthcare professionals in evidence-based treatment may speed up guideline implementation. Danish low back pain (LBP) guidelines focus on primary care treatment of LBP, to reduce referrals from primary care to secondary care. The primary aim of this project was to reduce secondary care referral within 12 weeks by a multifaceted implementation strategy (MuIS).

Methods

In a cluster randomised design, 189 general practices from the North Denmark Region were invited to participate. Practices were randomised (1:1) and stratified by practice size to MuIS (28 practices) or a passive implementation strategy (PaIS; 32 practices). Included were patients with LBP aged 18 to 65 years who were able to complete questionnaires, had no serious underlying pathology, and were not pregnant. We developed a MuIS including outreach visits, quality reports, and the STarT Back Tool for subgrouping patients with LBP. Both groups were offered the usual dissemination of guidelines, guideline-concordant structuring of the medical record, and a new referral opportunity for patients with psycho-social problems. In an intention-to-treat analysis, the primary and secondary outcomes pertained to the patient, and a cost-effectiveness analysis was performed from a healthcare sector perspective. Patients and the assessment of outcomes were blinded. Practices and caregivers delivering the interventions were not blinded.

Results

Between January 2013 and July 2014, 60 practices were included, of which 54 practices (28 MuIS, 26 PaIS) included 1101 patients (539 MuIS, 562 PaIS). Follow-up data for the primary outcome were available on 100 % of these patients. Twenty-seven patients (5.0 %) in the MuIS group were referred to secondary care vs. 59 patients (10.5 %) in the PaIS group. The adjusted odds ratio (AOR) was 0.52 [95 % CI 0.30 to 0.90; p = 0.020]. The MuIS was cost-saving £−93.20 (£406.51 vs. £499.71 per patient) after 12 weeks. Conversely, the MuIS resulted in less satisfied patients after 52 weeks (AOR 0.50 [95 % CI 0.31 to 0.81; p = 0.004]).

Conclusions

Using a MuIS changed general practice referral behaviour and was cost effective, but patients in the MuIS group were less satisfied. This study supports the application of a MuIS when implementing guidelines.

Trial registration

ClinicalTrials.gov, NCT01699256

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-016-0509-0) contains supplementary material, which is available to authorized users.

Yield of CT Pulmonary Angiography in the Emergency Department When Providers Override Evidence-based Clinical Decision Support

Purpose To determine the frequency of, and yield after, provider overrides of evidence-based clinical decision support (CDS) for ordering computed tomographic (CT) pulmonary angiography in the emergency department (ED). Materials and Methods This HIPAA-compliant, institutional review board-approved study was performed at a tertiary care, academic medical center ED with approximately 60 000 annual visits and included all patients who were suspected of having pulmonary embolism (PE) and who underwent CT pulmonary angiography between January 1, 2011, and August 31, 2013. The requirement to obtain informed consent was waived. Each CT order for pulmonary angiography was exposed to CDS on the basis of the Wells criteria. For patients with a Wells score of 4 or less, CDS alerts suggested d-dimer testing because acute PE is highly unlikely in these patients if d-dimer levels are normal. The yield of CT pulmonary angiography (number of positive PE diagnoses/total number of CT pulmonary angiographic examinations) was compared in patients in whom providers overrode CDS alerts (by performing CT pulmonary angiography in patients with a Wells score ≤4 and a normal d-dimer level or no d-dimer testing) (override group) and those in whom providers followed Wells criteria (CT pulmonary angiography only in patients with Wells score >4 or ≤4 with elevated d-dimer level) (adherent group). A validated natural language processing tool identified positive PE diagnoses, with subsegmental and/or indeterminate diagnoses removed by means of chart review. Statistical analysis was performed with the χ² test, the Student t test, and logistic regression. Results Among 2993 CT pulmonary angiography studies in 2655 patients, 563 examinations had a Wells score of 4 or less but did not undergo d-dimer testing and 26 had a Wells score of 4 or less and had normal d-dimer levels. The yield of CT pulmonary angiography was 4.2% in the override group (25 of 589 studies, none with a normal d-dimer level) and 11.2% in the adherent group (270 of 2404 studies) (P < .001). After adjustment for the risk factor differences between the two groups, the odds of an acute PE finding were 51.3% lower when providers overrode alerts than when they followed CDS guidelines. Comparison of the two groups including only patients unlikely to have PE led to similar results. Conclusion The odds of an acute PE finding in the ED when providers adhered to evidence presented in CDS were nearly double those seen when providers overrode CDS alerts. Most overrides were due to the lack of d-dimer testing in patients unlikely to have PE. ^© RSNA, 2016.

Assessing Strength of Evidence of Appropriate Use Criteria for Diagnostic Imaging Examinations

OBJECTIVE

For health information technology tools to fully inform evidence-based decisions, recommendations must be reliably assessed for quality and strength of evidence. We aimed to create an annotation framework for grading recommendations regarding appropriate use of diagnostic imaging examinations.

METHODS

The annotation framework was created by an expert panel (clinicians in three medical specialties, medical librarians, and biomedical scientists) who developed a process for achieving consensus in assessing recommendations, and evaluated by measuring agreement in grading the strength of evidence for 120 empirically selected recommendations using the Oxford Levels of Evidence.

RESULTS

Eighty-two percent of recommendations were assigned to Level 5 (expert opinion). Inter-annotator agreement was 0.70 on initial grading (κ = 0.35, 95% CI, 0.23-0.48). After systematic discussion utilizing the annotation framework, agreement increased significantly to 0.97 (κ = 0.88, 95% CI, 0.77-0.99).

CONCLUSIONS

A novel annotation framework was effective for grading the strength of evidence supporting appropriate use criteria for diagnostic imaging exams.

The Value of Imaging Part II: Value beyond Image Interpretation

Although image interpretation is an essential part of radiologists' value, there are other ways in which we contribute to patient care. Part II of the value of imaging series reviews current initiatives that demonstrate value beyond the image interpretation. Standardizing processes, reducing the radiation dose of our examinations, clarifying written reports, improving communications with patients and providers, and promoting appropriate imaging through decision support are all ways we can provide safer, more consistent, and higher quality care. As payers and policy makers push to drive value, research that demonstrates the value of these endeavors, or lack thereof, will become increasingly sought after and supported.

Optimizing Patient-centered Communication and Multidisciplinary Care Coordination in Emergency Diagnostic Imaging: A Research Agenda

Patient-centered emergency diagnostic imaging relies on efficient communication and multispecialty care coordination to ensure optimal imaging utilization. The construct of the emergency diagnostic imaging care coordination cycle with three main phases (pretest, test, and posttest) provides a useful framework to evaluate care coordination in patient-centered emergency diagnostic imaging. This article summarizes findings reached during the patient-centered outcomes session of the 2015 Academic Emergency Medicine consensus conference "Diagnostic Imaging in the Emergency Department: A Research Agenda to Optimize Utilization." The primary objective was to develop a research agenda focused on 1) defining component parts of the emergency diagnostic imaging care coordination process, 2) identifying gaps in communication that affect emergency diagnostic imaging, and 3) defining optimal methods of communication and multidisciplinary care coordination that ensure patient-centered emergency diagnostic imaging. Prioritized research questions provided the framework to define a research agenda for multidisciplinary care coordination in emergency diagnostic imaging.

Electronic health record-based interventions for improving appropriate diagnostic imaging: a systematic review and meta-analysis

BACKGROUND

One driver of increasing health care costs is the use of radiologic imaging procedures. More appropriate use could improve quality and reduce costs.

PURPOSE

To review interventions that use the computerized clinical decision-support (CCDS) capabilities of electronic health records to improve appropriate use of diagnostic radiologic test ordering.

DATA SOURCES

English-language articles in PubMed from 1995 to September 2014 and searches in Web of Science and PubMed of citations related to key articles.

STUDY SELECTION

23 studies, including 3 randomized trials, 7 time-series studies, and 13 pre-post studies that assessed the effect of CCDS on diagnostic radiologic test ordering in adults.

DATA EXTRACTION

2 independent reviewers extracted data on functionality, study outcomes, and context and assessed the quality of included studies.

DATA SYNTHESIS

Thirteen studies provided moderate-level evidence that CCDS improves appropriateness (effect size, -0.49 [95% CI, -0.71 to -0.26]) and reduces use (effect size, -0.13 [CI, -0.23 to -0.04]). Interventions with a "hard stop" that prevents a clinician from overriding the CCDS without outside consultation, as well as interventions in integrated care delivery systems, may be more effective. Harms have rarely been assessed but include decreased ordering of appropriate tests and physician dissatisfaction.

LIMITATION

Potential for publication bias, insufficient reporting of harms, and poor description of context and implementation.

CONCLUSION

Computerized clinical decision support integrated with the electronic health record can improve appropriate use of diagnostic radiology by a moderate amount and decrease use by a small amount. Before widespread adoption can be recommended, more data are needed on potential harms.

PRIMARY FUNDING SOURCE

U.S. Department of Veterans Affairs. (PROSPERO registration number: CRD42014007469).