Medicare Imaging Demonstration: Assessing Attributes of Appropriate Use Criteria and Their Influence on Ordering Behavior

Features and functions of decision support systems for appropriate diagnostic imaging: a scoping review

BACKGROUND

Diagnostic imaging decision support (DI-DS) systems could be effective tools for reducing inappropriate diagnostic imaging examinations. Since effective design and evaluation of these systems requires in-depth understanding of their features and functions, the present study aims to map the existing literature on DI-DS systems to identify features and functions of these systems.

METHODS

The search was performed using Scopus, Embase, PubMed, Web of Science, and Cochrane Central Registry of Controlled Trials (CENTRAL) and was limited to 2000 to 2021. Analytical studies, descriptive studies, reviews and book chapters that explicitly addressed the functions or features of DI-DS systems were included.

RESULTS

A total of 6,046 studies were identified. Out of these, 55 studies met the inclusion criteria. From these, 22 functions and 22 features were identified. Some of the identified features were: visibility, content chunking/grouping, deployed as a multidisciplinary program, clinically valid and relevant feedback, embedding current evidence, and targeted recommendations. And, some of the identified functions were: displaying an appropriateness score, recommending alternative or more appropriate imaging examination(s), providing recommendations for next diagnostic steps, and providing safety alerts.

CONCLUSIONS

The set of features and functions obtained in the present study can provide a basis for developing well-designed DI-DS systems, which could help to improve adherence to diagnostic imaging guidelines, minimize unnecessary costs, and improve the outcome of care through appropriate diagnosis and on-time care delivery.

Analytics to monitor local impact of the Protecting Access to Medicare Act's imaging clinical decision support requirements

OBJECTIVE

This study aimed is to: (1) extend the Integrating the Biology and the Bedside (i2b2) data and application models to include medical imaging appropriate use criteria, enabling it to serve as a platform to monitor local impact of the Protecting Access to Medicare Act's (PAMA) imaging clinical decision support (CDS) requirements, and (2) validate the i2b2 extension using data from the Medicare Imaging Demonstration (MID) CDS implementation.

MATERIALS AND METHODS

This study provided a reference implementation and assessed its validity and reliability using data from the MID, the federal government's predecessor to PAMA's imaging CDS program. The Star Schema was extended to describe the interactions of imaging ordering providers with the CDS. New ontologies were added to enable mapping medical imaging appropriateness data to i2b2 schema. z-Ratio for testing the significance of the difference between 2 independent proportions was utilized.

RESULTS

The reference implementation used 26 327 orders for imaging examinations which were persisted to the modified i2b2 schema. As an illustration of the analytical capabilities of the Web Client, we report that 331/1192 or 28.1% of imaging orders were deemed appropriate by the CDS system at the end of the intervention period (September 2013), an increase from 162/1223 or 13.2% for the first month of the baseline period, December 2011 (P = .0212), consistent with previous studies.

CONCLUSIONS

The i2b2 platform can be extended to monitor local impact of PAMA's appropriateness of imaging ordering CDS requirements.

Interventions to reduce low-value imaging - a systematic review of interventions and outcomes

BACKGROUND

It is estimated that 20-50% of all radiological examinations are of low value. Many attempts have been made to reduce the use of low-value imaging. However, the comparative effectiveness of interventions to reduce low-value imaging is unclear. Thus, the objective of this systematic review was to provide an overview and evaluate the outcomes of interventions aimed at reducing low-value imaging.

METHODS

An electronic database search was completed in Medline - Ovid, Embase-Ovid, Scopus, and Cochrane Library for citations between 2010 and 2020. The search was built from medical subject headings for Diagnostic imaging/Radiology, Health service misuse or medical overuse, and Health planning. Keywords were used for the concept of reduction and avoidance. Reference lists of included articles were also hand-searched for relevant citations. Only articles written in English, German, Danish, Norwegian, Dutch, and Swedish were included. The Mixed Methods Appraisal Tool was used to appraise the quality of the included articles. A narrative synthesis of the final included articles was completed.

RESULTS

The search identified 15,659 records. After abstract and full-text screening, 95 studies of varying quality were included in the final analysis, containing 45 studies found through hand-searching techniques. Both controlled and uncontrolled before-and-after studies, time series, chart reviews, and cohort studies were included. Most interventions were aimed at referring physicians. Clinical practice guidelines (n = 28) and education (n = 28) were most commonly evaluated interventions, either alone or in combination with other components. Multi-component interventions were often more effective than single-component interventions showing a reduction in the use of low-value imaging in 94 and 74% of the studies, respectively. The most addressed types of imaging were musculoskeletal (n = 26), neurological (n = 23) and vascular (n = 16) imaging. Seventy-seven studies reported reduced low-value imaging, while 3 studies reported an increase.

CONCLUSIONS

Multi-component interventions that include education were often more effective than single-component interventions. The contextual and cultural factors in the health care systems seem to be vital for successful reduction of low-value imaging. Further research should focus on assessing the impact of the context in interventions reducing low-value imaging and how interventions can be adapted to different contexts.

Impact of Radiologist-Driven Change-Order Requests on Outpatient CT and MRI Examinations

PURPOSE

To assess impact of electronic medical record-embedded radiologist-driven change-order request on outpatient CT and MRI examinations.

METHODS

Outpatient CT and MRI requests where an order change was requested by the protocoling radiologist in our tertiary care center, from April 11, 2017, to January 3, 2018, were analyzed. Percentage and categorization of requested order change, provider acceptance of requested change, patient and provider demographics, estimated radiation exposure reduction, and cost were analyzed. P < .05 was used for statistical significance.

RESULTS

In 79,310 outpatient studies in which radiologists determined protocol, change-order requests were higher for MRI (5.2%, 1,283 of 24,553) compared with CT (2.9%, 1,585 of 54,757; P < .001). Provider approval of requested change was equivalent for CT (82%, 1,299 of 1,585) and MRI (82%, 1,052 of 1,283). Change requests driven by improper contrast media utilization were most common and different between CT (76%, 992 of 1,299) and MRI (65%, 688 of 1,052; P < .001). Changing without and with intravenous contrast orders to with contrast only was most common for CT (39%, 505 of 1,299) and with and without intravenous contrast to without contrast only was most common for MRI (26%, 274 of 1,052; P < .001). Of approved changes in CT, 51% (661 of 1,299) resulted in lower radiation exposure. Approved changes frequently resulted in less costly examinations (CT 67% [799 of 1,198], MRI 48% [411 of 863]).

CONCLUSION

Outpatient CT and MRI orders are deemed incorrect in 2.9% to 5% of cases. Radiologist-driven change-order request for CT and MRI are well accepted by ordering providers and decrease radiation exposure associated with imaging.

Assessing information sources to elucidate diagnostic process errors in radiologic imaging - a human factors framework

Objective

To assess information sources that may elucidate errors related to radiologic diagnostic imaging, quantify the incidence of potential safety events from each source, and quantify the number of steps involved from diagnostic imaging chain and socio-technical factors.

Materials and Methods

This retrospective, Institutional Review Board-approved study was conducted at the ambulatory healthcare facilities associated with a large academic hospital. Five information sources were evaluated: an electronic safety reporting system (ESRS), alert notification for critical result (ANCR) system, picture archive and communication system (PACS)-based quality assurance (QA) tool, imaging peer-review system, and an imaging computerized physician order entry (CPOE) and scheduling system. Data from these sources (January-December 2015 for ESRS, ANCR, QA tool, and the peer-review system; January-October 2016 for the imaging ordering system) were collected to quantify the incidence of potential safety events. Reviewers classified events by the step(s) in the diagnostic process they could elucidate, and their socio-technical factors contributors per the Systems Engineering Initiative for Patient Safety (SEIPS) framework.

Results

Potential safety events ranged from 0.5% to 62.1% of events collected from each source. Each of the information sources contributed to elucidating diagnostic process errors in various steps of the diagnostic imaging chain and contributing socio-technical factors, primarily Person, Tasks, and Tools and Technology.

Discussion

Various information sources can differentially inform understanding diagnostic process errors related to radiologic diagnostic imaging.

Conclusion

Information sources elucidate errors in various steps within the diagnostic imaging workflow and can provide insight into socio-technical factors that impact patient safety in the diagnostic process.

Characteristics of knowledge content in a curated online evidence library

Objective

To describe types of recommendations represented in a curated online evidence library, report on the quality of evidence-based recommendations pertaining to diagnostic imaging exams, and assess underlying knowledge representation.

Materials and Methods

The evidence library is populated with clinical decision rules, professional society guidelines, and locally developed best practice guidelines. Individual recommendations were graded based on a standard methodology and compared using chi-square test. Strength of evidence ranged from grade 1 (systematic review) through grade 5 (recommendations based on expert opinion). Finally, variations in the underlying representation of these recommendations were identified.

Results

The library contains 546 individual imaging-related recommendations. Only 15% (16/106) of recommendations from clinical decision rules were grade 5 vs 83% (526/636) from professional society practice guidelines and local best practice guidelines that cited grade 5 studies (P < .0001). Minor head trauma, pulmonary embolism, and appendicitis were topic areas supported by the highest quality of evidence. Three main variations in underlying representations of recommendations were "single-decision," "branching," and "score-based."

Discussion

Most recommendations were grade 5, largely because studies to test and validate many recommendations were absent. Recommendation types vary in amount and complexity and, accordingly, the structure and syntax of statements they generate. However, they can be represented in single-decision, branching, and score-based representations.

Conclusion

In a curated evidence library with graded imaging-based recommendations, evidence quality varied widely, with decision rules providing the highest-quality recommendations. The library may be helpful in highlighting evidence gaps, comparing recommendations from varied sources on similar clinical topics, and prioritizing imaging recommendations to inform clinical decision support implementation.

What Physicians and Health Organizations Should Know About Mandated Imaging Appropriate Use Criteria

The Appropriate Use Criteria Program, enacted by the Centers for Medicare & Medicaid Services in response to the Protecting Access to Medicare Act of 2014 (PAMA), aims to reduce inappropriate and unnecessary imaging by mandating use of clinical decision support (CDS) by all providers who order advanced imaging examinations (magnetic resonance imaging; computed tomography; and nuclear medicine studies, including positron emission tomography). Beginning 1 January 2020, documentation of an interaction with a certified CDS system using approved appropriate use criteria will be required on all Medicare claims for advanced imaging in all emergency department patients and outpatients as a prerequisite for payment. The Appropriate Use Criteria Program will initially cover 8 priority clinical areas, including several (such as headache and low back pain) commonly encountered by internal medicine providers. All providers and organizations that order and provide advanced imaging must understand program requirements and their options for compliance strategies. Substantial resources and planning will be needed to comply with PAMA regulations and avoid unintended negative consequences on workflow and payments. However, robust evidence supporting the desired outcome of reducing inappropriate use of advanced imaging is lacking.