Radiology order decision support: examination-indication appropriateness assessed using 2 electronic systems

Impact of Computerized Physician Order Entry (CPOE) Coupled With Clinical Decision Support (CDS) on Radiologic Services

Medical imaging is an essential component of healthcare, enabling accurate diagnoses and facilitating effective treatment plans. However, the field is not without its challenges, including medical imaging errors, overutilization of procedures, and adverse reactions to contrast agents. This review explores the impact of computerized physician order entry (CPOE) systems coupled with clinical decision support (CDS) on radiologic services. By analyzing the findings from various studies, this paper highlights how CPOE coupled with CDS can significantly reduce inappropriate imaging, enhance adherence to clinical guidelines, and improve overall patient safety. The implementation of CPOE with CDS optimizes the utilization of radiologic procedures, thereby reducing healthcare costs and minimizing patients' exposure to unnecessary radiation. Despite its benefits, the adoption of CPOE with CDS encounters challenges such as high implementation costs, changes in workflow, and alert fatigue among healthcare providers. Addressing these challenges requires careful system design, including the customization of alerts to reduce override rates and improve the specificity of CDS recommendations. This review underscores the potential of CPOE with CDS to transform radiologic services, enhancing both the quality and safety of patient care. Further research is needed to explore the system's effectiveness in preventing adverse reactions to contrast media and to identify best practices for overcoming the barriers to its broader adoption.

Evaluating the Accuracy and Impact of the ESR-iGuide Decision Support Tool in Optimizing CT Imaging Referral Appropriateness

Radiology referral quality impacts patient care, yet factors influencing quality are poorly understood. This study assessed the quality of computed tomography (CT) referrals, identified associated characteristics, and evaluated the ESR-iGuide clinical decision support tool's ability to optimize referrals. A retrospective review analyzed 300 consecutive CT referrals from an acute care hospital. Referral quality was evaluated on a 5-point scale by three expert reviewers (inter-rater reliability κ = 0.763-0.97). The ESR-iGuide tool provided appropriateness scores and estimated radiation exposure levels for the actual referred exams and recommended exams. Scores were compared between actual and recommended exams. Associations between ESR-iGuide scores and referral characteristics, including the specialty of the ordering physician (surgical vs. non-surgical), were explored. Of the referrals, 67.1% were rated as appropriate. The most common exams were head and abdomen/pelvis CTs. The ESR-iGuide deemed 70% of the actual referrals "usually appropriate" and found that the recommended exams had lower estimated radiation exposure compared to the actual exams. Logistic regression analysis showed that non-surgical physicians were more likely to order inappropriate exams compared to surgical physicians. Over one-third of the referrals showed suboptimal quality in the unstructured system. The ESR-iGuide clinical decision support tool identified opportunities to optimize appropriateness and reduce radiation exposure. Implementation of such a tool warrants consideration to improve communication and maximize patient care quality.

Adoption by clinicians of electronic order communications in NHS secondary care: a descriptive account

BACKGROUND

Due to the rapid advancement in information technology, changes to communication modalities are increasingly implemented in healthcare. One such modality is Computerised Provider Order Entry (CPOE) systems which replace paper, verbal or telephone orders with electronic booking of requests. We aimed to understand the uptake, and user acceptability, of CPOE in a large National Health Service hospital system.

METHODS

This retrospective single-centre study investigates the longitudinal uptake of communications through the Prescribing, Information and Communication System (PICS). The development and configuration of PICS are led by the doctors, nurses and allied health professionals that use it and requests for CPOE driven by clinical need have been described.Records of every request (imaging, specialty review, procedure, laboratory) made through PICS were collected between October 2008 and July 2019 and resulting counts were presented. An estimate of the proportion of completed requests made through the system has been provided for three example requests. User surveys were completed.

RESULTS

In the first 6 months of implementation, a total of 832 new request types (imaging types and specialty referrals) were added to the system. Subsequently, an average of 6.6 new request types were added monthly. In total, 8 035 132 orders were requested through PICS. In three example request types (imaging, endoscopy and full blood count), increases in the proportion of requests being made via PICS were seen. User feedback at 6 months reported improved communications using the electronic system.

CONCLUSION

CPOE was popular, rapidly adopted and diversified across specialties encompassing wide-ranging requests.

Features and functions of decision support systems for appropriate diagnostic imaging: a scoping review

BACKGROUND

Diagnostic imaging decision support (DI-DS) systems could be effective tools for reducing inappropriate diagnostic imaging examinations. Since effective design and evaluation of these systems requires in-depth understanding of their features and functions, the present study aims to map the existing literature on DI-DS systems to identify features and functions of these systems.

METHODS

The search was performed using Scopus, Embase, PubMed, Web of Science, and Cochrane Central Registry of Controlled Trials (CENTRAL) and was limited to 2000 to 2021. Analytical studies, descriptive studies, reviews and book chapters that explicitly addressed the functions or features of DI-DS systems were included.

RESULTS

A total of 6,046 studies were identified. Out of these, 55 studies met the inclusion criteria. From these, 22 functions and 22 features were identified. Some of the identified features were: visibility, content chunking/grouping, deployed as a multidisciplinary program, clinically valid and relevant feedback, embedding current evidence, and targeted recommendations. And, some of the identified functions were: displaying an appropriateness score, recommending alternative or more appropriate imaging examination(s), providing recommendations for next diagnostic steps, and providing safety alerts.

CONCLUSIONS

The set of features and functions obtained in the present study can provide a basis for developing well-designed DI-DS systems, which could help to improve adherence to diagnostic imaging guidelines, minimize unnecessary costs, and improve the outcome of care through appropriate diagnosis and on-time care delivery.

Advancing acceptance: assessing acceptance of the ESR iGuide clinical decision support system for improved computed tomography test justification

Background

A clinical decision support system (CDSS), the European Society of Radiologists (ESR) iGuide, was developed to address gaps in the availability and use of effective imaging referral guidelines.

Aim

This study aimed to assess the appropriateness of computed tomography (CT) exams with and without ESR iGuide use, as well as the usability and acceptance of the physician systems.

Methods

A retrospective single-center study was conducted in which data from 278 consecutive CT tests referred by physicians were collected in the first phase (T1), and physicians used the ESR iGuide system for imaging referrals in the second phase (T2; n = 85). The appropriateness of imaging referrals in each phase was assessed by two experts, and physicians completed the System Usability Scale.

Results

The mean appropriateness level on a scale of 0-9 was 6.62 ± 2.69 at T1 and 7.88 ± 1.4 at T2. When using a binary variable (0-6 = non-appropriate; 7-9 = appropriate), 70.14% of cases were found appropriate at T1 and 96.47% at T2. Surgery physician specialty and post-intervention phase showed a higher likelihood of ordering an appropriate test (p = 0.0045 and p = 0.0003, respectively). However, the questionnaire results indicated low system trust and minimal clinical value, with all physicians indicating they would not recommend collegial use (100%).

Conclusion

The study suggests that ESR iGuide can effectively guide the selection of appropriate imaging tests. However, physicians showed low system trust and use, indicating a need for further understanding of CDSS acceptance properties. Maximizing CDSS potential could result in crucial decision-support compliance and promotion of appropriate imaging.

The Medicare Appropriate Use Criteria Program: A Review of Recommendations for Testing in Coronary Artery Disease

BACKGROUND

Congress established the Appropriate Use Criteria (AUC) Program to reduce unnecessary advanced imaging studies. Organizations that wish to develop AUC can apply to the Centers for Medicare & Medicaid Services (CMS) to qualify as provider-led entities (PLEs) under this program. Variable methods, content, and formatting of PLE-generated AUC could lead to clinician uncertainty about whether an advanced imaging test is appropriate or not.

PURPOSE

To review AUC published by CMS-qualified PLEs focused on advanced imaging tests for coronary artery disease (CAD), a "priority clinical area" identified by CMS.

DATA SOURCES

Publicly available data from the worldwide web searched on 29 August 2022.

STUDY SELECTION

Approved AUC with recommendations related to testing for CAD.

DATA EXTRACTION

Manual review of published AUC by all authors.

DATA SYNTHESIS

Among the 17 CMS-qualified PLEs, only 7 had published AUC related to CAD. Substantial variation in the methods and formatting of these AUCs was observed. The number of clinical scenarios covered ranged from 6 to 210, and the number of advanced imaging methods covered ranged from 1 to 25. When specifically applied to clinical scenarios, many AUC offered no guidance on appropriateness; those that did conflicted with respect to appropriateness.

LIMITATION

Other CMS-identified priority clinical areas were not evaluated.

CONCLUSION

CMS-qualified AUC for imaging of CAD are heterogeneous and sometimes discrepant, creating substantial potential for uncertainty among clinicians seeking to provide their patients with appropriate imaging tests.

PRIMARY FUNDING SOURCE

No funding was received for this study.

Effects of Computerized Decision Support Systems on Practitioner Performance and Patient Outcomes: Systematic Review

Background

Computerized decision support systems (CDSSs) are software programs that support the decision making of practitioners and other staff. Other reviews have analyzed the relationship between CDSSs, practitioner performance, and patient outcomes. These reviews reported positive practitioner performance in over half the articles analyzed, but very little information was found for patient outcomes.

Objective

The purpose of this review was to analyze the relationship between CDSSs, practitioner performance, and patient medical outcomes. PubMed, CINAHL, Embase, Web of Science, and Cochrane databases were queried.

Methods

Articles were chosen based on year published (last 10 years), high quality, peer-reviewed sources, and discussion of the relationship between the use of CDSS as an intervention and links to practitioner performance or patient outcomes. Reviewers used an Excel spreadsheet (Microsoft Corporation) to collect information on the relationship between CDSSs and practitioner performance or patient outcomes. Reviewers also collected observations of participants, intervention, comparison with control group, outcomes, and study design (PICOS) along with those showing implicit bias. Articles were analyzed by multiple reviewers following the Kruse protocol for systematic reviews. Data were organized into multiple tables for analysis and reporting.

Results

Themes were identified for both practitioner performance (n=38) and medical outcomes (n=36). A total of 66% (25/38) of articles had occurrences of positive practitioner performance, 13% (5/38) found no difference in practitioner performance, and 21% (8/38) did not report or discuss practitioner performance. Zero articles reported negative practitioner performance. A total of 61% (22/36) of articles had occurrences of positive patient medical outcomes, 8% (3/36) found no statistically significant difference in medical outcomes between intervention and control groups, and 31% (11/36) did not report or discuss medical outcomes. Zero articles found negative patient medical outcomes attributed to using CDSSs.

Conclusions

Results of this review are commensurate with previous reviews with similar objectives, but unlike these reviews we found a high level of reporting of positive effects on patient medical outcomes.

Patients undergoing recurrent CT exams: assessment of patients with non-malignant diseases, reasons for imaging and imaging appropriateness

OBJECTIVE

To determine percent of patients without malignancy and ≤ 40 years of age with high cumulative radiation doses through recurrent CT exams and assess imaging appropriateness.

METHODS

From the cohort of patients who received cumulative effective dose (CED) of ≥ 100 mSv over a 5-year period, a sub-set was identified with non-malignant disease. The top 50 clinical indications leading to multiple CTs were determined. Clinical decision support (CDS) system scores were analyzed using a widely adopted standard of 1-3 (red) as "not usually appropriate," 4-6 (yellow) "may or may not be appropriate," and 7-9 (green) "usually appropriate." Clinicians reviewed patient records to assess compliance with appropriate use criteria (AUC).

RESULTS

9.6% of patients in our series were with non-malignant conditions and 1.4% with age ≤ 40 years. CDS scores (rounded) were 2% red, 38% yellow, 27% green, and 33% unscored CTs. Clinical society guidelines for CT exams, wherever available, were followed in 87.5 to 100% of cases. AUCs were not available for several clinical indications as also referral guidelines for serial CT imaging. More than half of CT exams were unrelated to follow-up of a primary chronic disease.

CONCLUSIONS

We are faced with a situation wherein patients in age ≤ 40 years require or are thought to require many CT exams over the course of a few years but the radiation risk creates concern. There is a fair number of conditions for which AUC are not available. Suggested solutions include development of CT scanners with lesser radiation dose and further development of appropriateness criteria.

KEY POINTS

We are faced with a situation wherein patients in age group 0-40 years and with non-malignant diagnosis require or are thought to require many CT exams over the course of a few years. More than half of CT exams were unrelated to follow-up of a primary chronic disease. Imaging guidelines and appropriateness use criteria are not available for many conditions. Wherever available, they are for initial work-up and diagnosis and there is a lack of guidance on serial CT imaging.

A Day in the Life of MRI: The Variety and Appropriateness of Exams Being Performed in Canada

Purpose

This study aimed to determine the volumes and types of magnetic resonance imaging exams being performed across Canada, common indications for the exams, and exam appropriateness using multiple evaluation tools.

Methods

Thirteen academic medical institutions across Canada participated. Data were obtained relating to a single common day, October 1, 2014. Patient demographics, type by anatomic region and indication for imaging were analysed. Each exam was assessed for appropriateness via the Canadian Association of Radiologists Referral Guidelines and the American College of Radiology Appropriateness Criteria. The Alberta and Saskatchewan spine screening forms and the Alberta knee screening form were also used where applicable. The proportion of exams that were unscorable, appropriate, and inappropriate was determined. Exam-level results were compared between the 2 main evaluation tools.

Results

Data were obtained for 1087 relevant exams. There were 591 women and 460 men. 36 requisitions did not indicate the patient's sex. Brain exams were the most common, comprising 32.5% of the sample. Cancer was the most common indication. Overall, 87.0%–87.4% of the MR exams performed were appropriate; 6.6%–12.6% were inappropriate, based on the 2 main evaluation tools. Results differed by anatomic region; spine exams had the highest proportion, with nearly one-third of exams deemed inappropriate.

Conclusion

Variations by anatomic region indicate that focused exam request evaluation or screening methods could substantially reduce inappropriate imaging.

Evaluating the Effect of Unstructured Clinical Information on Clinical Decision Support Appropriateness Ratings

OBJECTIVE

To determine the appropriateness rating (AR) of advanced inpatient imaging requests that were not rated by prospective, point-of-care clinical decision support (CDS) using computerized provider order entry.

MATERIALS AND METHODS

During 30-day baseline and intervention periods, CDS generated an AR for advanced inpatient imaging requests (nuclear medicine, CT, and MRI) using provider-selected structured indications from pull-down menus in the computerized provider order entry portal. The AR was only displayed during the intervention, and providers were required to acknowledge the AR to finalize the request. Subsequently, the unstructured free text information accompanying all requests was reviewed, and the AR was revised when possible. The percentage of unrated requests and the overall AR, before and after radiologist review, were compared between periods and by provider type.

RESULTS

CDS software prospectively generated an AR for only 25.4% and 28.4% of baseline and intervention imaging requests, respectively; however, radiologist review generated an AR for 82.4% and 93.6% of the same requests. During the respective periods, the percentage of baseline and intervention imaging requests considered appropriate was 18.7% and 22.9% by prospective CDS software rating and increased to 82.4% and 88.7% with radiologist review.

CONCLUSION

Despite limited effective use of CDS software, the percentage of requests containing additional, relevant clinical information increased, and the majority of requests had overall high appropriateness when reviewed by a radiologist. Additional work is needed to improve the amount and quality of clinical information available to CDS software and to facilitate the entry of this information by appropriate end users.

Partnering With Your Health System to Select and Implement Clinical Decision Support for Imaging

Recent legislation mandates the documentation of appropriateness criteria consultation when ordering advanced imaging for Medicare patients to remain eligible for reimbursement. Implementation of imaging clinical decision support (CDS) is a solution adopted by many systems to automate compliance with the new requirements. This article is intended to help radiologists who are employed by, contracted with, or otherwise affiliated with systems planning to implement CDS in the near future and ensure that they are able to understand and contribute to the process wherever possible. It includes an in-depth discussion of the legislation, evidence for and against the efficacy of imaging CDS, considerations for selecting a CDS vendor, tips for configuring CDS in a fashion consistent with departmental goals, and pointers for implementation and change management.