The challenges, opportunities, and imperative of structured reporting in medical imaging

Perceptions of radiologists on structured reporting for cancer imaging-a survey by the European Society of Oncologic Imaging (ESOI)

OBJECTIVES

To assess radiologists' current use of, and opinions on, structured reporting (SR) in oncologic imaging, and to provide recommendations for a structured report template.

MATERIALS AND METHODS

An online survey with 28 questions was sent to European Society of Oncologic Imaging (ESOI) members. The questionnaire had four main parts: (1) participant information, e.g., country, workplace, experience, and current SR use; (2) SR design, e.g., numbers of sections and fields, and template use; (3) clinical impact of SR, e.g., on report quality and length, workload, and communication with clinicians; and (4) preferences for an oncology-focused structured CT report. Data analysis comprised descriptive statistics, chi-square tests, and Spearman correlation coefficients.

RESULTS

A total of 200 radiologists from 51 countries completed the survey: 57.0% currently utilized SR (57%), with a lower proportion within than outside of Europe (51.0 vs. 72.7%; p = 0.006). Among SR users, the majority observed markedly increased report quality (62.3%) and easier comparison to previous exams (53.5%), a slightly lower error rate (50.9%), and fewer calls/emails by clinicians (78.9%) due to SR. The perceived impact of SR on communication with clinicians (i.e., frequency of calls/emails) differed with radiologists' experience (p < 0.001), and experience also showed low but significant correlations with communication with clinicians (r = - 0.27, p = 0.003), report quality (r = 0.19, p = 0.043), and error rate (r = - 0.22, p = 0.016). Template use also affected the perceived impact of SR on report quality (p = 0.036).

CONCLUSION

Radiologists regard SR in oncologic imaging favorably, with perceived positive effects on report quality, error rate, comparison of serial exams, and communication with clinicians.

CLINICAL RELEVANCE STATEMENT

Radiologists believe that structured reporting in oncologic imaging improves report quality, decreases the error rate, and enables better communication with clinicians. Implementation of structured reporting in Europe is currently below the international level and needs society endorsement.

KEY POINTS

• The majority of oncologic imaging specialists (57% overall; 51% in Europe) use structured reporting in clinical practice. • The vast majority of oncologic imaging specialists use templates (92.1%), which are typically cancer-specific (76.2%). • Structured reporting is perceived to markedly improve report quality, communication with clinicians, and comparison to prior scans.

Standardizing imaging findings representation: harnessing Common Data Elements semantics and Fast Healthcare Interoperability Resources structures

OBJECTIVES

Designing a framework representing radiology results in a standards-based data structure using joint Radiological Society of North America/American College of Radiology Common Data Elements (CDEs) as the semantic labels on standard structures. This allows radiologist-created report data to integrate with artificial intelligence-generated results for use throughout downstream systems.

MATERIALS AND METHODS

We developed a framework modeling radiology findings as Health Level 7 (HL7) Fast Healthcare Interoperability Resources (FHIR) observations using CDE set/element identifiers as standardized semantic labels. This framework deploys CDE identifiers to specify radiology findings and attributes, providing consistent labels for radiology report concepts-diagnoses, recommendations, tabular/quantitative data-with built-in integration with RadLex, SNOMED CT, LOINC, and other ontologies. Observation structures fit within larger HL7 FHIR DiagnosticReport resources, providing output including both nuanced text and structured data.

RESULTS

Labeling radiology findings as discrete data for interchange between systems requires two components: structure and semantics. CDE definitions provide semantic identifiers for findings and their component values. The FHIR observation resource specifies a structure for associating identifiers with radiology findings in the context of reports, with CDE-encoded observations referring to definitions for CDE identifiers in a central repository. The discussion includes an example of encoding pulmonary nodules on a chest CT as CDE-labeled observations, demonstrating the application of this framework to exchange findings throughout the imaging workflow, making imaging data available to downstream clinical systems.

DISCUSSION

CDE-labeled observations establish a lingua franca for encoding, exchanging, and consuming radiology data at the level of individual findings, facilitating use throughout healthcare systems.

IMPORTANCE

CDE-labeled FHIR observation objects can increase the value of radiology results by facilitating their use throughout patient care.

Closing the Gap: A Critical Examination of Adherence, Inconsistency, and Improvements in Colonoscopy Reporting Practices

INTRODUCTION

Comprehensive and standardized colonoscopy reports are crucial in colorectal cancer prevention, monitoring, and research. This study investigates adherence to national and international guidelines by analyzing reporting practices among 21 endoscopists in 7 German centers, with a focus on polyp reporting.

METHODS

We identified and assessed German, European, American, and World Health Organization-provided statements to identify key elements in colonoscopy reporting. Board-certified gastroenterologists rated the relevance of each element and estimated their reporting frequency. Adherence to the identified report elements was evaluated for 874 polyps from 351 colonoscopy reports ranging from March 2021 to March 2022.

RESULTS

We identified numerous recommendations for colonoscopy reporting. We categorized the reasoning behind those recommendations into clinical relevance, justification, and quality control and research. Although all elements were considered relevant by the surveyed gastroenterologists, discrepancies were observed in the evaluated reports. Particularly diminutive polyps or attributes which are rarely abnormal (e.g., surface integrity) respectively rarely performed (e.g., injection) were sparsely documented. Furthermore, the white light morphology of polyps was inconsistently documented using either the Paris classification or free text. In summary, the analysis of 874 reported polyps revealed heterogeneous adherence to the recommendations, with reporting frequencies ranging from 3% to 89%.

CONCLUSION

The inhomogeneous report practices may result from implicit reporting practices and recommendations with varying clinical relevance. Future recommendations should clearly differentiate between clinical relevance and research and quality control or explanatory purposes. Additionally, the role of computer-assisted documentation should be further evaluated to increase report frequencies of non-pathological findings and diminutive polyps.

Assisted documentation as a new focus for artificial intelligence in endoscopy: the precedent of reliable withdrawal time and image reporting

BACKGROUND : Reliable documentation is essential for maintaining quality standards in endoscopy; however, in clinical practice, report quality varies. We developed an artificial intelligence (AI)-based prototype for the measurement of withdrawal and intervention times, and automatic photodocumentation. METHOD:  A multiclass deep learning algorithm distinguishing different endoscopic image content was trained with 10 557 images (1300 examinations, nine centers, four processors). Consecutively, the algorithm was used to calculate withdrawal time (AI prediction) and extract relevant images. Validation was performed on 100 colonoscopy videos (five centers). The reported and AI-predicted withdrawal times were compared with video-based measurement; photodocumentation was compared for documented polypectomies. RESULTS:  Video-based measurement in 100 colonoscopies revealed a median absolute difference of 2.0 minutes between the measured and reported withdrawal times, compared with 0.4 minutes for AI predictions. The original photodocumentation represented the cecum in 88 examinations compared with 98/100 examinations for the AI-generated documentation. For 39/104 polypectomies, the examiners' photographs included the instrument, compared with 68 for the AI images. Lastly, we demonstrated real-time capability (10 colonoscopies). CONCLUSION : Our AI system calculates withdrawal time, provides an image report, and is real-time ready. After further validation, the system may improve standardized reporting, while decreasing the workload created by routine documentation.

Multi-center Integrating Radiomics, Structured Reports, and Machine Learning Algorithms for Assisted Classification of COVID-19 in Lung Computed Tomography

Purpose

To evaluate the classification performance of structured report features, radiomics, and machine learning (ML) models to differentiate between Coronavirus Disease 2019 (COVID-19) and other types of pneumonia using chest computed tomography (CT) scans.

Methods

Sixty-four COVID-19 subjects and 64 subjects with non-COVID-19 pneumonia were selected. The data was split into two independent cohorts: one for the structured report, radiomic feature selection and model building (n = 73), and another for model validation (n = 55). Physicians performed readings with and without machine learning support. The model's sensitivity and specificity were calculated, and inter-rater reliability was assessed using Cohen's Kappa agreement coefficient.

Results

Physicians performed with mean sensitivity and specificity of 83.4 and 64.3%, respectively. When assisted with machine learning, the mean sensitivity and specificity increased to 87.1 and 91.1%, respectively. In addition, machine learning improved the inter-rater reliability from moderate to substantial.

Conclusion

Integrating structured reports and radiomics promises assisted classification of COVID-19 in CT chest scans.

Informatics Solutions to Mitigate Legal Risk Associated With Communication Failures

Communication failures are a documented cause of malpractice litigation against radiologists. As imaging volumes have increased, and with them the number of findings requiring further workup, radiologists are increasingly expected to communicate with ordering clinicians. However, communication may be unsuccessful for a variety of reasons that expose radiologists to potential malpractice risk. Informatics solutions have the potential to improve communication and decrease this risk. We discuss human-powered, purely automated, and hybrid approaches to closing the communications loop. In addition, we describe the Patient Test Results Information Act (Pennsylvania Act 112) and its implications for closing the loop on noncritical actionable findings.

Structured reporting in radiology: a systematic review to explore its potential

OBJECTIVES

Structured reporting (SR) in radiology reporting is suggested to be a promising tool in clinical practice. In order to implement such an emerging innovation, it is necessary to verify that radiology reporting can benefit from SR. Therefore, the purpose of this systematic review is to explore the level of evidence of structured reporting in radiology. Additionally, this review provides an overview on the current status of SR in radiology.

METHODS

A narrative systematic review was conducted, searching PubMed, Embase, and the Cochrane Library using the syntax 'radiol*' AND 'structur*' AND 'report*'. Structured reporting was divided in SR level 1, structured layout (use of templates and checklists), and SR level 2, structured content (a drop-down menu, point-and-click or clickable decision trees). Two reviewers screened the search results and included all quantitative experimental studies that discussed SR in radiology. A thematic analysis was performed to appraise the evidence level.

RESULTS

The search resulted in 63 relevant full text articles out of a total of 8561 articles. Thematic analysis resulted in 44 SR level 1 and 19 level 2 reports. Only one paper was scored as highest level of evidence, which concerned a double cohort study with randomized trial design.

CONCLUSION

The level of evidence for implementing SR in radiology is still low and outcomes should be interpreted with caution.

KEY POINTS

• Structured reporting is increasingly being used in radiology, especially in abdominal and neuroradiological CT and MRI reports. • SR can be subdivided into structured layout (SR level 1) and structured content (SR level 2), in which the first is defined as being a template in which the reporter has to report; the latter is an IT-based manner in which the content of the radiology report can be inserted and displayed into the report. • Despite the extensive amount of research on the subject of structured reporting, the level of evidence is low.

PI-RADS and Likert scales for structured reporting in multiparametric MR imaging of the prostate

Multiparametric MRI (mpMRI) plays a critical role in the detection, staging and risk stratification of prostate cancer (PCa). There are two widely accepted structured reporting systems used for interpretation of mpMRI of the prostate - PI-RADS v2.1 and Likert. Both these systems demonstrate good diagnostic performance with high cancer detection rates however have key conceptual differences. In this commentary, the authors highlight the individual strengths and areas of potential improvement as well as emphasize the need for continued clinical validation for these interpreting and reporting systems.

ENT Residents Benefit from a Structured Operation Planning Approach in the Training of Functional Endoscopic Sinus Surgery

Background and Objectives: Preoperative planning utilizing computed tomographies (CT) is of utmost importance in functional endoscopic sinus surgery (FESS). Frequently, no uniform documentation and planning structures are available to residents in training. Consequently, overall completeness and quality of operation planning may vary greatly. The objective of the present study was to evaluate the impact of a structured operation planning (SOP) approach on the report quality and user convenience during a 4-day sinus surgery course. Materials and Methods: Fifteen participant were requested to plan a FESS procedure based on a CT scan of the paranasal sinuses that exhibited common pathological features, in a conventional manner, using a free text. Afterwards, the participants reevaluated the same scans by means of a specifically designed structured reporting template. Two experienced ENT surgeons assessed the collected conventional operation planning (COP) and SOP methods independently with regard to time requirements, overall quality, and legibility. User convenience data were collected by utilizing visual analogue scales. Results: A significantly greater time expenditure was associated with SOPs (183 s vs. 297 s, p = 0.0003). Yet, legibility (100% vs. 72%, p < 0.0001) and overall completeness (61.3% vs. 22.7%, p < 0.0001) of SOPs was significantly superior to COPs. Additionally, description of highly relevant variants in anatomy and pathologies were outlined in greater detail. User convenience data delineated a significant preference for SOPs (VAS 7.9 vs. 6.9, p = 0.0185). Conclusions: CT-based planning of FESS procedures by residents in training using a structured approach is more time-consuming while producing a superior report quality in terms of detailedness and readability. Consequently, SOP can be considered as a valuable tool in the process of preoperative evaluations, especially within residency.

Radiology Reporting Errors: Learning from Report Addenda

Background The addition of new information to a completed radiology report in the form of an "addendum" conveys a variety of information, ranging from less significant typographical errors to serious omissions and misinterpretations. Understanding the reasons for errors and their clinical implications will lead to better clinical governance and radiology practice. Aims This article assesses the common reasons which lead to addenda generation to completed reports and their clinical implications. Subjects and Methods Retrospective study was conducted by reviewing addenda to computed tomography (CT), ultrasound, and magnetic resonance imaging reports between January 2018 to June 2018, to note the frequency and classification of report addenda. Results Rate of addenda generation was 1.1% ( n = 1,076) among the 97,003 approved cross-sectional radiology reports. Errors contributed to 71.2% ( n = 767) of addenda, most commonly communication (29.3%, n = 316) and observational errors (20.8%, n = 224), and 28.7% were nonerrors aimed at providing additional clinically relevant information. Majority of the addenda (82.3%, n = 886) did not have a significant clinical impact. CT and ultrasound reports accounted for 36.9% ( n = 398) and 35.2% ( n = 379) share, respectively. A time gap of 1 to 7 days was noted for 46.8% ( n = 504) addenda and 37.6% ( n = 405) were issued in less than a day. Radiologists with more than 6-year experience created majority (1.5%, n = 456) of addenda. Those which were added to reports generated during emergency hours contributed to 23.2% ( n = 250) of the addenda. Conclusion The study has identified the prevalence of report addenda in a radiology practice involving picture archiving and communication system in a tertiary care center in India. The etiology included both errors and non-errors. Results of this audit were used to generate a checklist and put protocols that will help decrease serious radiology misses and common errors.

Lower extremity CT angiography in peripheral arterial disease: from the established approach to evolving technical developments

With the advent of multidetector computed tomography (CT), CT angiography (CTA) has gained widespread popularity for noninvasive imaging of the arterial vasculature. Peripheral extremity CTA can nowadays be performed rapidly with high spatial resolution and a decreased amount of both intravenous contrast and radiation exposure. In patients with peripheral artery disease (PAD), this technique can be used to delineate the bilateral lower extremity arterial tree and to determine the amount of atherosclerotic disease while differentiating between acute and chronic changes. This article provides an overview of several imaging techniques for PAD, specifically discusses the use of peripheral extremity CTA in patients with PAD, clinical indications, established technical considerations and novel technical developments, and the effect of postprocessing imaging techniques and structured reporting.

Structured Reporting Using CEUS LI-RADS for the Diagnosis of Hepatocellular Carcinoma (HCC)-Impact and Advantages on Report Integrity, Quality and Interdisciplinary Communication

Simple Summary

Contrast-enhanced ultrasound (CEUS) is an increasingly accepted imaging modality for visualizing hepatocellular carcinoma (HCC) and is recommended as a secondary imaging option by most leading hepatology societies. In recent years, the use of structured reporting (SR) has been recommended by several societies to standardize report content and improve report quality of various diagnostic modalities when compared to conventional free-text reports (FTR). Our single-center study aimed to evaluate the use of SR using a CEUS LI-RADS software template in CEUS examinations of 50 HCC patients. SR significantly increased report integrity, satisfaction of the referring physicians, linguistic quality and overall report quality compared to FTR. Therefore, the use of SR in CEUS examinations of HCC patients may represent a valuable tool to facilitate clinical decision-making and improve interdisciplinary communication in the future.

Abstract

Background: Our retrospective single-center study aims to evaluate the impact of structured reporting (SR) using a CEUS LI-RADS template on report quality compared to conventional free-text reporting (FTR) in contrast-enhanced ultrasound (CEUS) for the diagnosis of hepatocellular carcinoma (HCC). Methods: We included 50 patients who underwent CEUS for HCC staging. FTR created after these examinations were compared to SR retrospectively generated by using template-based online software with clickable decision trees. The reports were evaluated regarding report completeness, information extraction, linguistic quality and overall report quality by two readers specialized in internal medicine and visceral surgery. Results: SR significantly increased report completeness with at least one key feature missing in 31% of FTR vs. 2% of SR (p < 0.001). Information extraction was considered easy in 98% of SR vs. 86% of FTR (p = 0.004). The trust of referring physicians in the report was significantly increased by SR with a mean of 5.68 for SR vs. 4.96 for FTR (p < 0.001). SR received significantly higher ratings regarding linguistic quality (5.79 for SR vs. 4.83 for FTR (p < 0.001)) and overall report quality (5.75 for SR vs. 5.01 for FTR (p < 0.001)). Conclusions: Using SR instead of conventional FTR increases the overall quality of reports in CEUS examinations of HCC patients and may represent a valuable tool to facilitate clinical decision-making and improve interdisciplinary communication in the future.

Prevalence and clinical significance of incidental extra-intestinal findings in MR enterography: experience of a single University Centre

PURPOSE

To determine the incidence and clinical relevance of extra-intestinal incidental findings (IF) in a cohort of patients with proven or suspected Crohn disease (CD) examined with magnetic resonance enterography (MR-E) in a single University Centre.

METHODS

Between January 2018 and June 2019, 182 patients with proven or suspected CD with a planned first MR-E examination, were retrospectively included in this study. Incidental findings were considered as any abnormality identified in the absence of previous clinically suspected or known disease. IF were categorized as unremarkable, benign or potentially relevant findings requiring further imaging or specific treatment.

RESULTS

Of the 182 revised MR-E, extra-intestinal IF were recorded in 70 cases (38.5%); 35 (50%) incidental lesions were recognized as non-significant, 24 (34%) as benign and 11 (16%) as clinically relevant. Moreover, there was a positive correlation between IF and patients' age (p < 0.0001).

CONCLUSIONS

In our experience, a high number of IF (38.5%) was found, with a prevalence that increases with patients' age. Clinically relevant findings were found in 16% of MR-E. This means that MR-E is a useful tool to detect IF, therefore, the presence of a radiologist during the image acquisition is crucial in adding sequences to the examination.

Redefining the structure of structured reporting in radiology

Structured reporting is advocated as a means of improving reporting in radiology to the ultimate benefit of both radiological and clinical practice. Several large initiatives are currently evaluating its potential. However, with numerous characterizations of the term in circulation, “structured reporting” has become ambiguous and is often confused with “standardization,” which may hamper proper evaluation and implementation in clinical practice. This paper provides an overview of interpretations of structured reporting and proposes a clear definition that differentiates structured reporting from standardization. Only a clear uniform definition facilitates evidence-based implementation, enables evaluation of its separate components, and supports (meta-)analyses of literature reports.

Impact of structured reporting on developing head and neck ultrasound skills

BACKGROUND

Reports of head and neck ultrasound examinations are frequently written by hand as free texts. This is a serious obstacle to the learning process of the modality due to a missing report structure and terminology. Therefore, there is a great inter-observer variability in overall report quality. Aim of the present study was to evaluate the impact of structured reporting on the learning process as indicated by the overall report quality of head and neck ultrasound examinations within medical school education.

METHODS

Following an immersion course on head and neck ultrasound, previously documented images of three common pathologies were handed out to 58 medical students who asked to create both standard free text reports (FTR) and structured reports (SR). A template for structured reporting of head and neck ultrasound examinations was created using a web-based approach. FTRs and SRs were evaluated with regard to overall quality, completeness, required time to completion and readability by two independent raters (Paired Wilcoxon test, 95% CI). Ratings were assessed for inter-rater reliability (Fleiss' kappa). Additionally, a questionnaire was utilized to evaluate user satisfaction.

RESULTS

SRs received significantly better ratings in terms of report completeness (97.7% vs. 53.5%, p < 0.001) regarding all items. In addition, pathologies were described in more detail using SRs (70% vs. 51.1%, p < 0.001). Readability was significantly higher in all SRs when compared to FTRs (100% vs. 54.4%, p < 0.001). Mean time to complete was significantly lower (79.6 vs. 205.4 s, p < 0.001) and user satisfaction was significantly higher when using SRs (8.5 vs. 4.1, p < 0.001). Also, inter-rater reliability was very high (Fleiss' kappa 0.93).

CONCLUSIONS

SRs of head and neck ultrasound examinations provide more detailed information with a better readability in a time-saving manner within medical education. Also, medical students may benefit from SRs in their learning process due to the structured approach and standardized terminology.

Structured reporting of head and neck ultrasound examinations

Background

Reports of head and neck ultrasound examinations are frequently written by hand as free texts. Naturally, quality and structure of free text reports is variable, depending on the examiner’s individual level of experience. Aim of the present study was to compare the quality of free text reports (FTR) and structured reports (SR) of head and neck ultrasound examinations.

Methods

Both standard FTRs and SRs of head and neck ultrasound examinations of 43 patients were acquired by nine independent examiners with comparable levels of experience. A template for structured reporting of head and neck ultrasound examinations was created using a web-based approach. FTRs and SRs were evaluated with regard to overall quality, completeness, required time to completion, and readability by four independent raters with different specializations (Paired Wilcoxon test, 95% CI) and inter-rater reliability was assessed (Fleiss’ kappa). A questionnaire was used to compare FTRs vs. SRs with respect to user satisfaction (Mann-Whitney U test, 95% CI).

Results

By comparison, completeness scores of SRs were significantly higher than FTRs’ completeness scores (94.4% vs. 45.6%, p < 0.001), and pathologies were described in more detail (91.1% vs. 54.5%, p < 0.001). Readability was significantly higher in all SRs when compared to FTRs (100% vs. 47.1%, p < 0.001). The mean time to complete a report, however, was significantly higher in SRs (176.5 vs. 107.3 s, p < 0.001). SRs achieved significantly higher user satisfaction ratings (VAS 8.87 vs. 1.41, p < 0.001) and a very high inter-rater reliability (Fleiss’ kappa 0.92).

Conclusions

As compared to FTRs, SRs of head and neck ultrasound examinations are more comprehensive and easier to understand. On the balance, the additional time needed for completing a SR is negligible. Also, SRs yield high inter-rater reliability and may be used for high-quality scientific data analyses.

Limitations in and Solutions for Improving the Functionality of Picture Archiving and Communication System: an Exploratory Study of PACS Professionals' Perspectives

Picture Archiving and Communication System (PACS) technology is evolving leading to improvements in the PACS functionality. However, the needs and expectations of PACS users are increasing to cope with the rising demands for improving the workflow and enhancing efficiency in healthcare. The aim was to study the limitations in the current generation of PACS and solutions for improving PACS functionality. This was a longitudinal online observational study of the perspectives of PACS professionals accessed through four online discussion groups on PACS using the LinkedIn network. In this exploratory study, the methodology involved a thematic analysis of qualitative data comprising 250 online posts/comments made by 124 unique PACS professionals collected between January 2014 and December 2015. Participants were mostly male (n = 119, 96%) from the North America (n = 88, 71%). Key themes on limitations in the current generation of PACS were image transmission problems, network and hardware issues, difficulties in changing specific settings, issues in hardcoded Digital Imaging and Communication in Medicine attributes, and problems in implementing open source PACS. Main themes on solutions for improving PACS functionality were the integration of multisite PACS, multimedia for PACS, web-based PACS, medical image viewer, open source PACS, PACS on mobile phones, vendor neutral archives for PACS, speech recognition and integration in PACS, PACS backup and recovery, and connecting PACS with other hospital systems. Despite ongoing technological developments, the current generation of PACS has limitations that affect PACS functionality leading to unmet needs and requirements of PACS users, which could impact workflow and efficiency in healthcare.

Emergence of "Big Data" and Its Potential and Current Limitations in Medical Imaging

Although electronic imaging was performed in the early 1950s in nuclear medicine, it was the introduction of computed tomography in 1972 that caused a revolution in medical imaging in that it marked the beginning of the inevitable transformation to digital imaging. This transformation is now more or less complete. While initially these CT images were relatively small, comprised of only about 6400 pixels per slice, the steady move toward higher spatial resolution, multislice imaging, digital radiography, and fluoroscopy rapidly increased the size of images and the amount of data required to be stored, processed, displayed, and moved about in a medical imaging department. The more recent introduction of digital pathology with submicron-sized pixels and the need for color further increases these demands. Rising work volumes in hospital, a push for cost containment, and a move toward greater precision in diagnosis and treatment of disease all work together to motivate the development of automated image analysis algorithms and techniques to improve efficiencies in in vivo imaging and pathology. This may require bringing together information from different imaging and nonimaging sources within the institution. While technological development has provided practical means for storage of the burgeoning data load and the use of multiple processors and high-speed networks has enabled more sophisticated analysis locally or in the cloud, challenges remain in terms of the ability to integrate data from different systems, the development of appropriately annotated image bases for training and testing of algorithms, and issues around privacy and ownership in obtaining access to patient-related data.

Effect of Implementing Community of Practice Modified Thyroid Imaging Reporting and Data System on Reporting Adherence and Number of Thyroid Biopsies

RATIONALE AND OBJECTIVES

Thyroid nodules are common in the population, although the rate of malignancy is relatively low (5%-15%). The purpose of this study was to determine if introducing a modified standardized reporting format and management algorithm (Thyroid Imaging Reporting and Data System [TI-RADS]) affects radiologist reporting adherence, number of thyroid biopsies, and other measurable outcomes.

MATERIALS AND METHODS

All thyroid biopsies performed over two 6-month periods were evaluated at a tertiary care hospital with Research Ethics Board approval. The first period was before implementation of TI-RADS and the second was several months after implementation of TI-RADS (using a modified version made through a multidisciplinary collaboration). The number of biopsies performed was determined in each of the two periods as well as the percent of positive malignancy, wait times, and rates of non-diagnostic/unsatisfactory and inconclusive biopsies, which included atypia of undetermined significance (AUS) and follicular lesion of undetermined significance (FLUS).

RESULTS

The average number of biopsies performed prior to implementing modified Kwak's TI-RADS was 74 thyroid biopsies per month and the average number of diagnostic ultrasounds was 271. After the introduction of modified Kwak's TI-RADS, the average number of thyroid biopsies decreased to 60 per month (an 18.9% reduction, P < .05), and the number of diagnostic ultrasound increased to 287 per month (a 5.9% increase from 2016 to 2017). The average wait time for a thyroid biopsy decreased from 5 to 3 weeks (P < .05). There was a slight increase in the rate of positive malignancy results (from 15% to 18%), although it was not statistically significant. The rate of non-diagnostic/unsatisfactory and inconclusive results (including AUS and FLUS) remained unchanged (18% AUS/FLUS/15% non-diagnostic/unsatisfactory before and 17% AUS/FLUS/15% non-diagnostic/unsatisfactory after TI-RADS introduction, P > .05).

CONCLUSIONS

Introduction of a multidisciplinary-approved standardized reporting system with evidence-based management recommendations led to no statistically significant change in the number of diagnostic ultrasounds but a statistically significant reduction in the number of monthly thyroid biopsies and associated reduction in wait times.

Structured reporting for fibrosing lung disease: a model shared by radiologist and pulmonologist

Objectives

To apply the Delphi exercise with iterative involvement of radiologists and pulmonologists with the aim of defining a structured reporting template for high-resolution computed tomography (HRCT) of patients with fibrosing lung disease (FLD).

Methods

The writing committee selected the HRCT criteria—the Delphi items—for rating from both radiology panelists (RP) and pulmonology panelists (PP). The Delphi items were first rated by RPs as “essential”, “optional”, or “not relevant”. The items rated “essential” by < 80% of the RP were selected for the PP rating. The format of reporting was rated by both RP and PP.

Results

A total of 42 RPs and 12 PPs participated to the survey. In both Delphi round 1 and 2, 10/27 (37.7%) items were rated “essential” by more than 80% of RP. The remaining 17/27 (63.3%) items were rated by the PP in round 3, with 2/17 items (11.7%) rated “essential” by the PP. PP proposed additional items for conclusion domain, which were rated by RPs in the fourth round. Poor consensus was observed for the format of reporting.

Conclusions

This study provides a template for structured report of FLD that features essential items as agreed by expert thoracic radiologists and pulmonologists.

Electronic supplementary material

The online version of this article (10.1007/s11547-017-0835-6) contains supplementary material, which is available to authorized users.

Negative predictive value of preoperative computed tomography in determining pathologic local invasion, nodal disease, and abdominal metastases in gastric cancer

BACKGROUND

Before undergoing curative-intent resection of gastric adenocarcinoma (ga), most patients undergo abdominal computed tomography (ct) imaging to determine contraindications to resection (local invasion, distant metastases). However, the ability to detect contraindications is variable, and the literature is limited to single-institution studies. We sought to assess, on a population level, the clinical relevance of preoperative ct in evaluating the resectability of ga tumours in patients undergoing surgery.

METHODS

In a provincial cancer registry, 2414 patients with ga diagnosed during 2005-2008 at 116 institutions were identified, and a primary chart review of radiology, operative, and pathology reports was performed for all patients. Preoperative abdominal ct reports were compared with intraoperative findings and final pathology reports (reference standard) to determine the negative predictive value (npv) of ct in assessing local invasion, nodal involvement, and intra-abdominal metastases.

RESULTS

Among patients undergoing gastrectomy, the npv of ct imaging in detecting local invasion was 86.9% (n = 536). For nodal metastasis, the npv of ct was 43.3% (n = 450). Among patients undergoing surgical exploration, the npv of ct for intra-abdominal metastases was 52.3% (n = 407).

CONCLUSIONS

Preoperative abdominal ct imaging reported as negative is most accurate in determining local invasion and least accurate in nodal assessment. The poor npv of ct should be taken into account when selecting patients for staging laparoscopy.

Analysis of free-form radiology dictations for completeness and clarity for pancreatic cancer staging

PURPOSE

To assess the completeness and clarity of current free-form radiology reports for pancreatic cancer staging by evaluating them against the elements of the RSNA CT oncology primary pancreas mass dictation template.

METHODS

This retrospective study was approved by our Institutional Review Board (IRB). 295 free-form computed tomography (CT) reports for baseline staging of pancreatic cancer (PC) generated between August 2008 and December 2010 were evaluated by one of two radiologists with expertise in pancreatic cancer imaging. Reports which indicated that metastatic disease was present were excluded. The completeness and clarity of the reports were analyzed against the elements of the RSNA CT pancreas mass dictation template. Fisher's exact tests were used to analyze differences by year and type of radiologist.

RESULTS

Primary lesion location, size, and effect on bile duct (BD) were provided in 93.9% (277/295), 69.8% (206/295), and 67.5% (199/295) of reports, respectively. Standard terms to describe vascular involvement were used in 47.5% (140/295) of reports. In 20.3% (60/295), the resectability status could not be defined based on the report alone. In 36.9% (109/295) of reports, review of CT images was necessary to understand vascular involvement. Radiologists expert in pancreatic oncology had a higher proportion of reports using standardized terminology and reports in which vascular involvement was understood without revisiting the images.

CONCLUSIONS

Free-form reports were more likely to use ambiguous terminology and/or require review of the actual images for understanding resectability status. The use of a standardized reporting template may improve the usefulness of pancreatic cancer staging reports.

Evaluation of the European Society of Urogenital Radiology (ESUR) PI-RADS scoring system for assessment of extra-prostatic extension in prostatic carcinoma

INTRODUCTION

To evaluate extra-prostatic extension (EPE) comparing PI-RADS to non-standardized reporting.

MATERIALS AND METHODS

With IRB approval, 145 consecutive patients underwent radical prostatectomy (RP) and multi-parametric (T2W+DWI+DCE) MRI between 2012 and 2013. Eighty patients (66.3% with EPE) were staged without PI-RADS and 65 patients (64.6% with EPE) were staged using a 5-point PI-RADS scoring system. Studies were reported by fellowship-trained radiologists in routine clinical practice. Individual PIRADS scores were assessed using ROC to determine the score which optimized sensitivity/specificity. Diagnostic accuracy for EPE was compared with/without PI-RADS using the McNemar test. Subgroup analysis by radiologist experience was performed using Spearman correlation and chi-square.

RESULTS

Area under ROC curve for EPE using PI-RADS was 0.62 and optimal sensitivity/specificity was achieved with PI-RADS score ≥ 3. Compared to non-standardized reporting, sensitivity for EPE improved with PI-RADS (59.5% [49.1-68.2] vs. 24.5% [16.7-31.2]), p=0.01; with no difference in specificity (68.0% [50.5-82.6]) vs. (75.0% [60.1-87.6]), p=0.06. Overall accuracy improved with PI-RADS (62.7% [49.6-73.6] vs. 42.0% [31.7-50.7%]), p=0.006. Diagnostic accuracy was better among experienced radiologists without PI-RADS (p=0.005); however, there was no difference in accuracy by reader experience using PI-RADS (p=0.24).

CONCLUSION

The PI-RADS criteria for EPE improves sensitivity without reducing specificity. PI-RADS may reduce differences in accuracy by reader experience.

Creation and implementation of department-wide structured reports: an analysis of the impact on error rate in radiology reports

The purpose of this study was to evaluate and compare textual error rates and subtypes in radiology reports before and after implementation of department-wide structured reports. Randomly selected radiology reports that were generated following the implementation of department-wide structured reports were evaluated for textual errors by two radiologists. For each report, the text was compared to the corresponding audio file. Errors in each report were tabulated and classified. Error rates were compared to results from a prior study performed prior to implementation of structured reports. Calculated error rates included the average number of errors per report, average number of nongrammatical errors per report, the percentage of reports with an error, and the percentage of reports with a nongrammatical error. Identical versions of voice-recognition software were used for both studies. A total of 644 radiology reports were randomly evaluated as part of this study. There was a statistically significant reduction in the percentage of reports with nongrammatical errors (33 to 26%; p = 0.024). The likelihood of at least one missense omission error (omission errors that changed the meaning of a phrase or sentence) occurring in a report was significantly reduced from 3.5 to 1.2% (p = 0.0175). A statistically significant reduction in the likelihood of at least one comission error (retained statements from a standardized report that contradict the dictated findings or impression) occurring in a report was also observed (3.9 to 0.8%; p = 0.0007). Carefully constructed structured reports can help to reduce certain error types in radiology reports.

PACS administrators' and radiologists' perspective on the importance of features for PACS selection

Picture archiving and communication systems (PACS) play a critical role in radiology. This paper presents the criteria important to PACS administrators for selecting a PACS. A set of criteria are identified and organized into an integrative hierarchical framework. Survey responses from 48 administrators are used to identify the relative weights of these criteria through an analytical hierarchy process. The five main dimensions for PACS selection in order of importance are system continuity and functionality, system performance and architecture, user interface for workflow management, user interface for image manipulation, and display quality. Among the subdimensions, the highest weights were assessed for security, backup, and continuity; tools for continuous performance monitoring; support for multispecialty images; and voice recognition/transcription. PACS administrators' preferences were generally in line with that of previously reported results for radiologists. Both groups assigned the highest priority to ensuring business continuity and preventing loss of data through features such as security, backup, downtime prevention, and tools for continuous PACS performance monitoring. PACS administrators' next high priorities were support for multispecialty images, image retrieval speeds from short-term and long-term storage, real-time monitoring, and architectural issues of compatibility and integration with other products. Thus, next to ensuring business continuity, administrators' focus was on issues that impact their ability to deliver services and support. On the other hand, radiologists gave high priorities to voice recognition, transcription, and reporting; structured reporting; and convenience and responsiveness in manipulation of images. Thus, radiologists' focus appears to be on issues that may impact their productivity, effort, and accuracy.

Informatics and Autopsy Pathology

Many health care providers believe that the autopsy is no longer relevant in high-technology medicine era. This has fueled a decline in the hospital autopsy rate. Although it seems that advanced diagnostic tests answer all clinical questions, studies repeatedly demonstrate that an autopsy uncovers as many undiagnosed conditions today as in the past. The forensic autopsy rate has also declined, although not as precipitously. Pathologists are still performing a nineteenth century autopsy procedure that remains essentially unchanged. Informatics offers several potential answers that will evolve the low-tech autopsy into the high-tech autopsy.

What roles should population-based cancer registries be playing in the 21st century? Reflections on the Asian Cancer Registry Forum, Bangkok, February 2014

Cancer registries have fundamental roles in cancer surveillance, research, and health services planning, monitoring and evaluation. Many are now assuming a broader role by contributing data for health-service management, alongside data inputs from other registries and administrative data sets. These data are being integrated into de-identified databases using privacy-protecting data linkage practices. Structured pathology reporting is increasing registry access to staging and other prognostic descriptors. Registry directions need to vary, depending on local need, barriers and opportunities. Flexibility and adaptability will be essential to optimize registry contributions to cancer control.

An electronic tool for systematic reporting of fractures on skeletal surveys in suspected child abuse: prototype development and physician feedback

OBJECTIVE

To describe a skeletal survey data entry and compilation tool and assess physician attitudes toward this reporting approach.

BACKGROUND

Narrative skeletal survey reports are highly variable and prone to inconsistencies with potential adverse impact on patients.

MATERIALS AND METHODS

The prototype skeletal survey data entry and compilation tool was developed and introduced into clinical practice at a large urban children's hospital. Pediatric radiologists and child protection team (CPT) pediatricians completed a survey of reporting preferences. Skeletal survey reports between March 1, 2013, and March 1, 2014, were reviewed to assess use of the tool.

RESULTS

The survey response rate was 70% (14/20) for radiologists and 100% (4/4) for CPT pediatricians. Among responding radiologists, 54.5% (6/11) indicated that a skeletal survey data entry and compilation tool was helpful for skeletal surveys with >3 fractures; 80% (8/10) of responding radiologists indicated that tabulated data from prior skeletal survey was helpful when interpreting a follow-up skeletal survey with >3 fractures; 90.9% (10/11) of radiologists thought the tool improved report organization; 72.7% (8/11) thought it improved accuracy. Most radiologists (11/12, 91.7%) and 100% (4/4) of CPT clinicians preferred reports with both free text and a tabulated fracture list for testifying in court when >3 fractures were present. The tool was used in the reporting of 14/23 (61%) skeletal surveys with >3 fractures during a 1-year period. A case example using the application is presented.

CONCLUSION

Most radiologists and CPT physicians at our center prefer skeletal survey reports with tabulated data and narrative description; 91.7% (11/12) of radiologists and all CPT clinicians prefer this approach for testifying in court when >3 fractures are present.

A novel method to assess incompleteness of mammography reports

Mammography has been shown to improve outcomes of women with breast cancer, but it is subject to inter-reader variability. One well-documented source of such variability is in the content of mammography reports. The mammography report is of crucial importance, since it documents the radiologist's imaging observations, interpretation of those observations in terms of likelihood of malignancy, and suggested patient management. In this paper, we define an incompleteness score to measure how incomplete the information content is in the mammography report and provide an algorithm to calculate this metric. We then show that the incompleteness score can be used to predict errors in interpretation. This method has 82.6% accuracy at predicting errors in interpretation and can possibly reduce total diagnostic errors by up to 21.7%. Such a method can easily be modified to suit other domains that depend on quality reporting.

Comprehensive review of the limitations of relative value unit measurements of productivity in academic departments

Measuring radiologist, especially sonologist, productivity has never been of greater interest than now, as radiology has moved from its historical status as a cost center to the largest revenue generator in most institutions. With more local institutional and federal oversight and regulation into the reimbursement and valuation of imaging procedures, including emphasis on outsourcing, overvalued procedures, and bundling, the ability to measure productivity and to draw meaningful conclusions from the data becomes increasingly imperative if we as radiologists and sonologists expect to contribute meaningfully to the process. This article presents a history of the "relative value unit" and discusses the valuation of radiologist/sonologist productivity in this era of ubiquitous high-technology implementation.

Development, implementation, and evaluation of a structured reporting web tool for abdominal aortic aneurysms

BACKGROUND

The majority of radiological reports are lacking a standard structure. Even within a specialized area of radiology, each report has its individual structure with regards to details and order, often containing too much of non-relevant information the referring physician is not interested in. For gathering relevant clinical key parameters in an efficient way or to support long-term therapy monitoring, structured reporting might be advantageous.

OBJECTIVE

Despite of new technologies in medical information systems, medical reporting is still not dynamic. To improve the quality of communication in radiology reports, a new structured reporting system was developed for abdominal aortic aneurysms (AAA), intended to enhance professional communication by providing the pertinent clinical information in a predefined standard.

METHODS

Actual state analysis was performed within the departments of radiology and vascular surgery by developing a Technology Acceptance Model. The SWOT (strengths, weaknesses, opportunities, and threats) analysis focused on optimization of the radiology reporting of patients with AAA. Definition of clinical parameters was achieved by interviewing experienced clinicians in radiology and vascular surgery. For evaluation, a focus group (4 radiologists) looked at the reports of 16 patients. The usability and reliability of the method was validated in a real-world test environment in the field of radiology.

RESULTS

A Web-based application for radiological "structured reporting" (SR) was successfully standardized for AAA. Its organization comprises three main categories: characteristics of pathology and adjacent anatomy, measurements, and additional findings. Using different graphical widgets (eg, drop-down menus) in each category facilitate predefined data entries. Measurement parameters shown in a diagram can be defined for clinical monitoring and be adducted for quick adjudications. Figures for optional use to guide and standardize the reporting are embedded. Analysis of variance shows decreased average time required with SR to obtain a radiological report compared to free-text reporting (P=.0001). Questionnaire responses confirm a high acceptance rate by the user.

CONCLUSIONS

The new SR system may support efficient radiological reporting for initial diagnosis and follow-up for AAA. Perceived advantages of our SR platform are ease of use, which may lead to more accurate decision support. The new system is open to communicate not only with clinical partners but also with Radiology Information and Hospital Information Systems.

Imaging-based observational databases for clinical problem solving: the role of informatics

Imaging has become a prevalent tool in the diagnosis and treatment of many diseases, providing a unique in vivo, multi-scale view of anatomic and physiologic processes. With the increased use of imaging and its progressive technical advances, the role of imaging informatics is now evolving--from one of managing images, to one of integrating the full scope of clinical information needed to contextualize and link observations across phenotypic and genotypic scales. Several challenges exist for imaging informatics, including the need for methods to transform clinical imaging studies and associated data into structured information that can be organized and analyzed. We examine some of these challenges in establishing imaging-based observational databases that can support the creation of comprehensive disease models. The development of these databases and ensuing models can aid in medical decision making and knowledge discovery and ultimately, transform the use of imaging to support individually-tailored patient care.

[Integrating information about imaging biomarkers into structured radiology reports]

Imaging biomarkers describe objective characteristics that are related to normal biological processes, diseases, or the response to treatment. They enable radiologists to incorporate into their reports data about structure, function, and tissue components. With the aim of taking maximum advantage of the quantification of medical images, we present a procedure to integrate imaging biomarkers into radiological reports, bringing the new paradigm of personal medicine closer to radiological workflow. In this manner, the results of quantification can complement traditional radiological diagnosis, improving accuracy and the evaluation of the efficacy of treatments. A more personalized, standardized, structured radiological report should include quantitative analyses to complement conventional qualitative reporting in selected cases.

Automatically correlating clinical findings and body locations in radiology reports using MedLEE

In this paper, we describe and evaluate a system that extracts clinical findings and body locations from radiology reports and correlates them. The system uses Medical Language Extraction and Encoding System (MedLEE) to map the reports' free text to structured semantic representations of their content. A lightweight reasoning engine extracts the clinical findings and body locations from MedLEE's semantic representation and correlates them. Our study is illustrative for research in which existing natural language processing software is embedded in a larger system. We manually created a standard reference based on a corpus of neuro and breast radiology reports. The standard reference was used to evaluate the precision and recall of the proposed system and its modules. Our results indicate that the precision of our system is considerably better than its recall (82.32-91.37% vs. 35.67-45.91%). We conducted an error analysis and discuss here the practical usability of the system given its recall and precision performance.

A novel report generation approach for medical applications: the SISDS methodology and its applications

BACKGROUND

Despite exciting innovation in information system technologies, the medical reporting has remained static for a long time. Structured reporting was established to address the deficiencies in report content but has largely failed in its adoption due to concerns over workflow and productivity. The methods used in medical reporting are insufficient in providing with information for statistical processing and medical decision making as well as high quality healthcare.

OBJECTIVE

The aim of this study is to introduce a novel method that enables professionals to efficiently produce medical reports that are less error-prone and can be used in decision support systems without extensive post-processing.

METHODOLOGY

We first present the formal definition of the proposed method, called SISDS, that provides a clear separation between the data, logic and presentation layers. It allows free-text like structured data entry in a structured form, and reduces the cognitive effort by inline editing and dynamically controlling the information flow based on the entered data. Then, we validate the usability and reliability of the method on a real-world testbed in the field of radiology. For this purpose, a sample esophagus report was constructed by a focus group of radiologists and real patient data have been collected using a web-based prototype; these data are then used to build a decision support system with off-the-shelf tools. The usability of the method is assessed by evaluating its acceptability by the users and the accuracy of the resulting decision support system. For reliability, we conducted a controlled experiment comparing the performance of the method to that of transcriptionist-oriented systems in terms of the rate of successful diagnosis and the total time required to enter the data.

RESULT

The most noticeable observation in the evaluation is that the rate of successful diagnosis improves significantly with the proposed method; in our case study, a success rate of 81.25% has been achieved by using the SISDS method compared to 43.75% for the transcriptionist-oriented system. In addition, the average time required to obtain the final approved reports decreased from 29 min to 14 min. Based on questionnaire responses, the acceptance rate of the SISDS methodology by users is also found to outperform the rates of the current methods.

CONCLUSION

The empirical results show that the method can effectively help to reduce medical errors, increase data quality, and lead to more accurate decision support. In addition, the dynamic hierarchical data entry model proves to provide a good balance between cognitive load and structured data collection.

Optimizing technology development and adoption in medical imaging using the principles of innovation diffusion, part II: practical applications

Successful adoption of new technology development can be accentuated by learning and applying the scientific principles of innovation diffusion. This is of particular importance to areas within the medical imaging practice which have lagged in innovation; perhaps, the most notable of which is reporting which has remained relatively stagnant for over a century. While the theoretical advantages of structured reporting have been well documented throughout the medical imaging community, adoption to date has been tepid and largely relegated to the academic and breast imaging communities. Widespread adoption will likely require an alternative approach to innovation, which addresses the heterogeneity and diversity of the practicing radiologist community along with the ever-changing expectations in service delivery. The challenges and strategies for reporting innovation and adoption are discussed, with the goal of adapting and customizing new technology to the preferences and needs of individual end-users.

Medical imaging data reconciliation, part 3: reconciliation of historical and current radiology report data

Correlation of historical imaging and radiology report data with the current imaging data set is a critical step in the radiologic interpretation process and, if incomplete, can adversely affect diagnostic accuracy. In its current form, the extraction and analysis of historical imaging and report data is limited by manual workflow, inefficient data organization, and a lack of imaging and report data integration. The reconciliation of historical and contemporaneous radiology report data provides an opportunity to improve the consistency, completeness, and accuracy of radiology report data, while providing opportunities to automate workflow related to data extraction, interpretation, and peer review. The derived data analytics can in turn be used to facilitate physician consultations, education and training, and proactive intervention in the event of report discrepancies.

Structured reporting: if, why, when, how-and at what expense? Results of a focus group meeting of radiology professionals from eight countries

Purpose

To determine why, despite growing evidence that radiologists and referring physicians prefer structured reporting (SR) to free text (FT) reporting, SR has not been widely adopted in most radiology departments.

Methods

A focus group was formed consisting of 11 radiology professionals from eight countries. Eight topics were submitted for discussion. The meeting was videotaped, transcribed, and analyzed according to the principles of qualitative healthcare research.

Results

Perceived advantages of SR were facilitation of research, easy comparison, discouragement of ambiguous reports, embedded links to images, highlighting important findings, not having to dictate text nobody will read, and automatic translation of teleradiology reports. Being compelled to report within a rigid frame was judged unacceptable. Personal convictions appeared to have high emotional value. It was felt that other healthcare stakeholders would impose SR without regard to what radiologists thought of it. If the industry were to provide ready-made templates for selected examinations, most radiologists would use them.

Conclusion

If radiologists can be convinced of the advantages of SR and the risks associated with failing to participate actively in its implementation, they will take a positive stand. The industry should propose technology allowing SR without compromising accuracy, completeness, workflows, and cost-benefit balance.

Main Messages

• Structured reporting offers radiologists opportunities to improve their service to other stakeholders.

• If radiologists can be convinced of the advantages of structured reporting, they may become early adopters.

• The healthcare industry should propose technology allowing structured reporting.

• Structured reporting will fail if it compromises accuracy, completeness, workflows or cost-benefit balance.

Informatics in radiology: Measuring and improving quality in radiology: meeting the challenge with informatics

Quality is becoming a critical issue for radiology. Measuring and improving quality is essential not only to ensure optimum effectiveness of care and comply with increasing regulatory requirements, but also to combat current trends leading to commoditization of radiology services. A key challenge to implementing quality improvement programs is to develop methods to collect knowledge related to quality care and to deliver that knowledge to practitioners at the point of care. There are many dimensions to quality in radiology that need to be measured, monitored, and improved, including examination appropriateness, procedure protocol, accuracy of interpretation, communication of imaging results, and measuring and monitoring performance improvement in quality, safety, and efficiency. Informatics provides the key technologies that can enable radiologists to measure and improve quality. However, few institutions recognize the opportunities that informatics methods provide to improve safety and quality. The information technology infrastructure in most hospitals is limited, and they have suboptimal adoption of informatics techniques. Institutions can tackle the challenges of assessing and improving quality in radiology by means of informatics.