The LOINC RSNA radiology playbook - a unified terminology for radiology procedures

The use of Dose Management Systems in Europe: Results of an ESR EuroSafe Imaging Questionnaire

Dose management systems (DMS) are an essential tool for quality assurance and optimising patient radiation exposure. For radiologists and medical physicists, they are important for managing many radiation protection tasks. In addition, they help fulfil the requirements of Directive 2013/59/EURATOM regarding the electronic transmission of dosimetric data and the detection of unintended patient exposures. The EuroSafe Imaging Clinical Dosimetry and Dose Management Working Group launched a questionnaire on the use of DMS in European member states and analysed the results in terms of modalities, frequency of radiological procedures, involvement of medical physics experts (MPEs), legal requirements, and local issues (support by information technology (IT), modality interfaces, protocol mapping, clinical workflow, and associated costs). CRITICAL RELEVANCE STATEMENT: Despite the great advantages of dose management systems for optimising radiation protection, distribution remains insufficient. This questionnaire shows that reasons include: a lack of DICOM interfaces, insufficient harmonisation of procedure names, lack of medical physicist and IT support, and costs. KEY POINTS: Quantitative radiation dose information is essential for justification and optimisation in medical imaging. Guidelines are required to ensure radiation dose management systems quality and for acceptance testing. Verifying dose data management is crucial before dose management systems clinical implementation. Medical physics experts are professionals who have important responsibilities for the proper management of dose monitoring.

Building RadiologyNET: an unsupervised approach to annotating a large-scale multimodal medical database

BACKGROUND

The use of machine learning in medical diagnosis and treatment has grown significantly in recent years with the development of computer-aided diagnosis systems, often based on annotated medical radiology images. However, the lack of large annotated image datasets remains a major obstacle, as the annotation process is time-consuming and costly. This study aims to overcome this challenge by proposing an automated method for annotating a large database of medical radiology images based on their semantic similarity.

RESULTS

An automated, unsupervised approach is used to create a large annotated dataset of medical radiology images originating from the Clinical Hospital Centre Rijeka, Croatia. The pipeline is built by data-mining three different types of medical data: images, DICOM metadata and narrative diagnoses. The optimal feature extractors are then integrated into a multimodal representation, which is then clustered to create an automated pipeline for labelling a precursor dataset of 1,337,926 medical images into 50 clusters of visually similar images. The quality of the clusters is assessed by examining their homogeneity and mutual information, taking into account the anatomical region and modality representation.

CONCLUSIONS

The results indicate that fusing the embeddings of all three data sources together provides the best results for the task of unsupervised clustering of large-scale medical data and leads to the most concise clusters. Hence, this work marks the initial step towards building a much larger and more fine-grained annotated dataset of medical radiology images.

Advancing Medical Imaging Research Through Standardization: The Path to Rapid Development, Rigorous Validation, and Robust Reproducibility

ABSTRACT

Artificial intelligence (AI) has made significant advances in radiology. Nonetheless, challenges in AI development, validation, and reproducibility persist, primarily due to the lack of high-quality, large-scale, standardized data across the world. Addressing these challenges requires comprehensive standardization of medical imaging data and seamless integration with structured medical data.Developed by the Observational Health Data Sciences and Informatics community, the OMOP Common Data Model enables large-scale international collaborations with structured medical data. It ensures syntactic and semantic interoperability, while supporting the privacy-protected distribution of research across borders. The recently proposed Medical Imaging Common Data Model is designed to encompass all DICOM-formatted medical imaging data and integrate imaging-derived features with clinical data, ensuring their provenance.The harmonization of medical imaging data and its seamless integration with structured clinical data at a global scale will pave the way for advanced AI research in radiology. This standardization will enable federated learning, ensuring privacy-preserving collaboration across institutions and promoting equitable AI through the inclusion of diverse patient populations. Moreover, it will facilitate the development of foundation models trained on large-scale, multimodal datasets, serving as powerful starting points for specialized AI applications. Objective and transparent algorithm validation on a standardized data infrastructure will enhance reproducibility and interoperability of AI systems, driving innovation and reliability in clinical applications.

Report of the HIMSS-SIIM Enterprise Imaging Community Data Standards Evaluation Workgroup: Anatomic Ontology Assessment

Previously, the lack of a standard body part ontology has been identified as a critical deficiency needed to enable enterprise imaging. This whitepaper aims to provide a comprehensive assessment of anatomical ontologies with the aim of facilitating enterprise imaging. It offers an overview of the process undertaken by the Health Information Management Systems Society (HIMSS) and Society for Imaging Informatics in medicine (SIIM) Enterprise Imaging Community Data Standards Evaluation workgroup to assess the viability of existing ontologies for supporting cross-disciplinary medical imaging workflows. The report analyzes the responses received from representatives of three significant ontologies: SNOMED CT, LOINC, and ICD, and delves into their suitability for the complex landscape of enterprise imaging. It highlights the strengths and limitations of each ontology, ultimately concluding that SNOMED CT is the most viable solution for standardizing anatomy terminology across the medical imaging community.

Demonstration of Japanese radiographic examination codes in establishing typical values for a wide variety of general radiography examinations

The purpose of this study was to demonstrate Japanese radiographic examination codes JJ1017 in establishing typical values for a wide variety of general radiography. About 200,000 sets of examination data were collected, including exposure conditions, JJ1017 code applied, examination room numbers and patient information. Typical values for adults, children, and infants were calculated from the collected data, and the following items were examined: comparing typical values of general radiography in Japan DRLs 2015 and typical values in a facility; comparison of typical values between X-ray equipment for examinations of DRLs 2015; comparison of typical values for different procedures at the same anatomical site; identification of examination items associated with high radiation doses. The total numbers of JJ1017 codes applicable to the examinations were 45,372 for adults, 542 for children, and 2339 for infants. To calculate the typical values and compare these with the DRLs, we used a combination of JJ1017 anatomical codes, posture codes, and direction of radiation codes. The combination of these codes allowed the calculation of a typical value and comparison with DRLs 2015. Comparison between devices reveals differences in radiation doses and provides an opportunity to review the characteristics of the devices and their operation to suggest dose reductions. By calculating typical values for examination items for which the DRLs were not available, we were able to identify examination items with high doses in a facility and suggest items that should be audited in the facility.

MI-Common Data Model: Extending Observational Medical Outcomes Partnership-Common Data Model (OMOP-CDM) for Registering Medical Imaging Metadata and Subsequent Curation Processes

PURPOSE

The explosion of big data and artificial intelligence has rapidly increased the need for integrated, homogenized, and harmonized health data. Many common data models (CDMs) and standard vocabularies have appeared in an attempt to offer harmonized access to the available information, with Observational Medical Outcomes Partnership (OMOP)-CDM being one of the most prominent ones, allowing the standardization and harmonization of health care information. However, despite its flexibility, still capturing imaging metadata along with the corresponding clinical data continues to pose a challenge. This challenge arises from the absence of a comprehensive standard representation for image-related information and subsequent image curation processes and their interlinkage with the respective clinical information. Successful resolution of this challenge holds the potential to enable imaging and clinical data to become harmonized, quality-checked, annotated, and ready to be used in conjunction, in the development of artificial intelligence models and other data-dependent use cases.

METHODS

To address this challenge, we introduce medical imaging (MI)-CDM-an extension of the OMOP-CDM specifically designed for registering medical imaging data and curation-related processes. Our modeling choices were the result of iterative numerous discussions among clinical and AI experts to enable the integration of imaging and clinical data in the context of the ProCAncer-I project, for answering a set of clinical questions across the prostate cancer's continuum.

RESULTS

Our MI-CDM extension has been successfully implemented for the use case of prostate cancer for integrating imaging and curation metadata along with clinical information by using the OMOP-CDM and its oncology extension.

CONCLUSION

By using our proposed terminologies and standardized attributes, we demonstrate how diverse imaging modalities can be seamlessly integrated in the future.

Pediatric computed tomography doses in Germany from 2016 to 2018 based on large-scale data collection

PURPOSE

Accumulating evidence from epidemiological studies that pediatric computed tomography (CT) examinations can be associated with a small but non-zero excess risk for developing leukemia or brain tumor highlights the need to optimize doses of pediatric CT procedures. Mandatory dose reference levels (DRL) can support reduction of collective dose from CT imaging. Regular surveys of applied dose-related parameters are instrumental to decide when technological advances and optimized protocol design allow lower doses without sacrificing image quality. Our aim was to collect dosimetric data to support adapting current DRL to changing clinical practice.

METHOD

Dosimetric data and technical scan parameters from common pediatric CT examinations were retrospectively collected directly from Picture Archiving and Communication Systems (PACS), Dose Management Systems (DMS), and Radiological Information Systems (RIS).

RESULTS

We collected data from 17 institutions on 7746 CT series from the years 2016 to 2018 from examinations of the head, thorax, abdomen, cervical spine, temporal bone, paranasal sinuses and knee in patients below 18 years of age. Most of the age-stratified parameter distributions were lower than distributions from previously-analyzed data from before 2010. Most of the third quartiles were lower than German DRL at the time of the survey.

CONCLUSIONS

Directly interfacing PACS, DMS, and RIS installations allows large-scale data collection but relies on high data-quality at the documentation stage. Data should be validated by expert knowledge or guided questionnaires. Observed clinical practice in pediatric CT imaging suggests lowering some DRL in Germany is reasonable.

Ontologies in the New Computational Age of Radiology: RadLex for Semantics and Interoperability in Imaging Workflows

From basic research to the bedside, precise terminology is key to advancing medicine and ensuring optimal and appropriate patient care. However, the wide spectrum of diseases and their manifestations superimposed on medical team-specific and discipline-specific communication patterns often impairs shared understanding and the shared use of common medical terminology. Common terms are currently used in medicine to ensure interoperability and facilitate integration of biomedical information for clinical practice and emerging scientific and educational applications alike, from database integration to supporting basic clinical operations such as billing. Such common terminologies can be provided in ontologies, which are formalized representations of knowledge in a particular domain. Ontologies unambiguously specify common concepts and describe the relationships between those concepts by using a form that is mathematically precise and accessible to humans and machines alike. RadLex^® is a key RSNA initiative that provides a shared domain model, or ontology, of radiology to facilitate integration of information in radiology education, clinical care, and research. As the contributions of the computational components of common radiologic workflows continue to increase with the ongoing development of big data, artificial intelligence, and novel image analysis and visualization tools, the use of common terminologies is becoming increasingly important for supporting seamless computational resource integration across medicine. This article introduces ontologies, outlines the fundamental semantic web technologies used to create and apply RadLex, and presents examples of RadLex applications in everyday radiology and research. It concludes with a discussion of emerging applications of RadLex, including artificial intelligence applications. ^© RSNA, 2023 Quiz questions for this article are available in the supplemental material.

Development and validation of a management system and dataset quality assessment tool for the Radiology Common Data Model (R_CDM): A case study in liver disease

BACKGROUND

The Observational Medical Outcomes Partnership-Common Data Model (OMOP-CDM), a distributed research network, has low clinical data coverage. Radiological data are valuable, but imaging metadata are often incomplete, and a standardized recording format in the OMOP-CDM is lacking. We developed a web-based management system and data quality assessment (RQA) tool for a radiology_CDM (R_CDM) and evaluated the feasibility of clinically applying this dataset.

METHODS

We designed an R_CDM with Radiology_Occurrence and Radiology_Image tables. This was seamlessly linked to the OMOP-CDM clinical data. We adopted the standardized terminology using the RadLex playbook and mapped 5,753 radiology protocol terms to the OMOP vocabulary. An extract, transform, and load (ETL) process was developed to extract detailed information that was difficult to extract from metadata and to compensate for missing values. Image-based quantification was performed to measure liver surface nodularity (LSN), using customized Wonkwang abdomen and liver total solution (WALTS) software.

RESULTS

On a PACS, 368,333,676 DICOM files (1,001,797 cases) were converted to R_CDM chronic liver disease (CLD) data (316,596 MR images, 228 cases; 926,753 CT images, 782 cases) and uploaded to a web-based management system. Acquisition date and resolution were extracted accurately, but other information, such as "contrast administration status" and "photography direction", could not be extracted from the metadata. Using WALTS, 9,609 pre-contrast axial-plane abdominal MR images (197 CLD cases) were assigned LSN scores by METAVIR fibrosis grades, which differed significantly by ANOVA (p < 0.001). The mean RQA score (83.5) indicated good quality.

CONCLUSION

This study developed a web-based system for management of the R_CDM dataset, RQA tool, and constructed a CLD R_CDM dataset, with good quality for clinical application. Our management system and R_CDM CLD dataset would be useful for multicentric and image-based quantification researches.

Development and Validation of the Radiology Common Data Model (R-CDM) for the International Standardization of Medical Imaging Data

PURPOSE

Digital Imaging and Communications in Medicine (DICOM), a standard file format for medical imaging data, contains metadata describing each file. However, metadata are often incomplete, and there is no standardized format for recording metadata, leading to inefficiency during the metadata-based data retrieval process. Here, we propose a novel standardization method for DICOM metadata termed the Radiology Common Data Model (R-CDM).

MATERIALS AND METHODS

R-CDM was designed to be compatible with Health Level Seven International (HL7)/Fast Healthcare Interoperability Resources (FHIR) and linked with the Observational Medical Outcomes Partnership (OMOP)-CDM to achieve a seamless link between clinical data and medical imaging data. The terminology system was standardized using the RadLex playbook, a comprehensive lexicon of radiology. As a proof of concept, the R-CDM conversion process was conducted with 41.7 TB of data from the Ajou University Hospital. The R-CDM database visualizer was developed to visualize the main characteristics of the R-CDM database.

RESULTS

Information from 2801360 cases and 87203226 DICOM files was organized into two tables constituting the R-CDM. Information on imaging device and image resolution was recorded with more than 99.9% accuracy. Furthermore, OMOP-CDM and R-CDM were linked to efficiently extract specific types of images from specific patient cohorts.

CONCLUSION

R-CDM standardizes the structure and terminology for recording medical imaging data to eliminate incomplete and unstandardized information. Successful standardization was achieved by the extract, transform, and load process and image classifier. We hope that the R-CDM will contribute to deep learning research in the medical imaging field by enabling the securement of large-scale medical imaging data from multinational institutions.

Biomedical Ontologies to Guide AI Development in Radiology

The advent of deep learning has engendered renewed and rapidly growing interest in artificial intelligence (AI) in radiology to analyze images, manipulate textual reports, and plan interventions. Applications of deep learning and other AI approaches must be guided by sound medical knowledge to assure that they are developed successfully and that they address important problems in biomedical research or patient care. To date, AI has been applied to a limited number of real-world radiology applications. As AI systems become more pervasive and are applied more broadly, they will benefit from medical knowledge on a larger scale, such as that available through computer-based approaches. A key approach to represent computer-based knowledge in a particular domain is an ontology. As defined in informatics, an ontology defines a domain's terms through their relationships with other terms in the ontology. Those relationships, then, define the terms' semantics, or "meaning." Biomedical ontologies commonly define the relationships between terms and more general terms, and can express causal, part-whole, and anatomic relationships. Ontologies express knowledge in a form that is both human-readable and machine-computable. Some ontologies, such as RSNA's RadLex radiology lexicon, have been applied to applications in clinical practice and research, and may be familiar to many radiologists. This article describes how ontologies can support research and guide emerging applications of AI in radiology, including natural language processing, image-based machine learning, radiomics, and planning.

Artificial Intelligence for Quality Improvement in Radiology

Artificial intelligence (AI) and informatics promise to improve the quality and efficiency of diagnostic radiology but will require substantially more standardization and operational coordination to realize and measure those improvements. As radiology steps into the AI-driven future we should work hard to identify the needs and desires of our customers and develop process controls to ensure we are meeting them. Rather than focusing on easy-to-measure turnaround times as surrogates for quality, AI and informatics can support more comprehensive quality metrics, such as ensuring that reports are accurate, readable, and useful to patients and health care providers.

Comparative analysis of machine learning algorithms for computer-assisted reporting based on fully automated cross-lingual RadLex mappings

Computer-assisted reporting (CAR) tools were suggested to improve radiology report quality by context-sensitively recommending key imaging biomarkers. However, studies evaluating machine learning (ML) algorithms on cross-lingual ontological (RadLex) mappings for developing embedded CAR algorithms are lacking. Therefore, we compared ML algorithms developed on human expert-annotated features against those developed on fully automated cross-lingual (German to English) RadLex mappings using 206 CT reports of suspected stroke. Target label was whether the Alberta Stroke Programme Early CT Score (ASPECTS) should have been provided (yes/no:154/52). We focused on probabilistic outputs of ML-algorithms including tree-based methods, elastic net, support vector machines (SVMs) and fastText (linear classifier), which were evaluated in the same 5 × fivefold nested cross-validation framework. This allowed for model stacking and classifier rankings. Performance was evaluated using calibration metrics (AUC, brier score, log loss) and -plots. Contextual ML-based assistance recommending ASPECTS was feasible. SVMs showed the highest accuracies both on human-extracted- (87%) and RadLex features (findings:82.5%; impressions:85.4%). FastText achieved the highest accuracy (89.3%) and AUC (92%) on impressions. Boosted trees fitted on findings had the best calibration profile. Our approach provides guidance for choosing ML classifiers for CAR tools in fully automated and language-agnostic fashion using bag-of-RadLex terms on limited expert-labelled training data.

The Importance of Body Part Labeling to Enable Enterprise Imaging: A HIMSS-SIIM Enterprise Imaging Community Collaborative White Paper

In order for enterprise imaging to be successful across a multitude of specialties, systems, and sites, standards are essential to categorize and classify imaging data. The HIMSS-SIIM Enterprise Imaging Community believes that the Digital Imaging Communications in Medicine (DICOM) Anatomic Region Sequence, or its equivalent in other data standards, is a vital data element for this role, when populated with standard coded values. We believe that labeling images with standard Anatomic Region Sequence codes will enhance the user’s ability to consume data, facilitate interoperability, and allow greater control of privacy. Image consumption—when a user views a patient’s images, he or she often wants to see relevant comparison images of the same lesion or anatomic region for the same patient automatically presented. Relevant comparison images may have been acquired from a variety of modalities and specialties. The Anatomic Region Sequence data element provides a basis to allow for efficient comparison in both instances. Interoperability—as patients move between health care systems, it is important to minimize friction for data transfer. Health care providers and facilities need to be able to consume and review the increasingly large and complex volume of data efficiently. The use of Anatomic Region Sequence, or its equivalent, populated with standard values enables seamless interoperability of imaging data regardless of whether images are used within a site or across different sites and systems. Privacy—as more visible light photographs are integrated into electronic systems, it becomes apparent that some images may need to be sequestered. Although additional work is needed to protect sensitive images, standard coded values in Anatomic Region Sequence support the identification of potentially sensitive images, enable facilities to create access control policies, and can be used as an interim surrogate for more sophisticated rule-based or attribute-based access control mechanisms. To satisfy such use cases, the HIMSS-SIIM Enterprise Imaging Community encourages the use of a pre-existing body part ontology. Through this white paper, we will identify potential challenges in employing this standard and provide potential solutions for these challenges.

Mapping of HIE CT terms to LOINC®: analysis of content-dependent coverage and coverage improvement through new term creation

Objective

We describe and evaluate the mapping of computerized tomography (CT) terms from 40 hospitals participating in a health information exchange (HIE) to a standard terminology.

Methods

Proprietary CT exam terms and corresponding exam frequency data were obtained from 40 participant HIE sites that transmitted radiology data to the HIE from January 2013 through October 2015. These terms were mapped to the Logical Observations Identifiers Names and Codes (LOINC®) terminology using the Regenstrief LOINC mapping assistant (RELMA) beginning in January 2016. Terms without initial LOINC match were submitted to LOINC as new term requests on an ongoing basis. After new LOINC terms were created, proprietary terms without an initial match were reviewed and mapped to these new LOINC terms where appropriate. Content type and token coverage were calculated for the LOINC version at the time of initial mapping (v2.54) and for the most recently released version at the time of our analysis (v2.63). Descriptive analysis was performed to assess for significant differences in content-dependent coverage between the 2 versions.

Results

LOINC's content type and token coverages of HIE CT exam terms for version 2.54 were 83% and 95%, respectively. Two-hundred-fifteen new LOINC CT terms were created in the interval between the releases of version 2.54 and 2.63, and content type and token coverages, respectively, increased to 93% and 99% (P < .001).

Conclusion

LOINC's content type coverage of proprietary CT terms across 40 HIE sites was 83% but improved significantly to 93% following new term creation.

Fostering a Healthy AI Ecosystem for Radiology: Conclusions of the 2018 RSNA Summit on AI in Radiology

The 2018 RSNA Summit on AI in Radiology brought together a diverse group of stakeholders to identify and prioritize areas of need related to artificial intelligence in radiology. This article presents the proceedings of the summit with emphasis on RSNA's role in leading, organizing, and catalyzing change during this important time in radiology. © RSNA, 2019.