Evaluation of an AI-Based Detection Software for Acute Findings in Abdominal Computed Tomography Scans: Toward an Automated Work List Prioritization of Routine CT Examinations

The RSNA Abdominal Traumatic Injury CT (RATIC) Dataset

Supplemental material is available for this article.

Applications of Artificial Intelligence in Acute Abdominal Imaging

Artificial intelligence (AI) is a rapidly growing field with significant implications for radiology. Acute abdominal pain is a common clinical presentation that can range from benign conditions to life-threatening emergencies. The critical nature of these situations renders emergent abdominal imaging an ideal candidate for AI applications. CT, radiographs, and ultrasound are the most common modalities for imaging evaluation of these patients. For each modality, numerous studies have assessed the performance of AI models for detecting common pathologies, such as appendicitis, bowel obstruction, and cholecystitis. The capabilities of these models range from simple classification to detailed severity assessment. This narrative review explores the evolution, trends, and challenges in AI applications for evaluating acute abdominal pathologies. We review implementations of AI for non-traumatic and traumatic abdominal pathologies, with discussion of potential clinical impact, challenges, and future directions for the technology.

Deep Learning Segmentation of Ascites on Abdominal CT Scans for Automatic Volume Quantification

Purpose To evaluate the performance of an automated deep learning method in detecting ascites and subsequently quantifying its volume in patients with liver cirrhosis and patients with ovarian cancer. Materials and Methods This retrospective study included contrast-enhanced and noncontrast abdominal-pelvic CT scans of patients with cirrhotic ascites and patients with ovarian cancer from two institutions, National Institutes of Health (NIH) and University of Wisconsin (UofW). The model, trained on The Cancer Genome Atlas Ovarian Cancer dataset (mean age [±SD], 60 years ± 11; 143 female), was tested on two internal datasets (NIH-LC and NIH-OV) and one external dataset (UofW-LC). Its performance was measured by the F1/Dice coefficient, SDs, and 95% CIs, focusing on ascites volume in the peritoneal cavity. Results On NIH-LC (25 patients; mean age, 59 years ± 14; 14 male) and NIH-OV (166 patients; mean age, 65 years ± 9; all female), the model achieved F1/Dice scores of 85.5% ± 6.1 (95% CI: 83.1, 87.8) and 82.6% ± 15.3 (95% CI: 76.4, 88.7), with median volume estimation errors of 19.6% (IQR, 13.2%-29.0%) and 5.3% (IQR: 2.4%-9.7%), respectively. On UofW-LC (124 patients; mean age, 46 years ± 12; 73 female), the model had a F1/Dice score of 83.0% ± 10.7 (95% CI: 79.8, 86.3) and median volume estimation error of 9.7% (IQR, 4.5%-15.1%). The model showed strong agreement with expert assessments, with r2 values of 0.79, 0.98, and 0.97 across the test sets. Conclusion The proposed deep learning method performed well in segmenting and quantifying the volume of ascites in patients with cirrhosis and those with ovarian cancer, in concordance with expert radiologist assessments. Keywords: Abdomen/GI, Cirrhosis, Deep Learning, Segmentation Supplemental material is available for this article. © RSNA, 2024 See also commentary by Aisen and Rodrigues in this issue.

Deep Learning Reconstruction of Accelerated MRI: False-Positive Cartilage Delamination Inserted in MRI Arthrography Under Traction

OBJECTIVES

The radiological imaging industry is developing and starting to offer a range of novel artificial intelligence software solutions for clinical radiology. Deep learning reconstruction of magnetic resonance imaging data seems to allow for the acceleration and undersampling of imaging data. Resulting reduced acquisition times would lead to greater machine utility and to greater cost-efficiency of machine operations.

MATERIALS AND METHODS

Our case shows images from magnetic resonance arthrography under traction of the right hip joint from a 30-year-old, otherwise healthy, male patient.

RESULTS

The undersampled image data when reconstructed by a deep learning tool can contain false-positive cartilage delamination and false-positive diffuse cartilage defects.

CONCLUSIONS

In the future, precision of this novel technology will have to be put to thorough testing. Bias of systems, in particular created by the choice of training data, will have to be part of those assessments.

The Expansion of Artificial Intelligence in Modifying and Enhancing the Current Management of Abdominal Aortic Aneurysms: A Literature Review

An abdominal aortic aneurysm (AAA) is a pathological dilation that is 3 cm or greater resulting in a bulging or balloon appearance. To meet a personalized therapeutic approach for patients, artificial intelligence (AI) can exhibit an array of applications ranging from decoding patterns from large data sets to predicting new data. The review aims to discuss how AI can assist and improve the standard of care and management plans for these patients. A comprehensive non-systematic literature review was carried out for published material on the use of AI relating to AAAs. The PubMed and Google Scholar databases were used to scout for articles relating to the title of this review. The review included 54 literature papers in this study. AI is involved on a genomic level, which assists in screening, diagnosing, and identifying individual risk factors of a patient. Personalized management plans can be created with AI predictions using patient data to reduce the risk of in-hospital mortality following a repair or due to complications. AI represents a promising group of programs aimed at improving patient management and assisting surgeons in making beneficial decisions to improve the patient's prognosis.

Automatic detection of pulmonary embolism on computed tomography pulmonary angiogram scan using a three-dimensional convolutional neural network

OBJECTIVE

To propose a convolutional neural network (EmbNet) for automatic pulmonary embolism detection on computed tomography pulmonary angiogram (CTPA) scans and to assess its diagnostic performance.

METHODS

305 consecutive CTPA scans between January 2019 and December 2021 were enrolled in this study (142 for training, 163 for internal validation), and 250 CTPA scans from a public dataset were used for external validation. The framework comprised a preprocessing step to segment the pulmonary vessels and the EmbNet to detect emboli. Emboli were divided into three location-based subgroups for detailed evaluation: central arteries, lobar branches, and peripheral regions. Ground truth was established by three radiologists.

RESULTS

The EmbNet's per-scan level sensitivity, specificity, positive predictive value (PPV), and negative predictive value were 90.9%, 75.4%, 48.4%, and 97.0% (internal validation) and 88.0%, 70.5%, 42.7%, and 95.9% (external validation). At the per-embolus level, the overall sensitivity and PPV of the EmbNet were 86.0% and 61.3% (internal validation), and 83.5% and 57.5% (external validation). The sensitivity and PPV of central emboli were 89.7% and 52.0% (internal validation), and 94.4% and 43.0% (external validation); of lobar emboli were 95.2% and 76.9% (internal validation), and 93.5% and 72.5% (external validation); and of peripheral emboli were 82.6% and 61.7% (internal validation), and 80.2% and 59.4% (external validation). The average false positive rate was 0.45 false emboli per scan (internal validation) and 0.69 false emboli per scan (external validation).

CONCLUSION

The EmbNet provides high sensitivity across embolus locations, suggesting its potential utility for initial screening in clinical practice.

Using artificial intelligence to promote equitable care for inpatients with language barriers and complex medical needs: clinical stakeholder perspectives

OBJECTIVES

Inpatients with language barriers and complex medical needs suffer disparities in quality of care, safety, and health outcomes. Although in-person interpreters are particularly beneficial for these patients, they are underused. We plan to use machine learning predictive analytics to reliably identify patients with language barriers and complex medical needs to prioritize them for in-person interpreters.

MATERIALS AND METHODS

This qualitative study used stakeholder engagement through semi-structured interviews to understand the perceived risks and benefits of artificial intelligence (AI) in this domain. Stakeholders included clinicians, interpreters, and personnel involved in caring for these patients or for organizing interpreters. Data were coded and analyzed using NVIVO software.

RESULTS

We completed 49 interviews. Key perceived risks included concerns about transparency, accuracy, redundancy, privacy, perceived stigmatization among patients, alert fatigue, and supply-demand issues. Key perceived benefits included increased awareness of in-person interpreters, improved standard of care and prioritization for interpreter utilization; a streamlined process for accessing interpreters, empowered clinicians, and potential to overcome clinician bias.

DISCUSSION

This is the first study that elicits stakeholder perspectives on the use of AI with the goal of improved clinical care for patients with language barriers. Perceived benefits and risks related to the use of AI in this domain, overlapped with known hazards and values of AI but some benefits were unique for addressing challenges with providing interpreter services to patients with language barriers.

CONCLUSION

Artificial intelligence to identify and prioritize patients for interpreter services has the potential to improve standard of care and address healthcare disparities among patients with language barriers.

Ability of ChatGPT to generate competent radiology reports for distal radius fracture by use of RSNA template items and integrated AO classifier

The amount of acquired radiology imaging studies grows worldwide at a rapid pace. Novel information technology tools for radiologists promise an increase of reporting quality and as well quantity at the same time. Automated text report drafting is one branch of this development. We defined for the present study in total 9 cases of distal radius fracture. Command files structured according to a template of the Radiological Society of North America (RSNA) and to Arbeitsgemeinschaft Osteosynthese (AO) classifiers were given as input to the natural language processing tool ChatGPT. ChatGPT was tasked with drafting an appropriate radiology report. A parameter study (n = 5 iterations) was performed. An overall high appraisal of ChatGPT radiology report quality was obtained in a score card based assessment. ChatGPT demonstrates the capability to adjust output files in response to minor changes in input command files. Existing shortcomings were found in technical terminology and medical interpretation of findings. Text drafting tools might well support work of radiologists in the future. They would allow a radiologist to focus time on the observation of image details and patient pathology. ChatGPT can be considered a substantial step forward towards that aim.

A Review of the Clinical Applications of Artificial Intelligence in Abdominal Imaging

Artificial intelligence (AI) has been a topic of substantial interest for radiologists in recent years. Although many of the first clinical applications were in the neuro, cardiothoracic, and breast imaging subspecialties, the number of investigated and real-world applications of body imaging has been increasing, with more than 30 FDA-approved algorithms now available for applications in the abdomen and pelvis. In this manuscript, we explore some of the fundamentals of artificial intelligence and machine learning, review major functions that AI algorithms may perform, introduce current and potential future applications of AI in abdominal imaging, provide a basic understanding of the pathways by which AI algorithms can receive FDA approval, and explore some of the challenges with the implementation of AI in clinical practice.

Imaging Artificial Intelligence: A Framework for Radiologists to Address Health Equity, From the AJR Special Series on DEI

Artificial intelligence (AI) holds promise for helping patients access new and individualized health care pathways while increasing efficiencies for health care practitioners. Radiology has been at the forefront of this technology in medicine; many radiology practices are implementing and trialing AI-focused products. AI also holds great promise for reducing health disparities and promoting health equity. Radiology is ideally positioned to help reduce disparities given its central and critical role in patient care. The purposes of this article are to discuss the potential benefits and pitfalls of deploying AI algorithms in radiology, specifically highlighting the impact of AI on health equity; to explore ways to mitigate drivers of inequity; and to enhance pathways for creating better health care for all individuals, centering on a practical framework that helps radiologists address health equity during deployment of new tools.

The impact on clinical outcomes after 1 year of implementation of an artificial intelligence solution for the detection of intracranial hemorrhage

BACKGROUND

To assess the effect of a commercial artificial intelligence (AI) solution implementation in the emergency department on clinical outcomes in a single level 1 trauma center.

METHODS

A retrospective cohort study for two time periods-pre-AI (1.1.2017-1.1.2018) and post-AI (1.1.2019-1.1.2020)-in a level 1 trauma center was performed. The ICH algorithm was applied to 587 consecutive patients with a confirmed diagnosis of ICH on head CT upon admission to the emergency department. Study variables included demographics, patient outcomes, and imaging data. Participants admitted to the emergency department during the same time periods for other acute diagnoses (ischemic stroke (IS) and myocardial infarction (MI)) served as control groups. Primary outcomes were 30- and 120-day all-cause mortality. The secondary outcome was morbidity based on Modified Rankin Scale for Neurologic Disability (mRS) at discharge.

RESULTS

Five hundred eighty-seven participants (289 pre-AI-age 71 ± 1, 169 men; 298 post-AI-age 69 ± 1, 187 men) with ICH were eligible for the analyzed period. Demographics, comorbidities, Emergency Severity Score, type of ICH, and length of stay were not significantly different between the two time periods. The 30- and 120-day all-cause mortality were significantly reduced in the post-AI group when compared to the pre-AI group (27.7% vs 17.5%; p = 0.004 and 31.8% vs 21.7%; p = 0.017, respectively). Modified Rankin Scale (mRS) at discharge was significantly reduced post-AI implementation (3.2 vs 2.8; p = 0.044).

CONCLUSION

The added value of this study emphasizes the introduction of artificial intelligence (AI) computer-aided triage and prioritization software in an emergent care setting that demonstrated a significant reduction in a 30- and 120-day all-cause mortality and morbidity for patients diagnosed with intracranial hemorrhage (ICH). Along with mortality rates, the AI software was associated with a significant reduction in the Modified Ranking Scale (mRs).

Establishment and validation of an AI-aid method in the diagnosis of myocardial perfusion imaging

BACKGROUND

This study aimed to develop and validate an AI (artificial intelligence)-aid method in myocardial perfusion imaging (MPI) to differentiate ischemia in coronary artery disease.

METHODS

We retrospectively selected 599 patients who had received gated-MPI protocol. Images were acquired using hybrid SPECT-CT systems. A training set was used to train and develop the neural network and a validation set was used to test the predictive ability of the neural network. We used a learning technique named "YOLO" to carry out the training process. We compared the predictive accuracy of AI with that of physician interpreters (beginner, inexperienced, and experienced interpreters).

RESULTS

Training performance showed that the accuracy ranged from 66.20% to 94.64%, the recall rate ranged from 76.96% to 98.76%, and the average precision ranged from 80.17% to 98.15%. In the ROC analysis of the validation set, the sensitivity range was 88.9 ~ 93.8%, the specificity range was 93.0 ~ 97.6%, and the AUC range was 94.1 ~ 96.1%. In the comparison between AI and different interpreters, AI outperformed the other interpreters (most P-value < 0.05).

CONCLUSION

The AI system of our study showed excellent predictive accuracy in the diagnosis of MPI protocols, and therefore might be potentially helpful to aid radiologists in clinical practice and develop more sophisticated models.

Assessment of Radiology Artificial Intelligence Software: A Validation and Evaluation Framework

Artificial intelligence (AI) software in radiology is becoming increasingly prevalent and performance is improving rapidly with new applications for given use cases being developed continuously, oftentimes with development and validation occurring in parallel. Several guidelines have provided reporting standards for publications of AI-based research in medicine and radiology. Yet, there is an unmet need for recommendations on the assessment of AI software before adoption and after commercialization. As the radiology AI ecosystem continues to grow and mature, a formalization of system assessment and evaluation is paramount to ensure patient safety, relevance and support to clinical workflows, and optimal allocation of limited AI development and validation resources before broader implementation into clinical practice. To fulfil these needs, we provide a glossary for AI software types, use cases and roles within the clinical workflow; list healthcare needs, key performance indicators and required information about software prior to assessment; and lay out examples of software performance metrics per software category. This conceptual framework is intended to streamline communication with the AI software industry and provide healthcare decision makers and radiologists with tools to assess the potential use of these software. The proposed software evaluation framework lays the foundation for a radiologist-led prospective validation network of radiology AI software. Learning Points: The rapid expansion of AI applications in radiology requires standardization of AI software specification, classification, and evaluation. The Canadian Association of Radiologists' AI Tech & Apps Working Group Proposes an AI Specification document format and supports the implementation of a clinical expert evaluation process for Radiology AI software.

Deep learning algorithm performs similarly to radiologists in the assessment of prostate volume on MRI

OBJECTIVES

Prostate volume (PV) in combination with prostate specific antigen (PSA) yields PSA density which is an increasingly important biomarker. Calculating PV from MRI is a time-consuming, radiologist-dependent task. The aim of this study was to assess whether a deep learning algorithm can replace PI-RADS 2.1 based ellipsoid formula (EF) for calculating PV.

METHODS

Eight different measures of PV were retrospectively collected for each of 124 patients who underwent radical prostatectomy and preoperative MRI of the prostate (multicenter and multi-scanner MRI's 1.5 and 3 T). Agreement between volumes obtained from the deep learning algorithm (PV_DL) and ellipsoid formula by two radiologists (PV_EF1 and PV_EF2) was evaluated against the reference standard PV obtained by manual planimetry by an expert radiologist (PV_MPE). A sensitivity analysis was performed using a prostatectomy specimen as the reference standard. Inter-reader agreement was evaluated between the radiologists using the ellipsoid formula and between the expert and inexperienced radiologists performing manual planimetry.

RESULTS

PV_DL showed better agreement and precision than PV_EF1 and PV_EF2 using the reference standard PV_MPE (mean difference [95% limits of agreement] PV_DL: -0.33 [-10.80; 10.14], PV_EF1: -3.83 [-19.55; 11.89], PV_EF2: -3.05 [-18.55; 12.45]) or the PV determined based on specimen weight (PV_DL: -4.22 [-22.52; 14.07], PV_EF1: -7.89 [-30.50; 14.73], PV_EF2: -6.97 [-30.13; 16.18]). Inter-reader agreement was excellent between the two experienced radiologists using the ellipsoid formula and was good between expert and inexperienced radiologists performing manual planimetry.

CONCLUSION

Deep learning algorithm performs similarly to radiologists in the assessment of prostate volume on MRI.

KEY POINTS

• A commercially available deep learning algorithm performs similarly to radiologists in the assessment of prostate volume on MRI. • The deep-learning algorithm was previously untrained on this heterogenous multicenter day-to-day practice MRI data set.

Applications of Artificial Intelligence in the Radiology Roundtrip: Process Streamlining, Workflow Optimization, and Beyond

There are many impactful applications of artificial intelligence (AI) in the electronic radiology roundtrip and the patient's journey through the healthcare system that go beyond diagnostic applications. These tools have the potential to improve quality and safety, optimize workflow, increase efficiency, and increase patient satisfaction. In this article, we review the role of AI for process improvement and workflow enhancement which includes applications beginning from the time of order entry, scan acquisition, applications supporting the image interpretation task, and applications supporting tasks after image interpretation such as result communication. These non-diagnostic workflow and process optimization tasks are an important part of the arsenal of potential AI tools that can streamline day to day clinical practice and patient care.

CNN-based evaluation of bone density improves diagnostic performance to detect osteopenia and osteoporosis in patients with non-contrast chest CT examinations

PURPOSE

As osteoporosis is still underdiagnosed by clinicians and radiologists, the aim of the present study was to assess the performance of an Artificial intelligence (AI)-based Convolutional Neuronal Network (CNN)-Algorithm for the detection of low bone density on routine non-contrast chest CT in comparison to clinical reports using DEXA scans as reference.

METHOD

This retrospective cross-sectional study included patients who underwent non-contrast chest CT and DEXA between April 2018 and June 2018 (n = 109, 19 men, mean age: 67.7 years). CT studies were evaluated for thoracic vertebral bone pathologies using a CNN-Algorithm, which calculates the attenuation profile of the spine. The content of the radiological reports was evaluated for the description of osteoporosis or osteopenia. DEXA was used as the reference standard. To estimate correlation the Spearman test was used and the comparison of the different groups was performed using the Wilcoxon rank sum test. Diagnostic was evaluated by performing a receiver operating characteristic curve analysis.

RESULTS

The DEXA examination revealed normal bone density in 42 patients, while 49 patients had osteopenia and 7 osteoporosis. There was a statistically significant correlation between the mean CNN-based attenuation of the thoracic spine and the bone density measured on the DEXA in the hip (r = 0.51, p < 0.001) and lumbar spine (r = 0.34, p = 0.01). The mean attenuation was significantly higher in patients with normal bone density (172 ± 44.5 HU) compared to those with osteopenia or osteoporosis (125.2 ± 33.8 HU), (p < 0.0001). Diagnostic performance in distinguishing normal from abnormal bone density was higher using the CNN-based vertebral attenuation (accuracy 0.75, sensitivity: 0.93, specificity: 0.61) compared to clinical reports (accuracy 0.51, sensitivity: 0.14, specificity: 0.53).

CONCLUSION

CNN-based evaluation of bone density may provide additional value over standard clinical reports for the detection of osteopenia and osteoporosis in patients undergoing routine non-contrast chest CT scans. This additional value could improve identification of fracture risk and subsequent treatment.

Artificial intelligence in emergency radiology: A review of applications and possibilities

Artificial intelligence (AI) applications in radiology have been rising exponentially in the last decade. Although AI has found usage in various areas of healthcare, its utilization in the emergency department (ED) as a tool for emergency radiologists shows great promise towards easing some of the challenges faced daily. There have been numerous reported studies examining the application of AI-based algorithms in identifying common ED conditions to ensure more rapid reporting and in turn quicker patient care. In addition to interpretive applications, AI assists with many of the non-interpretive tasks that are encountered every day by emergency radiologists. These include, but are not limited to, protocolling, image quality control and workflow prioritization. AI continues to face challenges such as physician uptake or costs, but is a long-term investment that shows great potential to relieve many difficulties faced by emergency radiologists and ultimately improve patient outcomes. This review sums up the current advances of AI in emergency radiology, including current diagnostic applications (interpretive) and applications that stretch beyond imaging (non-interpretive), analyzes current drawbacks of AI in emergency radiology and discusses future challenges.

Artificial Intelligence in Emergency Radiology: Where Are We Going?

Emergency Radiology is a unique branch of imaging, as rapidity in the diagnosis and management of different pathologies is essential to saving patients' lives. Artificial Intelligence (AI) has many potential applications in emergency radiology: firstly, image acquisition can be facilitated by reducing acquisition times through automatic positioning and minimizing artifacts with AI-based reconstruction systems to optimize image quality, even in critical patients; secondly, it enables an efficient workflow (AI algorithms integrated with RIS-PACS workflow), by analyzing the characteristics and images of patients, detecting high-priority examinations and patients with emergent critical findings. Different machine and deep learning algorithms have been trained for the automated detection of different types of emergency disorders (e.g., intracranial hemorrhage, bone fractures, pneumonia), to help radiologists to detect relevant findings. AI-based smart reporting, summarizing patients' clinical data, and analyzing the grading of the imaging abnormalities, can provide an objective indicator of the disease's severity, resulting in quick and optimized treatment planning. In this review, we provide an overview of the different AI tools available in emergency radiology, to keep radiologists up to date on the current technological evolution in this field.

The current and future roles of artificial intelligence in pediatric radiology

Artificial intelligence (AI) is a broad and complicated concept that has begun to affect many areas of medicine, perhaps none so much as radiology. While pediatric radiology has been less affected than other radiology subspecialties, there are some well-developed and some nascent applications within the field. This review focuses on the use of AI within pediatric radiology for image interpretation, with descriptive summaries of the literature to date. We highlight common features that enable successful application of the technology, along with some of the limitations that can inhibit the development of this field. We present some ideas for further research in this area and challenges that must be overcome, with an understanding that technology often advances in unpredictable ways.

[Artificial intelligence in orthopaedic and trauma surgery imaging]

Artificial intelligence (AI) is playing an increasing role in radiological imaging in orthopaedics and trauma surgery. The algorithms available to date are predominantly used in the detection of (occult) fractures and in length and angle measurements in conventional X‑ray images. However, current AI solutions also enable the analysis and pattern recognition of CT datasets, e.g. in the detection of rib or vertebral body fractures. A special application is EOS™ (ATEC Spine Group, Paris, France), which enables a 3‑D simulation of the axial skeleton and semi-automatic length and angle calculations based on a digital 2‑D X‑ray image. In this paper, the current spectrum of AI applications for orthopaedics and trauma surgery is presented and discussed.

Accuracy of artificial intelligence software for the detection of confirmed pleural effusion in thoracic radiographs in dogs

The use of artificial intelligence (AI) algorithms in diagnostic radiology is a developing area in veterinary medicine and may provide substantial benefit in many clinical settings. These range from timely image interpretation in the emergency setting when no boarded radiologist is available to allowing boarded radiologists to focus on more challenging cases that require complex medical decision making. Testing the performance of artificial intelligence (AI) software in veterinary medicine is at its early stages, and only a scant number of reports of validation of AI software have been published. The purpose of this study was to investigate the performance of an AI algorithm (Vetology AI^® ) in the detection of pleural effusion in thoracic radiographs of dogs. In this retrospective, diagnostic case-controlled study, 62 canine patients were recruited. A control group of 21 dogs with normal thoracic radiographs and a sample group of 41 dogs with confirmed pleural effusion were selected from the electronic medical records at the Cummings School of Veterinary Medicine. The images were cropped to include only the area of interest (i.e., thorax). The software then classified images into those with pleural effusion and those without. The AI algorithm was able to determine the presence of pleural effusion with 88.7% accuracy (P < 0.05). The sensitivity and specificity were 90.2% and 81.8%, respectively (positive predictive value, 92.5%; negative predictive value, 81.8%). The application of this technology in the diagnostic interpretation of thoracic radiographs in veterinary medicine appears to be of value and warrants further investigation and testing.

How artificial intelligence improves radiological interpretation in suspected pulmonary embolism

Objectives

To evaluate and compare the diagnostic performances of a commercialized artificial intelligence (AI) algorithm for diagnosing pulmonary embolism (PE) on CT pulmonary angiogram (CTPA) with those of emergency radiologists in routine clinical practice.

Methods

This was an IRB-approved retrospective multicentric study including patients with suspected PE from September to December 2019 (i.e., during a preliminary evaluation period of an approved AI algorithm). CTPA quality and conclusions by emergency radiologists were retrieved from radiological reports. The gold standard was a retrospective review of CTPA, radiological and clinical reports, AI outputs, and patient outcomes. Diagnostic performance metrics for AI and radiologists were assessed in the entire cohort and depending on CTPA quality.

Results

Overall, 1202 patients were included (median age: 66.2 years). PE prevalence was 15.8% (190/1202). The AI algorithm detected 219 suspicious PEs, of which 176 were true PEs, including 19 true PEs missed by radiologists. In the cohort, the highest sensitivity and negative predictive values (NPVs) were obtained with AI (92.6% versus 90% and 98.6% versus 98.1%, respectively), while the highest specificity and positive predictive value (PPV) were found with radiologists (99.1% versus 95.8% and 95% versus 80.4%, respectively). Accuracy, specificity, and PPV were significantly higher for radiologists except in subcohorts with poor-to-average injection quality. Radiologists positively evaluated the AI algorithm to improve their diagnostic comfort (55/79 [69.6%]).

Conclusion

Instead of replacing radiologists, AI for PE detection appears to be a safety net in emergency radiology practice due to high sensitivity and NPV, thereby increasing the self-confidence of radiologists.

Key Points

• Both the AI algorithm and emergency radiologists showed excellent performance in diagnosing PE on CTPA (sensitivity and specificity ≥ 90%; accuracy ≥ 95%).

• The AI algorithm for PE detection can help increase the sensitivity and NPV of emergency radiologists in clinical practice, especially in cases of poor-to-moderate injection quality.

• Emergency radiologists recommended the use of AI for PE detection in satisfaction surveys to increase their confidence and comfort in their final diagnosis.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-022-08645-2.

Automated detection of pulmonary embolism from CT-angiograms using deep learning

Background

The aim of this study was to develop and evaluate a deep neural network model in the automated detection of pulmonary embolism (PE) from computed tomography pulmonary angiograms (CTPAs) using only weakly labelled training data.

Methods

We developed a deep neural network model consisting of two parts: a convolutional neural network architecture called InceptionResNet V2 and a long-short term memory network to process whole CTPA stacks as sequences of slices. Two versions of the model were created using either chest X-rays (Model A) or natural images (Model B) as pre-training data. We retrospectively collected 600 CTPAs to use in training and validation and 200 CTPAs to use in testing. CTPAs were annotated only with binary labels on both stack- and slice-based levels. Performance of the models was evaluated with ROC and precision–recall curves, specificity, sensitivity, accuracy, as well as positive and negative predictive values.

Results

Both models performed well on both stack- and slice-based levels. On the stack-based level, Model A reached specificity and sensitivity of 93.5% and 86.6%, respectively, outperforming Model B slightly (specificity 90.7% and sensitivity 83.5%). However, the difference between their ROC AUC scores was not statistically significant (0.94 vs 0.91, p = 0.07).

Conclusions

We show that a deep learning model trained with a relatively small, weakly annotated dataset can achieve excellent performance results in detecting PE from CTPAs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12880-022-00763-z.

Overview of Noninterpretive Artificial Intelligence Models for Safety, Quality, Workflow, and Education Applications in Radiology Practice

Artificial intelligence has become a ubiquitous term in radiology over the past several years, and much attention has been given to applications that aid radiologists in the detection of abnormalities and diagnosis of diseases. However, there are many potential applications related to radiologic image quality, safety, and workflow improvements that present equal, if not greater, value propositions to radiology practices, insurance companies, and hospital systems. This review focuses on six major categories for artificial intelligence applications: study selection and protocoling, image acquisition, worklist prioritization, study reporting, business applications, and resident education. All of these categories can substantially affect different aspects of radiology practices and workflows. Each of these categories has different value propositions in terms of whether they could be used to increase efficiency, improve patient safety, increase revenue, or save costs. Each application is covered in depth in the context of both current and future areas of work. Keywords: Use of AI in Education, Application Domain, Supervised Learning, Safety © RSNA, 2022.

Comparison of artificial intelligence to the veterinary radiologist's diagnosis of canine cardiogenic pulmonary edema

Application of artificial intelligence (AI) to improve clinical diagnosis is a burgeoning field in human and veterinary medicine. The objective of this prospective, diagnostic accuracy study was to determine the accuracy, sensitivity, and specificity of an AI-based software for diagnosing canine cardiogenic pulmonary edema from thoracic radiographs, using an American College of Veterinary Radiology-certified veterinary radiologist's interpretation as the reference standard. Five hundred consecutive canine thoracic radiographs made after-hours by a veterinary Emergency Department were retrieved. A total of 481 of 500 cases were technically analyzable. Based on the radiologist's assessment, 46 (10.4%) of these 481 dogs were diagnosed with cardiogenic pulmonary edema (CPE+). Of these cases, the AI software designated 42 of 46 as CPE+ and four of 46 as cardiogenic pulmonary edema negative (CPE-). Accuracy, sensitivity, and specificity of the AI-based software compared to radiologist diagnosis were 92.3%, 91.3%, and 92.4%, respectively (positive predictive value, 56%; negative predictive value, 99%). Findings supported using AI software screening for thoracic radiographs of dogs with suspected cardiogenic pulmonary edema to assist with short-term decision-making when a radiologist is unavailable.

A Deep Residual U-Net Algorithm for Automatic Detection and Quantification of Ascites on Abdominopelvic Computed Tomography Images Acquired in the Emergency Department: Model Development and Validation

Background

Detection and quantification of intra-abdominal free fluid (ie, ascites) on computed tomography (CT) images are essential processes for finding emergent or urgent conditions in patients. In an emergency department, automatic detection and quantification of ascites will be beneficial.

Objective

We aimed to develop an artificial intelligence (AI) algorithm for the automatic detection and quantification of ascites simultaneously using a single deep learning model (DLM).

Methods

We developed 2D DLMs based on deep residual U-Net, U-Net, bidirectional U-Net, and recurrent residual U-Net (R2U-Net) algorithms to segment areas of ascites on abdominopelvic CT images. Based on segmentation results, the DLMs detected ascites by classifying CT images into ascites images and nonascites images. The AI algorithms were trained using 6337 CT images from 160 subjects (80 with ascites and 80 without ascites) and tested using 1635 CT images from 40 subjects (20 with ascites and 20 without ascites). The performance of the AI algorithms was evaluated for diagnostic accuracy of ascites detection and for segmentation accuracy of ascites areas. Of these DLMs, we proposed an AI algorithm with the best performance.

Results

The segmentation accuracy was the highest for the deep residual U-Net model with a mean intersection over union (mIoU) value of 0.87, followed by U-Net, bidirectional U-Net, and R2U-Net models (mIoU values of 0.80, 0.77, and 0.67, respectively). The detection accuracy was the highest for the deep residual U-Net model (0.96), followed by U-Net, bidirectional U-Net, and R2U-Net models (0.90, 0.88, and 0.82, respectively). The deep residual U-Net model also achieved high sensitivity (0.96) and high specificity (0.96).

Conclusions

We propose a deep residual U-Net–based AI algorithm for automatic detection and quantification of ascites on abdominopelvic CT scans, which provides excellent performance.

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics

Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.

A Novel Deep Learning Based Computer-Aided Diagnosis System Improves the Accuracy and Efficiency of Radiologists in Reading Biparametric Magnetic Resonance Images of the Prostate: Results of a Multireader, Multicase Study

OBJECTIVE

The aim of this study was to evaluate the effect of a deep learning based computer-aided diagnosis (DL-CAD) system on radiologists' interpretation accuracy and efficiency in reading biparametric prostate magnetic resonance imaging scans.

MATERIALS AND METHODS

We selected 100 consecutive prostate magnetic resonance imaging cases from a publicly available data set (PROSTATEx Challenge) with and without histopathologically confirmed prostate cancer. Seven board-certified radiologists were tasked to read each case twice in 2 reading blocks (with and without the assistance of a DL-CAD), with a separation between the 2 reading sessions of at least 2 weeks. Reading tasks were to localize and classify lesions according to Prostate Imaging Reporting and Data System (PI-RADS) v2.0 and to assign a radiologist's level of suspicion score (scale from 1-5 in 0.5 increments; 1, benign; 5, malignant). Ground truth was established by consensus readings of 3 experienced radiologists. The detection performance (receiver operating characteristic curves), variability (Fleiss κ), and average reading time without DL-CAD assistance were evaluated.

RESULTS

The average accuracy of radiologists in terms of area under the curve in detecting clinically significant cases (PI-RADS ≥4) was 0.84 (95% confidence interval [CI], 0.79-0.89), whereas the same using DL-CAD was 0.88 (95% CI, 0.83-0.94) with an improvement of 4.4% (95% CI, 1.1%-7.7%; P = 0.010). Interreader concordance (in terms of Fleiss κ) increased from 0.22 to 0.36 (P = 0.003). Accuracy of radiologists in detecting cases with PI-RADS ≥3 was improved by 2.9% (P = 0.10). The median reading time in the unaided/aided scenario was reduced by 21% from 103 to 81 seconds (P < 0.001).

CONCLUSIONS

Using a DL-CAD system increased the diagnostic accuracy in detecting highly suspicious prostate lesions and reduced both the interreader variability and the reading time.

Noninterpretive Uses of Artificial Intelligence in Radiology

We deem a computer to exhibit artificial intelligence (AI) when it performs a task that would normally require intelligent action by a human. Much of the recent excitement about AI in the medical literature has revolved around the ability of AI models to recognize anatomy and detect pathology on medical images, sometimes at the level of expert physicians. However, AI can also be used to solve a wide range of noninterpretive problems that are relevant to radiologists and their patients. This review summarizes some of the newer noninterpretive uses of AI in radiology.

[Artificial intelligence in image evaluation and diagnosis]

Die Radiologie ist von stetem Wandel geprägt und definiert sich über den technologischen Fortschritt. Künstliche Intelligenz (KI) wird die praktische Tätigkeit in der Kinder- und Jugendradiologie künftig in allen Belangen verändern. Bildakquisition, Befunderkennung und -segmentierung sowie die Erkennung von Gewebeeigenschaften und deren Kombination mit Big Data werden die Haupteinsatzgebiete in der Radiologie sein. Höhere Effektivität, Beschleunigung von Untersuchung und Befundung sowie Kosteneinsparung sind mit der Anwendung von KI verbundene Erwartungshaltungen. Ein verbessertes Patientenmanagement, Arbeitserleichterungen für medizinisch-technische Radiologieassistenten und Kinder- und Jugendradiologen sowie schnellere Untersuchungs- und Befundzeiten markieren die Meilensteine der KI-Entwicklung in der Radiologie. Von der Terminkommunikation und Gerätesteuerung bis zu Therapieempfehlung und -monitoring wird der Alltag durch Elemente der KI verändert. Kinder- und Jugendradiologen müssen daher grundlegend über KI informiert sein und mit Datenwissenschaftlern bei der Etablierung und Anwendung von KI-Elementen zusammenarbeiten.

Workflow Applications of Artificial Intelligence in Radiology and an Overview of Available Tools

In the past decade, there has been tremendous interest in applying artificial intelligence (AI) to improve the field of radiology. Currently, numerous AI applications are in development, with potential benefits spanning all steps of the imaging chain from test ordering to report communication. AI has been proposed as a means to optimize patient scheduling, improve worklist management, enhance image acquisition, and help radiologists interpret diagnostic studies. Although the potential for AI in radiology appears almost endless, the field is still in the early stages, with many uses still theoretical, in development, or limited to single institutions. Moreover, although the current use of AI in radiology has emphasized its clinical applications, some of which are in the distant future, it is increasingly clear that AI algorithms could also be used in the more immediate future for a variety of noninterpretive and quality improvement uses. Such uses include the integration of AI into electronic health record systems to reduce unwarranted variation in radiologists' follow-up recommendations and to improve other dimensions of radiology report quality. In the end, the potential of AI in radiology must be balanced with acknowledgment of its current limitations regarding generalizability and data privacy.

Deep learning-based automated detection of pulmonary embolism on CT pulmonary angiograms: No significant effects on report communication times and patient turnaround in the emergency department nine months after technical implementation

OBJECTIVES

Rapid communication of CT exams positive for pulmonary embolism (PE) is crucial for timely initiation of anticoagulation and patient outcome. It is unknown if deep learning automated detection of PE on CT Pulmonary Angiograms (CTPA) in combination with worklist prioritization and an electronic notification system (ENS) can improve communication times and patient turnaround in the Emergency Department (ED).

METHODS

In 01/2019, an ENS allowing direct communication between radiology and ED was installed. Starting in 10/2019, CTPAs were processed by a deep learning (DL)-powered algorithm for detection of PE. CTPAs acquired between 04/2018 and 06/2020 (n = 1808) were analysed. To assess the impact of the ENS and the DL-algorithm, radiology report reading times (RRT), radiology report communication time (RCT), time to anticoagulation (TTA), and patient turnaround times (TAT) in the ED were compared for three consecutive time periods. Performance measures of the algorithm were calculated on a per exam level (sensitivity, specificity, PPV, NPV, F1-score), with written reports and exam review as ground truth.

RESULTS

Sensitivity of the algorithm was 79.6 % (95 %CI:70.8-87.2%), specificity 95.0 % (95 %CI:92.0-97.1%), PPV 82.2 % (95 %CI:73.9-88.3), and NPV 94.1 % (95 %CI:91.4-96 %). There was no statistically significant reduction of any of the observed times (RRT, RCT, TTA, TAT).

CONCLUSION

DL-assisted detection of PE in CTPAs and ENS-assisted communication of results to referring physicians technically work. However, the mere clinical introduction of these tools, even if they exhibit a good performance, is not sufficient to achieve significant effects on clinical performance measures.

Identification and classification of pneumonia disease using a deep learning-based intelligent computational framework

Pneumonia is one of the hazardous diseases that lead to life insecurity. It needs to be diagnosed at the initial stages to prevent a person from more damage and help them save their lives. Various techniques are used to identify pneumonia, including chest X-ray, blood culture, sputum culture, fluid sample, bronchoscopy, and pulse oximetry. Chest X-ray is the most widely used method to diagnose pneumonia and is considered one of the most reliable approaches. To analyse chest X-ray images accurately, an expert radiologist needs expertise and experience in the desired domain. However, human-assisted approaches have some drawbacks: expert availability, treatment cost, availability of diagnostic tools, etc. Hence, the need for an intelligent and automated system comes into place that operates on chest X-ray images and diagnoses pneumonia. The primary purpose of technology is to develop algorithms and tools that assist humans and make their lives easier. This study proposes a scalable and interpretable deep convolutional neural network (DCNN) to identify pneumonia using chest X-ray images. The proposed modified DCNN model first extracts useful features from the images and then classifies them into normal and pneumonia classes. The proposed system has been trained and tested on chest X-ray images dataset. Various performance metrics have been utilized to inspect the stability and efficacy of the proposed model. The experimental result shows that the proposed model's performance is greater compared to the other state-of-the-art methodologies used to identify pneumonia.

Artificial Intelligence and Machine Learning in Radiology: Current State and Considerations for Routine Clinical Implementation

Although artificial intelligence (AI) has been a focus of medical research for decades, in the last decade, the field of radiology has seen tremendous innovation and also public focus due to development and application of machine-learning techniques to develop new algorithms. Interestingly, this innovation is driven simultaneously by academia, existing global medical device vendors, and-fueled by venture capital-recently founded startups. Radiologists find themselves once again in the position to lead this innovation to improve clinical workflows and ultimately patient outcome. However, although the end of today's radiologists' profession has been proclaimed multiple times, routine clinical application of such AI algorithms in 2020 remains rare. The goal of this review article is to describe in detail the relevance of appropriate imaging data as a bottleneck for innovation, provide insights into the many obstacles for technical implementation, and give additional perspectives to radiologists who often view AI solely from their clinical role. As regulatory approval processes for such medical devices are currently under public discussion and the relevance of imaging data is transforming, radiologists need to establish themselves as the leading gatekeepers for evolution of their field and be aware of the many stakeholders and sometimes conflicting interests.

Artificial intelligence in child abuse imaging

There have been rapid advances in artificial intelligence (AI) technology in recent years, and the field of diagnostic imaging is no exception. Just as digital technology revolutionized how radiology is practiced, so these new technologies also appear poised to bring sweeping change. As AI tools make the transition from the theoretical to the everyday, important decisions need to be made about how they will be applied and what their role will be in the practice of radiology. Pediatric radiology presents distinct challenges and opportunities for the application of these tools, and in this article we discuss some of these, specifically as they relate to the prediction, identification and investigation of child abuse.

Management of abdominal emergencies in adults using telemedicine and artificial intelligence

The terms "telemedicine" and "artificial intelligence" (AI) are used today throughout all fields of medicine, with varying degrees of relevance. If telemedicine corresponds to practices currently being developed to supply a high quality response to medical provider shortages in the general provision of healthcare and to specific regional challenges. Through the possibilities of "scalability" and the "augmented physician" that it has helped to create, AI may also constitute a revolution in our practices. In the management of surgical emergencies, abdominal pain is one of the most frequent complaints of patients who present for emergency consultation, and up to 20% of patients prove to have an organic lesion that will require surgical management. In view of the very large number of patients concerned, the variety of clinical presentations, the potential seriousness of the etiological pathology that sometimes involves a life-threatening prognosis, healthcare workers responsible for these patients have logically been led to regularly rely on imaging examinations, which remain the critical key to subsequent management. Therefore, it is not surprising that articles have been published in recent years concerning the potential contributions of telemedicine (and teleradiology) to the diagnostic management of these patients, and also concerning the contribution of AI (albeit still in its infancy) to aid in diagnosis and treatment, including surgery. This review article presents the existing data and proposes a collaborative vision of an optimized patient pathway, giving medical meaning to the use of these tools.

Artificial intelligence in radiology: relevance of collaborative work between radiologists and engineers for building a multidisciplinary team

The use of artificial intelligence (AI) algorithms in the field of radiology is becoming more common. Several studies have demonstrated the potential utility of machine learning (ML) and deep learning (DL) techniques as aids for radiologists to solve specific radiological challenges. The decision-making process, the establishment of specific clinical or radiological targets, the profile of the different professionals involved in the development of AI solutions, and the relation with partnerships and stakeholders are only some of the main issues that have to be faced and solved prior to starting the development of radiological AI solutions. Among all the players in this multidisciplinary team, the communication between radiologists and data scientists is essential for a successful collaborative work. There are specific skills that are inherent to radiological and medical training that are critical for identifying anatomical or clinical targets as well as for segmenting or labelling lesions. These skills would then have to be transferred, explained, and taught to the data science experts to facilitate their comprehension and integration into ML or DL algorithms. On the other hand, there is a wide range of complex software packages, deep neural-network architectures, and data transfer processes for which radiologists need the expertise of software engineers and data scientists in order to select the optimal manner to analyse and post-process this amount of data. This paper offers a summary of the top five challenges faced by radiologists and data scientists including tips and tricks to build a successful AI team.

Assessment of a Deep Learning Algorithm for the Detection of Rib Fractures on Whole-Body Trauma Computed Tomography

Objective

To assess the diagnostic performance of a deep learning-based algorithm for automated detection of acute and chronic rib fractures on whole-body trauma CT.

Materials and Methods

We retrospectively identified all whole-body trauma CT scans referred from the emergency department of our hospital from January to December 2018 (n = 511). Scans were categorized as positive (n = 159) or negative (n = 352) for rib fractures according to the clinically approved written CT reports, which served as the index test. The bone kernel series (1.5-mm slice thickness) served as an input for a detection prototype algorithm trained to detect both acute and chronic rib fractures based on a deep convolutional neural network. It had previously been trained on an independent sample from eight other institutions (n = 11455).

Results

All CTs except one were successfully processed (510/511). The algorithm achieved a sensitivity of 87.4% and specificity of 91.5% on a per-examination level [per CT scan: rib fracture(s): yes/no]. There were 0.16 false-positives per examination (= 81/510). On a per-finding level, there were 587 true-positive findings (sensitivity: 65.7%) and 307 false-negatives. Furthermore, 97 true rib fractures were detected that were not mentioned in the written CT reports. A major factor associated with correct detection was displacement.

Conclusion

We found good performance of a deep learning-based prototype algorithm detecting rib fractures on trauma CT on a per-examination level at a low rate of false-positives per case. A potential area for clinical application is its use as a screening tool to avoid false-negative radiology reports.

Diverse Applications of Artificial Intelligence in Neuroradiology

Recent advances in artificial intelligence (AI) and deep learning (DL) hold promise to augment neuroimaging diagnosis for patients with brain tumors and stroke. Here, the authors review the diverse landscape of emerging neuroimaging applications of AI, including workflow optimization, lesion segmentation, and precision education. Given the many modalities used in diagnosing neurologic diseases, AI may be deployed to integrate across modalities (MR imaging, computed tomography, PET, electroencephalography, clinical and laboratory findings), facilitate crosstalk among specialists, and potentially improve diagnosis in patients with trauma, multiple sclerosis, epilepsy, and neurodegeneration. Together, there are myriad applications of AI for neuroradiology."

A Practical Guide to Artificial Intelligence-Based Image Analysis in Radiology

The use of artificial intelligence (AI) is a powerful tool for image analysis that is increasingly being evaluated by radiology professionals. However, due to the fact that these methods have been developed for the analysis of nonmedical image data and data structure in radiology departments is not "AI ready", implementing AI in radiology is not straightforward. The purpose of this review is to guide the reader through the pipeline of an AI project for automated image analysis in radiology and thereby encourage its implementation in radiology departments. At the same time, this review aims to enable readers to critically appraise articles on AI-based software in radiology.

[Information technology and eHealth to improve patient safety]

Patient safety is a key element of high-quality healthcare. Digitalization, new eHealth applications and data-based algorithms have high potential to make a significant contribution. This article presents current technological developments along a simplified patient journey from emergency medical triage, diagnosis and therapy to follow-up. The technical interventions are highly diverse and mostly accompanied by a low level of evidence, since most of them are from single academic projects or start-ups. Although there should be no doubt that technology is an important instrument for increasing patient safety, new technologies also involve new risks. Furthermore, technical measures must always be embedded in an overall concept of organizational measures, adequate education, training and accompanying research in order to generate the highest possible benefits and lowest possible risks.

[Artificial Intelligence in radiology : What can be expected in the next few years?]

CLINICAL/METHODOLOGICAL ISSUE

Artificial intelligence (AI) is being increasingly used in the field of radiology. The aim of this review is to illustrate the developments expected in the next 5 to 10 years as well as possible advantages and risks.

STANDARD RADIOLOGICAL METHODS

Currently, all computed tomography (CT) images are reconstructed using programmed algorithms. Pathologies are detected by the radiologist with a high expenditure of time and evaluated using standardized procedures.

METHODOLOGICAL INNOVATIONS

AI can potentially provide a significant improvement to all these standard procedures in the future. CT reconstructions can be significantly enhanced using generative adversarial networks (GAN). Histology can be evaluated using radiomics or deep learning (DL)-based image analysis and the prognosis of the patient can be predicted highly individualized.

PERFORMANCE

The performance of the networks is strongly influenced by data quality and requires extensive validation. The ability and willingness of the manufacturers to integrate these into the existing RIS/PACS systems is also decisive.

EVALUATION

AI will have a large impact on the daily clinical work of radiologists. However, publications on the risks of the technology and on adequate validation are still lacking. In addition to opening new fields of application, further research regarding possible risks is warranted.

PRACTICAL RECOMMENDATIONS

In the next 5 to 10 years, AI will improve and facilitate work in clinical practice. The integration of the applications into the existing RIS/PACS systems is expected to take place via app stores and/or existing teleradiology networks.

Artificial Intelligence in Imaging: The Radiologist's Role

Rapid technological advancements in artificial intelligence (AI) methods have fueled explosive growth in decision tools being marketed by a rapidly growing number of companies. AI developments are being driven largely by computer scientists, informaticians, engineers, and businesspeople, with much less direct participation by radiologists. Participation by radiologists in AI is largely restricted to educational efforts to familiarize them with the tools and promising results, but techniques to help them decide which AI tools should be used in their practices and to how to quantify their value are not being addressed. This article focuses on the role of radiologists in imaging AI and suggests specific ways they can be engaged by (1) considering the clinical need for AI tools in specific clinical use cases, (2) undertaking formal evaluation of AI tools they are considering adopting in their practices, and (3) maintaining their expertise and guarding against the pitfalls of overreliance on technology.