1
|
Raj A, Allababidi A, Kayed H, Gerken ALH, Müller J, Schoenberg SO, Zöllner FG, Rink JS. Streamlining Acute Abdominal Aortic Dissection Management-An AI-based CT Imaging Workflow. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01164-0. [PMID: 38864947 DOI: 10.1007/s10278-024-01164-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 05/24/2024] [Accepted: 06/04/2024] [Indexed: 06/13/2024]
Abstract
Life-threatening acute aortic dissection (AD) demands timely diagnosis for effective intervention. To streamline intrahospital workflows, automated detection of AD in abdominal computed tomography (CT) scans seems useful to assist humans. We aimed at creating a robust convolutional neural network (CNN)-based pipeline capable of real-time screening for signs of abdominal AD in CT. In this retrospective study, abdominal CT data from AD patients presenting with AD and from non-AD patients were collected (n 195, AD cases 94, mean age 65.9 years, female ratio 35.8%). A CNN-based algorithm was developed with the goal of enabling a robust, automated, and highly sensitive detection of abdominal AD. Two sets from internal (n = 32, AD cases 16) and external sources (n = 1189, AD cases 100) were procured for validation. The abdominal region was extracted, followed by the automatic isolation of the aorta region of interest (ROI) and highlighting of the membrane via edge extraction, followed by classification of the aortic ROI as dissected/healthy. A fivefold cross-validation was employed on the internal set, and an ensemble of the 5 trained models was used to predict the internal and external validation set. Evaluation metrics included receiver operating characteristic curve (AUC) and balanced accuracy. The AUC, balanced accuracy, and sensitivity scores of the internal dataset were 0.932 (CI 0.891-0.963), 0.860, and 0.885, respectively. For the internal validation dataset, the AUC, balanced accuracy, and sensitivity scores were 0.887 (CI 0.732-0.988), 0.781, and 0.875, respectively. Furthermore, for the external validation dataset, AUC, balanced accuracy, and sensitivity scores were 0.993 (CI 0.918-0.994), 0.933, and 1.000, respectively. The proposed automated pipeline could assist humans in expediting acute aortic dissection management when integrated into clinical workflows.
Collapse
Affiliation(s)
- Anish Raj
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany.
- Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany.
| | - Ahmad Allababidi
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Hany Kayed
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Andreas L H Gerken
- Department of Surgery, Medical Faculty Mannheim, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Julia Müller
- Mediri GmbH, Eppelheimer Straße 13, D-69115, Heidelberg, Germany
| | - Stefan O Schoenberg
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Frank G Zöllner
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
- Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Johann S Rink
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| |
Collapse
|
2
|
Koç U, Sezer EA, Özkaya YA, Yarbay Y, Beşler MS, Taydaş O, Yalçın A, Evrimler Ş, Kızıloğlu HA, Kesimal U, Atasoy D, Oruç M, Ertuğrul M, Karakaş E, Karademir F, Sebik NB, Topuz Y, Aktan ME, Sezer Ö, Aydın Ş, Varlı S, Akdoğan E, Ülgü MM, Birinci Ş. Elevating healthcare through artificial intelligence: analyzing the abdominal emergencies data set (TR_ABDOMEN_RAD_EMERGENCY) at TEKNOFEST-2022. Eur Radiol 2024; 34:3588-3597. [PMID: 37947834 DOI: 10.1007/s00330-023-10391-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 08/28/2023] [Accepted: 09/08/2023] [Indexed: 11/12/2023]
Abstract
OBJECTIVES The artificial intelligence competition in healthcare at TEKNOFEST-2022 provided a platform to address the complex multi-class classification challenge of abdominal emergencies using computer vision techniques. This manuscript aimed to comprehensively present the methodologies for data preparation, annotation procedures, and rigorous evaluation metrics. Moreover, it was conducted to introduce a meticulously curated abdominal emergencies data set to the researchers. METHODS The data set underwent a comprehensive central screening procedure employing diverse algorithms extracted from the e-Nabız (Pulse) and National Teleradiology System of the Republic of Türkiye, Ministry of Health. Full anonymization of the data set was conducted. Subsequently, the data set was annotated by a group of ten experienced radiologists. The evaluation process was executed by calculating F1 scores, which were derived from the intersection over union values between the predicted bounding boxes and the corresponding ground truth (GT) bounding boxes. The establishment of baseline performance metrics involved computing the average of the highest five F1 scores. RESULTS Observations indicated a progressive decline in F1 scores as the threshold value increased. Furthermore, it could be deduced that class 6 (abdominal aortic aneurysm/dissection) was relatively straightforward to detect compared to other classes, with class 5 (acute diverticulitis) presenting the most formidable challenge. It is noteworthy, however, that if all achieved outcomes for all classes were considered with a threshold of 0.5, the data set's complexity and associated challenges became pronounced. CONCLUSION This data set's significance lies in its pioneering provision of labels and GT-boxes for six classes, fostering opportunities for researchers. CLINICAL RELEVANCE STATEMENT The prompt identification and timely intervention in cases of emergent medical conditions hold paramount significance. The handling of patients' care can be augmented, while the potential for errors is minimized, particularly amidst high caseload scenarios, through the application of AI. KEY POINTS • The data set used in artificial intelligence competition in healthcare (TEKNOFEST-2022) provides a 6-class data set of abdominal CT images consisting of a great variety of abdominal emergencies. • This data set is compiled from the National Teleradiology System data repository of emergency radiology departments of 459 hospitals. • Radiological data on abdominal emergencies is scarce in literature and this annotated competition data set can be a valuable resource for further studies and new AI models.
Collapse
Affiliation(s)
- Ural Koç
- Department of Radiology, Ankara Bilkent City Hospital, Ankara, Türkiye.
| | - Ebru Akçapınar Sezer
- Artificial Intelligence Division, Department of Computer Engineering, Hacettepe University, Ankara, Türkiye
| | | | - Yasin Yarbay
- General Directorate of Health Information Systems, Ministry of Health, Ankara, Türkiye
| | | | - Onur Taydaş
- Department of Radiology, Faculty of Medicine, Sakarya University, Sakarya, Türkiye
| | - Ahmet Yalçın
- Department of Radiology, Faculty of Medicine, Erzurum Atatürk University, Erzurum, Türkiye
| | - Şehnaz Evrimler
- Department of Radiology, Ankara Etlik City Hospital, Ankara, Türkiye
| | | | - Uğur Kesimal
- Department of Radiology, Ankara Training and Research Hospital, Ankara, Türkiye
| | - Dilara Atasoy
- Department of Radiology, Sivas Numune State Hospital, Sivas, Türkiye
| | - Meltem Oruç
- Department of Radiology, Karaman Training and Research Hospital, Karaman, Türkiye
| | - Mustafa Ertuğrul
- Department of Radiology, Ürgüp State Hospital, Nevşehir, Türkiye
| | - Emrah Karakaş
- General Directorate of Health Information Systems, Ministry of Health, Ankara, Türkiye
| | | | - Nihat Barış Sebik
- General Directorate of Health Information Systems, Ministry of Health, Ankara, Türkiye
| | | | | | - Özgür Sezer
- General Directorate of Health Information Systems, Ministry of Health, Ankara, Türkiye
| | - Şahin Aydın
- General Directorate of Health Information Systems, Ministry of Health, Ankara, Türkiye
| | - Songül Varlı
- Health Institutes of Türkiye, İstanbul, Türkiye
- Department of Computer Engineering, Yıldız Technical University, İstanbul, Türkiye
| | - Erhan Akdoğan
- Health Institutes of Türkiye, İstanbul, Türkiye
- Department of Mechatronics Engineering, Faculty of Mechanical Engineering, Yıldız Technical University, İstanbul, Türkiye
| | - Mustafa Mahir Ülgü
- General Directorate of Health Information Systems, Ministry of Health, Ankara, Türkiye
| | | |
Collapse
|
3
|
Spinella G, Fantazzini A, Finotello A, Vincenzi E, Boschetti GA, Brutti F, Magliocco M, Pane B, Basso C, Conti M. Artificial Intelligence Application to Screen Abdominal Aortic Aneurysm Using Computed tomography Angiography. J Digit Imaging 2023; 36:2125-2137. [PMID: 37407843 PMCID: PMC10501994 DOI: 10.1007/s10278-023-00866-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2023] [Revised: 05/13/2023] [Accepted: 06/06/2023] [Indexed: 07/07/2023] Open
Abstract
The aim of our study is to validate a totally automated deep learning (DL)-based segmentation pipeline to screen abdominal aortic aneurysms (AAA) in computed tomography angiography (CTA) scans. We retrospectively evaluated 73 thoraco-abdominal CTAs (48 AAA and 25 control CTA) by means of a DL-based segmentation pipeline built on a 2.5D convolutional neural network (CNN) architecture to segment lumen and thrombus of the aorta. The maximum aortic diameter of the abdominal tract was compared using a threshold value (30 mm). Blinded manual measurements from a radiologist were done in order to create a true comparison. The screening pipeline was tested on 48 patients with aneurysm and 25 without aneurysm. The average diameter manually measured was 51.1 ± 14.4 mm for patients with aneurysms and 21.7 ± 3.6 mm for patients without aneurysms. The pipeline correctly classified 47 AAA out of 48 and 24 control patients out of 25 with 97% accuracy, 98% sensitivity, and 96% specificity. The automated pipeline of aneurysm measurements in the abdominal tract reported a median error with regard to the maximum abdominal diameter measurement of 1.3 mm. Our approach allowed for the maximum diameter of 51.2 ± 14.3 mm in patients with aneurysm and 22.0 ± 4.0 mm in patients without an aneurysm. The DL-based screening for AAA is a feasible and accurate method, calling for further validation using a larger pool of diagnostic images towards its clinical use.
Collapse
Affiliation(s)
- Giovanni Spinella
- Department of Surgical Sciences and Integrated Diagnostics (DISC), University of Genoa, Viale Benedetto XV 6, 16132, Genoa, Italy.
- Vascular and Endovascular Surgery Clinic, IRCCS Ospedale Policlinico San Martino, Largo R. Benzi 10, 16132, Genoa, Italy.
| | | | | | - Elena Vincenzi
- Camelot Biomedical System, Genoa, Italy
- Department of Computer Science, Robotics and Systems Engineering, University of Genoa, BioengineeringGenoa, Italy
| | | | | | - Marco Magliocco
- Department of Civil Engineering and Architecture, University of Pavia, Pavia, Italy
| | - Bianca Pane
- Department of Surgical Sciences and Integrated Diagnostics (DISC), University of Genoa, Viale Benedetto XV 6, 16132, Genoa, Italy
- Vascular and Endovascular Surgery Clinic, IRCCS Ospedale Policlinico San Martino, Largo R. Benzi 10, 16132, Genoa, Italy
| | | | - Michele Conti
- Department of Civil Engineering and Architecture, University of Pavia, Pavia, Italy
| |
Collapse
|
4
|
An Extra Set of Intelligent Eyes: Application of Artificial Intelligence in Imaging of Abdominopelvic Pathologies in Emergency Radiology. Diagnostics (Basel) 2022; 12:diagnostics12061351. [PMID: 35741161 PMCID: PMC9221728 DOI: 10.3390/diagnostics12061351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/19/2022] [Accepted: 05/26/2022] [Indexed: 11/25/2022] Open
Abstract
Imaging in the emergent setting carries high stakes. With increased demand for dedicated on-site service, emergency radiologists face increasingly large image volumes that require rapid turnaround times. However, novel artificial intelligence (AI) algorithms may assist trauma and emergency radiologists with efficient and accurate medical image analysis, providing an opportunity to augment human decision making, including outcome prediction and treatment planning. While traditional radiology practice involves visual assessment of medical images for detection and characterization of pathologies, AI algorithms can automatically identify subtle disease states and provide quantitative characterization of disease severity based on morphologic image details, such as geometry and fluid flow. Taken together, the benefits provided by implementing AI in radiology have the potential to improve workflow efficiency, engender faster turnaround results for complex cases, and reduce heavy workloads. Although analysis of AI applications within abdominopelvic imaging has primarily focused on oncologic detection, localization, and treatment response, several promising algorithms have been developed for use in the emergency setting. This article aims to establish a general understanding of the AI algorithms used in emergent image-based tasks and to discuss the challenges associated with the implementation of AI into the clinical workflow.
Collapse
|