1
|
Raj A, Allababidi A, Kayed H, Gerken ALH, Müller J, Schoenberg SO, Zöllner FG, Rink JS. Streamlining Acute Abdominal Aortic Dissection Management-An AI-based CT Imaging Workflow. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01164-0. [PMID: 38864947 DOI: 10.1007/s10278-024-01164-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 05/24/2024] [Accepted: 06/04/2024] [Indexed: 06/13/2024]
Abstract
Life-threatening acute aortic dissection (AD) demands timely diagnosis for effective intervention. To streamline intrahospital workflows, automated detection of AD in abdominal computed tomography (CT) scans seems useful to assist humans. We aimed at creating a robust convolutional neural network (CNN)-based pipeline capable of real-time screening for signs of abdominal AD in CT. In this retrospective study, abdominal CT data from AD patients presenting with AD and from non-AD patients were collected (n 195, AD cases 94, mean age 65.9 years, female ratio 35.8%). A CNN-based algorithm was developed with the goal of enabling a robust, automated, and highly sensitive detection of abdominal AD. Two sets from internal (n = 32, AD cases 16) and external sources (n = 1189, AD cases 100) were procured for validation. The abdominal region was extracted, followed by the automatic isolation of the aorta region of interest (ROI) and highlighting of the membrane via edge extraction, followed by classification of the aortic ROI as dissected/healthy. A fivefold cross-validation was employed on the internal set, and an ensemble of the 5 trained models was used to predict the internal and external validation set. Evaluation metrics included receiver operating characteristic curve (AUC) and balanced accuracy. The AUC, balanced accuracy, and sensitivity scores of the internal dataset were 0.932 (CI 0.891-0.963), 0.860, and 0.885, respectively. For the internal validation dataset, the AUC, balanced accuracy, and sensitivity scores were 0.887 (CI 0.732-0.988), 0.781, and 0.875, respectively. Furthermore, for the external validation dataset, AUC, balanced accuracy, and sensitivity scores were 0.993 (CI 0.918-0.994), 0.933, and 1.000, respectively. The proposed automated pipeline could assist humans in expediting acute aortic dissection management when integrated into clinical workflows.
Collapse
Affiliation(s)
- Anish Raj
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany.
- Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany.
| | - Ahmad Allababidi
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Hany Kayed
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Andreas L H Gerken
- Department of Surgery, Medical Faculty Mannheim, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Julia Müller
- Mediri GmbH, Eppelheimer Straße 13, D-69115, Heidelberg, Germany
| | - Stefan O Schoenberg
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Frank G Zöllner
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
- Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| | - Johann S Rink
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Theodor-Kutzer-Ufer 1-3, D-68167, Mannheim, Germany
| |
Collapse
|
2
|
Langius-Wiffen E, Slotman DJ, Groeneveld J, Ac van Osch J, Nijholt IM, de Boer E, Nijboer-Oosterveld J, Veldhuis WB, de Jong PA, Boomsma MF. External validation of the RSNA 2020 pulmonary embolism detection challenge winning deep learning algorithm. Eur J Radiol 2024; 173:111361. [PMID: 38401407 DOI: 10.1016/j.ejrad.2024.111361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 01/17/2024] [Accepted: 02/08/2024] [Indexed: 02/26/2024]
Abstract
PURPOSE To evaluate the diagnostic performance and generalizability of the winning DL algorithm of the RSNA 2020 PE detection challenge to a local population using CTPA data from two hospitals. MATERIALS AND METHODS Consecutive CTPA images from patients referred for suspected PE were retrospectively analysed. The winning RSNA 2020 DL algorithm was retrained on the RSNA-STR Pulmonary Embolism CT (RSPECT) dataset. The algorithm was tested in hospital A on multidetector CT (MDCT) images of 238 patients and in hospital B on spectral detector CT (SDCT) and virtual monochromatic images (VMI) of 114 patients. The output of the DL algorithm was compared with a reference standard, which included a consensus reading by at least two experienced cardiothoracic radiologists for both hospitals. Areas under the receiver operating characteristic curve (AUCs) were calculated. Sensitivity and specificity were determined using the maximum Youden index. RESULTS According to the reference standard, PE was present in 73 patients (30.7%) in hospital A and 33 patients (29.0%) in hospital B. For the DL algorithm the AUC was 0.96 (95% CI 0.92-0.98) in hospital A, 0.89 (95% CI 0.81-0.94) for conventional reconstruction in hospital B and 0.87 (95% CI 0.80-0.93) for VMI. CONCLUSION The RSNA 2020 pulmonary embolism detection on CTPA challenge winning DL algorithm, retrained on the RSPECT dataset, showed high diagnostic accuracy on MDCT images. A somewhat lower performance was observed on SDCT images, which suggest additional training on novel CT technology may improve generalizability of this DL algorithm.
Collapse
Affiliation(s)
| | - Derk J Slotman
- Department of Radiology, Isala Hospital, Zwolle, the Netherlands; Department of Radiology, University Medical Centre Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Jorik Groeneveld
- Department of Radiology, Isala Hospital, Zwolle, the Netherlands
| | | | - Ingrid M Nijholt
- Department of Radiology, Isala Hospital, Zwolle, the Netherlands; Department of Radiology, University Medical Centre Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Erwin de Boer
- Department of Radiology, Isala Hospital, Zwolle, the Netherlands
| | | | - Wouter B Veldhuis
- Department of Radiology, University Medical Centre Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Pim A de Jong
- Department of Radiology, University Medical Centre Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Martijn F Boomsma
- Department of Radiology, Isala Hospital, Zwolle, the Netherlands; Department of Radiology, University Medical Centre Utrecht, Utrecht University, Utrecht, the Netherlands
| |
Collapse
|
3
|
Hussain A, Lee C, Hu E, Amirouche F. Deep learning automation of radiographic patterns for hallux valgus diagnosis. World J Orthop 2024; 15:105-109. [PMID: 38464350 PMCID: PMC10921175 DOI: 10.5312/wjo.v15.i2.105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 12/22/2023] [Accepted: 01/04/2024] [Indexed: 02/07/2024] Open
Abstract
Artificial intelligence (AI) and deep learning are becoming increasingly powerful tools in diagnostic and radiographic medicine. Deep learning has already been utilized for automated detection of pneumonia from chest radiographs, diabetic retinopathy, breast cancer, skin carcinoma classification, and metastatic lymphadenopathy detection, with diagnostic reliability akin to medical experts. In the World Journal of Orthopedics article, the authors apply an automated and AI-assisted technique to determine the hallux valgus angle (HVA) for assessing HV foot deformity. With the U-net neural network, the authors constructed an algorithm for pattern recognition of HV foot deformity from anteroposterior high-resolution radiographs. The performance of the deep learning algorithm was compared to expert clinician manual performance and assessed alongside clinician-clinician variability. The authors found that the AI tool was sufficient in assessing HVA and proposed the system as an instrument to augment clinical efficiency. Though further sophistication is needed to establish automated algorithms for more complicated foot pathologies, this work adds to the growing evidence supporting AI as a powerful diagnostic tool.
Collapse
Affiliation(s)
- Angela Hussain
- Department of Orthopaedic Surgery, University of Illinois College of Medicine, Chicago, IL 60612, United States
| | - Cadence Lee
- Department of Orthopaedic Surgery, University of Illinois College of Medicine, Chicago, IL 60612, United States
| | - Eric Hu
- Department of Orthopaedic Surgery, University of Illinois College of Medicine, Chicago, IL 60612, United States
| | - Farid Amirouche
- Department of Orthopaedics Surgery, University of Illinois at Chicago, Chicago, IL 60612, United States
- Department of Orthopaedic Surgery, Northshore University Health System, Skokie, IL 6007, United States
| |
Collapse
|
4
|
Berghea EC, Ionescu MD, Gheorghiu RM, Tincu IF, Cobilinschi CO, Craiu M, Bălgrădean M, Berghea F. Integrating Artificial Intelligence in Pediatric Healthcare: Parental Perceptions and Ethical Implications. CHILDREN (BASEL, SWITZERLAND) 2024; 11:240. [PMID: 38397353 PMCID: PMC10887612 DOI: 10.3390/children11020240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 01/30/2024] [Accepted: 02/09/2024] [Indexed: 02/25/2024]
Abstract
BACKGROUND Our study aimed to explore the way artificial intelligence (AI) utilization is perceived in pediatric medicine, examining its acceptance among patients (in this case represented by their adult parents), and identify the challenges it presents in order to understand the factors influencing its adoption in clinical settings. METHODS A structured questionnaire was applied to caregivers (parents or grandparents) of children who presented in tertiary pediatric clinics. RESULTS The most significant differentiations were identified in relation to the level of education (e.g., aversion to AI involvement was 22.2% among those with postgraduate degrees, 43.9% among those with university degrees, and 54.5% among those who only completed high school). The greatest fear among respondents regarding the medical use of AI was related to the possibility of errors occurring (70.1%). CONCLUSIONS The general attitude toward the use of AI can be considered positive, provided that it remains human-supervised, and that the technology used is explained in detail by the physician. However, there were large differences among groups (mainly defined by education level) in the way AI is perceived and accepted.
Collapse
Affiliation(s)
- Elena Camelia Berghea
- “Marie S. Curie” Emergency Children’s Clinical Hospital, Carol Davila University of Medicine and Pharmacy, 041451 Bucharest, Romania; (E.C.B.); (M.B.)
| | - Marcela Daniela Ionescu
- “Marie S. Curie” Emergency Children’s Clinical Hospital, Carol Davila University of Medicine and Pharmacy, 041451 Bucharest, Romania; (E.C.B.); (M.B.)
| | - Radu Marian Gheorghiu
- National Institute for Mother and Child Health “Alessandrescu-Rusescu”, Carol Davila University of Medicine and Pharmacy, 041249 Bucharest, Romania;
| | - Iulia Florentina Tincu
- Dr. Victor Gomoiu Clinical Children Hospital, Carol Davila University of Medicine and Pharmacy, 022102 Bucharest, Romania;
| | - Claudia Oana Cobilinschi
- Sfanta Maria Clinica Hospital, Carol Davila University of Medicine and Pharmacy, 011172 Bucharest, Romania; (C.O.C.); (F.B.)
| | - Mihai Craiu
- National Institute for Mother and Child Health “Alessandrescu-Rusescu”, Carol Davila University of Medicine and Pharmacy, 041249 Bucharest, Romania;
| | - Mihaela Bălgrădean
- “Marie S. Curie” Emergency Children’s Clinical Hospital, Carol Davila University of Medicine and Pharmacy, 041451 Bucharest, Romania; (E.C.B.); (M.B.)
| | - Florian Berghea
- Sfanta Maria Clinica Hospital, Carol Davila University of Medicine and Pharmacy, 011172 Bucharest, Romania; (C.O.C.); (F.B.)
| |
Collapse
|
5
|
Shevtsova D, Ahmed A, Boot IWA, Sanges C, Hudecek M, Jacobs JJL, Hort S, Vrijhoef HJM. Trust in and Acceptance of Artificial Intelligence Applications in Medicine: Mixed Methods Study. JMIR Hum Factors 2024; 11:e47031. [PMID: 38231544 PMCID: PMC10831593 DOI: 10.2196/47031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 09/25/2023] [Accepted: 11/20/2023] [Indexed: 01/18/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI)-powered technologies are being increasingly used in almost all fields, including medicine. However, to successfully implement medical AI applications, ensuring trust and acceptance toward such technologies is crucial for their successful spread and timely adoption worldwide. Although AI applications in medicine provide advantages to the current health care system, there are also various associated challenges regarding, for instance, data privacy, accountability, and equity and fairness, which could hinder medical AI application implementation. OBJECTIVE The aim of this study was to identify factors related to trust in and acceptance of novel AI-powered medical technologies and to assess the relevance of those factors among relevant stakeholders. METHODS This study used a mixed methods design. First, a rapid review of the existing literature was conducted, aiming to identify various factors related to trust in and acceptance of novel AI applications in medicine. Next, an electronic survey including the rapid review-derived factors was disseminated among key stakeholder groups. Participants (N=22) were asked to assess on a 5-point Likert scale (1=irrelevant to 5=relevant) to what extent they thought the various factors (N=19) were relevant to trust in and acceptance of novel AI applications in medicine. RESULTS The rapid review (N=32 papers) yielded 110 factors related to trust and 77 factors related to acceptance toward AI technology in medicine. Closely related factors were assigned to 1 of the 19 overarching umbrella factors, which were further grouped into 4 categories: human-related (ie, the type of institution AI professionals originate from), technology-related (ie, the explainability and transparency of AI application processes and outcomes), ethical and legal (ie, data use transparency), and additional factors (ie, AI applications being environment friendly). The categorized 19 umbrella factors were presented as survey statements, which were evaluated by relevant stakeholders. Survey participants (N=22) represented researchers (n=18, 82%), technology providers (n=5, 23%), hospital staff (n=3, 14%), and policy makers (n=3, 14%). Of the 19 factors, 16 (84%) human-related, technology-related, ethical and legal, and additional factors were considered to be of high relevance to trust in and acceptance of novel AI applications in medicine. The patient's gender, age, and education level were found to be of low relevance (3/19, 16%). CONCLUSIONS The results of this study could help the implementers of medical AI applications to understand what drives trust and acceptance toward AI-powered technologies among key stakeholders in medicine. Consequently, this would allow the implementers to identify strategies that facilitate trust in and acceptance of medical AI applications among key stakeholders and potential users.
Collapse
Affiliation(s)
- Daria Shevtsova
- Panaxea bv, Den Bosch, Netherlands
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | | | | | | | | | | | - Simon Hort
- Fraunhofer Institute for Production Technology, Aachen, Germany
| | | |
Collapse
|