1
|
Ling C, Arruzza E, Chau A, Parange N. What are the causes and outcomes of malpractice litigation in medical imaging technologists and sonographers? A scoping review. Radiography (Lond) 2025; 31:102922. [PMID: 40154260 DOI: 10.1016/j.radi.2025.102922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Revised: 01/17/2025] [Accepted: 03/06/2025] [Indexed: 04/01/2025]
Abstract
INTRODUCTION Medical imaging examinations are performed by radiographers, nuclear medicine technologists (NMT) and sonographers. Radiology litigation has been extensively studied, however, litigation involving imaging professionals is not. This scoping review aims to identify the causes and outcomes of malpractice litigation among medical imaging technologists and sonographers. METHODS A scoping review in accordance with the Joanna Briggs Institute Manual for Evidence Synthesis and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses - Scoping Review checklist was performed using five databases and five grey literature sources. Australian professional bodies, insurance companies and coronial services were contacted. Literature published between 2018-2023 were included. No exclusions were placed on the practitioner's age, sex, or levels of clinical experience. RESULTS Thirty-five cases and one study were included. Of the 35 cases, 26 were radiographer cases (X-ray and magnetic resonance imaging), one was a NMT case and eight were sonographer cases. The main categories that led to litigation for radiographers were unprofessional behaviour (16.87%), lack of competency and/or misconduct (13.25%) and errors in imaging technique (9.64%). Lack of competency and/or misconduct (17.02%), operator-dependent errors (12.77%) and incorrect reporting and/or documentation issues (10.64%) were the main categories for sonographer litigation. Being struck off from a professional register was the most common case outcome (22.64%) for radiographers, while conditions of practice (20.00%), voluntary removal (20.00%) and suspension (20.00%) were equally tied for sonographer case outcomes. CONCLUSION Categories of malpractice litigation and discipline-specific technical errors leading to litigation were identified for MITs and sonographers. Lack of studies in this area suggest further research is required to confirm our findings. IMPLICATIONS FOR PRACTICE Identifying the common causes of malpractice litigation can reveal strategies to mitigate litigation risks and improve patient safety. Our findings can educate students, practitioners and promote best practice policies.
Collapse
Affiliation(s)
- C Ling
- Allied Health and Human Performance Unit, University of South Australia (UniSA), Corner of North Terrace and Frome Rd, GPO Box 2471, Adelaide, SA 5001, Australia.
| | - E Arruzza
- Allied Health and Human Performance Unit, University of South Australia (UniSA), Corner of North Terrace and Frome Rd, GPO Box 2471, Adelaide, SA 5001, Australia
| | - A Chau
- Allied Health and Human Performance Unit, University of South Australia (UniSA), Corner of North Terrace and Frome Rd, GPO Box 2471, Adelaide, SA 5001, Australia
| | - N Parange
- Allied Health and Human Performance Unit, University of South Australia (UniSA), Corner of North Terrace and Frome Rd, GPO Box 2471, Adelaide, SA 5001, Australia
| |
Collapse
|
2
|
Shetty S, Talaat W, Al-Rawi N, Al Kawas S, Sadek M, Elayyan M, Gaballah K, Narasimhan S, Ozsahin I, Ozsahin DU, David LR. Accuracy of deep learning models in the detection of accessory ostium in coronal cone beam computed tomographic images. Sci Rep 2025; 15:8324. [PMID: 40064998 PMCID: PMC11894202 DOI: 10.1038/s41598-025-93250-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2024] [Accepted: 03/05/2025] [Indexed: 03/14/2025] Open
Abstract
Accessory ostium [AO] is one of the important anatomical variations in the maxillary sinus. AO is often associated with sinus pathology. Radiographic imaging plays a very important role in the detection of AO. Deep learning models have been used in maxillofacial imaging for interpretation and segmentation. However, there have been no research papers investigating the effectiveness of CNN in detecting AO in radiographs. To fill this gap of knowledge, we conducted a study to determine the accuracy of deep learning models in detecting AO in coronal CBCT images. Two examiners collected 454 coronal section images (227 with AO and 227 without AO) from 856 large field of view [FOV] cone beam tomography [CBCT] scans in the dental radiology archives of a teaching hospital. The collected images were then pre-processed and augmented to obtain 1260 images. Three pre-trained models, the Visual Geometry Group of the University of Oxford-16 layers [VGG16], MobileNetV2, and ResNet101V2, were used as base models. The performance of all the models was analyzed, and ResNet101v2 was selected for classification of images. Fine-tuning approach was employed with L1 (Lasso regression) regularization to avoid overfitting. The test accuracy and loss of the ResNet-101V2 classification model was 0.81 and 0.51, respectively. The precision, recall, F1-score, and AUC of the classification model were 0.82, 0.81, 0.81, and 0.87 respectively. ResNet-101V2 showed good accuracy in the detection of AO from coronal CBCT images. The present study used cropped two-dimensional images of CBCT scans. Future work can be carried out to determine the accuracy of deep learning models in the detection of AO in three-dimensional CBCT scans.
Collapse
Affiliation(s)
- Shishir Shetty
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates.
| | - Wael Talaat
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Natheer Al-Rawi
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Sausan Al Kawas
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Mais Sadek
- Department of Orthodontics, Pediatric and Community Dentistry, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
- Faculty of Dentistry, Ain Shams University, Cairo, Egypt
| | - Malak Elayyan
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Kamis Gaballah
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Sangeetha Narasimhan
- Department of Oral and Craniofacial Health Sciences, College of Dental medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Ilker Ozsahin
- Operational Research Center in Healthcare, Near East University, TRNC, Nicosia, Turkey
| | - Dilber Uzun Ozsahin
- Department of Medical Diagnostic Imaging, College of Health Sciences, University of Sharjah, Sharjah, United Arab Emirates.
| | - Leena R David
- Department of Medical Diagnostic Imaging, College of Health Sciences, University of Sharjah, Sharjah, United Arab Emirates.
| |
Collapse
|
3
|
Shim S, Kim MS, Yae CG, Kang YK, Do JR, Kim HK, Yang HL. Development and validation of a multi-stage self-supervised learning model for optical coherence tomography image classification. J Am Med Inform Assoc 2025:ocaf021. [PMID: 40037789 DOI: 10.1093/jamia/ocaf021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 11/03/2024] [Accepted: 01/23/2025] [Indexed: 03/06/2025] Open
Abstract
OBJECTIVE This study aimed to develop a novel multi-stage self-supervised learning model tailored for the accurate classification of optical coherence tomography (OCT) images in ophthalmology reducing reliance on costly labeled datasets while maintaining high diagnostic accuracy. MATERIALS AND METHODS A private dataset of 2719 OCT images from 493 patients was employed, along with 3 public datasets comprising 84 484 images from 4686 patients, 3231 images from 45 patients, and 572 images. Extensive internal, external, and clinical validation were performed to assess model performance. Grad-CAM was employed for qualitative analysis to interpret the model's decisions by highlighting relevant areas. Subsampling analyses evaluated the model's robustness with varying labeled data availability. RESULTS The proposed model outperformed conventional supervised or self-supervised learning-based models, achieving state-of-the-art results across 3 public datasets. In a clinical validation, the model exhibited up to 17.50% higher accuracy and 17.53% higher macro F-1 score than a supervised learning-based model under limited training data. DISCUSSION The model's robustness in OCT image classification underscores the potential of the multi-stage self-supervised learning to address challenges associated with limited labeled data. The availability of source codes and pre-trained models promotes the use of this model in a variety of clinical settings, facilitating broader adoption. CONCLUSION This model offers a promising solution for advancing OCT image classification, achieving high accuracy while reducing the cost of extensive expert annotation and potentially streamlining clinical workflows, thereby supporting more efficient patient management.
Collapse
Affiliation(s)
- Sungho Shim
- Department of Electrical Engineering and Computer Science, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Daegu 42988, Republic of Korea
| | - Min-Soo Kim
- School of Computing, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Che Gyem Yae
- Department of Ophthalmology, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea
| | - Yong Koo Kang
- Department of Ophthalmology, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea
| | - Jae Rock Do
- Department of Ophthalmology, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea
| | - Hong Kyun Kim
- Department of Ophthalmology, School of Medicine, Kyungpook National University, Daegu 41944, Republic of Korea
| | - Hyun-Lim Yang
- Office of Hospital Information, Seoul National University Hospital, Seoul 03080, Republic of Korea
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul 03080, Republic of Korea
- Department of Medicine, College of Medicine, Seoul National University, Seoul 03080, Republic of Korea
| |
Collapse
|
4
|
Raissaki M, Stafrace S, Kozana A, Nievelstein RAJ, Papaioannou G. Collaborating with non-radiological clinical colleagues. Pediatr Radiol 2025; 55:397-410. [PMID: 39168913 DOI: 10.1007/s00247-024-06027-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 08/05/2024] [Accepted: 08/05/2024] [Indexed: 08/23/2024]
Abstract
Paediatric radiology is a challenging and intriguing subspecialty, dealing with children, guardians and non-radiological clinical colleagues. Paediatric radiologists are routinely in contact with numerous paediatric and surgical subspecialties, all having different needs, perceptions, prioritisations and expectations. Moreover, the radiologist is part of the team of radiographers, sonographers, nurses and secretaries, assisted by appropriate equipment and electronic tools. The framework of good collaboration to ensure safety and effectiveness for the imaged child is a shared responsibility among all medical practitioners involved. Communication in routine practice has many forms and includes appropriately filled radiology requests in accordance to the patient's medical records, routine and timely production of structured, problem-solving radiology reports, face-to-face or electronic-assisted communications and discussions on a pre-defined framework, mutually-agreed and evidence-based protocols adjusted to local availability, skills and national and international guidelines. Mutual understanding of advantages and limitations of imaging is paramount. Well-meant discussions, professionalism and empathy should promote soft skills, bidirectional communication and good collaboration for the benefit of added-value paediatric radiology. International societies, health authorities, medical directors and senior consultants have the responsibility to suggest and safeguard frameworks and recommendations. Regular multidisciplinary meetings and multidisciplinary research projects under openness, honesty and transparency are pathways favouring good collaboration.
Collapse
Affiliation(s)
- Maria Raissaki
- Department of Radiology, University Hospital of Heraklion, University of Crete, Stavrakia Medical School Campus, 71110, Heraklion, Crete, Greece.
| | - Samuel Stafrace
- Department of Radiology, McMaster Children's Hospital, McMaster University, Hamilton, Ontario, Canada
| | - Androniki Kozana
- Department of Radiology, University Hospital of Heraklion, Heraklion, Crete, Greece
| | - Rutger A J Nievelstein
- Division Imaging & Oncology, Department of Radiology & Nuclear Medicine, UMC Utrecht/Wilhelmina Children's Hospital, Utrecht, The Netherlands
| | - Georgia Papaioannou
- Department of Pediatric Radiology, Mitera Maternal and Children's Hospital, Athens, Greece
| |
Collapse
|
5
|
Dramburg S. [Artificial intelligence in paediatric pneumology - opportunities and unanswered questions]. KLINISCHE PADIATRIE 2025; 237:73-80. [PMID: 39900085 DOI: 10.1055/a-2511-8548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2025]
Abstract
Artificial intelligence (AI) is already being used in most medical disciplines, including paediatric pneumology. This review describes current developments in AI-supported technologies and discusses their potential for the diagnosis and treatment of lung diseases in children and adolescents. The spectrum ranges from models for analysing respiratory sounds and the automated evaluation of medical imaging to systems for supporting clinical decisions. In particular, challenges in the adaptation of AI for paediatric populations are also described. Finally, open questions, such as the implementation of AI-based software in everyday clinical practice, will be discussed.
Collapse
Affiliation(s)
- Stephanie Dramburg
- Department of Pediatric Respiratory Care, Immunology and Intensive Care Medicine, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
6
|
Kumar R, Singh A, Kassar ASA, Humaida MI, Joshi S, Sharma M. Unlocking the Power of AI: Healthcare Workforce Perception and Its Impact on their Work Performance in Saudi Arabia. Pak J Med Sci 2025; 41:682-686. [PMID: 40103878 PMCID: PMC11911756 DOI: 10.12669/pjms.41.3.11014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Revised: 02/01/2025] [Accepted: 02/19/2025] [Indexed: 03/20/2025] Open
Abstract
Objective To investigate the perception of AI among the healthcare workforce and its impact on their performance, with technology readiness acting as a moderating factor. Methods In this cross-sectional study, a close-ended, self-administered survey questionnaire was used between 02 June to 04 August, 2024 to collect responses from 434 participants working in the public hospitals in Hail health cluster in Saudi Arabia. The study employed demographic summaries, descriptive statistics, regression analysis using Hayes' Process, and regression diagnostics for data analysis. The data were analyzed using SPSS version 27. Results The participant demographics indicated a majority of male respondents from the medical field, primarily aged between 36-45 years. Most participants had 9-10 or more years of experience in their current position and held graduate degrees in the healthcare sector of Saudi Arabia. Regression analysis using Hayes' Process showed an insignificant negative impact of AI perception on workforce performance (β_1 = -0.0062, p = .315). However, technology readiness significantly moderated this effect, turning it into a positive and significant impact (β_3 = 0.2512, p = .0209). Conclusion The study demonstrates that while AI perception alone has a negligible effect on workforce performance, its influence becomes significant when moderated by higher levels of technology readiness. Future research should examine how factors such as organizational culture and resource availability influence AI perceptions in healthcare.
Collapse
Affiliation(s)
- Rakesh Kumar
- Rakesh Kumar, PhD Department of Health Management, College of Public Health and Health Informatics, University of Hail, Saudi Arabia
| | - Ajay Singh
- Ajay Singh, PhD Department of Management & Information Systems, College of Business Administration, University of Hail, Saudi Arabia
| | - Ahmed Subahi Ahmed Kassar
- Ahmed Subahi Ahmed Kassar, PhD Department of Public Health, College of Public Health and Health Informatics, University of Hail, Saudi Arabia
| | - Mohammed Ismail Humaida
- Mohammed Ismail Humaida, PhD Department of Public Health, College of Public Health and Health Informatics, University of Hail, Saudi Arabia
| | - Sudhanshu Joshi
- Sudhanshu Joshi, PhD School of Management, Doon University, Dehradun, Uttarakhand, India
| | - Manu Sharma
- Manu Sharma, PhD Department of Management Studies, Graphic Era University, Dehradun, Uttarakhand, India
| |
Collapse
|
7
|
Bellvert Rios A. [An optimistic look at the futuristic present: AI at the service of Primary Care]. Semergen 2025; 51:102450. [PMID: 40020534 DOI: 10.1016/j.semerg.2025.102450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2024] [Revised: 01/10/2025] [Accepted: 01/16/2025] [Indexed: 03/03/2025]
|
8
|
Melazzini L, Bortolotto C, Brizzi L, Achilli M, Basla N, D'Onorio De Meo A, Gerbasi A, Bottinelli OM, Bellazzi R, Preda L. AI for image quality and patient safety in CT and MRI. Eur Radiol Exp 2025; 9:28. [PMID: 39987533 PMCID: PMC11847764 DOI: 10.1186/s41747-025-00562-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2024] [Accepted: 01/27/2025] [Indexed: 02/25/2025] Open
Abstract
Substantial endeavors have been recently dedicated to developing artificial intelligence (AI) solutions, especially deep learning-based, tailored to enhance radiological procedures, in particular algorithms designed to minimize radiation exposure and enhance image clarity. Thus, not only better diagnostic accuracy but also reduced potential harm to patients was pursued, thereby exemplifying the intersection of technological innovation and the highest standards of patient care. We provide herein an overview of recent AI developments in computed tomography and magnetic resonance imaging. Major AI results in CT regard: optimization of patient positioning, scan range selection (avoiding "overscanning"), and choice of technical parameters; reduction of the amount of injected contrast agent and injection flow rate (also avoiding extravasation); faster and better image reconstruction reducing noise level and artifacts. Major AI results in MRI regard: reconstruction of undersampled images; artifact removal, including those derived from unintentional patient's (or fetal) movement or from heart motion; up to 80-90% reduction of GBCA dose. Challenges include limited generalizability, lack of external validation, insufficient explainability of models, and opacity of decision-making. Developing explainable AI algorithms that provide transparent and interpretable outputs is essential to enable seamless AI integration into CT and MRI practice. RELEVANCE STATEMENT: This review highlights how AI-driven advancements in CT and MRI improve image quality and enhance patient safety by leveraging AI solutions for dose reduction, contrast optimization, noise reduction, and efficient image reconstruction, paving the way for safer, faster, and more accurate diagnostic imaging practices. KEY POINTS: Advancements in AI are revolutionizing the way radiological images are acquired, reconstructed, and interpreted. AI algorithms can assist in optimizing radiation doses, reducing scan times, and enhancing image quality. AI techniques are paving the way for a future of more efficient, accurate, and safe medical imaging examinations.
Collapse
Affiliation(s)
- Luca Melazzini
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
| | - Chandra Bortolotto
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
- Department of Radiology, IRCCS Policlinico San Matteo, Pavia, Italy
| | - Leonardo Brizzi
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy.
| | - Marina Achilli
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
| | - Nicoletta Basla
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
| | | | - Alessia Gerbasi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Olivia Maria Bottinelli
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Lorenzo Preda
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
- Department of Radiology, IRCCS Policlinico San Matteo, Pavia, Italy
| |
Collapse
|
9
|
Kim SH, Schramm S, Riedel EO, Schmitzer L, Rosenkranz E, Kertels O, Bodden J, Paprottka K, Sepp D, Renz M, Kirschke J, Baum T, Maegerlein C, Boeckh-Behrens T, Zimmer C, Wiestler B, Hedderich DM. Automation bias in AI-assisted detection of cerebral aneurysms on time-of-flight MR angiography. LA RADIOLOGIA MEDICA 2025:10.1007/s11547-025-01964-6. [PMID: 39939458 DOI: 10.1007/s11547-025-01964-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Accepted: 01/23/2025] [Indexed: 02/14/2025]
Abstract
PURPOSE To determine how automation bias (inclination of humans to overly trust-automated decision-making systems) can affect radiologists when interpreting AI-detected cerebral aneurysm findings in time-of-flight magnetic resonance angiography (TOF-MRA) studies. MATERIAL AND METHODS Nine radiologists with varying levels of experience evaluated twenty TOF-MRA examinations for the presence of cerebral aneurysms. Every case was evaluated with and without assistance by the AI software © mdbrain, with a washout period of at least four weeks in-between. Half of the cases included at least one false-positive AI finding. Aneurysm ratings, follow-up recommendations, and reading times were assessed using the Wilcoxon signed-rank test. RESULTS False-positive AI results led to significantly higher suspicion of aneurysm findings (p = 0.01). Inexperienced readers further recommended significantly more intense follow-up examinations when presented with false-positive AI findings (p = 0.005). Reading times were significantly shorter with AI assistance in inexperienced (164.1 vs 228.2 s; p < 0.001), moderately experienced (126.2 vs 156.5 s; p < 0.009), and very experienced (117.9 vs 153.5 s; p < 0.001) readers alike. CONCLUSION Our results demonstrate the susceptibility of radiology readers to automation bias in detecting cerebral aneurysms in TOF-MRA studies when encountering false-positive AI findings. While AI systems for cerebral aneurysm detection can provide benefits, challenges in human-AI interaction need to be mitigated to ensure safe and effective adoption.
Collapse
Affiliation(s)
- Su Hwan Kim
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany.
| | - Severin Schramm
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Evamaria Olga Riedel
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Lena Schmitzer
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Enrike Rosenkranz
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Olivia Kertels
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Jannis Bodden
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Karolin Paprottka
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Dominik Sepp
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Martin Renz
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Jan Kirschke
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Thomas Baum
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Christian Maegerlein
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Tobias Boeckh-Behrens
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Claus Zimmer
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Benedikt Wiestler
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Dennis M Hedderich
- Institute of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine and Health, Technical University of Munich, Munich, Germany
| |
Collapse
|
10
|
Chowdhury MA, Rizk R, Chiu C, Zhang JJ, Scholl JL, Bosch TJ, Singh A, Baugh LA, McGough JS, Santosh KC, Chen WC. The Heart of Transformation: Exploring Artificial Intelligence in Cardiovascular Disease. Biomedicines 2025; 13:427. [PMID: 40002840 PMCID: PMC11852486 DOI: 10.3390/biomedicines13020427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Revised: 01/23/2025] [Accepted: 01/24/2025] [Indexed: 02/27/2025] Open
Abstract
The application of artificial intelligence (AI) and machine learning (ML) in medicine and healthcare has been extensively explored across various areas. AI and ML can revolutionize cardiovascular disease management by significantly enhancing diagnostic accuracy, disease prediction, workflow optimization, and resource utilization. This review summarizes current advancements in AI and ML concerning cardiovascular disease, including their clinical investigation and use in primary cardiac imaging techniques, common cardiovascular disease categories, clinical research, patient care, and outcome prediction. We analyze and discuss commonly used AI and ML models, algorithms, and methodologies, highlighting their roles in improving clinical outcomes while addressing current limitations and future clinical applications. Furthermore, this review emphasizes the transformative potential of AI and ML in cardiovascular practice by improving clinical decision making, reducing human error, enhancing patient monitoring and support, and creating more efficient healthcare workflows for complex cardiovascular conditions.
Collapse
Affiliation(s)
- Mohammed A. Chowdhury
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
- Health Sciences Ph.D. Program, Department of Public Health & Health Sciences, School of Health Sciences, University of South Dakota, Vermillion, SD 57069, USA
- Pulmonary Vascular Disease Program, Brigham and Women’s Hospital, Boston, MA 02115, USA
| | - Rodrigue Rizk
- AI Research Lab, Department of Computer Science, University of South Dakota, Vermillion, SD 57069, USA;
| | - Conroy Chiu
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
| | - Jing J. Zhang
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
| | - Jamie L. Scholl
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
| | - Taylor J. Bosch
- Department of Psychology, University of South Dakota, Vermillion, SD 57069, USA;
| | - Arun Singh
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
| | - Lee A. Baugh
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
| | - Jeffrey S. McGough
- Department of Electrical Engineering and Computer Science, South Dakota School of Mines and Technology, Rapid City, SD 57701, USA
| | - KC Santosh
- AI Research Lab, Department of Computer Science, University of South Dakota, Vermillion, SD 57069, USA;
| | - William C.W. Chen
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD 57069, USA; (M.A.C.); (C.C.); (J.J.Z.); (J.L.S.); (A.S.); (L.A.B.)
- Health Sciences Ph.D. Program, Department of Public Health & Health Sciences, School of Health Sciences, University of South Dakota, Vermillion, SD 57069, USA
| |
Collapse
|
11
|
Lekadir K, Frangi AF, Porras AR, Glocker B, Cintas C, Langlotz CP, Weicken E, Asselbergs FW, Prior F, Collins GS, Kaissis G, Tsakou G, Buvat I, Kalpathy-Cramer J, Mongan J, Schnabel JA, Kushibar K, Riklund K, Marias K, Amugongo LM, Fromont LA, Maier-Hein L, Cerdá-Alberich L, Martí-Bonmatí L, Cardoso MJ, Bobowicz M, Shabani M, Tsiknakis M, Zuluaga MA, Fritzsche MC, Camacho M, Linguraru MG, Wenzel M, De Bruijne M, Tolsgaard MG, Goisauf M, Cano Abadía M, Papanikolaou N, Lazrak N, Pujol O, Osuala R, Napel S, Colantonio S, Joshi S, Klein S, Aussó S, Rogers WA, Salahuddin Z, Starmans MPA. FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare. BMJ 2025; 388:e081554. [PMID: 39909534 PMCID: PMC11795397 DOI: 10.1136/bmj-2024-081554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/10/2025] [Indexed: 02/07/2025]
Affiliation(s)
- Karim Lekadir
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| | - Alejandro F Frangi
- Center for Computational Imaging & Simulation Technologies in Biomedicine, Schools of Computing and Medicine, University of Leeds, Leeds, UK
- Medical Imaging Research Centre (MIRC), Cardiovascular Science and Electronic Engineering Departments, KU Leuven, Leuven, Belgium
| | - Antonio R Porras
- Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
| | - Ben Glocker
- Department of Computing, Imperial College London, London, UK
| | | | - Curtis P Langlotz
- Departments of Radiology, Medicine, and Biomedical Data Science, Stanford University School of Medicine, Stanford, CA, USA
| | - Eva Weicken
- Fraunhofer Heinrich Hertz Institute, Berlin, Germany
| | - Folkert W Asselbergs
- Amsterdam University Medical Centers, Department of Cardiology, University of Amsterdam, Amsterdam, Netherlands
- Health Data Research UK and Institute of Health Informatics, University College London, London, UK
| | - Fred Prior
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Gary S Collins
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Georgios Kaissis
- Institute for AI and Informatics in Medicine, Klinikum rechts der Isar, Technical University Munich, Munich, Germany
| | - Gianna Tsakou
- Gruppo Maggioli, Research and Development Lab, Athens, Greece
| | | | | | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
| | - Julia A Schnabel
- Institute of Machine Learning in Biomedical Imaging, Helmholtz Center Munich, Munich, Germany
| | - Kaisar Kushibar
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Katrine Riklund
- Department of Radiation Sciences, Diagnostic Radiology, Umeå University, Umeå, Sweden
| | - Kostas Marias
- Foundation for Research and Technology-Hellas (FORTH), Crete, Greece
| | - Lameck M Amugongo
- Department of Software Engineering, Namibia University of Science & Technology, Windhoek, Namibia
| | - Lauren A Fromont
- Centre for Genomic Regulation, Barcelona Institute of Science and Technology, Barcelona, Spain
| | - Lena Maier-Hein
- Division of Intelligent Medical Systems, German Cancer Research Centre, Heidelberg, Germany
| | | | - Luis Martí-Bonmatí
- Medical Imaging Department, Hospital Universitario y Politécnico La Fe, Valencia, Spain
| | - M Jorge Cardoso
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, UK
| | - Maciej Bobowicz
- 2nd Division of Radiology, Medical University of Gdansk, Gdansk, Poland
| | - Mahsa Shabani
- Faculty of Law and Criminology, Ghent University, Ghent, Belgium
| | - Manolis Tsiknakis
- Foundation for Research and Technology-Hellas (FORTH), Crete, Greece
| | | | | | - Marina Camacho
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Marius George Linguraru
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington DC, USA
| | - Markus Wenzel
- Fraunhofer Heinrich Hertz Institute, Berlin, Germany
| | - Marleen De Bruijne
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Centre, Rotterdam, Netherlands
| | - Martin G Tolsgaard
- Copenhagen Academy for Medical Education and Simulation Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | | | | | | | - Noussair Lazrak
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Oriol Pujol
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Richard Osuala
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Sandy Napel
- Integrative Biomedical Imaging Informatics at Stanford (IBIIS), Department of Radiology, Stanford University, Stanford, CA, USA
| | - Sara Colantonio
- Institute of Information Science and Technologies of the National Research Council of Italy, Pisa, Italy
| | - Smriti Joshi
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Stefan Klein
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Centre, Rotterdam, Netherlands
| | - Susanna Aussó
- Artificial Intelligence in Healthcare Program, TIC Salut Social Foundation, Barcelona, Spain
| | - Wendy A Rogers
- Department of Philosophy, and School of Medicine, Macquarie University, Sydney, Australia
| | - Zohaib Salahuddin
- The D-lab, Department of Precision Medicine, GROW-School for Oncology and Reproduction, Maastricht University, Maastricht, Netherlands
| | - Martijn P A Starmans
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Centre, Rotterdam, Netherlands
| |
Collapse
|
12
|
Xie Y, Zhai Y, Lu G. Evolution of artificial intelligence in healthcare: a 30-year bibliometric study. Front Med (Lausanne) 2025; 11:1505692. [PMID: 39882522 PMCID: PMC11775008 DOI: 10.3389/fmed.2024.1505692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 12/31/2024] [Indexed: 01/31/2025] Open
Abstract
Introduction In recent years, the development of artificial intelligence (AI) technologies, including machine learning, deep learning, and large language models, has significantly supported clinical work. Concurrently, the integration of artificial intelligence with the medical field has garnered increasing attention from medical experts. This study undertakes a dynamic and longitudinal bibliometric analysis of AI publications within the healthcare sector over the past three decades to investigate the current status and trends of the fusion between medicine and artificial intelligence. Methods Following a search on the Web of Science, researchers retrieved all reviews and original articles concerning artificial intelligence in healthcare published between January 1993 and December 2023. The analysis employed Bibliometrix, Biblioshiny, and Microsoft Excel, incorporating the bibliometrix R package for data mining and analysis, and visualized the observed trends in bibliometrics. Results A total of 22,950 documents were collected in this study. From 1993 to 2023, there was a discernible upward trajectory in scientific output within bibliometrics. The United States and China emerged as primary contributors to medical artificial intelligence research, with Harvard University leading in publication volume among institutions. Notably, the rapid expansion of emerging topics such as COVID-19 and new drug discovery in recent years is noteworthy. Furthermore, the top five most cited papers in 2023 were all pertinent to the theme of ChatGPT. Conclusion This study reveals a sustained explosive growth trend in AI technologies within the healthcare sector in recent years, with increasingly profound applications in medicine. Additionally, medical artificial intelligence research is dynamically evolving with the advent of new technologies. Moving forward, concerted efforts to bolster international collaboration and enhance comprehension and utilization of AI technologies are imperative for fostering novel innovations in healthcare.
Collapse
Affiliation(s)
- Yaojue Xie
- Yangjiang Bainian Yanshen Medical Technology Co., Ltd., Yangjiang, China
| | - Yuansheng Zhai
- Department of Cardiology, Heart Center, First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- NHC Key Laboratory of Assisted Circulation (Sun Yat-sen University), Guangzhou, China
| | - Guihua Lu
- Department of Cardiology, Heart Center, First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- NHC Key Laboratory of Assisted Circulation (Sun Yat-sen University), Guangzhou, China
| |
Collapse
|
13
|
Sasseville M, Ouellet S, Rhéaume C, Sahlia M, Couture V, Després P, Paquette JS, Darmon D, Bergeron F, Gagnon MP. Bias Mitigation in Primary Health Care Artificial Intelligence Models: Scoping Review. J Med Internet Res 2025; 27:e60269. [PMID: 39773888 PMCID: PMC11751650 DOI: 10.2196/60269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Revised: 09/26/2024] [Accepted: 11/07/2024] [Indexed: 01/11/2025] Open
Abstract
BACKGROUND Artificial intelligence (AI) predictive models in primary health care have the potential to enhance population health by rapidly and accurately identifying individuals who should receive care and health services. However, these models also carry the risk of perpetuating or amplifying existing biases toward diverse groups. We identified a gap in the current understanding of strategies used to assess and mitigate bias in primary health care algorithms related to individuals' personal or protected attributes. OBJECTIVE This study aimed to describe the attempts, strategies, and methods used to mitigate bias in AI models within primary health care, to identify the diverse groups or protected attributes considered, and to evaluate the results of these approaches on both bias reduction and AI model performance. METHODS We conducted a scoping review following Joanna Briggs Institute (JBI) guidelines, searching Medline (Ovid), CINAHL (EBSCO), PsycINFO (Ovid), and Web of Science databases for studies published between January 1, 2017, and November 15, 2022. Pairs of reviewers independently screened titles and abstracts, applied selection criteria, and performed full-text screening. Discrepancies regarding study inclusion were resolved by consensus. Following reporting standards for AI in health care, we extracted data on study objectives, model features, targeted diverse groups, mitigation strategies used, and results. Using the mixed methods appraisal tool, we appraised the quality of the studies. RESULTS After removing 585 duplicates, we screened 1018 titles and abstracts. From the remaining 189 full-text articles, we included 17 studies. The most frequently investigated protected attributes were race (or ethnicity), examined in 12 of the 17 studies, and sex (often identified as gender), typically classified as "male versus female" in 10 of the studies. We categorized bias mitigation approaches into four clusters: (1) modifying existing AI models or datasets, (2) sourcing data from electronic health records, (3) developing tools with a "human-in-the-loop" approach, and (4) identifying ethical principles for informed decision-making. Algorithmic preprocessing methods, such as relabeling and reweighing data, along with natural language processing techniques that extract data from unstructured notes, showed the greatest potential for bias mitigation. Other methods aimed at enhancing model fairness included group recalibration and the application of the equalized odds metric. However, these approaches sometimes exacerbated prediction errors across groups or led to overall model miscalibrations. CONCLUSIONS The results suggest that biases toward diverse groups are more easily mitigated when data are open-sourced, multiple stakeholders are engaged, and during the algorithm's preprocessing stage. Further empirical studies that include a broader range of groups, such as Indigenous peoples in Canada, are needed to validate and expand upon these findings. TRIAL REGISTRATION OSF Registry osf.io/9ngz5/; https://osf.io/9ngz5/. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/46684.
Collapse
Affiliation(s)
- Maxime Sasseville
- Faculté des sciences infirmières, Université Laval, Québec, QC, Canada
- Vitam Research Center on Sustainable Health, Québec, QC, Canada
| | - Steven Ouellet
- Faculté des sciences infirmières, Université Laval, Québec, QC, Canada
| | - Caroline Rhéaume
- Vitam Research Center on Sustainable Health, Québec, QC, Canada
- Département de médecine familiale et de médecine d'urgence de la Faculté de médecine, Université Laval, Québec, QC, Canada
- Research Center of Quebec Heart and Lungs Institute, Québec, QC, Canada
| | - Malek Sahlia
- École Nationale des Sciences de l'Informatique, Université de La Manouba, La Manouba, Tunisia
| | - Vincent Couture
- Faculté des sciences infirmières, Université Laval, Québec, QC, Canada
| | - Philippe Després
- Département de physique, de génie physique et d'optique de la Faculté des sciences et de génie, Université Laval, Québec, QC, Canada
| | - Jean-Sébastien Paquette
- Vitam Research Center on Sustainable Health, Québec, QC, Canada
- Département de médecine familiale et de médecine d'urgence de la Faculté de médecine, Université Laval, Québec, QC, Canada
| | - David Darmon
- Risques, Epidémiologie, Territoires, Informations, Education et Santé. Département d'enseignement et de recherche en médecine générale, Université Côte d'Azur, Nice, France
| | - Frédéric Bergeron
- Direction des services-conseils de la Bibliothèque, Université Laval, Québec, QC, Canada
| | - Marie-Pierre Gagnon
- Faculté des sciences infirmières, Université Laval, Québec, QC, Canada
- Vitam Research Center on Sustainable Health, Québec, QC, Canada
| |
Collapse
|
14
|
Nadeem A, Ashraf R, Mahmood T, Parveen S. Automated CAD system for early detection and classification of pancreatic cancer using deep learning model. PLoS One 2025; 20:e0307900. [PMID: 39752442 PMCID: PMC11698441 DOI: 10.1371/journal.pone.0307900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Accepted: 07/10/2024] [Indexed: 01/06/2025] Open
Abstract
Accurate diagnosis of pancreatic cancer using CT scan images is critical for early detection and treatment, potentially saving numerous lives globally. Manual identification of pancreatic tumors by radiologists is challenging and time-consuming due to the complex nature of CT scan images and variations in tumor shape, size, and location of the pancreatic tumor also make it challenging to detect and classify different types of tumors. Thus, to address this challenge we proposed a four-stage framework of computer-aided diagnosis systems. In the preprocessing stage, the input image resizes into 227 × 227 dimensions then converts the RGB image into a grayscale image, and enhances the image by removing noise without blurring edges by applying anisotropic diffusion filtering. In the segmentation stage, the preprocessed grayscale image a binary image is created based on a threshold, highlighting the edges by Sobel filtering, and watershed segmentation to segment the tumor region and we also implement the U-Net method for segmentation. Then refine the geometric structure of the image using morphological operation and extracting the texture features from the image using a gray-level co-occurrence matrix computed by analyzing the spatial relationship of pixel intensities in the refined image, counting the occurrences of pixel pairs with specific intensity values and spatial relationships. The detection stage analyzes the tumor region's extracted features characteristics by labeling the connected components and selecting the region with the highest density to locate the tumor area, achieving a good accuracy of 99.64%. In the classification stage, the system classifies the detected tumor into the normal, pancreatic tumor, then into benign, pre-malignant, or malignant using a proposed reduced 11-layer AlexNet model. The classification stage attained an accuracy level of 98.72%, an AUC of 0.9979, and an overall system average processing time of 1.51 seconds, demonstrating the capability of the system to effectively and efficiently identify and classify pancreatic cancers.
Collapse
Affiliation(s)
- Abubakar Nadeem
- Department of Computer Science, National Textile University, Faisalabad, Pakistan
| | - Rahan Ashraf
- Department of Computer Science, National Textile University, Faisalabad, Pakistan
| | - Toqeer Mahmood
- Department of Computer Science, National Textile University, Faisalabad, Pakistan
| | - Sajida Parveen
- Department of Computer Science, National Textile University, Faisalabad, Pakistan
| |
Collapse
|
15
|
Gohla G, Estler A, Zerweck L, Knoppik J, Ruff C, Werner S, Nikolaou K, Ernemann U, Afat S, Brendlin A. Deep Learning-Based Denoising Enables High-Quality, Fully Diagnostic Neuroradiological Trauma CT at 25% Radiation Dose. Acad Radiol 2025; 32:373-390. [PMID: 39294053 DOI: 10.1016/j.acra.2024.08.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 08/04/2024] [Accepted: 08/09/2024] [Indexed: 09/20/2024]
Abstract
RATIONALE AND OBJECTIVES Traumatic neuroradiological emergencies necessitate rapid and accurate diagnosis, often relying on computed tomography (CT). However, the associated ionizing radiation poses long-term risks. Modern artificial intelligence reconstruction algorithms have shown promise in reducing radiation dose while maintaining image quality. Therefore, we aimed to evaluate the dose reduction capabilities of a deep learning-based denoising (DLD) algorithm in traumatic neuroradiological emergency CT scans. MATERIALS AND METHODS This retrospective single-center study included 100 patients with neuroradiological trauma CT scans. Full-dose (100%) and low-dose (25%) simulated scans were processed using iterative reconstruction (IR2) and DLD. Subjective and objective image quality assessments were performed by four neuroradiologists alongside clinical endpoint analysis. Bayesian sensitivity and specificity were computed with 95% credible intervals. RESULTS Subjective analysis showed superior scores for 100% DLD compared to 100% IR2 and 25% IR2 (p < 0.001). No significant differences were observed between 25% DLD and 100% IR2. Objective analysis revealed no significant CT value differences but higher noise at 25% dose for DLD and IR2 compared to 100% (p < 0.001). DLD exhibited lower noise than IR2 at both dose levels (p < 0.001). Clinical endpoint analysis indicated equivalence to 100% IR2 in fracture detection for all datasets, with sensitivity losses in hemorrhage detection at 25% IR2. DLD (25% and 100%) maintained comparable sensitivity to 100% IR2. All comparisons demonstrated robust specificity. CONCLUSIONS The evaluated algorithm enables high-quality, fully diagnostic CT scans at 25% of the initial radiation dose and improves patient care by reducing unnecessary radiation exposure.
Collapse
Affiliation(s)
- Georg Gohla
- Department of Diagnostic and Interventional Neuroradiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (G.G., A.E., L.Z., J.K., C.R., U.E.).
| | - Arne Estler
- Department of Diagnostic and Interventional Neuroradiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (G.G., A.E., L.Z., J.K., C.R., U.E.)
| | - Leonie Zerweck
- Department of Diagnostic and Interventional Neuroradiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (G.G., A.E., L.Z., J.K., C.R., U.E.)
| | - Jessica Knoppik
- Department of Diagnostic and Interventional Neuroradiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (G.G., A.E., L.Z., J.K., C.R., U.E.)
| | - Christer Ruff
- Department of Diagnostic and Interventional Neuroradiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (G.G., A.E., L.Z., J.K., C.R., U.E.)
| | - Sebastian Werner
- Department of Diagnostic and Interventional Radiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (S.W., K.N., S.A., A.B.)
| | - Konstantin Nikolaou
- Department of Diagnostic and Interventional Radiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (S.W., K.N., S.A., A.B.)
| | - Ulrike Ernemann
- Department of Diagnostic and Interventional Neuroradiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (G.G., A.E., L.Z., J.K., C.R., U.E.)
| | - Saif Afat
- Department of Diagnostic and Interventional Radiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (S.W., K.N., S.A., A.B.)
| | - Andreas Brendlin
- Department of Diagnostic and Interventional Radiology, Eberhard Karls-University Tuebingen, D-72076 Tuebingen, Germany (S.W., K.N., S.A., A.B.)
| |
Collapse
|
16
|
Jung IC, Schuler K, Zerlik M, Grummt S, Sedlmayr M, Sedlmayr B. Overview of basic design recommendations for user-centered explanation interfaces for AI-based clinical decision support systems: A scoping review. Digit Health 2025; 11:20552076241308298. [PMID: 39866885 PMCID: PMC11758527 DOI: 10.1177/20552076241308298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 11/14/2024] [Indexed: 01/28/2025] Open
Abstract
Objective The application of artificial intelligence (AI)-based clinical decision support systems (CDSS) in the healthcare domain is still limited. End-users' difficulty understanding how the outputs of opaque black AI models are generated contributes to this. It is still unknown which explanations are best presented to end users and how to design the interfaces they are presented in (explanation user interface, XUI). This article aims to provide an overview of recommendations for the user-centered design of XUIs from the scientific literature. Methods A scoping review was conducted to identify recommendations for the design of XUIs. Articles published between 2017 and 2022 in English or German, presenting original research or literature reviews, focusing on XUIs for end users or domain experts, which are intended for presentation in graphical user interfaces and from which recommendations could be extracted were included in the review. Articles were retrieved from Scopus, Web of Science, IEEE Explore, PubMed, ACM Digital Library, and PsychInfo. A mind map was created to organize and summarize the identified recommendations. Results From the 47 included articles, 240 recommendations for the user-centered design were extracted. The organization in a mind map resulted in 64 summarized recommendations. Conclusion This review provides a synopsis of basic recommendations for the user-centered design of XUIs, focusing on the healthcare domain. During the analysis of the articles, it became clear that no specific and directly implementable design recommendations for AI-based CDSS can be given, but only basic recommendations for raising awareness about the user-centered design of XUIs.
Collapse
Affiliation(s)
- Ian-C. Jung
- Institute for Medical Informatics and Biometry, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - Katharina Schuler
- Institute for Medical Informatics and Biometry, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - Maria Zerlik
- Institute for Medical Informatics and Biometry, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - Sophia Grummt
- Institute for Medical Informatics and Biometry, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - Martin Sedlmayr
- Institute for Medical Informatics and Biometry, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| |
Collapse
|
17
|
Mohanarajan M, Salunke PP, Arif A, Iglesias Gonzalez PM, Ospina D, Benavides DS, Amudha C, Raman KK, Siddiqui HF. Advancements in Machine Learning and Artificial Intelligence in the Radiological Detection of Pulmonary Embolism. Cureus 2025; 17:e78217. [PMID: 40026993 PMCID: PMC11872007 DOI: 10.7759/cureus.78217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/29/2025] [Indexed: 03/05/2025] Open
Abstract
Pulmonary embolism (PE) is a clinically challenging diagnosis that varies from silent to life-threatening symptoms. Timely diagnosis of the condition is subject to clinical assessment, D-dimer testing and radiological imaging. Computed tomography pulmonary angiogram (CTPA) is considered the gold standard imaging modality, although some cases can be missed due to reader dependency, resulting in adverse patient outcomes. Hence, it is crucial to implement faster and precise diagnostic strategies to help clinicians diagnose and treat PE patients promptly and mitigate morbidity and mortality. Machine learning (ML) and artificial intelligence (AI) are the newly emerging tools in the medical field, including in radiological imaging, potentially improving diagnostic efficacy. Our review of the studies showed that computer-aided design (CAD) and AI tools displayed similar to superior sensitivity and specificity in identifying PE on CTPA as compared to radiologists. Several tools demonstrated the potential in identifying minor PE on radiological scans showing promising ability to aid clinicians in reducing missed cases substantially. However, it is imperative to design sophisticated tools and conduct large clinical trials to integrate AI use in everyday clinical setting and establish guidelines for its ethical applicability. ML and AI can also potentially help physicians in formulating individualized management strategies to enhance patient outcomes.
Collapse
Affiliation(s)
| | | | - Ali Arif
- Medicine, Dow University of Health Sciences, Karachi, PAK
| | | | - David Ospina
- Internal Medicine, Universidad de los Andes, Bogotá, COL
| | | | - Chaithanya Amudha
- Medicine and Surgery, Saveetha Medical College and Hospital, Chennai, IND
| | - Kumareson K Raman
- Cardiology, Nottingham University Hospitals National Health Service (NHS) Trust, Nottingham, GBR
| | - Humza F Siddiqui
- Internal Medicine, Jinnah Postgraduate Medical Centre, Karachi, PAK
| |
Collapse
|
18
|
Shin HJ, Han K, Son NH, Kim EK, Kim MJ, Gatidis S, Vasanawala S. Optimizing adult-oriented artificial intelligence for pediatric chest radiographs by adjusting operating points. Sci Rep 2024; 14:31329. [PMID: 39732934 PMCID: PMC11682289 DOI: 10.1038/s41598-024-82775-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Accepted: 12/09/2024] [Indexed: 12/30/2024] Open
Abstract
The purpose of this study was to evaluate whether the optimal operating points of adult-oriented artificial intelligence (AI) software differ for pediatric chest radiographs and to assess its diagnostic performance. Chest radiographs from patients under 19 years old, collected between March and November 2021, were divided into test and exploring sets. A commercial adult-oriented AI software was utilized to detect lung lesions, including pneumothorax, consolidation, nodule, and pleural effusion, using a standard operating point of 15%. A pediatric radiologist reviewed the radiographs to establish ground truth for lesion presence. To determine the optimal operating points, receiver operating characteristic (ROC) curve analysis was conducted, varying thresholds to balance sensitivity and specificity by lesion type, age group, and imaging method. The test set (4,727 chest radiographs, mean 7.2 ± 6.1 years) and exploring set (2,630 radiographs, mean 5.9 ± 6.0 years) yielded optimal operating points of 11% for pneumothorax, 14% for consolidation, 15% for nodules, and 6% for pleural effusion. Using a 3% operating point improved pneumothorax sensitivity for children under 2 years, portable radiographs, and anteroposterior projections. Therefore, optimizing operating points of AI based on lesion type, age, and imaging method could improve diagnostic performance for pediatric chest radiographs, building on adult-oriented AI as a foundation.
Collapse
Affiliation(s)
- Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, 16995, Gyeonggi-do, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology, Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, 50 - 1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, Republic of Korea
| | - Nak-Hoon Son
- Department of Statistics, Keimyung University, 1095 Dalgubeol-daero, Dalseo-gu, Daegu, 42601, Republic of Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, 16995, Gyeonggi-do, Republic of Korea
| | - Min Jung Kim
- Department of Pediatrics, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, 16995, Gyeonggi-do, Republic of Korea
| | - Sergios Gatidis
- Department of Radiology, Stanford University, Lucile Packard Children's Hospital, 725 Welch Road, Palo Alto, CA, 94304, USA
| | - Shreyas Vasanawala
- Department of Radiology, Stanford University, Lucile Packard Children's Hospital, 725 Welch Road, Palo Alto, CA, 94304, USA.
| |
Collapse
|
19
|
Lee L, Salami RK, Martin H, Shantharam L, Thomas K, Ashworth E, Allan E, Yung KW, Pauling C, Leyden D, Arthurs OJ, Shelmerdine SC. "How I would like AI used for my imaging": children and young persons' perspectives. Eur Radiol 2024; 34:7751-7764. [PMID: 38900281 PMCID: PMC11557655 DOI: 10.1007/s00330-024-10839-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 04/11/2024] [Accepted: 04/27/2024] [Indexed: 06/21/2024]
Abstract
OBJECTIVES Artificial intelligence (AI) tools are becoming more available in modern healthcare, particularly in radiology, although less attention has been paid to applications for children and young people. In the development of these, it is critical their views are heard. MATERIALS AND METHODS A national, online survey was publicised to UK schools, universities and charity partners encouraging any child or young adult to participate. The survey was "live" for one year (June 2022 to 2023). Questions about views of AI in general, and in specific circumstances (e.g. bone fractures) were asked. RESULTS One hundred and seventy-one eligible responses were received, with a mean age of 19 years (6-23 years) with representation across all 4 UK nations. Most respondents agreed or strongly agreed they wanted to know the accuracy of an AI tool that was being used (122/171, 71.3%), that accuracy was more important than speed (113/171, 66.1%), and that AI should be used with human oversight (110/171, 64.3%). Many respondents (73/171, 42.7%) felt AI would be more accurate at finding problems on bone X-rays than humans, with almost all respondents who had sustained a missed fracture strongly agreeing with that sentiment (12/14, 85.7%). CONCLUSIONS Children and young people in our survey had positive views regarding AI, and felt it should be integrated into modern healthcare, but expressed a preference for a "medical professional in the loop" and accuracy of findings over speed. Key themes regarding information on AI performance and governance were raised and should be considered prior to future AI implementation for paediatric healthcare. CLINICAL RELEVANCE STATEMENT Artificial intelligence (AI) integration into clinical practice must consider all stakeholders, especially paediatric patients who have largely been ignored. Children and young people favour AI involvement with human oversight, seek assurances for safety, accuracy, and clear accountability in case of failures. KEY POINTS Paediatric patient's needs and voices are often overlooked in AI tool design and deployment. Children and young people approved of AI, if paired with human oversight and reliability. Children and young people are stakeholders for developing and deploying AI tools in paediatrics.
Collapse
Affiliation(s)
- Lauren Lee
- Young Persons Advisory Group (YPAG), Great Ormond Street Hospital for Children, London, WC1H 3JH, UK
| | | | - Helena Martin
- Guy's and St Thomas' NHS Foundation Trust, London, UK
| | | | - Kate Thomas
- Royal Hospital for Children & Young People, Edinburgh, Scotland, UK
| | - Emily Ashworth
- St George's Hospital, Blackshaw Road, Tooting London, London, UK
| | - Emma Allan
- Department of Clinical Radiology, Great Ormond Street Hospital for Children, London, WC1H 3JH, UK
| | - Ka-Wai Yung
- Wellcome/ EPSRC Centre for Interventional and Surgical Sciences, Charles Bell House, 43-45 Foley Street, London, W1W 7TY, UK
| | - Cato Pauling
- University College London, Gower Street, London, WC1E 6BT, UK.
| | - Deirdre Leyden
- Young Persons Advisory Group (YPAG), Great Ormond Street Hospital for Children, London, WC1H 3JH, UK
| | - Owen J Arthurs
- Department of Clinical Radiology, Great Ormond Street Hospital for Children, London, WC1H 3JH, UK
- UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK, WC1N 1EH, UK
- NIHR Great Ormond Street Hospital Biomedical Research Centre, 30 Guilford Street, Bloomsbury, London, WC1N 1EH, UK
| | - Susan Cheng Shelmerdine
- Department of Clinical Radiology, Great Ormond Street Hospital for Children, London, WC1H 3JH, UK
- UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK, WC1N 1EH, UK
- NIHR Great Ormond Street Hospital Biomedical Research Centre, 30 Guilford Street, Bloomsbury, London, WC1N 1EH, UK
| |
Collapse
|
20
|
Stogiannos N, Jennings M, George CS, Culbertson J, Salehi H, Furterer S, Pergola M, Culp MP, Malamateniou C. The American Society of Radiologic Technologists (ASRT) AI educator survey: A cross-sectional study to explore knowledge, experience, and use of AI within education. J Med Imaging Radiat Sci 2024; 55:101449. [PMID: 39004006 DOI: 10.1016/j.jmir.2024.101449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 05/09/2024] [Accepted: 06/04/2024] [Indexed: 07/16/2024]
Abstract
INTRODUCTION Artificial Intelligence (AI) is revolutionizing medical imaging and radiation therapy. AI-powered applications are being deployed to aid Medical Radiation Technologists (MRTs) in clinical workflows, decision-making, dose optimisation, and a wide range of other tasks. Exploring the levels of AI education provided across the United States is crucial to prepare future graduates to deliver the digital future. This study aims to assess educators' levels of AI knowledge, the current state of AI educational provisions, the perceived challenges around AI education, and important factors for future advancements. METHODS An online survey was electronically administered to all radiologic technologists in the American Society of Radiologic Technologists (ASRT) database who indicated that they had an educator role in the United States. This was distributed through the membership of the ASRT, from February to April 2023. All quantitative data was analysed using frequency and descriptive statistics. The survey's open-ended questions were analysed using a conceptual content analysis approach. RESULTS Out of 5,066 educators in the ASRT database, 373 valid responses were received, resulting in a response rate of 7.4%. Despite 84.5% of educators expressing the importance of teaching AI, 23.7% currently included AI in academic curricula. Of the 76.3% that did not include AI in their curricula, lack of AI knowledge among educators was the top reason for not integrating AI in education (59.1%). Similarly, AI-enabled tools were utilised by only 11.1% of the programs to assist teaching. The levels of trust in AI varied among educators. CONCLUSION The study found that although US educators of MRTs have a good baseline knowledge of general concepts regarding AI, they could improve on the teaching and use of AI in their curricula. AI training and guidance, adequate time to develop educational resources, and funding and support from higher education institutions were key priorities as highlighted by educators.
Collapse
Affiliation(s)
- Nikolaos Stogiannos
- Department of Midwifery & Radiography, School of Health and Psychological Sciences, City, University of London, UK; Magnitiki Tomografia Kerkiras, Corfu, Greece.
| | - Michael Jennings
- Senior Research Analyst, American Society of Radiologic Technologists, New Mexico, USA
| | - Craig St George
- Director of Education, American Society of Radiologic Technologists, New Mexico, USA
| | - John Culbertson
- Director of Research, American Society of Radiologic Technologists, New Mexico, USA
| | - Hugh Salehi
- Department of Biomedical Industrial & Human Factor Engineering, Wright State University, Ohio, USA
| | - Sandra Furterer
- Department of Integrated Systems Engineering, The Ohio State University, Ohio, USA
| | - Melissa Pergola
- Chief Executive Officer, American Society of Radiologic Technologists, New Mexico, USA
| | - Melissa P Culp
- Executive Vice President of Member Engagement, American Society of Radiologic Technologists, New Mexico, USA.
| | - Christina Malamateniou
- Department of Midwifery & Radiography, School of Health and Psychological Sciences, City, University of London, UK; Discipline of Medical Imaging and Radiation Therapy, College of Medicine and Health, University College Cork, Ireland; European Society of Medical Imaging Informatics, Vienna, Austria
| |
Collapse
|
21
|
Durmuş MA, Kömeç S, Gülmez A. Artificial intelligence applications for immunology laboratory: image analysis and classification study of IIF photos. Immunol Res 2024; 72:1277-1287. [PMID: 39107556 DOI: 10.1007/s12026-024-09527-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2024] [Accepted: 08/01/2024] [Indexed: 02/06/2025]
Abstract
Artificial intelligence (AI) is increasingly being used in medicine to enhance the speed and accuracy of disease diagnosis and treatment. AI-based image analysis is expected to play a crucial role in future healthcare facilities and laboratories, offering improved precision and cost-effectiveness. As technology advances, the requirement for specialized software knowledge to utilize AI applications is diminishing. Our study will examine the advantages and challenges of employing AI-based image analysis in the field of immunology and will investigate whether physicians without software expertise can use MS Azure Portal for ANA IIF test classification and image analysis. This is the first study to perform Hep-2 image analysis using MS Azure Portal. We will also assess the potential for AI applications to aid physicians in interpreting ANA IIF results in immunology laboratories. The study was designed in four stages by two specialists. Stage 1: creation of an image library, Stage 2: finding an artificial intelligence application, Stage 3: uploading images and training artificial intelligence, Stage 4: performance analysis of the artificial intelligence application. In the first training, the average pattern identification accuracy for 72 testing images was 81.94%. After the second training, this accuracy increased to 87.5%. Patterns Precision improved from 71.42 to 79.96% after the second training. As a result, the number of correctly identified patterns and their accuracy increased with the second training process. Artificial intelligence-based image analysis shows promising potential. This technology is expected to become essential in healthcare facility laboratories, offering higher accuracy rates and lower costs.
Collapse
Affiliation(s)
- Mehmet Akif Durmuş
- Medical Microbiology Laboratory, Çam and Sakura City Hospital, Istanbul, Türkiye.
| | - Selda Kömeç
- Medical Microbiology Laboratory, Çam and Sakura City Hospital, Istanbul, Türkiye
| | - Abdurrahman Gülmez
- Medical Microbiology Laboratory, Aydın Atatürk State Hospital, Aydın, Türkiye
| |
Collapse
|
22
|
Malamateniou C, O'Regan T, McFadden SL, Jackson M. Artificial intelligence (AI) in radiography practice, research and education: A review of contemporary developments and predictions for the future. Radiography (Lond) 2024; 30 Suppl 2:56-59. [PMID: 39406037 DOI: 10.1016/j.radi.2024.09.062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2024] [Accepted: 09/25/2024] [Indexed: 12/17/2024]
Affiliation(s)
- C Malamateniou
- Department of Midwifery and Radiography, School of Health and Psychological Sciences, City St George's University of London, London UK; Executive Board, European Society of Medical Imaging Informatics, Vienna, Austria; Research Committee, European Federation of Radiographer Societies, Cumiera, Portugal.
| | - T O'Regan
- The Society and College of Radiographers, London, UK.
| | - S L McFadden
- School of Health Sciences, Ulster University, Coleraine, UK; Research HUB Working Group, European Federation of Radiographer Societies, Cumiera, Portugal.
| | - M Jackson
- The Society and College of Radiographers, London, UK; Centre for Allied Health, School of Health and Medical Sciences, City St George's, University of London, London UK
| |
Collapse
|
23
|
Xuereb F, Portelli DJL. The knowledge and perception of patients in Malta towards artificial intelligence in medical imaging. J Med Imaging Radiat Sci 2024; 55:101743. [PMID: 39317135 DOI: 10.1016/j.jmir.2024.101743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 07/23/2024] [Accepted: 07/31/2024] [Indexed: 09/26/2024]
Abstract
INTRODUCTION Artificial intelligence (AI) is becoming increasingly implemented in radiology, especially in image reporting. Patients' perceptions about AI integration in medical imaging is a relatively unexplored area that has received limited investigation in the literature. This study aimed to determine current knowledge and perceptions of patients in Malta towards AI application in medical imaging. METHODS A cross-sectional study using a self-designed paper-based questionnaire, partly adapted with permission from two previous studies, was distributed in English or Maltese language amongst eligible outpatients attending medical imaging examinations across public hospitals in Malta and Gozo in March 2023. RESULTS 280 questionnaires were analysed, resulting in a 5.83 % confidence interval. 42.1 % of patients indicated basic AI knowledge, while 36.4 % reported minimal to no knowledge. Responses indicated favourable opinions towards the collaborative integration of humans and AI to improve healthcare. However, participants expressed preference for doctors to retain final-decision making when AI is used. For some statements, a statistically significant association was observed between patients' perception of AI-based technology and their gender, age, and educational background. Essentially, 92.1 % expressed the importance of being informed whenever AI is to be utilised in their care. DISCUSSION As key stakeholders, patients should be actively involved when AI technology is used. Informing patients about the use of AI in medical imaging is important to cultivate trust, address ethical concerns, and help ensure that AI integration in healthcare systems aligns with patients' values and needs. CONCLUSION This study highlights the need to enhance AI literacy amongst patients, possibly though awareness campaigns or educational programmes. Additionally, clear policies relating to the use of AI in medical imaging and how such AI use is communicated to patients are necessary.
Collapse
Affiliation(s)
- Francesca Xuereb
- Department of Radiography, Faculty of Health Sciences, University of Malta, Msida, Malta.
| | - Dr Jonathan L Portelli
- Department of Radiography, Faculty of Health Sciences, University of Malta, Msida, Malta.
| |
Collapse
|
24
|
Hogg HDJ, Brittain K, Talks J, Keane PA, Maniatopoulos G. Intervention design for artificial intelligence-enabled macular service implementation: a primary qualitative study. Implement Sci Commun 2024; 5:131. [PMID: 39593115 PMCID: PMC11600873 DOI: 10.1186/s43058-024-00667-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Accepted: 11/05/2024] [Indexed: 11/28/2024] Open
Abstract
BACKGROUND Neovascular age-related macular degeneration (nAMD) is one of the largest single-disease contributors to hospital outpatient appointments. Challenges in finding the clinical capacity to meet this demand can lead to sight-threatening delays in the macular services that provide treatment. Clinical artificial intelligence (AI) technologies pose one opportunity to rebalance demand and capacity in macular services. However, there is a lack of evidence to guide early-adopters seeking to use AI as a solution to demand-capacity imbalance. This study aims to provide guidance for these early adopters on how AI-enabled macular services may best be implemented by exploring what will influence the outcome of AI implementation and why. METHODS Thirty-six semi-structured interviews were conducted with participants. Data were analysed with the Nonadoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) framework to identify factors likely to influence implementation outcomes. These factors and the primary data then underwent a secondary analysis using the Fit between Individuals, Technology and Task (FITT) framework to propose an actionable intervention. RESULTS nAMD treatment should be initiated at face-to-face appointments with clinicians who recommend year-long periods of AI-enabled scheduling of treatments. This aims to maintain or enhance the quality of patient communication, whilst reducing consultation frequency. Appropriately trained photographers should take on the additional roles of inputting retinal imaging into the AI device and overseeing its communication to clinical colleagues, while ophthalmologists assume clinical oversight and consultation roles. Interoperability to facilitate this intervention would best be served by imaging equipment that can send images to the cloud securely for analysis by AI tools. Picture Archiving and Communication Software (PACS) should have the capability to output directly into electronic medical records (EMR) familiar to clinical and administrative staff. CONCLUSION There are many enablers to implementation and few of the remaining barriers relate directly to the AI technology itself. The proposed intervention requires local tailoring and prospective evaluation but can support early adopters in optimising the chances of success from initial efforts to implement AI-enabled macular services. PROTOCOL REGISTRATION Hogg HDJ, Brittain K, Teare D, Talks J, Balaskas K, Keane P, Maniatopoulos G. Safety and efficacy of an artificial intelligence-enabled decision tool for treatment decisions in neovascular age-related macular degeneration and an exploration of clinical pathway integration and implementation: protocol for a multi-methods validation study. BMJ Open. 2023 Feb 1;13(2):e069443. https://doi.org/10.1136/bmjopen-2022-069443 . PMID: 36725098; PMCID: PMC9896175.
Collapse
Affiliation(s)
- Henry David Jeffry Hogg
- Research, Development and Innovation, University Hospitals Birmingham NHS Foundation Trust, Level 2 ITM, Queen Elizabeth HospitalMindelsohn Way, Birmingham, B15 2GW, UK.
- Department of Applied Health Research, School of Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK.
- Moorfields Eye Hospital NHS Foundation Trust, London, UK.
| | - Katie Brittain
- Population Health Sciences Institute, Newcastle University, Newcastle Upon Tyne, UK
| | - James Talks
- Newcastle Eye Centre, Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Pearse Andrew Keane
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
- Institute of Ophthalmology, University College London, London, UK
| | - Gregory Maniatopoulos
- Population Health Sciences Institute, Newcastle University, Newcastle Upon Tyne, UK
- School of Business, Leicester University, Leicester, UK
| |
Collapse
|
25
|
Jeong S, Han K, Kang Y, Kim EK, Song K, Vasanawala S, Shin HJ. The Impact of Artificial Intelligence on Radiologists' Reading Time in Bone Age Radiograph Assessment: A Preliminary Retrospective Observational Study. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01323-3. [PMID: 39528879 DOI: 10.1007/s10278-024-01323-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 10/24/2024] [Accepted: 10/28/2024] [Indexed: 11/16/2024]
Abstract
To evaluate the real-world impact of artificial intelligence (AI) on radiologists' reading time during bone age (BA) radiograph assessments. Patients (<19 year-old) who underwent left-hand BA radiographs between December 2021 and October 2023 were retrospectively included. A commercial AI software was installed from October 2022. Radiologists' reading times, automatically recorded in the PACS log, were compared between the AI-unaided and AI-aided periods using linear regression tests and factors affecting reading time were identified. A total of 3643 radiographs (M:F=1295:2348, mean age 9.12 ± 2.31 years) were included and read by three radiologists, with 2937 radiographs (80.6%) in the AI-aided period. Overall reading times were significantly shorter in the AI-aided period compared to the AI-unaided period (mean 17.2 ± 12.9 seconds vs. mean 22.3 ± 14.7 seconds, p < 0.001). Staff reading times significantly decreased in the AI-aided period (mean 15.9 ± 11.4 seconds vs. mean 19.9 ± 13.4 seconds, p < 0.001), while resident reading times increased (mean 38.3 ± 16.4 seconds vs. 33.6 ± 15.3 seconds, p = 0.013). The use of AI and years of experience in radiology were significant factors affecting reading time (all, p≤0.001). The degree of decrease in reading time as experience increased was larger when utilizing AI (-1.151 for AI-unaided, -1.866 for AI-aided, difference =-0.715, p<0.001). In terms of AI exposure time, the staff's reading time decreased by 0.62 seconds per month (standard error 0.07, p<0.001) during the AI-aided period. The reading time of radiologists for BA assessment was influenced by AI. The time-saving effect of utilizing AI became more pronounced as the radiologists' experience and AI exposure time increased.
Collapse
Affiliation(s)
- Sejin Jeong
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Yaeseul Kang
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Kyungchul Song
- Department of Pediatrics, Yonsei University College of Medicine, Gangnam Severance Hospital, Seoul, Republic of Korea
| | | | - Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
26
|
Alis D, Tanyel T, Meltem E, Seker ME, Seker D, Karakaş HM, Karaarslan E, Öksüz İ. Choosing the right artificial intelligence solutions for your radiology department: key factors to consider. Diagn Interv Radiol 2024; 30:357-365. [PMID: 38682670 PMCID: PMC11589526 DOI: 10.4274/dir.2024.232658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Accepted: 04/15/2024] [Indexed: 05/01/2024]
Abstract
The rapid evolution of artificial intelligence (AI), particularly in deep learning, has significantly impacted radiology, introducing an array of AI solutions for interpretative tasks. This paper provides radiology departments with a practical guide for selecting and integrating AI solutions, focusing on interpretative tasks that require the active involvement of radiologists. Our approach is not to list available applications or review scientific evidence, as this information is readily available in previous studies; instead, we concentrate on the essential factors radiology departments must consider when choosing AI solutions. These factors include clinical relevance, performance and validation, implementation and integration, clinical usability, costs and return on investment, and regulations, security, and privacy. We illustrate each factor with hypothetical scenarios to provide a clearer understanding and practical relevance. Through our experience and literature review, we provide insights and a practical roadmap for radiologists to navigate the complex landscape of AI in radiology. We aim to assist in making informed decisions that enhance diagnostic precision, improve patient outcomes, and streamline workflows, thus contributing to the advancement of radiological practices and patient care.
Collapse
Affiliation(s)
- Deniz Alis
- Acıbadem Mehmet Ali Aydınlar University Faculty of Medicine, Department of Radiology, İstanbul, Türkiye
| | - Toygar Tanyel
- İstanbul Technical University, Biomedical Engineering Graduate Program, İstanbul, Türkiye
| | - Emine Meltem
- University of Health Sciences Türkiye, İstanbul Training and Research Hospital, Clinic of Diagnostic and Interventional Radiology, İstanbul, Türkiye
| | - Mustafa Ege Seker
- Acıbadem Mehmet Ali Aydınlar University Faculty of Medicine, Department of Radiology, İstanbul, Türkiye
| | - Delal Seker
- Dicle University Faculty of Engineering, Department of Electrical-Electronics Engineering, Diyarbakır, Türkiye
| | | | - Ercan Karaarslan
- Acıbadem Mehmet Ali Aydınlar University Faculty of Medicine, Department of Radiology, İstanbul, Türkiye
| | - İlkay Öksüz
- İstanbul Technical University Faculty of Engineering, Department of Computer Engineering, İstanbul, Türkiye
| |
Collapse
|
27
|
Jahn J, Weiß J, Bamberg F, Kotter E. [Applications of artificial intelligence in radiology]. RADIOLOGIE (HEIDELBERG, GERMANY) 2024; 64:752-757. [PMID: 39186073 DOI: 10.1007/s00117-024-01357-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 07/19/2024] [Indexed: 08/27/2024]
Abstract
BACKGROUND Artificial intelligence (AI) is increasingly finding its way into routine radiological work. OBJECTIVE Presentation of the current advances and applications of AI along the entire radiological patient journey. METHODS Systematic literature review of established AI techniques and current research projects, with reference to consensus recommendations. RESULTS The applications of AI in radiology cover a wide range, starting with AI-supported scheduling and indications assessment, extending to AI-enhanced image acquisition and reconstruction techniques that have the potential to reduce radiation doses in computed tomography (CT) or acquisition times in magnetic resonance imaging (MRI), while maintaining comparable image quality. These include computer-aided detection and diagnosis, such as fracture recognition or nodule detection. Additionally, methods such as worklist prioritization and structured reporting facilitated by large language models enable a rethinking of the reporting process. The use of AI promises to increase the efficiency of all steps of the radiology workflow and an improved diagnostic accuracy. To achieve this, seamless integration into technical workflows and proven evidence of AI systems are necessary. CONCLUSION Applications of AI have the potential to profoundly influence the role of radiologists in the future.
Collapse
Affiliation(s)
- Johannes Jahn
- Klinik für Diagnostische und Interventionelle Radiologie, Universitätsklinikum Freiburg, Medizinische Fakultät, Albert-Ludwigs-Universität Freiburg, Freiburg, Deutschland.
- Klinik für Diagnostische und Interventionelle Radiologie, Universitätsklinikum Freiburg, Hugstetter Straße 55, 79106, Freiburg, Deutschland.
| | - Jakob Weiß
- Klinik für Diagnostische und Interventionelle Radiologie, Universitätsklinikum Freiburg, Medizinische Fakultät, Albert-Ludwigs-Universität Freiburg, Freiburg, Deutschland
| | - Fabian Bamberg
- Klinik für Diagnostische und Interventionelle Radiologie, Universitätsklinikum Freiburg, Medizinische Fakultät, Albert-Ludwigs-Universität Freiburg, Freiburg, Deutschland
| | - Elmar Kotter
- Klinik für Diagnostische und Interventionelle Radiologie, Universitätsklinikum Freiburg, Medizinische Fakultät, Albert-Ludwigs-Universität Freiburg, Freiburg, Deutschland.
- Klinik für Diagnostische und Interventionelle Radiologie, Universitätsklinikum Freiburg, Hugstetter Straße 55, 79106, Freiburg, Deutschland.
| |
Collapse
|
28
|
Mekonen KA, Mohammed SH, Kebede T, Bedane A, Buser AA. Artificial Intelligence in Radiology for Ethiopia. Ethiop J Health Sci 2024; 34:1-2. [PMID: 39735519 PMCID: PMC11674759 DOI: 10.4314/ejhs.v34i1.1s] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2024] [Accepted: 10/17/2024] [Indexed: 12/31/2024] Open
Affiliation(s)
- Kumlachew Abate Mekonen
- Department of Radiology and Medical Radiologic Technology, School of Medicine, St. Paul's Hospital Millennium Medical College, Addis Ababa, Ethiopia
| | - Shimels Hussien Mohammed
- Department of Public Health, School of Public Health, St. Paul's Hospital Millennium Medical College, Addis Ababa, Ethiopia
| | - Tesfaye Kebede
- Department of Radiology, School of Medicine, Addis Ababa University, Addis Ababa, Ethiopia
| | - Alemayehu Bedane
- Department of Radiology and Medical Radiologic Technology, School of Medicine, St. Paul's Hospital Millennium Medical College, Addis Ababa, Ethiopia
| | - Ashenafi Aberra Buser
- Department of Radiology and Medical Radiologic Technology, School of Medicine, St. Paul's Hospital Millennium Medical College, Addis Ababa, Ethiopia
| |
Collapse
|
29
|
Wenderott K, Krups J, Zaruchas F, Weigl M. Effects of artificial intelligence implementation on efficiency in medical imaging-a systematic literature review and meta-analysis. NPJ Digit Med 2024; 7:265. [PMID: 39349815 PMCID: PMC11442995 DOI: 10.1038/s41746-024-01248-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Accepted: 08/31/2024] [Indexed: 10/04/2024] Open
Abstract
In healthcare, integration of artificial intelligence (AI) holds strong promise for facilitating clinicians' work, especially in clinical imaging. We aimed to assess the impact of AI implementation for medical imaging on efficiency in real-world clinical workflows and conducted a systematic review searching six medical databases. Two reviewers double-screened all records. Eligible records were evaluated for methodological quality. The outcomes of interest were workflow adaptation due to AI implementation, changes in time for tasks, and clinician workload. After screening 13,756 records, we identified 48 original studies to be incuded in the review. Thirty-three studies measured time for tasks, with 67% reporting reductions. Yet, three separate meta-analyses of 12 studies did not show significant effects after AI implementation. We identified five different workflows adapting to AI use. Most commonly, AI served as a secondary reader for detection tasks. Alternatively, AI was used as the primary reader for identifying positive cases, resulting in reorganizing worklists or issuing alerts. Only three studies scrutinized workload calculations based on the time saved through AI use. This systematic review and meta-analysis represents an assessment of the efficiency improvements offered by AI applications in real-world clinical imaging, predominantly revealing enhancements across the studies. However, considerable heterogeneity in available studies renders robust inferences regarding overall effectiveness in imaging tasks. Further work is needed on standardized reporting, evaluation of system integration, and real-world data collection to better understand the technological advances of AI in real-world healthcare workflows. Systematic review registration: Prospero ID CRD42022303439, International Registered Report Identifier (IRRID): RR2-10.2196/40485.
Collapse
Affiliation(s)
| | - Jim Krups
- Institute for Patient Safety, University Hospital Bonn, Bonn, Germany
| | - Fiona Zaruchas
- Institute for Patient Safety, University Hospital Bonn, Bonn, Germany
| | - Matthias Weigl
- Institute for Patient Safety, University Hospital Bonn, Bonn, Germany
| |
Collapse
|
30
|
Thompson YLE, Levine GM, Chen W, Sahiner B, Li Q, Petrick N, Delfino JG, Lago MA, Cao Q, Samuelson FW. Applying queueing theory to evaluate wait-time-savings of triage algorithms. QUEUEING SYSTEMS 2024; 108:579-610. [PMID: 39449985 PMCID: PMC11496365 DOI: 10.1007/s11134-024-09927-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 08/10/2024] [Accepted: 08/23/2024] [Indexed: 10/26/2024]
Abstract
In the past decade, artificial intelligence (AI) algorithms have made promising impacts in many areas of healthcare. One application is AI-enabled prioritization software known as computer-aided triage and notification (CADt). This type of software as a medical device is intended to prioritize reviews of radiological images with time-sensitive findings, thus shortening the waiting time for patients with these findings. While many CADt devices have been deployed into clinical workflows and have been shown to improve patient treatment and clinical outcomes, quantitative methods to evaluate the wait-time-savings from their deployment are not yet available. In this paper, we apply queueing theory methods to evaluate the wait-time-savings of a CADt by calculating the average waiting time per patient image without and with a CADt device being deployed. We study two workflow models with one or multiple radiologists (servers) for a range of AI diagnostic performances, radiologist's reading rates, and patient image (customer) arrival rates. To evaluate the time-saving performance of a CADt, we use the difference in the mean waiting time between the diseased patient images in the with-CADt scenario and that in the without-CADt scenario as our performance metric. As part of this effort, we have developed and also share a software tool to simulate the radiology workflow around medical image interpretation, to verify theoretical results, and to provide confidence intervals for the performance metric we defined. We show quantitatively that a CADt triage device is more effective in a busy, short-staffed reading setting, which is consistent with our clinical intuition and simulation results. Although this work is motivated by the need for evaluating CADt devices, the evaluation methodology presented in this paper can be applied to assess the time-saving performance of other types of algorithms that prioritize a subset of customers based on binary outputs.
Collapse
Affiliation(s)
| | - Gary M. Levine
- The U.S. Food and Drug Administration, White Oak, MD USA
| | - Weijie Chen
- The U.S. Food and Drug Administration, White Oak, MD USA
| | | | - Qin Li
- The U.S. Food and Drug Administration, White Oak, MD USA
| | | | | | - Miguel A. Lago
- The U.S. Food and Drug Administration, White Oak, MD USA
| | - Qian Cao
- The U.S. Food and Drug Administration, White Oak, MD USA
| | | |
Collapse
|
31
|
Wong CR, Zhu A, Baltzer HL. The Accuracy of Artificial Intelligence Models in Hand/Wrist Fracture and Dislocation Diagnosis: A Systematic Review and Meta-Analysis. JBJS Rev 2024; 12:01874474-202409000-00006. [PMID: 39236148 DOI: 10.2106/jbjs.rvw.24.00106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/07/2024]
Abstract
BACKGROUND Early and accurate diagnosis is critical to preserve function and reduce healthcare costs in patients with hand and wrist injury. As such, artificial intelligence (AI) models have been developed for the purpose of diagnosing fractures through imaging. The purpose of this systematic review and meta-analysis was to determine the accuracy of AI models in identifying hand and wrist fractures and dislocations. METHODS Adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Diagnostic Test Accuracy guidelines, Ovid MEDLINE, Embase, and Cochrane Central Register of Controlled Trials were searched from their inception to October 10, 2023. Studies were included if they utilized an AI model (index test) for detecting hand and wrist fractures and dislocations in pediatric (<18 years) or adult (>18 years) patients through any radiologic imaging, with the reference standard established through image review by a medical expert. Results were synthesized through bivariate analysis. Risk of bias was assessed using the QUADAS-2 tool. This study was registered with PROSPERO (CRD42023486475). Certainty of evidence was assessed using Grading of Recommendations Assessment, Development, and Evaluation. RESULTS A systematic review identified 36 studies. Most studies assessed wrist fractures (27.90%) through radiograph imaging (94.44%), with radiologists serving as the reference standard (66.67%). AI models demonstrated area under the curve (0.946), positive likelihood ratio (7.690; 95% confidence interval, 6.400-9.190), and negative likelihood ratio (0.112; 0.0848-0.145) in diagnosing hand and wrist fractures and dislocations. Examining only studies characterized by a low risk of bias, sensitivity analysis did not reveal any difference from the overall results. Overall certainty of evidence was moderate. CONCLUSION In demonstrating the accuracy of AI models in hand and wrist fracture and dislocation diagnosis, we have demonstrated that the potential use of AI in diagnosing hand and wrist fractures is promising. LEVEL OF EVIDENCE Level III. See Instructions for Authors for a complete description of levels of evidence.
Collapse
Affiliation(s)
- Chloe R Wong
- Division of Plastic, Reconstructive & Aesthetic Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Alice Zhu
- Division of General Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Heather L Baltzer
- Division of Plastic, Reconstructive & Aesthetic Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
32
|
Teodorescu B, Gilberg L, Melton PW, Hehr RM, Guzel HE, Koc AM, Baumgart A, Maerkisch L, Ataide EJG. A systematic review of deep learning-based spinal bone lesion detection in medical images. Acta Radiol 2024; 65:1115-1125. [PMID: 39033391 DOI: 10.1177/02841851241263066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/23/2024]
Abstract
Spinal bone lesions encompass a wide array of pathologies, spanning from benign abnormalities to aggressive malignancies, such as diffusely localized metastases. Early detection and accurate differentiation of the underlying diseases is crucial for every patient's clinical treatment and outcome, with radiological imaging being a core element in the diagnostic pathway. Across numerous pathologies and imaging techniques, deep learning (DL) models are progressively considered a valuable resource in the clinical setting. This review describes not only the diagnostic performance of these models and the differing approaches in the field of spinal bone malignancy recognition, but also the lack of standardized methodology and reporting that we believe is currently hampering this newly founded area of research. In line with their established and reliable role in lesion detection, this publication focuses on both computed tomography and magnetic resonance imaging, as well as various derivative modalities (i.e. SPECT). After conducting a systematic literature search and subsequent analysis for applicability and quality using a modified QUADAS-2 scoring system, we confirmed that most of the 14 identified studies were plagued by major limitations, such as insufficient reporting of model statistics and data acquisition, a lacking external validation dataset, and potentially biased annotation. Although we experienced these limitations, we nonetheless conclude that the potential of these methods shines through in the presented results. These findings underline the need for more stringent quality controls in DL studies, as well as model development to afford increased insight and progress in this promising novel field.
Collapse
Affiliation(s)
- Bianca Teodorescu
- Floy GmbH, Munich, Germany
- Department of Medicine II, University Hospital, LMU Munich, Munich, Germany
| | - Leonard Gilberg
- Floy GmbH, Munich, Germany
- Department of Medicine IV, University Hospital, LMU Munich, Munich, Germany
| | - Philip William Melton
- Floy GmbH, Munich, Germany
- Institute for Stroke and Dementia Research, Klinikum der Universität München, Munich, Germany
| | | | - Hamza Eren Guzel
- Floy GmbH, Munich, Germany
- University of Health Sciences İzmir Bozyaka Research and Training Hospital, Izmir, Turkey
| | - Ali Murat Koc
- Floy GmbH, Munich, Germany
- Ataturk Education and Research Hospital, Department of Radiology, Izmir Katip Celebi University, Izmir, Turkey
| | - Andre Baumgart
- Mannheim Institute of Public Health, Universität Medizin Mannheim, Mannheim, Germany
| | | | | |
Collapse
|
33
|
Burti S, Zotti A, Banzato T. Role of AI in diagnostic imaging error reduction. Front Vet Sci 2024; 11:1437284. [PMID: 39280838 PMCID: PMC11392848 DOI: 10.3389/fvets.2024.1437284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 08/21/2024] [Indexed: 09/18/2024] Open
Abstract
The topic of diagnostic imaging error and the tools and strategies for error mitigation are poorly investigated in veterinary medicine. The increasing popularity of diagnostic imaging and the high demand for teleradiology make mitigating diagnostic imaging errors paramount in high-quality services. The different sources of error have been thoroughly investigated in human medicine, and the use of AI-based products is advocated as one of the most promising strategies for error mitigation. At present, AI is still an emerging technology in veterinary medicine and, as such, is raising increasing interest among in board-certified radiologists and general practitioners alike. In this perspective article, the role of AI in mitigating different types of errors, as classified in the human literature, is presented and discussed. Furthermore, some of the weaknesses specific to the veterinary world, such as the absence of a regulatory agency for admitting medical devices to the market, are also discussed.
Collapse
Affiliation(s)
- Silvia Burti
- Department of Animal Medicine, Production and Health, University of Padua, Padua, Italy
| | - Alessandro Zotti
- Department of Animal Medicine, Production and Health, University of Padua, Padua, Italy
| | - Tommaso Banzato
- Department of Animal Medicine, Production and Health, University of Padua, Padua, Italy
| |
Collapse
|
34
|
Ong W, Lee A, Tan WC, Fong KTD, Lai DD, Tan YL, Low XZ, Ge S, Makmur A, Ong SJ, Ting YH, Tan JH, Kumar N, Hallinan JTPD. Oncologic Applications of Artificial Intelligence and Deep Learning Methods in CT Spine Imaging-A Systematic Review. Cancers (Basel) 2024; 16:2988. [PMID: 39272846 PMCID: PMC11394591 DOI: 10.3390/cancers16172988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Revised: 08/14/2024] [Accepted: 08/26/2024] [Indexed: 09/15/2024] Open
Abstract
In spinal oncology, integrating deep learning with computed tomography (CT) imaging has shown promise in enhancing diagnostic accuracy, treatment planning, and patient outcomes. This systematic review synthesizes evidence on artificial intelligence (AI) applications in CT imaging for spinal tumors. A PRISMA-guided search identified 33 studies: 12 (36.4%) focused on detecting spinal malignancies, 11 (33.3%) on classification, 6 (18.2%) on prognostication, 3 (9.1%) on treatment planning, and 1 (3.0%) on both detection and classification. Of the classification studies, 7 (21.2%) used machine learning to distinguish between benign and malignant lesions, 3 (9.1%) evaluated tumor stage or grade, and 2 (6.1%) employed radiomics for biomarker classification. Prognostic studies included three (9.1%) that predicted complications such as pathological fractures and three (9.1%) that predicted treatment outcomes. AI's potential for improving workflow efficiency, aiding decision-making, and reducing complications is discussed, along with its limitations in generalizability, interpretability, and clinical integration. Future directions for AI in spinal oncology are also explored. In conclusion, while AI technologies in CT imaging are promising, further research is necessary to validate their clinical effectiveness and optimize their integration into routine practice.
Collapse
Affiliation(s)
- Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Aric Lee
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Wei Chuan Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Kuan Ting Dominic Fong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Daoyong David Lai
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Yi Liang Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Shuliang Ge
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Shao Jin Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Yong Han Ting
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Jiong Hao Tan
- National University Spine Institute, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Naresh Kumar
- National University Spine Institute, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
35
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, Pinto Dos Santos D, Tang A, Wald C, Slavotinek J. Developing, Purchasing, Implementing and Monitoring AI Tools in Radiology: Practical Considerations. A Multi-Society Statement From the ACR, CAR, ESR, RANZCR & RSNA. J Am Coll Radiol 2024; 21:1292-1310. [PMID: 38276923 DOI: 10.1016/j.jacr.2023.12.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
Artificial intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever-growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones. This multi-society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools. KEY POINTS.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical Center, Birmingham, Alabama; American College of Radiology Data Science Institute, Reston, Virginia
| | - Jaron Chong
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Elmar Kotter
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, California; Stanford Center for Artificial Intelligence in Medicine & Imaging, Palo Alto, California
| | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, California
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Daniel Pinto Dos Santos
- Department of Radiology, University Hospital of Cologne, Cologne, Germany; Department of Radiology, University Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation Oncology, and Nuclear Medicine, Université de Montréal, Montréal, Québec, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital & Medical Center, Burlington, Massachusetts; Tufts University Medical School, Boston, Massachusetts; Commision on Informatics, and Member, Board of Chancellors, American College of Radiology, Virginia
| | - John Slavotinek
- South Australia Medical Imaging, Flinders Medical Centre Adelaide, Adelaide, Australia; College of Medicine and Public Health, Flinders University, Adelaide, Australia
| |
Collapse
|
36
|
Troupis CJ, Knight RAH, Lau KKP. What is the appropriate measure of radiology workload: Study or image numbers? J Med Imaging Radiat Oncol 2024; 68:530-539. [PMID: 38837555 DOI: 10.1111/1754-9485.13713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 05/15/2024] [Indexed: 06/07/2024]
Abstract
INTRODUCTION Previous studies assessing the volume of radiological studies rarely considered the corresponding number of images. We aimed to quantify the increases in study and image numbers per radiologist in a tertiary healthcare network to better understand the demands on imaging services. METHODS Using the Picture Archiving and Communication System (PACS), the number of images per study was obtained for all diagnostic studies reported by in-house radiologists at a tertiary healthcare network in Melbourne, Australia, between January 2009 and December 2022. Payroll data was used to obtain the numbers of full-time equivalent radiologists. RESULTS Across all modalities, there were 4,462,702 diagnostic studies and 1,116,311,209 images. The number of monthly studies increased from 17,235 to 35,152 (104%) over the study period. The number of monthly images increased from 1,120,832 to 13,353,056 (1091%), with computed tomography (CT) showing the greatest absolute increase of 9,395,653 images per month (1476%). There was no increase in the monthly studies per full-time equivalent radiologist; however, the number of monthly image slices per radiologist increased 399%, from 48,781 to 243,518 (Kendall Tau correlation coefficient 0.830, P-value < 0.0001). CONCLUSION The number of monthly images per radiologist increased substantially from 2009 to 2022, despite a relatively constant number of monthly studies per radiologist. Our study suggests that using the number of studies as an isolated fundamental data set underestimates the true radiologist's workload. We propose that the increased volume of images examined by individual radiologists may more appropriately reflect true work demand and may add more weight to future workforce planning.
Collapse
Affiliation(s)
- Christopher John Troupis
- The Royal Melbourne Hospital, Parkville, Victoria, Australia
- Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Parkville, Victoria, Australia
| | | | - Kenneth Kwok-Pan Lau
- Monash Imaging, Monash Health, Clayton, Victoria, Australia
- School of Clinical Sciences, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
- Sir Peter MacCallum Department of Oncology, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, 305 Grattan Street, 3050, Victoria, Australia
| |
Collapse
|
37
|
Kibrom BT, Manyazewal T, Demma BD, Feleke TH, Kabtimer AS, Ayele ND, Korsa EW, Hailu SS. Emerging technologies in pediatric radiology: current developments and future prospects. Pediatr Radiol 2024; 54:1428-1436. [PMID: 39012407 DOI: 10.1007/s00247-024-05997-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 07/02/2024] [Accepted: 07/03/2024] [Indexed: 07/17/2024]
Abstract
Radiological imaging is a crucial diagnostic tool for the pediatric population. However, it is associated with several unique challenges in this age group compared to adults. These challenges mainly come from the fact that children are not small-sized adults and differ in development, anatomy, physiology, and pathology compared to adults. This paper reviews relevant articles published between January 2015 and October 2023 to analyze challenges associated with imaging technologies currently used in pediatric radiology, emerging technologies, and their role in resolving the challenges and future prospects of pediatric radiology. In recent decades, imaging technologies have advanced rapidly, developing advanced ultrasound, computed tomography, magnetic resonance, nuclear imaging, teleradiology, artificial intelligence, machine learning, three-dimensional printing, radiomics, and radiogenomics, among many others. By prioritizing the unique needs of pediatric patients while developing such technologies, we can significantly alleviate the challenges faced in pediatric radiology.
Collapse
Affiliation(s)
- Bethlehem T Kibrom
- Centre for Innovative Drug Development and Therapeutic Trials for Africa (CDT-Africa), College of Health Sciences, Addis Ababa University, P.O. Box 9086, Addis Ababa, Ethiopia.
| | - Tsegahun Manyazewal
- Centre for Innovative Drug Development and Therapeutic Trials for Africa (CDT-Africa), College of Health Sciences, Addis Ababa University, P.O. Box 9086, Addis Ababa, Ethiopia
| | - Biruk D Demma
- College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia
| | - Tesfahunegn H Feleke
- Centre for Innovative Drug Development and Therapeutic Trials for Africa (CDT-Africa), College of Health Sciences, Addis Ababa University, P.O. Box 9086, Addis Ababa, Ethiopia
- Potomac Urology Clinic, Alexandria, VA, USA
| | | | - Nitsuh D Ayele
- College of Health Sciences, Wolkite University, Wolkite, Ethiopia
| | - Eyasu W Korsa
- Department of Radiology, College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia
| | - Samuel S Hailu
- Department of Radiology, College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia
| |
Collapse
|
38
|
Kaya K, Gietzen C, Hahnfeldt R, Zoubi M, Emrich T, Halfmann MC, Sieren MM, Elser Y, Krumm P, Brendel JM, Nikolaou K, Haag N, Borggrefe J, Krüchten RV, Müller-Peltzer K, Ehrengut C, Denecke T, Hagendorff A, Goertz L, Gertz RJ, Bunck AC, Maintz D, Persigehl T, Lennartz S, Luetkens JA, Jaiswal A, Iuga AI, Pennig L, Kottlors J. Generative Pre-trained Transformer 4 analysis of cardiovascular magnetic resonance reports in suspected myocarditis: A multicenter study. J Cardiovasc Magn Reson 2024; 26:101068. [PMID: 39079602 PMCID: PMC11414660 DOI: 10.1016/j.jocmr.2024.101068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 07/04/2024] [Accepted: 07/24/2024] [Indexed: 09/13/2024] Open
Abstract
BACKGROUND Diagnosing myocarditis relies on multimodal data, including cardiovascular magnetic resonance (CMR), clinical symptoms, and blood values. The correct interpretation and integration of CMR findings require radiological expertise and knowledge. We aimed to investigate the performance of Generative Pre-trained Transformer 4 (GPT-4), a large language model, for report-based medical decision-making in the context of cardiac MRI for suspected myocarditis. METHODS This retrospective study includes CMR reports from 396 patients with suspected myocarditis and eight centers, respectively. CMR reports and patient data including blood values, age, and further clinical information were provided to GPT-4 and radiologists with 1 (resident 1), 2 (resident 2), and 4 years (resident 3) of experience in CMR and knowledge of the 2018 Lake Louise Criteria. The final impression of the report regarding the radiological assessment of whether myocarditis is present or not was not provided. The performance of Generative pre-trained transformer 4 (GPT-4) and the human readers were compared to a consensus reading (two board-certified radiologists with 8 and 10 years of experience in CMR). Sensitivity, specificity, and accuracy were calculated. RESULTS GPT-4 yielded an accuracy of 83%, sensitivity of 90%, and specificity of 78%, which was comparable to the physician with 1 year of experience (R1: 86%, 90%, 84%, p = 0.14) and lower than that of more experienced physicians (R2: 89%, 86%, 91%, p = 0.007 and R3: 91%, 85%, 96%, p < 0.001). GPT-4 and human readers showed a higher diagnostic performance when results from T1- and T2-mapping sequences were part of the reports, for residents 1 and 3 with statistical significance (p = 0.004 and p = 0.02, respectively). CONCLUSION GPT-4 yielded good accuracy for diagnosing myocarditis based on CMR reports in a large dataset from multiple centers and therefore holds the potential to serve as a diagnostic decision-supporting tool in this capacity, particularly for less experienced physicians. Further studies are required to explore the full potential and elucidate educational aspects of the integration of large language models in medical decision-making.
Collapse
Affiliation(s)
- Kenan Kaya
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.
| | - Carsten Gietzen
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Robert Hahnfeldt
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Maher Zoubi
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Bonn, University of Bonn, Bonn, Germany
| | - Tilman Emrich
- Department of Diagnostic and Interventional Radiology, University Medical Center of the Johannes-Gutenberg-University, Mainz, Germany; Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, South Carolina, USA; German Centre for Cardiovascular Research, Partner Site Rhine-Main, Mainz, Germany
| | - Moritz C Halfmann
- Department of Diagnostic and Interventional Radiology, University Medical Center of the Johannes-Gutenberg-University, Mainz, Germany
| | - Malte Maria Sieren
- Department of Radiology and Nuclear Medicine, UKSH, Campus Lübeck, Lübeck, Germany; Institute of Interventional Radiology, UKSH, Campus Lübeck, Lübeck, Germany
| | - Yannic Elser
- Department of Radiology and Nuclear Medicine, UKSH, Campus Lübeck, Lübeck, Germany
| | - Patrick Krumm
- Department of Radiology, Diagnostic and Interventional Radiology, University of Tübingen, Tübingen, Germany
| | - Jan M Brendel
- Department of Radiology, Diagnostic and Interventional Radiology, University of Tübingen, Tübingen, Germany
| | - Konstantin Nikolaou
- Department of Radiology, Diagnostic and Interventional Radiology, University of Tübingen, Tübingen, Germany
| | - Nina Haag
- Institute for Radiology, Neuroradiology and Nuclear Medicine Johannes Wesling University Hospital/Mühlenkreiskliniken, Bochum/Minden, Germany
| | - Jan Borggrefe
- Institute for Radiology, Neuroradiology and Nuclear Medicine Johannes Wesling University Hospital/Mühlenkreiskliniken, Bochum/Minden, Germany
| | - Ricarda von Krüchten
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Katharina Müller-Peltzer
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Constantin Ehrengut
- Department of Diagnostic and Interventional Radiology, University of Leipzig, Leipzig, Germany
| | - Timm Denecke
- Department of Diagnostic and Interventional Radiology, University of Leipzig, Leipzig, Germany
| | | | - Lukas Goertz
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Roman J Gertz
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Alexander Christian Bunck
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - David Maintz
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Thorsten Persigehl
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Simon Lennartz
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Julian A Luetkens
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Bonn, University of Bonn, Bonn, Germany
| | - Astha Jaiswal
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Andra Iza Iuga
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Lenhard Pennig
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Jonathan Kottlors
- Institute for Diagnostic and Interventional Radiology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| |
Collapse
|
39
|
Rasche A, Brader P, Borggrefe J, Seuss H, Carr Z, Hebecker A, Ten Cate G. Impact of intelligent virtual and AI-based automated collimation functionalities on the efficiency of radiographic acquisitions. Radiography (Lond) 2024; 30:1073-1079. [PMID: 38763093 DOI: 10.1016/j.radi.2024.05.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Revised: 05/02/2024] [Accepted: 05/08/2024] [Indexed: 05/21/2024]
Abstract
INTRODUCTION Intelligent virtual and AI-based collimation functionalities have the potential to enable an efficient workflow for radiographers, but the specific impact on clinical routines is still unknown. This study analyzes primarily the influence of intelligent collimation functionalities on the examination time and the number of needed interactions with the radiography system. METHODS An observational study was conducted on the use of three camera-based intelligent features at five clinical sites in Europe and the USA: AI-based auto thorax collimation (ATC), smart virtual ortho (SVO) collimation for stitched long-leg and full-spine examinations, and virtual collimation (VC) at the radiography system workstation. Two people conducted semi-structured observations during routine examinations to collect data with the functionalities either activated or deactivated. RESULTS Median exam duration was 31 vs. 45 s (p < 0.0001) for 95 thorax examinations with ATC and 94 without ATC. For stitched orthopedic examinations, 34 were performed with SVO and 40 without SVO, and the median exam duration was 62 vs. 82 s (p < 0.0001). The median time for setting the ortho range - i.e., the time between setting the upper and the lower limits of the collimation field - was 7 vs. 16 s for 39 examinations with SVO and 43 without SVO (p < 0.0001). In 109 thorax examinations with ATC and 112 without ATC, the median number of system interactions was 1 vs. 2 (p < 0.0001). VC was used to collimate in 2.4% and to check the collimation field in 68.5% of 292 observed chest and other examinations. CONCLUSION ATC and SVO enable the radiographer to save time during chest or stitched examinations. Additionally, ATC reduces machine interactions during chest examinations. IMPLICATIONS FOR PRACTICE System and artificial intelligence can support the radiographer during the image acquisition by providing a more efficient workflow.
Collapse
Affiliation(s)
- A Rasche
- Siemens Healthineers AG, Siemensstrasse 3, 91301 Forchheim, Germany.
| | - P Brader
- Diagnostikum Linz GmbH, Saporoshjestrasse 3, 4030 Linz, Austria.
| | - J Borggrefe
- Department of Radiology, Johannes Wesling Universitätsklinikum/Mühlenkreiskliniken, Hans-Nolte-Strasse 1, 32429 Minden, Germany.
| | - H Seuss
- Department of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Maximiliansplatz 3, 91054 Erlangen, Germany; Department of Radiology, Klinikum Forchheim - Fränkische Schweiz, Krankenhausstrasse 10, 91301 Forchheim, Germany.
| | - Z Carr
- Department of Radiology, The Ohio State University Wexner Medical Center, 274V Doan Hall, 450 W. 10th Ave, Columbus, OH, 43210, United States.
| | - A Hebecker
- Siemens Healthineers AG, Siemensstrasse 3, 91301 Forchheim, Germany.
| | - G Ten Cate
- Siemens Healthineers AG, Siemensstrasse 3, 91301 Forchheim, Germany.
| |
Collapse
|
40
|
Pieters ALP, van der Veer T, Meerburg JJ, Andrinopoulou ER, van der Eerden MM, Ciet P, Aliberti S, Burgel PR, Crichton ML, Shoemark A, Goeminne PC, Shteinberg M, Loebinger MR, Haworth CS, Blasi F, Tiddens HAWM, Caudri D, Chalmers JD. Structural Lung Disease and Clinical Phenotype in Bronchiectasis Patients: The EMBARC CT Study. Am J Respir Crit Care Med 2024; 210:87-96. [PMID: 38635862 DOI: 10.1164/rccm.202311-2109oc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 04/18/2024] [Indexed: 04/20/2024] Open
Abstract
Rationale: Chest computed tomography (CT) scans are essential to diagnose and monitor bronchiectasis (BE). To date, few quantitative data are available about the nature and extent of structural lung abnormalities (SLAs) on CT scans of patients with BE. Objectives: To investigate SLAs on CT scans of patients with BE and the relationship of SLAs to clinical features using the EMBARC (European Multicenter Bronchiectasis Audit and Research Collaboration) registry. Methods: CT scans from patients with BE included in the EMBARC registry were analyzed using the validated Bronchiectasis Scoring Technique for CT (BEST-CT). The subscores of this instrument are expressed as percentages of total lung volume. The items scored are atelectasis/consolidation, BE with and without mucus plugging (MP), airway wall thickening, MP, ground-glass opacities, bullae, airways, and parenchyma. Four composite scores were calculated: total BE (i.e., BE with and without MP), total MP (i.e., BE with MP plus MP alone), total inflammatory changes (i.e., atelectasis/consolidation plus total MP plus ground-glass opacities), and total disease (i.e., all items but airways and parenchyma). Measurements and Main Results: CT scans of 524 patients with BE were analyzed. Mean subscores were 4.6 (range, 2.3-7.7) for total BE, 4.2 (1.2-8.1) for total MP, 8.3 (3.5-16.7) for total inflammatory changes, and 14.9 (9.1-25.9) for total disease. BE associated with primary ciliary dyskinesia was associated with more SLAs, whereas chronic obstructive pulmonary disease was associated with fewer SLAs. Lower FEV1, longer disease duration, Pseudomonas aeruginosa and nontuberculous mycobacterial infections, and severe exacerbations were all independently associated with worse SLAs. Conclusions: The type and extent of SLAs in patients with BE are highly heterogeneous. Strong relationships between radiological disease and clinical features suggest that CT analysis may be a useful tool for clinical phenotyping.
Collapse
Affiliation(s)
- Angelina L P Pieters
- Department of Radiology and Nuclear Medicine
- Department of Pediatrics, Division of Respiratory Medicine and Allergy, Erasmus MC-Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | | | - Jennifer J Meerburg
- Department of Radiology and Nuclear Medicine
- Department of Pediatrics, Division of Respiratory Medicine and Allergy, Erasmus MC-Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Eleni-Rosalina Andrinopoulou
- Department of Biostatistics, and
- Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | | | - Pierluigi Ciet
- Department of Radiology and Nuclear Medicine
- Department of Pediatrics, Division of Respiratory Medicine and Allergy, Erasmus MC-Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
- Department of Radiology, University of Cagliari, Cagliari, Italy
| | - Stefano Aliberti
- Department of Biomedical Sciences, Humanitas University, Milan, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico Humanitas Research Hospital, Respiratory Unit, Milan, Italy
| | - Pierre-Regis Burgel
- Institut Cochin, Hôpital Cochin, Assistance Publique-Hôpitaux de Paris, Université Paris Descartes, Paris, France
| | - Megan L Crichton
- School of Medicine, University of Dundee, Ninewells Hospital and Medical School, Dundee, United Kingdom
| | - Amelia Shoemark
- School of Medicine, University of Dundee, Ninewells Hospital and Medical School, Dundee, United Kingdom
| | - Pieter C Goeminne
- Department of Respiratory Medicine, AZ Nikolaas, Sint-Niklaas, Belgium
| | | | - Michael R Loebinger
- Host Defence Unit, Royal Brompton Hospital, National Heart and Lung Institute, Imperial College, London, United Kingdom
| | - Charles S Haworth
- Cambridge Centre for Lung Infection, Royal Papworth Hospital, Cambridge, United Kingdom
| | - Francesco Blasi
- Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy; and
- Internal Medicine Department, Respiratory Unit and Cystic Fibrosis Center, Fondazione Istituto di Ricovero e Cura a Carattere Scientifico Cà'Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Harm A W M Tiddens
- Department of Radiology and Nuclear Medicine
- Department of Pediatrics, Division of Respiratory Medicine and Allergy, Erasmus MC-Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Daan Caudri
- Department of Radiology and Nuclear Medicine
- Department of Pediatrics, Division of Respiratory Medicine and Allergy, Erasmus MC-Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - James D Chalmers
- School of Medicine, University of Dundee, Ninewells Hospital and Medical School, Dundee, United Kingdom
| |
Collapse
|
41
|
Atkinson CJ, Seth I, Seifman MA, Rozen WM, Cuomo R. Enhancing Hand Fracture Care: A Prospective Study of Artificial Intelligence Application With ChatGPT. JOURNAL OF HAND SURGERY GLOBAL ONLINE 2024; 6:524-528. [PMID: 39166196 PMCID: PMC11331228 DOI: 10.1016/j.jhsg.2024.03.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Accepted: 03/26/2024] [Indexed: 08/22/2024] Open
Abstract
Purpose The integration of artificial intelligence and machine learning technologies into the medical field has brought about remarkable advancements, particularly in the domain of clinical decision support systems. However, it is uncertain how they will perform as clinical decision-makers. Methods This prospective cohort study evaluates the potential of incorporating ChatGPT-4 plus into the management of subcapital fifth metacarpal fractures. The treatment recommendations provided by ChatGPT-4 plus were compared with those of the two control groups-the attending clinic plastic surgeon and an independent expert panel. The primary outcome measures, operative or conservative, were compared between the groups. Intraclass correlation of 0.61 infers moderate reliability in the consistency of recommended management plans across all groups. Results Key predictors for opting for operative management, regardless of the decision-maker, included clinical signs of scissoring, extension deficit, and radiographic evidence of intra-articular extension. Conclusions These findings support the potential for artificial intelligence applications in enhancing diagnostic and treatment decisions. Type of study/level of evidence Therapeutic IV.
Collapse
Affiliation(s)
- Connor John Atkinson
- Department of Plastic and Reconstructive Surgery, Frankston Hospital, Peninsula Health, Frankston, VIC, Australia
| | - Ishith Seth
- Department of Plastic and Reconstructive Surgery, Frankston Hospital, Peninsula Health, Frankston, VIC, Australia
- Department of Surgery, Central Clinical School, Monash University, Alfred Hospital, Prahran, VIC, Australia
| | - Marc Adam Seifman
- Department of Plastic and Reconstructive Surgery, Frankston Hospital, Peninsula Health, Frankston, VIC, Australia
| | - Warren Matthew Rozen
- Department of Plastic and Reconstructive Surgery, Frankston Hospital, Peninsula Health, Frankston, VIC, Australia
- Department of Surgery, Central Clinical School, Monash University, Alfred Hospital, Prahran, VIC, Australia
| | - Roberto Cuomo
- Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| |
Collapse
|
42
|
Alami H, Lehoux P, Papoutsi C, Shaw SE, Fleet R, Fortin JP. Understanding the integration of artificial intelligence in healthcare organisations and systems through the NASSS framework: a qualitative study in a leading Canadian academic centre. BMC Health Serv Res 2024; 24:701. [PMID: 38831298 PMCID: PMC11149257 DOI: 10.1186/s12913-024-11112-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 05/14/2024] [Indexed: 06/05/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) technologies are expected to "revolutionise" healthcare. However, despite their promises, their integration within healthcare organisations and systems remains limited. The objective of this study is to explore and understand the systemic challenges and implications of their integration in a leading Canadian academic hospital. METHODS Semi-structured interviews were conducted with 29 stakeholders concerned by the integration of a large set of AI technologies within the organisation (e.g., managers, clinicians, researchers, patients, technology providers). Data were collected and analysed using the Non-Adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework. RESULTS Among enabling factors and conditions, our findings highlight: a supportive organisational culture and leadership leading to a coherent organisational innovation narrative; mutual trust and transparent communication between senior management and frontline teams; the presence of champions, translators, and boundary spanners for AI able to build bridges and trust; and the capacity to attract technical and clinical talents and expertise. Constraints and barriers include: contrasting definitions of the value of AI technologies and ways to measure such value; lack of real-life and context-based evidence; varying patients' digital and health literacy capacities; misalignments between organisational dynamics, clinical and administrative processes, infrastructures, and AI technologies; lack of funding mechanisms covering the implementation, adaptation, and expertise required; challenges arising from practice change, new expertise development, and professional identities; lack of official professional, reimbursement, and insurance guidelines; lack of pre- and post-market approval legal and governance frameworks; diversity of the business and financing models for AI technologies; and misalignments between investors' priorities and the needs and expectations of healthcare organisations and systems. CONCLUSION Thanks to the multidimensional NASSS framework, this study provides original insights and a detailed learning base for analysing AI technologies in healthcare from a thorough socio-technical perspective. Our findings highlight the importance of considering the complexity characterising healthcare organisations and systems in current efforts to introduce AI technologies within clinical routines. This study adds to the existing literature and can inform decision-making towards a judicious, responsible, and sustainable integration of these technologies in healthcare organisations and systems.
Collapse
Affiliation(s)
- Hassane Alami
- Department of Health Management, Evaluation and Policy, School of Public Health, University of Montreal, P.O. Box 6128, Branch Centre-Ville, Montreal, QC, H3C 3J7, Canada.
- Center for Public Health Research of the University of Montreal, Montreal, QC, Canada.
- Institute for Data Valorization (IVADO), Montreal, QC, Canada.
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
| | - Pascale Lehoux
- Department of Health Management, Evaluation and Policy, School of Public Health, University of Montreal, P.O. Box 6128, Branch Centre-Ville, Montreal, QC, H3C 3J7, Canada
- Center for Public Health Research of the University of Montreal, Montreal, QC, Canada
| | - Chrysanthi Papoutsi
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sara E Shaw
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Richard Fleet
- Faculty of Medicine, Laval University, Quebec, QC, Canada
- VITAM Research Centre on Sustainable Health, Faculty of Medicine, Laval University, Quebec, QC, Canada
| | - Jean-Paul Fortin
- Faculty of Medicine, Laval University, Quebec, QC, Canada
- VITAM Research Centre on Sustainable Health, Faculty of Medicine, Laval University, Quebec, QC, Canada
| |
Collapse
|
43
|
Seoni S, Shahini A, Meiburger KM, Marzola F, Rotunno G, Acharya UR, Molinari F, Salvi M. All you need is data preparation: A systematic review of image harmonization techniques in Multi-center/device studies for medical support systems. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 250:108200. [PMID: 38677080 DOI: 10.1016/j.cmpb.2024.108200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 04/20/2024] [Accepted: 04/22/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND AND OBJECTIVES Artificial intelligence (AI) models trained on multi-centric and multi-device studies can provide more robust insights and research findings compared to single-center studies. However, variability in acquisition protocols and equipment can introduce inconsistencies that hamper the effective pooling of multi-source datasets. This systematic review evaluates strategies for image harmonization, which standardizes appearances to enable reliable AI analysis of multi-source medical imaging. METHODS A literature search using PRISMA guidelines was conducted to identify relevant papers published between 2013 and 2023 analyzing multi-centric and multi-device medical imaging studies that utilized image harmonization approaches. RESULTS Common image harmonization techniques included grayscale normalization (improving classification accuracy by up to 24.42 %), resampling (increasing the percentage of robust radiomics features from 59.5 % to 89.25 %), and color normalization (enhancing AUC by up to 0.25 in external test sets). Initially, mathematical and statistical methods dominated, but machine and deep learning adoption has risen recently. Color imaging modalities like digital pathology and dermatology have remained prominent application areas, though harmonization efforts have expanded to diverse fields including radiology, nuclear medicine, and ultrasound imaging. In all the modalities covered by this review, image harmonization improved AI performance, with increasing of up to 24.42 % in classification accuracy and 47 % in segmentation Dice scores. CONCLUSIONS Continued progress in image harmonization represents a promising strategy for advancing healthcare by enabling large-scale, reliable analysis of integrated multi-source datasets using AI. Standardizing imaging data across clinical settings can help realize personalized, evidence-based care supported by data-driven technologies while mitigating biases associated with specific populations or acquisition protocols.
Collapse
Affiliation(s)
- Silvia Seoni
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Alen Shahini
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Kristen M Meiburger
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Francesco Marzola
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Giulia Rotunno
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Centre for Health Research, University of Southern Queensland, Australia
| | - Filippo Molinari
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Massimo Salvi
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy.
| |
Collapse
|
44
|
Hoffmann E, Masthoff M, Kunz WG, Seidensticker M, Bobe S, Gerwing M, Berdel WE, Schliemann C, Faber C, Wildgruber M. Multiparametric MRI for characterization of the tumour microenvironment. Nat Rev Clin Oncol 2024; 21:428-448. [PMID: 38641651 DOI: 10.1038/s41571-024-00891-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/04/2024] [Indexed: 04/21/2024]
Abstract
Our understanding of tumour biology has evolved over the past decades and cancer is now viewed as a complex ecosystem with interactions between various cellular and non-cellular components within the tumour microenvironment (TME) at multiple scales. However, morphological imaging remains the mainstay of tumour staging and assessment of response to therapy, and the characterization of the TME with non-invasive imaging has not yet entered routine clinical practice. By combining multiple MRI sequences, each providing different but complementary information about the TME, multiparametric MRI (mpMRI) enables non-invasive assessment of molecular and cellular features within the TME, including their spatial and temporal heterogeneity. With an increasing number of advanced MRI techniques bridging the gap between preclinical and clinical applications, mpMRI could ultimately guide the selection of treatment approaches, precisely tailored to each individual patient, tumour and therapeutic modality. In this Review, we describe the evolving role of mpMRI in the non-invasive characterization of the TME, outline its applications for cancer detection, staging and assessment of response to therapy, and discuss considerations and challenges for its use in future medical applications, including personalized integrated diagnostics.
Collapse
Affiliation(s)
- Emily Hoffmann
- Clinic of Radiology, University of Münster, Münster, Germany
| | - Max Masthoff
- Clinic of Radiology, University of Münster, Münster, Germany
| | - Wolfgang G Kunz
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Max Seidensticker
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Stefanie Bobe
- Gerhard Domagk Institute of Pathology, University Hospital Münster, Münster, Germany
| | - Mirjam Gerwing
- Clinic of Radiology, University of Münster, Münster, Germany
| | | | | | - Cornelius Faber
- Clinic of Radiology, University of Münster, Münster, Germany
| | - Moritz Wildgruber
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany.
| |
Collapse
|
45
|
Biroš M, Kvak D, Dandár J, Hrubý R, Janů E, Atakhanova A, Al-antari MA. Enhancing Accuracy in Breast Density Assessment Using Deep Learning: A Multicentric, Multi-Reader Study. Diagnostics (Basel) 2024; 14:1117. [PMID: 38893643 PMCID: PMC11172127 DOI: 10.3390/diagnostics14111117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 05/20/2024] [Accepted: 05/24/2024] [Indexed: 06/21/2024] Open
Abstract
The evaluation of mammographic breast density, a critical indicator of breast cancer risk, is traditionally performed by radiologists via visual inspection of mammography images, utilizing the Breast Imaging-Reporting and Data System (BI-RADS) breast density categories. However, this method is subject to substantial interobserver variability, leading to inconsistencies and potential inaccuracies in density assessment and subsequent risk estimations. To address this, we present a deep learning-based automatic detection algorithm (DLAD) designed for the automated evaluation of breast density. Our multicentric, multi-reader study leverages a diverse dataset of 122 full-field digital mammography studies (488 images in CC and MLO projections) sourced from three institutions. We invited two experienced radiologists to conduct a retrospective analysis, establishing a ground truth for 72 mammography studies (BI-RADS class A: 18, BI-RADS class B: 43, BI-RADS class C: 7, BI-RADS class D: 4). The efficacy of the DLAD was then compared to the performance of five independent radiologists with varying levels of experience. The DLAD showed robust performance, achieving an accuracy of 0.819 (95% CI: 0.736-0.903), along with an F1 score of 0.798 (0.594-0.905), precision of 0.806 (0.596-0.896), recall of 0.830 (0.650-0.946), and a Cohen's Kappa (κ) of 0.708 (0.562-0.841). The algorithm achieved robust performance that matches and in four cases exceeds that of individual radiologists. The statistical analysis did not reveal a significant difference in accuracy between DLAD and the radiologists, underscoring the model's competitive diagnostic alignment with professional radiologist assessments. These results demonstrate that the deep learning-based automatic detection algorithm can enhance the accuracy and consistency of breast density assessments, offering a reliable tool for improving breast cancer screening outcomes.
Collapse
Affiliation(s)
- Marek Biroš
- Carebot, Ltd., 128 00 Prague, Czech Republic; (M.B.); (J.D.); (R.H.); (A.A.)
| | - Daniel Kvak
- Carebot, Ltd., 128 00 Prague, Czech Republic; (M.B.); (J.D.); (R.H.); (A.A.)
- Department of Simulation Medicine, Faculty of Medicine, Masaryk University, 625 00 Brno, Czech Republic
| | - Jakub Dandár
- Carebot, Ltd., 128 00 Prague, Czech Republic; (M.B.); (J.D.); (R.H.); (A.A.)
| | - Robert Hrubý
- Carebot, Ltd., 128 00 Prague, Czech Republic; (M.B.); (J.D.); (R.H.); (A.A.)
| | - Eva Janů
- Department of Radiology, Masaryk Memorial Cancer Institute, 602 00 Brno, Czech Republic
| | - Anora Atakhanova
- Carebot, Ltd., 128 00 Prague, Czech Republic; (M.B.); (J.D.); (R.H.); (A.A.)
| | - Mugahed A. Al-antari
- Department of Artificial Intelligence and Data Science, Daeyang AI Center, Sejong University, Seoul 05006, Republic of Korea;
| |
Collapse
|
46
|
Pinto DS, Noronha SM, Saigal G, Quencer RM. Comparison of an AI-Generated Case Report With a Human-Written Case Report: Practical Considerations for AI-Assisted Medical Writing. Cureus 2024; 16:e60461. [PMID: 38883028 PMCID: PMC11179998 DOI: 10.7759/cureus.60461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/15/2024] [Indexed: 06/18/2024] Open
Abstract
INTRODUCTION The utility of ChatGPT has recently caused consternation in the medical world. While it has been utilized to write manuscripts, only a few studies have evaluated the quality of manuscripts generated by AI (artificial intelligence). OBJECTIVE We evaluate the ability of ChatGPT to write a case report when provided with a framework. We also provide practical considerations for manuscript writing using AI. METHODS We compared a manuscript written by a blinded human author (10 years of medical experience) with a manuscript written by ChatGPT on a rare presentation of a common disease. We used multiple iterations of the manuscript generation request to derive the best ChatGPT output. Participants, outcomes, and measures: 22 human reviewers compared the manuscripts using parameters that characterize human writing and relevant standard manuscript assessment criteria, viz., scholarly impact quotient (SIQ). We also compared the manuscripts using the "average perplexity score" (APS), "burstiness score" (BS), and "highest perplexity of a sentence" (GPTZero parameters to detect AI-generated content). RESULTS The human manuscript had a significantly higher quality of presentation and nuanced writing (p<0.05). Both manuscripts had a logical flow. 12/22 reviewers were able to identify the AI-generated manuscript (p<0.05), but 4/22 reviewers wrongly identified the human-written manuscript as AI-generated. GPTZero software erroneously identified four sentences of the human-written manuscript to be AI-generated. CONCLUSION Though AI showed an ability to highlight the novelty of the case report and project a logical flow comparable to the human manuscript, it could not outperform the human writer on all parameters. The human manuscript showed a better quality of presentation and more nuanced writing. The practical considerations we provide for AI-assisted medical writing will help to better utilize AI in manuscript writing.
Collapse
Affiliation(s)
| | | | - Gaurav Saigal
- Radiology, University of Miami Miller School of Medicine, Miami, USA
| | - Robert M Quencer
- Radiology, University of Miami Miller School of Medicine, Miami, USA
| |
Collapse
|
47
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, Dos Santos DP, Tang A, Wald C, Slavotinek J. Developing, Purchasing, Implementing and Monitoring AI Tools in Radiology: Practical Considerations. A Multi-Society Statement From the ACR, CAR, ESR, RANZCR & RSNA. Can Assoc Radiol J 2024; 75:226-244. [PMID: 38251882 DOI: 10.1177/08465371231222229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024] Open
Abstract
Artificial Intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever‑growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones. This multi‑society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical Center, Birmingham, AL, USA
- Data Science Institute, American College of Radiology, Reston, VA, USA
| | - Jaron Chong
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Elmar Kotter
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, CA, USA
- Stanford Center for Artificial Intelligence in Medicine & Imaging, Palo Alto, CA, USA
| | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, SA, Australia
| | - Daniel Pinto Dos Santos
- Department of Radiology, University Hospital of Cologne, Cologne, Germany
- Department of Radiology, University Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation Oncology, and Nuclear Medicine, Université de Montréal, Montréal, QC, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital & Medical Center, Burlington, MA, USA
- Tufts University Medical School, Boston, MA, USA
- American College of Radiology, Reston, VA, USA
| | - John Slavotinek
- South Australia Medical Imaging, Flinders Medical Centre Adelaide, SA, Australia
- College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| |
Collapse
|
48
|
Butler JJ, Puleo J, Harrington MC, Dahmen J, Rosenbaum AJ, Kerkhoffs GMMJ, Kennedy JG. From technical to understandable: Artificial Intelligence Large Language Models improve the readability of knee radiology reports. Knee Surg Sports Traumatol Arthrosc 2024; 32:1077-1086. [PMID: 38488217 DOI: 10.1002/ksa.12133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Revised: 02/19/2024] [Accepted: 02/22/2024] [Indexed: 04/23/2024]
Abstract
PURPOSE The purpose of this study was to evaluate the effectiveness of an Artificial Intelligence-Large Language Model (AI-LLM) at improving the readability of knee radiology reports. METHODS Reports of 100 knee X-rays, 100 knee computed tomography (CT) scans and 100 knee magnetic resonance imaging (MRI) scans were retrieved. The following prompt command was inserted into the AI-LLM: 'Explain this radiology report to a patient in layman's terms in the second person:[Report Text]'. The Flesch-Kincaid reading level (FKRL) score, Flesch reading ease (FRE) score and report length were calculated for the original radiology report and the AI-LLM generated report. Any 'hallucination' or inaccurate text produced by the AI-LLM-generated report was documented. RESULTS Statistically significant improvements in mean FKRL scores in the AI-LLM generated X-ray report (12.7 ± 1.0-7.2 ± 0.6), CT report (13.4 ± 1.0-7.5 ± 0.5) and MRI report (13.5 ± 0.9-7.5 ± 0.6) were observed. Statistically significant improvements in mean FRE scores in the AI-LLM generated X-ray report (39.5 ± 7.5-76.8 ± 5.1), CT report (27.3 ± 5.9-73.1 ± 5.6) and MRI report (26.8 ± 6.4-73.4 ± 5.0) were observed. Superior FKRL scores and FRE scores were observed in the AI-LLM-generated X-ray report compared to the AI-LLM-generated CT report and MRI report, p < 0.001. The hallucination rates in the AI-LLM generated X-ray report, CT report and MRI report were 2%, 5% and 5%, respectively. CONCLUSIONS This study highlights the promising use of AI-LLMs as an innovative, patient-centred strategy to improve the readability of knee radiology reports. The clinical relevance of this study is that an AI-LLM-generated knee radiology report may enhance patients' understanding of their imaging reports, potentially reducing the responder burden placed on the ordering physicians. However, due to the 'hallucinations' produced by the AI-LLM-generated report, the ordering physician must always engage in a collaborative discussion with the patient regarding both reports and the corresponding images. LEVEL OF EVIDENCE Level IV.
Collapse
Affiliation(s)
- James J Butler
- Department of Orthopaedic Surgery, Foot and Ankle Division, NYU Langone Health, New York City, New York, USA
| | - James Puleo
- Albany Medical Center, Albany, New York, USA
| | | | - Jari Dahmen
- Department of Orthopaedic Surgery and Sports Medicine, Amsterdam Movement Sciences, Amsterdam UMC, University of Amsterdam, Location AMC, Amsterdam, The Netherlands
- Academic Center for Evidence-Based Sports Medicine, Amsterdam UMC, Amsterdam, The Netherlands
- Amsterdam Collaboration for Health and Safety in Sports, International Olympic Committee Research Center, Amsterdam UMC, Amsterdam, The Netherlands
| | | | - Gino M M J Kerkhoffs
- Department of Orthopaedic Surgery and Sports Medicine, Amsterdam Movement Sciences, Amsterdam UMC, University of Amsterdam, Location AMC, Amsterdam, The Netherlands
- Academic Center for Evidence-Based Sports Medicine, Amsterdam UMC, Amsterdam, The Netherlands
- Amsterdam Collaboration for Health and Safety in Sports, International Olympic Committee Research Center, Amsterdam UMC, Amsterdam, The Netherlands
| | - John G Kennedy
- Department of Orthopaedic Surgery, Foot and Ankle Division, NYU Langone Health, New York City, New York, USA
| |
Collapse
|
49
|
Katwaroo AR, Adesh VS, Lowtan A, Umakanthan S. The diagnostic, therapeutic, and ethical impact of artificial intelligence in modern medicine. Postgrad Med J 2024; 100:289-296. [PMID: 38159301 DOI: 10.1093/postmj/qgad135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 12/02/2023] [Indexed: 01/03/2024]
Abstract
In the evolution of modern medicine, artificial intelligence (AI) has been proven to provide an integral aspect of revolutionizing clinical diagnosis, drug discovery, and patient care. With the potential to scrutinize colossal amounts of medical data, radiological and histological images, and genomic data in healthcare institutions, AI-powered systems can recognize, determine, and associate patterns and provide impactful insights that would be strenuous and challenging for clinicians to detect during their daily clinical practice. The outcome of AI-mediated search offers more accurate, personalized patient diagnoses, guides in research for new drug therapies, and provides a more effective multidisciplinary treatment plan that can be implemented for patients with chronic diseases. Among the many promising applications of AI in modern medicine, medical imaging stands out distinctly as an area with tremendous potential. AI-powered algorithms can now accurately and sensitively identify cancer cells and other lesions in medical images with greater accuracy and sensitivity. This allows for earlier diagnosis and treatment, which can significantly impact patient outcomes. This review provides a comprehensive insight into diagnostic, therapeutic, and ethical issues with the advent of AI in modern medicine.
Collapse
Affiliation(s)
- Arun Rabindra Katwaroo
- Department of Medicine, Trinidad Institute of Medical Technology, St Augustine, Trinidad and Tobago
| | | | - Amrita Lowtan
- Department of Preclinical Sciences, Faculty of Medical Sciences, The University of the West Indies, St. Augustine, Trinidad and Tobago
| | - Srikanth Umakanthan
- Department of Paraclinical Sciences, Faculty of Medical Sciences, The University of the West Indies, St. Augustine, Trinidad and Tobago
| |
Collapse
|
50
|
Droppelmann G, Rodríguez C, Jorquera C, Feijoo F. Artificial intelligence in diagnosing upper limb musculoskeletal disorders: a systematic review and meta-analysis of diagnostic tests. EFORT Open Rev 2024; 9:241-251. [PMID: 38579757 PMCID: PMC11044087 DOI: 10.1530/eor-23-0174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/07/2024] Open
Abstract
Purpose The integration of artificial intelligence (AI) in radiology has revolutionized diagnostics, optimizing precision and decision-making. Specifically in musculoskeletal imaging, AI tools can improve accuracy for upper extremity pathologies. This study aimed to assess the diagnostic performance of AI models in detecting musculoskeletal pathologies of the upper extremity using different imaging modalities. Methods A meta-analysis was conducted, involving searches on MEDLINE/PubMed, SCOPUS, Cochrane Library, Lilacs, and SciELO. The quality of the studies was assessed using the QUADAS-2 tool. Diagnostic accuracy measures including sensitivity, specificity, diagnostic odds ratio (DOR), positive and negative likelihood ratios (PLR, NLR), area under the curve (AUC), and summary receiver operating characteristic were pooled using a random-effects model. Heterogeneity and subgroup analyses were also included. All statistical analyses and plots were performed using the R software package. Results Thirteen models from ten articles were analyzed. The sensitivity and specificity of the AI models to detect musculoskeletal conditions in the upper extremity were 0.926 (95% CI: 0.900; 0.945) and 0.908 (95% CI: 0.810; 0.958). The PLR, NLR, lnDOR, and the AUC estimates were found to be 19.18 (95% CI: 8.90; 29.34), 0.11 (95% CI: 0.18; 0.46), 4.62 (95% CI: 4.02; 5.22) with a (P < 0.001), and 95%, respectively. Conclusion The AI models exhibited strong univariate and bivariate performance in detecting both positive and negative cases within the analyzed dataset of musculoskeletal pathologies in the upper extremity.
Collapse
Affiliation(s)
- Guillermo Droppelmann
- Research Center on Medicine, Exercise, Sport and Health, MEDS Clinic, Santiago, RM, Chile
- Health Sciences PhD Program, Universidad Católica de Murcia UCAM, Murcia, Spain
- Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA
| | | | - Carlos Jorquera
- Facultad de Ciencias, Escuela de Nutrición y Dietética, Universidad Mayor, Santiago, RM, Chile
| | - Felipe Feijoo
- School of Industrial Engineering, Pontificia Universidad Católica de Valparaíso, Valparaíso, Chile
| |
Collapse
|