1
|
Shiri I, Salimi Y, Sirjani N, Razeghi B, Bagherieh S, Pakbin M, Mansouri Z, Hajianfar G, Avval AH, Askari D, Ghasemian M, Sandoughdaran S, Sohrabi A, Sadati E, Livani S, Iranpour P, Kolahi S, Khosravi B, Bijari S, Sayfollahi S, Atashzar MR, Hasanian M, Shahhamzeh A, Teimouri A, Goharpey N, Shirzad-Aski H, Karimi J, Radmard AR, Rezaei-Kalantari K, Oghli MG, Oveisi M, Vafaei Sadr A, Voloshynovskiy S, Zaidi H. Differential privacy preserved federated learning for prognostic modeling in COVID-19 patients using large multi-institutional chest CT dataset. Med Phys 2024; 51:4736-4747. [PMID: 38335175 DOI: 10.1002/mp.16964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 01/10/2024] [Accepted: 01/21/2024] [Indexed: 02/12/2024] Open
Abstract
BACKGROUND Notwithstanding the encouraging results of previous studies reporting on the efficiency of deep learning (DL) in COVID-19 prognostication, clinical adoption of the developed methodology still needs to be improved. To overcome this limitation, we set out to predict the prognosis of a large multi-institutional cohort of patients with COVID-19 using a DL-based model. PURPOSE This study aimed to evaluate the performance of deep privacy-preserving federated learning (DPFL) in predicting COVID-19 outcomes using chest CT images. METHODS After applying inclusion and exclusion criteria, 3055 patients from 19 centers, including 1599 alive and 1456 deceased, were enrolled in this study. Data from all centers were split (randomly with stratification respective to each center and class) into a training/validation set (70%/10%) and a hold-out test set (20%). For the DL model, feature extraction was performed on 2D slices, and averaging was performed at the final layer to construct a 3D model for each scan. The DensNet model was used for feature extraction. The model was developed using centralized and FL approaches. For FL, we employed DPFL approaches. Membership inference attack was also evaluated in the FL strategy. For model evaluation, different metrics were reported in the hold-out test sets. In addition, models trained in two scenarios, centralized and FL, were compared using the DeLong test for statistical differences. RESULTS The centralized model achieved an accuracy of 0.76, while the DPFL model had an accuracy of 0.75. Both the centralized and DPFL models achieved a specificity of 0.77. The centralized model achieved a sensitivity of 0.74, while the DPFL model had a sensitivity of 0.73. A mean AUC of 0.82 and 0.81 with 95% confidence intervals of (95% CI: 0.79-0.85) and (95% CI: 0.77-0.84) were achieved by the centralized model and the DPFL model, respectively. The DeLong test did not prove statistically significant differences between the two models (p-value = 0.98). The AUC values for the inference attacks fluctuate between 0.49 and 0.51, with an average of 0.50 ± 0.003 and 95% CI for the mean AUC of 0.500 to 0.501. CONCLUSION The performance of the proposed model was comparable to centralized models while operating on large and heterogeneous multi-institutional datasets. In addition, the model was resistant to inference attacks, ensuring the privacy of shared data during the training process.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Nasim Sirjani
- Research and Development Department, Med Fanavarn Plus Co, Karaj, Iran
| | - Behrooz Razeghi
- Department of Computer Science, University of Geneva, Geneva, Switzerland
| | - Sara Bagherieh
- School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Masoumeh Pakbin
- Imaging Department, Qom University of Medical Sciences, Qom, Iran
| | - Zahra Mansouri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Ghasem Hajianfar
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | | | - Dariush Askari
- Department of Radiology Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohammadreza Ghasemian
- Department of Radiology, Shahid Beheshti Hospital, Qom University of Medical Sciences, Qom, Iran
| | - Saleh Sandoughdaran
- Department of Clinical Oncology, Royal Surrey County Hospital, Guildford, UK
| | - Ahmad Sohrabi
- Radin Makian Azma Mehr Ltd., Radinmehr Veterinary Laboratory, Iran University of Medical Sciences, Gorgan, Iran
| | - Elham Sadati
- Department of Medical Physics, Faculty of Medical Sciences, Tarbiat Modares University, Tehran, Iran
| | - Somayeh Livani
- Clinical Research Development Unit (CRDU), Sayad Shirazi Hospital, Golestan University of Medical Sciences, Gorgan, Iran
| | - Pooya Iranpour
- Medical Imaging Research Center, Department of Radiology, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Shahriar Kolahi
- Department of Radiology, School of Medicine, Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Imam Khomeini Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Bardia Khosravi
- Digestive Diseases Research Center, Digestive Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Salar Bijari
- Department of Medical Physics, Faculty of Medical Sciences, Tarbiat Modares University, Tehran, Iran
| | - Sahar Sayfollahi
- Department of Neurosurgery, Faculty of Medical Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mohammad Reza Atashzar
- Department of Immunology, School of Medicine, Fasa University of Medical Sciences, Fasa, Iran
| | - Mohammad Hasanian
- Department of Radiology, Arak University of Medical Sciences, Arak, Iran
| | - Alireza Shahhamzeh
- Clinical research development center, Qom University of Medical Sciences, Qom, Iran
| | - Arash Teimouri
- Medical Imaging Research Center, Department of Radiology, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Neda Goharpey
- Department of radiation oncology, Shohada-e Tajrish Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | | | - Jalal Karimi
- Department of Infectious Disease, School of Medicine, Fasa University of Medical Sciences, Fasa, Iran
| | - Amir Reza Radmard
- Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Kiara Rezaei-Kalantari
- Rajaie Cardiovascular, Medical & Research Center, Iran University of Medical Science, Tehran, Iran
| | | | - Mehrdad Oveisi
- Department of Computer Science, University of British Columbia, Vancouver, British Columbia, Canada
| | - Alireza Vafaei Sadr
- Department of Public Health Sciences, College of Medicine, Pennsylvania State University, Hershey, Pennsylvania, USA
| | | | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
- University Research and Innovation Center, Óbuda University, Budapest, Hungary
| |
Collapse
|
2
|
Suresh V, Singh KK, Vaish E, Gurjar M, Ambuli Nambi A, Khulbe Y, Muzaffar S. Artificial Intelligence in the Intensive Care Unit: Current Evidence on an Inevitable Future Tool. Cureus 2024; 16:e59797. [PMID: 38846182 PMCID: PMC11154024 DOI: 10.7759/cureus.59797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/07/2024] [Indexed: 06/09/2024] Open
Abstract
Artificial intelligence (AI) is a technique that attempts to replicate human intelligence, analytical behavior, and decision-making ability. This includes machine learning, which involves the use of algorithms and statistical techniques to enhance the computer's ability to make decisions more accurately. Due to AI's ability to analyze, comprehend, and interpret considerable volumes of data, it has been increasingly used in the field of healthcare. In critical care medicine, where most of the patient load requires timely interventions due to the perilous nature of the condition, AI's ability to monitor, analyze, and predict unfavorable outcomes is an invaluable asset. It can significantly improve timely interventions and prevent unfavorable outcomes, which, otherwise, is not always achievable owing to the constrained human ability to multitask with optimum efficiency. AI has been implicated in intensive care units over the past many years. In addition to its advantageous applications, this article discusses its disadvantages, prospects, and the changes needed to train future critical care professionals. A comprehensive search of electronic databases was performed using relevant keywords. Data from articles pertinent to the topic was assimilated into this review article.
Collapse
Affiliation(s)
- Vinay Suresh
- General Medicine and Surgery, King George's Medical University, Lucknow, IND
| | - Kaushal K Singh
- General Medicine, King George's Medical University, Lucknow, IND
| | - Esha Vaish
- Internal Medicine, Mount Sinai Morningside West, New York, USA
| | - Mohan Gurjar
- Critical Care Medicine, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow, IND
| | | | - Yashita Khulbe
- General Medicine and Surgery, King George's Medical University, Lucknow, IND
| | - Syed Muzaffar
- Critical Care Medicine, King George's Medical University, Lucknow, IND
| |
Collapse
|
3
|
Fang X, Lv Y, Lv W, Liu L, Feng Y, Liu L, Pan F, Zhang Y. CT-based Assessment at 6-Month Follow-up of COVID-19 Pneumonia patients in China. Sci Rep 2024; 14:5028. [PMID: 38424447 PMCID: PMC10904828 DOI: 10.1038/s41598-024-54920-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Accepted: 02/18/2024] [Indexed: 03/02/2024] Open
Abstract
This study aimed to assess pulmonary changes at 6-month follow-up CT and predictors of pulmonary residual abnormalities and fibrotic-like changes in COVID-19 pneumonia patients in China following relaxation of COVID restrictions in 2022. A total of 271 hospitalized patients with COVID-19 pneumonia admitted between November 29, 2022 and February 10, 2023 were prospectively evaluated at 6 months. CT characteristics and Chest CT scores of pulmonary abnormalities were compared between the initial and the 6-month CT. The association of demographic and clinical factors with CT residual abnormalities or fibrotic-like changes were assessed using logistic regression. Follow-up CT scans were obtained at a median of 177 days (IQR, 170-185 days) after hospital admission. Pulmonary residual abnormalities and fibrotic-like changes were found in 98 (36.2%) and 39 (14.4%) participants. In multivariable analysis of pulmonary residual abnormalities and fibrotic-like changes, the top three predictive factors were invasive ventilation (OR 13.6; 95% CI 1.9, 45; P < .001), age > 60 years (OR 9.1; 95% CI 2.3, 39; P = .01), paxlovid (OR 0.11; 95% CI 0.04, 0.48; P = .01) and invasive ventilation (OR 10.3; 95% CI 2.9, 33; P = .002), paxlovid (OR 0.1; 95% CI 0.03, 0.48; P = .01), smoker (OR 9.9; 95% CI 2.4, 31; P = .01), respectively. The 6-month follow-up CT of recent COVID-19 pneumonia cases in China showed a considerable proportion of the patients with pulmonary residual abnormalities and fibrotic-like changes. Antivirals against SARS-CoV-2 like paxlovid may be beneficial for long-term regression of COVID-19 pneumonia.
Collapse
Affiliation(s)
- Xingyu Fang
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Yuan Lv
- Medical Department of General Surgery, Chinese PLA General Hospital, The 1St Medical Center, Beijing, 100853, China
- Department of General Surgery, The 7Th Medical Center, Chinese PLA General Hospital, Beijing, 100700, China
| | - Wei Lv
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Lin Liu
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Yun Feng
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Li Liu
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Feng Pan
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Yijun Zhang
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China.
| |
Collapse
|
4
|
Soltan AAS, Thakur A, Yang J, Chauhan A, D'Cruz LG, Dickson P, Soltan MA, Thickett DR, Eyre DW, Zhu T, Clifton DA. A scalable federated learning solution for secondary care using low-cost microcomputing: privacy-preserving development and evaluation of a COVID-19 screening test in UK hospitals. Lancet Digit Health 2024; 6:e93-e104. [PMID: 38278619 DOI: 10.1016/s2589-7500(23)00226-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 10/17/2023] [Accepted: 10/30/2023] [Indexed: 01/28/2024]
Abstract
BACKGROUND Multicentre training could reduce biases in medical artificial intelligence (AI); however, ethical, legal, and technical considerations can constrain the ability of hospitals to share data. Federated learning enables institutions to participate in algorithm development while retaining custody of their data but uptake in hospitals has been limited, possibly as deployment requires specialist software and technical expertise at each site. We previously developed an artificial intelligence-driven screening test for COVID-19 in emergency departments, known as CURIAL-Lab, which uses vital signs and blood tests that are routinely available within 1 h of a patient's arrival. Here we aimed to federate our COVID-19 screening test by developing an easy-to-use embedded system-which we introduce as full-stack federated learning-to train and evaluate machine learning models across four UK hospital groups without centralising patient data. METHODS We supplied a Raspberry Pi 4 Model B preloaded with our federated learning software pipeline to four National Health Service (NHS) hospital groups in the UK: Oxford University Hospitals NHS Foundation Trust (OUH; through the locally linked research University, University of Oxford), University Hospitals Birmingham NHS Foundation Trust (UHB), Bedfordshire Hospitals NHS Foundation Trust (BH), and Portsmouth Hospitals University NHS Trust (PUH). OUH, PUH, and UHB participated in federated training, training a deep neural network and logistic regressor over 150 rounds to form and calibrate a global model to predict COVID-19 status, using clinical data from patients admitted before the pandemic (COVID-19-negative) and testing positive for COVID-19 during the first wave of the pandemic. We conducted a federated evaluation of the global model for admissions during the second wave of the pandemic at OUH, PUH, and externally at BH. For OUH and PUH, we additionally performed local fine-tuning of the global model using the sites' individual training data, forming a site-tuned model, and evaluated the resultant model for admissions during the second wave of the pandemic. This study included data collected between Dec 1, 2018, and March 1, 2021; the exact date ranges used varied by site. The primary outcome was overall model performance, measured as the area under the receiver operating characteristic curve (AUROC). Removable micro secure digital (microSD) storage was destroyed on study completion. FINDINGS Clinical data from 130 941 patients (1772 COVID-19-positive), routinely collected across three hospital groups (OUH, PUH, and UHB), were included in federated training. The evaluation step included data from 32 986 patients (3549 COVID-19-positive) attending OUH, PUH, or BH during the second wave of the pandemic. Federated training of a global deep neural network classifier improved upon performance of models trained locally in terms of AUROC by a mean of 27·6% (SD 2·2): AUROC increased from 0·574 (95% CI 0·560-0·589) at OUH and 0·622 (0·608-0·637) at PUH using the locally trained models to 0·872 (0·862-0·882) at OUH and 0·876 (0·865-0·886) at PUH using the federated global model. Performance improvement was smaller for a logistic regression model, with a mean increase in AUROC of 13·9% (0·5%). During federated external evaluation at BH, AUROC for the global deep neural network model was 0·917 (0·893-0·942), with 89·7% sensitivity (83·6-93·6) and 76·6% specificity (73·9-79·1). Site-specific tuning of the global model did not significantly improve performance (change in AUROC <0·01). INTERPRETATION We developed an embedded system for federated learning, using microcomputing to optimise for ease of deployment. We deployed full-stack federated learning across four UK hospital groups to develop a COVID-19 screening test without centralising patient data. Federation improved model performance, and the resultant global models were generalisable. Full-stack federated learning could enable hospitals to contribute to AI development at low cost and without specialist technical expertise at each site. FUNDING The Wellcome Trust, University of Oxford Medical and Life Sciences Translational Fund.
Collapse
Affiliation(s)
- Andrew A S Soltan
- Oxford University Hospitals NHS Foundation Trust, Oxford, UK; Department of Oncology, University of Oxford, Oxford, UK; Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK; Big Data Institute, Nuffield Department of Population Health, University of Oxford, Oxford, UK; Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
| | - Anshul Thakur
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
| | - Jenny Yang
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
| | - Anoop Chauhan
- Portsmouth Hospitals University NHS Trust, Portsmouth, UK
| | - Leon G D'Cruz
- Portsmouth Hospitals University NHS Trust, Portsmouth, UK
| | | | - Marina A Soltan
- The Queen Elizabeth Hospital, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK; Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
| | - David R Thickett
- The Queen Elizabeth Hospital, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK; Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
| | - David W Eyre
- Oxford University Hospitals NHS Foundation Trust, Oxford, UK; Big Data Institute, Nuffield Department of Population Health, University of Oxford, Oxford, UK; NIHR Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, University of Oxford and Public Health England, Oxford, UK; NIHR Oxford Biomedical Research Centre, Oxford, UK
| | - Tingting Zhu
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
| | - David A Clifton
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK; NIHR Oxford Biomedical Research Centre, Oxford, UK; Oxford-Suzhou Centre for Advanced Research, Suzhou, China
| |
Collapse
|
5
|
Grenier PA, Brun AL, Mellot F. [The contribution of artificial intelligence (AI) subsequent to the processing of thoracic imaging]. Rev Mal Respir 2024; 41:110-126. [PMID: 38129269 DOI: 10.1016/j.rmr.2023.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 11/27/2023] [Indexed: 12/23/2023]
Abstract
The contribution of artificial intelligence (AI) to medical imaging is currently the object of widespread experimentation. The development of deep learning (DL) methods, particularly convolution neural networks (CNNs), has led to performance gains often superior to those achieved by conventional methods such as machine learning. Radiomics is an approach aimed at extracting quantitative data not accessible to the human eye from images expressing a disease. The data subsequently feed machine learning models and produce diagnostic or prognostic probabilities. As for the multiple applications of AI methods in thoracic imaging, they are undergoing evaluation. Chest radiography is a practically ideal field for the development of DL algorithms able to automatically interpret X-rays. Current algorithms can detect up to 14 different abnormalities present either in isolation or in combination. Chest CT is another area offering numerous AI applications. Various algorithms have been specifically formed and validated for the detection and characterization of pulmonary nodules and pulmonary embolism, as well as segmentation and quantitative analysis of the extent of diffuse lung diseases (emphysema, infectious pneumonias, interstitial lung disease). In addition, the analysis of medical images can be associated with clinical, biological, and functional data (multi-omics analysis), the objective being to construct predictive approaches regarding disease prognosis and response to treatment.
Collapse
Affiliation(s)
- P A Grenier
- Délégation à la recherche clinique et l'innovation, hôpital Foch, Suresnes, France.
| | - A L Brun
- Service de radiologie, hôpital Foch, Suresnes, France
| | - F Mellot
- Service de radiologie, hôpital Foch, Suresnes, France
| |
Collapse
|
6
|
Ha J, Yoon DY, Baek S, Lee CW, Lim KJ, Seo YL, Yun EJ. The 100 most-cited and 100 most-mentioned COVID-19-related radiological articles: a comparative bibliometric analysis. Eur Radiol 2024; 34:1167-1175. [PMID: 37581662 DOI: 10.1007/s00330-023-10001-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 05/23/2023] [Accepted: 06/05/2023] [Indexed: 08/16/2023]
Abstract
OBJECTIVES This study aimed to identify the 100 most-cited and 100 most-mentioned coronavirus disease-2019 (COVID-19)-related radiological articles and compare their characteristics. MATERIALS AND METHODS We searched the Web of Science and Altmetric.com using the search terms "COVID," "COVID-19," "Coronavirus," "SARS-CoV-2," "nCoV," and "pandemic" to identify the most-cited and most-mentioned COVID-19-related articles. We identified the top 100 most-cited and 100 most-mentioned articles in the field of radiology, regardless of their publication journal. We extracted the information from the listed articles and compared the characteristics between the most-cited and most-mentioned. RESULTS Thirty (30%) articles were featured in the lists of the most-cited and most-mentioned articles. The comparison of the 100 most-cited and most-mentioned articles on each list showed that the most frequently cited articles were published in November 2020 and before (p < .001), originated from China (p < .001), covered the topic of diagnosis of COVID-19 (p < .001), and were related to the subspecialty of pulmonary imaging (p < .001); the most frequently mentioned articles were published in December 2020 and after (p < .001), originated from the USA (p < .001), covered the topic of diagnosis of sequelae of COVID-19 (p = .013) and post-vaccination complications (p < .001), and were related to the subspecialties of cardiac imaging (p < .001) and neuroradiology (p < .013). CONCLUSION Significant differences were observed in publication date, country of origin, topic, and subspecialty of scientific knowledge related to COVID-19 in the field of radiology, between citation and public dissemination. CLINICAL RELEVANCE STATEMENT This bibliometric analysis compares the 100 most-cited and 100 most-mentioned COVID-19-related radiologic articles, aiming to provide valuable insights into the patterns of knowledge dissemination during the pandemic era. KEY POINTS • Thirty articles were featured on the lists of the 100 most-cited and 100 most-mentioned COVID-19-related articles. • The 70 unique most-cited articles more frequently originated from China (48.6%), while the unique most-mentioned articles more frequently originated from the USA (51.4%) (p < 0.001). • The 70 unique most-mentioned articles were more frequently related to cardiac imaging (25.7% vs.0%, p < 0.001) and neuroradiology (15.7% vs. 1.4%, p < 0.005) compared to the unique most-mentioned articles.
Collapse
Affiliation(s)
- Jiyeon Ha
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea
| | - Dae Young Yoon
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea.
| | - Sora Baek
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea.
| | - Chae Woon Lee
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea
| | - Kyoung Ja Lim
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea
| | - Young Lan Seo
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea
| | - Eun Joo Yun
- Department of Radiology, Kangdong Seong-Sim Hospital, Hallym University College of Medicine, 150, Seongan-Ro, Gangdong-Gu, Seoul, 05355, Republic of Korea
| |
Collapse
|
7
|
Haque SBU, Zafar A. Robust Medical Diagnosis: A Novel Two-Phase Deep Learning Framework for Adversarial Proof Disease Detection in Radiology Images. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:308-338. [PMID: 38343214 PMCID: PMC11266337 DOI: 10.1007/s10278-023-00916-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 09/23/2023] [Accepted: 10/08/2023] [Indexed: 03/02/2024]
Abstract
In the realm of medical diagnostics, the utilization of deep learning techniques, notably in the context of radiology images, has emerged as a transformative force. The significance of artificial intelligence (AI), specifically machine learning (ML) and deep learning (DL), lies in their capacity to rapidly and accurately diagnose diseases from radiology images. This capability has been particularly vital during the COVID-19 pandemic, where rapid and precise diagnosis played a pivotal role in managing the spread of the virus. DL models, trained on vast datasets of radiology images, have showcased remarkable proficiency in distinguishing between normal and COVID-19-affected cases, offering a ray of hope amidst the crisis. However, as with any technological advancement, vulnerabilities emerge. Deep learning-based diagnostic models, although proficient, are not immune to adversarial attacks. These attacks, characterized by carefully crafted perturbations to input data, can potentially disrupt the models' decision-making processes. In the medical context, such vulnerabilities could have dire consequences, leading to misdiagnoses and compromised patient care. To address this, we propose a two-phase defense framework that combines advanced adversarial learning and adversarial image filtering techniques. We use a modified adversarial learning algorithm to enhance the model's resilience against adversarial examples during the training phase. During the inference phase, we apply JPEG compression to mitigate perturbations that cause misclassification. We evaluate our approach on three models based on ResNet-50, VGG-16, and Inception-V3. These models perform exceptionally in classifying radiology images (X-ray and CT) of lung regions into normal, pneumonia, and COVID-19 pneumonia categories. We then assess the vulnerability of these models to three targeted adversarial attacks: fast gradient sign method (FGSM), projected gradient descent (PGD), and basic iterative method (BIM). The results show a significant drop in model performance after the attacks. However, our defense framework greatly improves the models' resistance to adversarial attacks, maintaining high accuracy on adversarial examples. Importantly, our framework ensures the reliability of the models in diagnosing COVID-19 from clean images.
Collapse
Affiliation(s)
- Sheikh Burhan Ul Haque
- Department of Computer Science, Aligarh Muslim University, Uttar Pradesh, Aligarh, 202002, India.
| | - Aasim Zafar
- Department of Computer Science, Aligarh Muslim University, Uttar Pradesh, Aligarh, 202002, India
| |
Collapse
|
8
|
Sandhu SS, Gorji HT, Tavakolian P, Tavakolian K, Akhbardeh A. Medical Imaging Applications of Federated Learning. Diagnostics (Basel) 2023; 13:3140. [PMID: 37835883 PMCID: PMC10572559 DOI: 10.3390/diagnostics13193140] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 10/03/2023] [Accepted: 10/03/2023] [Indexed: 10/15/2023] Open
Abstract
Since its introduction in 2016, researchers have applied the idea of Federated Learning (FL) to several domains ranging from edge computing to banking. The technique's inherent security benefits, privacy-preserving capabilities, ease of scalability, and ability to transcend data biases have motivated researchers to use this tool on healthcare datasets. While several reviews exist detailing FL and its applications, this review focuses solely on the different applications of FL to medical imaging datasets, grouping applications by diseases, modality, and/or part of the body. This Systematic Literature review was conducted by querying and consolidating results from ArXiv, IEEE Xplorer, and PubMed. Furthermore, we provide a detailed description of FL architecture, models, descriptions of the performance achieved by FL models, and how results compare with traditional Machine Learning (ML) models. Additionally, we discuss the security benefits, highlighting two primary forms of privacy-preserving techniques, including homomorphic encryption and differential privacy. Finally, we provide some background information and context regarding where the contributions lie. The background information is organized into the following categories: architecture/setup type, data-related topics, security, and learning types. While progress has been made within the field of FL and medical imaging, much room for improvement and understanding remains, with an emphasis on security and data issues remaining the primary concerns for researchers. Therefore, improvements are constantly pushing the field forward. Finally, we highlighted the challenges in deploying FL in medical imaging applications and provided recommendations for future directions.
Collapse
Affiliation(s)
- Sukhveer Singh Sandhu
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
| | - Hamed Taheri Gorji
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
- SafetySpect Inc., 4200 James Ray Dr., Grand Forks, ND 58202, USA
| | - Pantea Tavakolian
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
| | - Kouhyar Tavakolian
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
| | | |
Collapse
|
9
|
Tanaka H, Maetani T, Chubachi S, Tanabe N, Shiraishi Y, Asakura T, Namkoong H, Shimada T, Azekawa S, Otake S, Nakagawara K, Fukushima T, Watase M, Terai H, Sasaki M, Ueda S, Kato Y, Harada N, Suzuki S, Yoshida S, Tateno H, Yamada Y, Jinzaki M, Hirai T, Okada Y, Koike R, Ishii M, Hasegawa N, Kimura A, Imoto S, Miyano S, Ogawa S, Kanai T, Fukunaga K. Clinical utilization of artificial intelligence-based COVID-19 pneumonia quantification using chest computed tomography - a multicenter retrospective cohort study in Japan. Respir Res 2023; 24:241. [PMID: 37798709 PMCID: PMC10552312 DOI: 10.1186/s12931-023-02530-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 09/04/2023] [Indexed: 10/07/2023] Open
Abstract
BACKGROUND Computed tomography (CT) imaging and artificial intelligence (AI)-based analyses have aided in the diagnosis and prediction of the severity of COVID-19. However, the potential of AI-based CT quantification of pneumonia in assessing patients with COVID-19 has not yet been fully explored. This study aimed to investigate the potential of AI-based CT quantification of COVID-19 pneumonia to predict the critical outcomes and clinical characteristics of patients with residual lung lesions. METHODS This retrospective cohort study included 1,200 hospitalized patients with COVID-19 from four hospitals. The incidence of critical outcomes (requiring the support of high-flow oxygen or invasive mechanical ventilation or death) and complications during hospitalization (bacterial infection, renal failure, heart failure, thromboembolism, and liver dysfunction) was compared between the groups of pneumonia with high/low-percentage lung lesions, based on AI-based CT quantification. Additionally, 198 patients underwent CT scans 3 months after admission to analyze prognostic factors for residual lung lesions. RESULTS The pneumonia group with a high percentage of lung lesions (N = 400) had a higher incidence of critical outcomes and complications during hospitalization than the low percentage group (N = 800). Multivariable analysis demonstrated that AI-based CT quantification of pneumonia was independently associated with critical outcomes (adjusted odds ratio [aOR] 10.5, 95% confidence interval [CI] 5.59-19.7), as well as with oxygen requirement (aOR 6.35, 95% CI 4.60-8.76), IMV requirement (aOR 7.73, 95% CI 2.52-23.7), and mortality rate (aOR 6.46, 95% CI 1.87-22.3). Among patients with follow-up CT scans (N = 198), the multivariable analysis revealed that the pneumonia group with a high percentage of lung lesions on admission (aOR 4.74, 95% CI 2.36-9.52), older age (aOR 2.53, 95% CI 1.16-5.51), female sex (aOR 2.41, 95% CI 1.13-5.11), and medical history of hypertension (aOR 2.22, 95% CI 1.09-4.50) independently predicted persistent residual lung lesions. CONCLUSIONS AI-based CT quantification of pneumonia provides valuable information beyond qualitative evaluation by physicians, enabling the prediction of critical outcomes and residual lung lesions in patients with COVID-19.
Collapse
Affiliation(s)
- Hiromu Tanaka
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Tomoki Maetani
- Department of Respiratory Medicine, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Shotaro Chubachi
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan.
| | - Naoya Tanabe
- Department of Respiratory Medicine, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan.
| | - Yusuke Shiraishi
- Department of Respiratory Medicine, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Takanori Asakura
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
- Department of Clinical Medicine (Laboratory of Bioregulatory Medicine), Kitasato University School of Pharmacy, Tokyo, Japan
- Department of Respiratory Medicine, Kitasato University, Kitasato Institute Hospital, Tokyo, Japan
| | - Ho Namkoong
- Department of Infectious Diseases, Keio University School of Medicine, Tokyo, Japan
| | - Takashi Shimada
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Shuhei Azekawa
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Shiro Otake
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Kensuke Nakagawara
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Takahiro Fukushima
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Mayuko Watase
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Hideki Terai
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Mamoru Sasaki
- Department of Respiratory Medicine, JCHO (Japan Community Health care Organization), Saitama Medical Center, Saitama, Japan
| | - Soichiro Ueda
- Department of Respiratory Medicine, JCHO (Japan Community Health care Organization), Saitama Medical Center, Saitama, Japan
| | - Yukari Kato
- Department of Respiratory Medicine, Juntendo University Faculty of Medicine and Graduate School of Medicine, Tokyo, Japan
| | - Norihiro Harada
- Department of Respiratory Medicine, Juntendo University Faculty of Medicine and Graduate School of Medicine, Tokyo, Japan
| | - Shoji Suzuki
- Department of Pulmonary Medicine, Saitama City Hospital, Saitama, Japan
| | - Shuichi Yoshida
- Department of Pulmonary Medicine, Saitama City Hospital, Saitama, Japan
| | - Hiroki Tateno
- Department of Pulmonary Medicine, Saitama City Hospital, Saitama, Japan
| | - Yoshitake Yamada
- Department of Radiology, Keio University School of Medicine, Tokyo, Japan
| | - Masahiro Jinzaki
- Department of Radiology, Keio University School of Medicine, Tokyo, Japan
| | - Toyohiro Hirai
- Department of Respiratory Medicine, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Yukinori Okada
- Department of Statistical Genetics, Osaka University Graduate School of Medicine, Suita, Japan
- Department of Genome Informatics, Graduate School of Medicine, the University of Tokyo, Tokyo, Japan
- Laboratory for Systems Genetics, RIKEN Center for Integrative Medical Sciences, Kanagawa, Japan
| | - Ryuji Koike
- Health Science Research and Development Center (HeRD), Tokyo Medical and Dental University, Tokyo, Japan
| | - Makoto Ishii
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
- Department of Respiratory Medicine, Nagoya University Graduate School of Medicine, Nagoya, Japan
| | - Naoki Hasegawa
- Department of Infectious Diseases, Keio University School of Medicine, Tokyo, Japan
| | - Akinori Kimura
- Institute of Research, Tokyo Medical and Dental University, Tokyo, Japan
| | - Seiya Imoto
- Division of Health Medical Intelligence, Human Genome Center, the Institute of Medical Science, the University of Tokyo, Tokyo, Japan
| | - Satoru Miyano
- M&D Data Science Center, Tokyo Medical and Dental University, Tokyo, Japan
| | - Seishi Ogawa
- Department of Pathology and Tumor Biology, Kyoto University, Kyoto, Japan
| | - Takanori Kanai
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Keio University School of Medicine, Tokyo, Japan
| | - Koichi Fukunaga
- Division of Pulmonary Medicine, Department of Internal Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| |
Collapse
|
10
|
Ebong U, Büttner SM, Schmidt SA, Flack F, Korf P, Peters L, Grüner B, Stenger S, Stamminger T, Kestler H, Beer M, Kloth C. Quantitative Evaluation of COVID-19 Pneumonia CT Using AI Analysis-Feasibility and Differentiation from Other Common Pneumonia Forms. Diagnostics (Basel) 2023; 13:2129. [PMID: 37371024 DOI: 10.3390/diagnostics13122129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 05/14/2023] [Accepted: 05/23/2023] [Indexed: 06/29/2023] Open
Abstract
PURPOSE: To implement the technical feasibility of an AI-based software prototype optimized for the detection of COVID-19 pneumonia in CT datasets of the lung and the differentiation between other etiologies of pneumonia. METHODS: This single-center retrospective case-control-study consecutively yielded 144 patients (58 female, mean age 57.72 ± 18.25 y) with CT datasets of the lung. Subgroups including confirmed bacterial (n = 24, 16.6%), viral (n = 52, 36.1%), or fungal (n = 25, 16.6%) pneumonia and (n = 43, 30.7%) patients without detected pneumonia (comparison group) were evaluated using the AI-based Pneumonia Analysis prototype. Scoring (extent, etiology) was compared to reader assessment. RESULTS: The software achieved an optimal sensitivity of 80.8% with a specificity of 50% for the detection of COVID-19; however, the human radiologist achieved optimal sensitivity of 80.8% and a specificity of 97.2%. The mean postprocessing time was 7.61 ± 4.22 min. The use of a contrast agent did not influence the results of the software (p = 0.81). The mean evaluated COVID-19 probability is 0.80 ± 0.36 significantly higher in COVID-19 patients than in patients with fungal pneumonia (p < 0.05) and bacterial pneumonia (p < 0.001). The mean percentage of opacity (PO) and percentage of high opacity (PHO ≥ -200 HU) were significantly higher in COVID-19 patients than in healthy patients. However, the total mean HU in COVID-19 patients was -679.57 ± 112.72, which is significantly higher than in the healthy control group (p < 0.001). CONCLUSION: The detection and quantification of pneumonia beyond the primarily trained COVID-19 datasets is possible and shows comparable results for COVID-19 pneumonia to an experienced reader. The advantages are the fast, automated segmentation and quantification of the pneumonia foci.
Collapse
Affiliation(s)
- Una Ebong
- Department of Diagnostic and Interventional Radiology, Ulm University Medical Center, Albert-Einstein-Allee 23, 89081 Ulm, Germany
| | - Susanne Martina Büttner
- Department of Diagnostic and Interventional Radiology, Ulm University Medical Center, Albert-Einstein-Allee 23, 89081 Ulm, Germany
| | - Stefan A Schmidt
- Department of Diagnostic and Interventional Radiology, Ulm University Medical Center, Albert-Einstein-Allee 23, 89081 Ulm, Germany
| | - Franziska Flack
- Scientific Collaborations Siemens Healthcare GmbH Erlangen, 91052 Erlangen, Germany
| | - Patrick Korf
- Scientific Collaborations Siemens Healthcare GmbH Erlangen, 91052 Erlangen, Germany
| | - Lynn Peters
- Division of Infectious Diseases, University Hospital and Medical Centre of Ulm, 89081 Ulm, Germany
| | - Beate Grüner
- Division of Infectious Diseases, University Hospital and Medical Centre of Ulm, 89081 Ulm, Germany
| | - Steffen Stenger
- Institute of Medical Microbiology and Hygiene, Ulm University Medical Center, 89081 Ulm, Germany
| | - Thomas Stamminger
- Institute of Virology, Ulm University Medical Center, 89081 Ulm, Germany
| | - Hans Kestler
- Institute for Medical Systems Biology, Ulm University, 89081 Ulm, Germany
| | - Meinrad Beer
- Department of Diagnostic and Interventional Radiology, Ulm University Medical Center, Albert-Einstein-Allee 23, 89081 Ulm, Germany
| | - Christopher Kloth
- Department of Diagnostic and Interventional Radiology, Ulm University Medical Center, Albert-Einstein-Allee 23, 89081 Ulm, Germany
| |
Collapse
|
11
|
Shi Y, Qin Y, Zheng Z, Wang P, Liu J. Risk Factor Analysis and Multiple Predictive Machine Learning Models for Mortality in COVID-19: A Multicenter and Multi-Ethnic Cohort Study. J Emerg Med 2023; 65:S0736-4679(23)00359-1. [PMID: 39492024 PMCID: PMC10281034 DOI: 10.1016/j.jemermed.2023.06.012] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Accepted: 06/13/2023] [Indexed: 11/05/2024]
Abstract
BACKGROUND The COVID-19 pandemic presents a significant challenge to the global health care system. Implementing timely, accurate, and cost-effective screening approaches is crucial in preventing infections and saving lives by guiding disease management. OBJECTIVES The study aimed to use machine learning algorithms to analyze clinical features from routine clinical data to identify risk factors and predict the mortality of COVID-19. METHODS The data used in this research were originally collected for the study titled "Neurologic Syndromes Predict Higher In-Hospital Mortality in COVID-19." A total of 4711 patients with confirmed COVID-19 were enrolled consecutively from four hospitals. Three machine learning models, including random forest (RF), partial least squares discriminant analysis (PLS-DA), and support vector machine (SVM), were used to find risk factors and predict COVID-19 mortality. RESULTS The predictive models were developed based on three machine learning algorithms. The RF model was trained with 20 variables and had a receiver operating characteristic (ROC) value of 0.859 (95% confidence interval [CI] 0.804-0.920). The PLS-DA model was trained with 20 variables and had a ROC value of 0.775 (95% CI 0.694-0.833). The SVM model was trained with 10 variables and had a ROC value of 0.828 (95% CI 0.785-0.865). The nine variables that were present in all three models were age, procalcitonin, ferritin, C-reactive protein, troponin, blood urea nitrogen, mean arterial pressure, aspartate transaminase, and alanine transaminase. CONCLUSION This study developed and validated three machine learning prediction models for COVID-19 mortality based on accessible clinical features. The RF model showed the best performance among the three models. The nine variables identified in the models may warrant further investigation as potential prognostic indicators of severe COVID-19.
Collapse
Affiliation(s)
- Yuchen Shi
- Center for Coronary Artery Disease (CCAD), Beijing Anzhen Hospital, Capital Medical University, and Beijing Institute of Heart, Lung and Blood Vessel Diseases, Beijing, China
| | - Yanwen Qin
- Beijing Anzhen Hospital, Capital Medical University, Beijing Institute of Heart Lung and Blood Vessel Disease, The Key Laboratory of Remodeling-Related Cardiovascular Diseases, Ministry of Education, Beijing, China
| | - Ze Zheng
- Center for Coronary Artery Disease (CCAD), Beijing Anzhen Hospital, Capital Medical University, and Beijing Institute of Heart, Lung and Blood Vessel Diseases, Beijing, China
| | - Ping Wang
- Center for Coronary Artery Disease (CCAD), Beijing Anzhen Hospital, Capital Medical University, and Beijing Institute of Heart, Lung and Blood Vessel Diseases, Beijing, China
| | - Jinghua Liu
- Center for Coronary Artery Disease (CCAD), Beijing Anzhen Hospital, Capital Medical University, and Beijing Institute of Heart, Lung and Blood Vessel Diseases, Beijing, China
| |
Collapse
|
12
|
Smith C, Nance S, Chamberlin JH, Maisuria D, O'Doherty J, Baruah D, Schoepf UJ, Szemes AV, Elojeimy S, Kabakus IM. Application of an artificial intelligence ensemble for detection of important secondary findings on lung ventilation and perfusion SPECT-CT. Clin Imaging 2023; 100:24-29. [PMID: 37167806 DOI: 10.1016/j.clinimag.2023.04.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 04/22/2023] [Accepted: 04/27/2023] [Indexed: 05/13/2023]
Abstract
RATIONALE Single-photon-emission-computerized-tomography/computed-tomography(SPECT/CT) is commonly used for pulmonary disease. Scant work has been done to determine ability of AI for secondary findings using low-dose-CT(LDCT) attenuation correction series of SPECT/CT. METHODS 120 patients with ventilation-perfusion-SPECT/CT from 9/1/21-5/1/22 were included in this retrospective study. AI-RAD companion(VA10A,Siemens-Healthineers, Erlangen, Germany), an ensemble of deep-convolutional-neural-networks was evaluated for the detection of pulmonary nodules, coronary artery calcium, aortic ectasia/aneurysm, and vertebral height loss. Accuracy, sensitivity, specificity was measured for the outcomes. Inter-rater reliability were measured. Inter-rater reliability was measured using the intraclass correlation coefficient (ICC) by comparing the number of nodules identified by the AI to radiologist. RESULTS Overall per-nodule accuracy, sensitivity, and specificity for detection of lung nodules were 0.678(95%CI 0.615-0.732), 0.956(95%CI 0.900-0.985), and 0.456(95%CI 0.376-0.543), respectively, with an intraclass correlation coefficient (ICC) between AI and radiologist of 0.78(95%CI 0.71-0.83). Overall per-patient accuracy for AI detection of coronary artery calcium, aortic ectasia/aneurysm, and vertebral height loss was 0.939(95%CI 0.878-0.975), 0.974(95%CI 0.925-0.995), and 0.857(95%CI 0.781-0.915), respectively. Sensitivity for coronary artery calcium, aortic ectasia/aneurysm, and vertebral height loss was 0.898(95%CI 0.778-0.966), 1 (95%CI 0.958-1), and 1 (95%CI 0.961-1), respectively. Specificity for coronary artery calcium, aortic ectasia/aneurysm, and vertebral height loss was 0.969(95% CI 0.893-0.996), 0.897 (95% CI 0.726-0.978), and 0.346 (95% CI 0.172-0.557), respectively. CONCLUSION AI ensemble was accurate for coronary artery calcium and aortic ectasia/aneurysm, while sensitive for aortic ectasia/aneurysm, lung nodules and vertebral height loss on LDCT attenuation correction series of SPECT/CT.
Collapse
Affiliation(s)
- Carter Smith
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Sophia Nance
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Jordan H Chamberlin
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Dhruw Maisuria
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Jim O'Doherty
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America; Siemens Healthineers, 40 Liberty Boulevard, Malvern, PA 19355, United States of America.
| | - Dhiraj Baruah
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Uwe Joseph Schoepf
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Akos-Varga Szemes
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Saeed Elojeimy
- Division of Nuclear Medicine, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| | - Ismail M Kabakus
- Division of CardioThoracic Radiology, Department of Radiology and Radiological Science, Medical University of South Carolina, 96 Jonathan Lucas Street, Suite 210, MSC 323, Charleston, SC 29425, United States of America.
| |
Collapse
|
13
|
Paul SG, Saha A, Biswas AA, Zulfiker MS, Arefin MS, Rahman MM, Reza AW. Combating Covid-19 using machine learning and deep learning: Applications, challenges, and future perspectives. ARRAY 2023; 17:100271. [PMID: 36530931 PMCID: PMC9737520 DOI: 10.1016/j.array.2022.100271] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/05/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
COVID-19, a worldwide pandemic that has affected many people and thousands of individuals have died due to COVID-19, during the last two years. Due to the benefits of Artificial Intelligence (AI) in X-ray image interpretation, sound analysis, diagnosis, patient monitoring, and CT image identification, it has been further researched in the area of medical science during the period of COVID-19. This study has assessed the performance and investigated different machine learning (ML), deep learning (DL), and combinations of various ML, DL, and AI approaches that have been employed in recent studies with diverse data formats to combat the problems that have arisen due to the COVID-19 pandemic. Finally, this study shows the comparison among the stand-alone ML and DL-based research works regarding the COVID-19 issues with the combinations of ML, DL, and AI-based research works. After in-depth analysis and comparison, this study responds to the proposed research questions and presents the future research directions in this context. This review work will guide different research groups to develop viable applications based on ML, DL, and AI models, and will also guide healthcare institutes, researchers, and governments by showing them how these techniques can ease the process of tackling the COVID-19.
Collapse
Affiliation(s)
- Showmick Guha Paul
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Arpa Saha
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Al Amin Biswas
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh,Corresponding author
| | - Md. Sabab Zulfiker
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Mohammad Shamsul Arefin
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh,Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chittagong, Bangladesh
| | - Md. Mahfujur Rahman
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Ahmed Wasif Reza
- Department of Computer Science and Engineering, East West University, Dhaka, Bangladesh
| |
Collapse
|
14
|
Ershadi MM, Rise ZR. Fusing clinical and image data for detecting the severity level of hospitalized symptomatic COVID-19 patients using hierarchical model. RESEARCH ON BIOMEDICAL ENGINEERING 2023; 39:209-232. [PMCID: PMC9957693 DOI: 10.1007/s42600-023-00268-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 02/08/2023] [Indexed: 02/05/2024]
Abstract
Purpose Based on medical reports, it is hard to find levels of different hospitalized symptomatic COVID-19 patients according to their features in a short time. Besides, there are common and special features for COVID-19 patients at different levels based on physicians’ knowledge that make diagnosis difficult. For this purpose, a hierarchical model is proposed in this paper based on experts’ knowledge, fuzzy C-mean (FCM) clustering, and adaptive neuro-fuzzy inference system (ANFIS) classifier. Methods Experts considered a special set of features for different groups of COVID-19 patients to find their treatment plans. Accordingly, the structure of the proposed hierarchical model is designed based on experts’ knowledge. In the proposed model, we applied clustering methods to patients’ data to determine some clusters. Then, we learn classifiers for each cluster in a hierarchical model. Regarding different common and special features of patients, FCM is considered for the clustering method. Besides, ANFIS had better performances than other classification methods. Therefore, FCM and ANFIS were considered to design the proposed hierarchical model. FCM finds the membership degree of each patient’s data based on common and special features of different clusters to reinforce the ANFIS classifier. Next, ANFIS identifies the need of hospitalized symptomatic COVID-19 patients to ICU and to find whether or not they are in the end-stage (mortality target class). Two real datasets about COVID-19 patients are analyzed in this paper using the proposed model. One of these datasets had only clinical features and another dataset had both clinical and image features. Therefore, some appropriate features are extracted using some image processing and deep learning methods. Results According to the results and statistical test, the proposed model has the best performance among other utilized classifiers. Its accuracies based on clinical features of the first and second datasets are 92% and 90% to find the ICU target class. Extracted features of image data increase the accuracy by 94%. Conclusion The accuracy of this model is even better for detecting the mortality target class among different classifiers in this paper and the literature review. Besides, this model is compatible with utilized datasets about COVID-19 patients based on clinical data and both clinical and image data, as well. Highlights • A new hierarchical model is proposed using ANFIS classifiers and FCM clustering method in this paper. Its structure is designed based on experts’ knowledge and real medical process. FCM reinforces the ANFIS classification learning phase based on the features of COVID-19 patients. • Two real datasets about COVID-19 patients are studied in this paper. One of these datasets has both clinical and image data. Therefore, appropriate features are extracted based on its image data and considered with available meaningful clinical data. Different levels of hospitalized symptomatic COVID-19 patients are considered in this paper including the need of patients to ICU and whether or not they are in end-stage. • Well-known classification methods including case-based reasoning (CBR), decision tree, convolutional neural networks (CNN), K-nearest neighbors (KNN), learning vector quantization (LVQ), multi-layer perceptron (MLP), Naive Bayes (NB), radial basis function network (RBF), support vector machine (SVM), recurrent neural networks (RNN), fuzzy type-I inference system (FIS), and adaptive neuro-fuzzy inference system (ANFIS) are designed for these datasets and their results are analyzed for different random groups of the train and test data; • According to unbalanced utilized datasets, different performances of classifiers including accuracy, sensitivity, specificity, precision, F-score, and G-mean are compared to find the best classifier. ANFIS classifiers have the best results for both datasets. • To reduce the computational time, the effects of the Principal Component Analysis (PCA) feature reduction method are studied on the performances of the proposed model and classifiers. According to the results and statistical test, the proposed hierarchical model has the best performances among other utilized classifiers. Graphical Abstract Supplementary Information The online version contains supplementary material available at 10.1007/s42600-023-00268-w.
Collapse
Affiliation(s)
- Mohammad Mahdi Ershadi
- Department of Industrial Engineering and Management Systems, Amirkabir University of Technology, No. 350, Hafez Ave, Valiasr Square, Tehran, 1591634311 Iran
| | - Zeinab Rahimi Rise
- Department of Industrial Engineering and Management Systems, Amirkabir University of Technology, No. 350, Hafez Ave, Valiasr Square, Tehran, 1591634311 Iran
| |
Collapse
|
15
|
Zakariaee SS, Abdi AI, Naderi N, Babashahi M. Prognostic significance of chest CT severity score in mortality prediction of COVID-19 patients, a machine learning study. THE EGYPTIAN JOURNAL OF RADIOLOGY AND NUCLEAR MEDICINE 2023; 54:73. [PMCID: PMC10116092 DOI: 10.1186/s43055-023-01022-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 04/13/2023] [Indexed: 04/05/2024] Open
Abstract
Background The high mortality rate of COVID-19 makes it necessary to seek early identification of high-risk patients with poor prognoses. Although the association between CT-SS and mortality of COVID-19 patients was reported, its prognosis significance in combination with other prognostic parameters was not evaluated yet. Methods This retrospective single-center study reviewed a total of 6854 suspected patients referred to Imam Khomeini hospital, Ilam city, west of Iran, from February 9, 2020 to December 20, 2020. The prognostic performances of k-Nearest Neighbors (kNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and J48 decision tree algorithms were evaluated based on the most important and relevant predictors. The metrics derived from the confusion matrix were used to determine the performance of the ML models. Results After applying exclusion criteria, 815 hospitalized cases were entered into the study. Of these, 447(54.85%) were male and the mean (± SD) age of participants was 57.22(± 16.76) years. The results showed that the performances of the ML algorithms were improved when they are fed by the dataset with CT-SS data. The kNN model with an accuracy of 94.1%, sensitivity of 100. 0%, precision of 89.5%, specificity of 88.3%, and AUC around 97.2% had the best performance among the other three ML techniques. Conclusions The integration of CT-SS data with demographics, risk factors, clinical manifestations, and laboratory parameters improved the prognostic performances of the ML algorithms. An ML model with a comprehensive collection of predictors could identify high-risk patients more efficiently and lead to the optimal use of hospital resources.
Collapse
Affiliation(s)
- Seyed Salman Zakariaee
- Department of Medical Physics, Faculty of Paramedical Sciences, Ilam University of Medical Sciences, Ilam, Iran
| | - Aza Ismail Abdi
- Department of Radiology, Erbil Medical Technical Institute, Erbil Polytechnic University, Erbil, Iraq
| | - Negar Naderi
- Department of Midwifery, Faculty of Nursing and Midwifery, Ilam University of Medical Sciences, Ilam, Iran
| | - Mashallah Babashahi
- Department of Pathology, Faculty of Paramedical Sciences, Ilam University of Medical Sciences, Ilam, Iran
| |
Collapse
|
16
|
Di Basilio F, Esposisto G, Monoscalco L, Giansanti D. The Artificial Intelligence in Digital Radiology: Part 2: Towards an Investigation of acceptance and consensus on the Insiders. Healthcare (Basel) 2022; 10:153. [PMID: 35052316 PMCID: PMC8775988 DOI: 10.3390/healthcare10010153] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 12/19/2021] [Accepted: 01/10/2022] [Indexed: 02/04/2023] Open
Abstract
Background. The study deals with the introduction of the artificial intelligence in digital radiology. There is a growing interest in this area of scientific research in acceptance and consensus studies involving both insiders and the public, based on surveys focused mainly on single professionals. Purpose. The goal of the study is to perform a contemporary investigation on the acceptance and the consensus of the three key professional figures approaching in this field of application: (1) Medical specialists in image diagnostics: the medical specialists (MS)s; (2) experts in physical imaging processes: the medical physicists (MP)s; (3) AI designers: specialists of applied sciences (SAS)s. Methods. Participants (MSs = 92: 48 males/44 females, averaged age 37.9; MPs = 91: 43 males/48 females, averaged age 36.1; SAS = 90: 47 males/43 females, averaged age 37.3) were properly recruited based on specific training. An electronic survey was designed and submitted to the participants with a wide range questions starting from the training and background up to the different applications of the AI and the environment of application. Results. The results show that generally, the three professionals show (a) a high degree of encouraging agreement on the introduction of AI both in imaging and in non-imaging applications using both standalone applications and/or mHealth/eHealth, and (b) a different consent on AI use depending on the training background. Conclusions. The study highlights the usefulness of focusing on both the three key professionals and the usefulness of the investigation schemes facing a wide range of issues. The study also suggests the importance of different methods of administration to improve the adhesion and the need to continue these investigations both with federated and specific initiatives.
Collapse
Affiliation(s)
- Francesco Di Basilio
- Facoltà di Medicina e Psicologia, Sapienza University, Piazzale Aldo Moro, 00185 Rome, Italy; (F.D.B.); (G.E.)
| | - Gianluca Esposisto
- Facoltà di Medicina e Psicologia, Sapienza University, Piazzale Aldo Moro, 00185 Rome, Italy; (F.D.B.); (G.E.)
| | - Lisa Monoscalco
- Faculty of Engineering, Tor Vergata University, 00133 Rome, Italy;
| | | |
Collapse
|