1
|
Abad M, Casas-Roma J, Prados F. Generalizable disease detection using model ensemble on chest X-ray images. Sci Rep 2024; 14:5890. [PMID: 38467705 PMCID: PMC10928229 DOI: 10.1038/s41598-024-56171-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 03/03/2024] [Indexed: 03/13/2024] Open
Abstract
In the realm of healthcare, the demand for swift and precise diagnostic tools has been steadily increasing. This study delves into a comprehensive performance analysis of three pre-trained convolutional neural network (CNN) architectures: ResNet50, DenseNet121, and Inception-ResNet-v2. To ensure the broad applicability of our approach, we curated a large-scale dataset comprising a diverse collection of chest X-ray images, that included both positive and negative cases of COVID-19. The models' performance was evaluated using separate datasets for internal validation (from the same source as the training images) and external validation (from different sources). Our examination uncovered a significant drop in network efficacy, registering a 10.66% reduction for ResNet50, a 36.33% decline for DenseNet121, and a 19.55% decrease for Inception-ResNet-v2 in terms of accuracy. Best results were obtained with DenseNet121 achieving the highest accuracy at 96.71% in internal validation and Inception-ResNet-v2 attaining 76.70% accuracy in external validation. Furthermore, we introduced a model ensemble approach aimed at improving network performance when making inferences on images from diverse sources beyond their training data. The proposed method uses uncertainty-based weighting by calculating the entropy in order to assign appropriate weights to the outputs of each network. Our results showcase the effectiveness of the ensemble method in enhancing accuracy up to 97.38% for internal validation and 81.18% for external validation, while maintaining a balanced ability to detect both positive and negative cases.
Collapse
Affiliation(s)
- Maider Abad
- Universitat Oberta de Catalunya, e-Health Center, Barcelona, Spain.
| | - Jordi Casas-Roma
- Universitat Oberta de Catalunya, e-Health Center, Barcelona, Spain
- Department of Computer Science, Universitat Autònoma de Barcelona (UAB), Bellaterra, Spain
- Computer Vision Center (CVC), Universitat Autònoma de Barcelona (UAB), Bellaterra, Spain
| | - Ferran Prados
- Universitat Oberta de Catalunya, e-Health Center, Barcelona, Spain
- Queen Square MS Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, Faculty of Brain Science, University College of London, London, WC1N 3BG, UK
- Centre for Medical Image Computing (CMIC), Department of Medical Physics and Bioengineering, University College London, London, WC1V 6LJ, UK
| |
Collapse
|
2
|
Fang X, Lv Y, Lv W, Liu L, Feng Y, Liu L, Pan F, Zhang Y. CT-based Assessment at 6-Month Follow-up of COVID-19 Pneumonia patients in China. Sci Rep 2024; 14:5028. [PMID: 38424447 PMCID: PMC10904828 DOI: 10.1038/s41598-024-54920-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Accepted: 02/18/2024] [Indexed: 03/02/2024] Open
Abstract
This study aimed to assess pulmonary changes at 6-month follow-up CT and predictors of pulmonary residual abnormalities and fibrotic-like changes in COVID-19 pneumonia patients in China following relaxation of COVID restrictions in 2022. A total of 271 hospitalized patients with COVID-19 pneumonia admitted between November 29, 2022 and February 10, 2023 were prospectively evaluated at 6 months. CT characteristics and Chest CT scores of pulmonary abnormalities were compared between the initial and the 6-month CT. The association of demographic and clinical factors with CT residual abnormalities or fibrotic-like changes were assessed using logistic regression. Follow-up CT scans were obtained at a median of 177 days (IQR, 170-185 days) after hospital admission. Pulmonary residual abnormalities and fibrotic-like changes were found in 98 (36.2%) and 39 (14.4%) participants. In multivariable analysis of pulmonary residual abnormalities and fibrotic-like changes, the top three predictive factors were invasive ventilation (OR 13.6; 95% CI 1.9, 45; P < .001), age > 60 years (OR 9.1; 95% CI 2.3, 39; P = .01), paxlovid (OR 0.11; 95% CI 0.04, 0.48; P = .01) and invasive ventilation (OR 10.3; 95% CI 2.9, 33; P = .002), paxlovid (OR 0.1; 95% CI 0.03, 0.48; P = .01), smoker (OR 9.9; 95% CI 2.4, 31; P = .01), respectively. The 6-month follow-up CT of recent COVID-19 pneumonia cases in China showed a considerable proportion of the patients with pulmonary residual abnormalities and fibrotic-like changes. Antivirals against SARS-CoV-2 like paxlovid may be beneficial for long-term regression of COVID-19 pneumonia.
Collapse
Affiliation(s)
- Xingyu Fang
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Yuan Lv
- Medical Department of General Surgery, Chinese PLA General Hospital, The 1St Medical Center, Beijing, 100853, China
- Department of General Surgery, The 7Th Medical Center, Chinese PLA General Hospital, Beijing, 100700, China
| | - Wei Lv
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Lin Liu
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Yun Feng
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Li Liu
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Feng Pan
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China
| | - Yijun Zhang
- Department of Radiology, the 305 Hospital of PLA, 13 Wenjin Street, Beijing, 100017, China.
| |
Collapse
|
3
|
Grenier PA, Brun AL, Mellot F. [The contribution of artificial intelligence (AI) subsequent to the processing of thoracic imaging]. Rev Mal Respir 2024; 41:110-126. [PMID: 38129269 DOI: 10.1016/j.rmr.2023.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 11/27/2023] [Indexed: 12/23/2023]
Abstract
The contribution of artificial intelligence (AI) to medical imaging is currently the object of widespread experimentation. The development of deep learning (DL) methods, particularly convolution neural networks (CNNs), has led to performance gains often superior to those achieved by conventional methods such as machine learning. Radiomics is an approach aimed at extracting quantitative data not accessible to the human eye from images expressing a disease. The data subsequently feed machine learning models and produce diagnostic or prognostic probabilities. As for the multiple applications of AI methods in thoracic imaging, they are undergoing evaluation. Chest radiography is a practically ideal field for the development of DL algorithms able to automatically interpret X-rays. Current algorithms can detect up to 14 different abnormalities present either in isolation or in combination. Chest CT is another area offering numerous AI applications. Various algorithms have been specifically formed and validated for the detection and characterization of pulmonary nodules and pulmonary embolism, as well as segmentation and quantitative analysis of the extent of diffuse lung diseases (emphysema, infectious pneumonias, interstitial lung disease). In addition, the analysis of medical images can be associated with clinical, biological, and functional data (multi-omics analysis), the objective being to construct predictive approaches regarding disease prognosis and response to treatment.
Collapse
Affiliation(s)
- P A Grenier
- Délégation à la recherche clinique et l'innovation, hôpital Foch, Suresnes, France.
| | - A L Brun
- Service de radiologie, hôpital Foch, Suresnes, France
| | - F Mellot
- Service de radiologie, hôpital Foch, Suresnes, France
| |
Collapse
|
4
|
Iqbal MS, Naqvi RA, Alizadehsani R, Hussain S, Moqurrab SA, Lee SW. An adaptive ensemble deep learning framework for reliable detection of pandemic patients. Comput Biol Med 2024; 168:107836. [PMID: 38086139 DOI: 10.1016/j.compbiomed.2023.107836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 11/14/2023] [Accepted: 12/06/2023] [Indexed: 01/10/2024]
Abstract
Nurses, often considered the backbone of global health services, are disproportionately vulnerable to COVID-19 due to their front-line roles. They conduct essential patient tests, including blood pressure, temperature, and complete blood counts. The pandemic-induced loss of nursing staff has resulted in critical shortages. To address this, robotic solutions offer promising avenues. To solve this problem, we developed an ensemble deep learning (DL) model that uses seven different models to detect patients. Detected images are then used as input for the soft robot, which performs basic assessment tests. In this study, we introduce a deep learning-based approach for nursing soft robots, and propose a novel deep learning model named Deep Ensemble of Adaptive Architectures. Our method is twofold: firstly, an ensemble deep learning technique detects COVID-19 patients; secondly, a soft robot performs basic assessment tests on the identified patients. We evaluate the performance of various deep learning-based object detectors for patient detection, examining implementations of You Only Look Once (YOLO), Single Shot MultiBox Detector (SSD), Region-Based Convolutional Neural Network (RCNN), and Region-Based Fully Convolutional Network (R-FCN) on a proprietary dataset comprising 32,668 hospital surveillance images. Our results indicate that while YOLO and VGG facilitate rapid detection, Faster-RCNN (Inception ResNet-v2) and our proposed Ensemble-DL achieve the highest accuracy. Ensemble-DL offers accurate results in a reasonable timeframe, making it apt for patient detection on embedded platforms. Through real-world experiments, our method outperforms baseline approaches (including Faster-RCNN, R-FCN variants, CNN+LSTM, etc.) in terms of both precision and recall. Achieving an impressive accuracy of 98.32%, our deep learning-based model for nursing soft robots presents a significant advancement in the identification and assessment of COVID-19 patients, ultimately enhancing healthcare efficiency and patient care.
Collapse
Affiliation(s)
- Muhammad Shahid Iqbal
- School of Computer Science and Technology, Anhui University, Hefei, China; Department of Computer Science and Information Technology, Women University of Azad Jammu & Kashmir, Bagh, Pakistan.
| | - Rizwan Ali Naqvi
- Department of Artificial Intelligence and Robotics, Sejong University, Seoul 05006, Republic of Korea.
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, Geelong, VIC 3216, Australia
| | - Sadiq Hussain
- Examination Branch, Dibrugarh University, Dibrugarh 786004, India
| | - Syed Atif Moqurrab
- School of Computing, Gachon University, 1342, Seongnam-daero, Sujeong-gu, Seongnam-si, 13120, Republic of Korea.
| | - Seung-Won Lee
- School of Medicine, Sungkyunkwan University, Suwon 16419, Republic of Korea.
| |
Collapse
|
5
|
Shin HJ, Kim MH, Son NH, Han K, Kim EK, Kim YC, Park YS, Lee EH, Kyong T. Clinical Implication and Prognostic Value of Artificial-Intelligence-Based Results of Chest Radiographs for Assessing Clinical Outcomes of COVID-19 Patients. Diagnostics (Basel) 2023; 13:2090. [PMID: 37370985 DOI: 10.3390/diagnostics13122090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 06/15/2023] [Accepted: 06/15/2023] [Indexed: 06/29/2023] Open
Abstract
This study aimed to investigate the clinical implications and prognostic value of artificial intelligence (AI)-based results for chest radiographs (CXR) in coronavirus disease 2019 (COVID-19) patients. Patients who were admitted due to COVID-19 from September 2021 to March 2022 were retrospectively included. A commercial AI-based software was used to assess CXR data for consolidation and pleural effusion scores. Clinical data, including laboratory results, were analyzed for possible prognostic factors. Total O2 supply period, the last SpO2 result, and deterioration were evaluated as prognostic indicators of treatment outcome. Generalized linear mixed model and regression tests were used to examine the prognostic value of CXR results. Among a total of 228 patients (mean 59.9 ± 18.8 years old), consolidation scores had a significant association with erythrocyte sedimentation rate and C-reactive protein changes, and initial consolidation scores were associated with the last SpO2 result (estimate -0.018, p = 0.024). All consolidation scores during admission showed significant association with the total O2 supply period and the last SpO2 result. Early changing degree of consolidation score showed an association with deterioration (odds ratio 1.017, 95% confidence interval 1.005-1.03). In conclusion, AI-based CXR results for consolidation have potential prognostic value for predicting treatment outcomes in COVID-19 patients.
Collapse
Affiliation(s)
- Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Min Hyung Kim
- Division of Infectious Diseases, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Nak-Hoon Son
- Department of Statistics, Keimyung University, Daegu 42601, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology, Severance Hospital, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul 03722, Republic of Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Yong Chan Kim
- Division of Infectious Diseases, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Yoon Soo Park
- Division of Infectious Diseases, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Eun Hye Lee
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Taeyoung Kyong
- Department of Hospital Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| |
Collapse
|
6
|
Kołodziejczak MM, Sierakowska K, Tkachenko Y, Kowalski P. Artificial Intelligence in the Intensive Care Unit: Present and Future in the COVID-19 Era. J Pers Med 2023; 13:891. [PMID: 37373880 DOI: 10.3390/jpm13060891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Revised: 05/18/2023] [Accepted: 05/22/2023] [Indexed: 06/29/2023] Open
Abstract
The development of artificial intelligence (AI) allows for the construction of technologies capable of implementing functions that represent the human mind, senses, and problem-solving skills, leading to automation, rapid data analysis, and acceleration of tasks. These solutions has been initially implemented in medical fields relying on image analysis; however, technological development and interdisciplinary collaboration allows for the introduction of AI-based enhancements to further medical specialties. During the COVID-19 pandemic, novel technologies established on big data analysis experienced a rapid expansion. Yet, despite the possibilities of advancements with these AI technologies, there are number of shortcomings that need to be resolved to assert the highest and the safest level of performance, especially in the setting of the intensive care unit (ICU). Within the ICU, numerous factors and data affect clinical decision making and work management that could be managed by AI-based technologies. Early detection of a patient's deterioration, identification of unknown prognostic parameters, or even improvement of work organization are a few of many areas where patients and medical personnel can benefit from solutions developed with AI.
Collapse
Affiliation(s)
- Michalina Marta Kołodziejczak
- Department of Anesthesiology and Intensive Care, Collegium Medicum Bydgoszcz, Nicolaus Copernicus University Torun, Antoni Jurasz University Hospital No.1, 85-094 Bydgoszcz, Poland
| | - Katarzyna Sierakowska
- Department of Anesthesiology and Intensive Care, Collegium Medicum Bydgoszcz, Nicolaus Copernicus University Torun, Antoni Jurasz University Hospital No.1, 85-094 Bydgoszcz, Poland
| | - Yurii Tkachenko
- Department of Anesthesiology and Intensive Care, Władysław Biegański Regional Specialized Hospital, 86-300 Grudziadz, Poland
| | - Piotr Kowalski
- Department of Anesthesiology and Intensive Care, Władysław Biegański Regional Specialized Hospital, 86-300 Grudziadz, Poland
| |
Collapse
|