1
|
Tandon P, Nguyen KAN, Edalati M, Parchure P, Raut G, Reich DL, Freeman R, Levin MA, Timsina P, Powell CA, Fayad ZA, Kia A. Development and Validation of a Deep Learning Classifier Using Chest Radiographs to Predict Extubation Success in Patients Undergoing Invasive Mechanical Ventilation. Bioengineering (Basel) 2024; 11:626. [PMID: 38927862 PMCID: PMC11200686 DOI: 10.3390/bioengineering11060626] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Revised: 05/27/2024] [Accepted: 06/10/2024] [Indexed: 06/28/2024] Open
Abstract
The decision to extubate patients on invasive mechanical ventilation is critical; however, clinician performance in identifying patients to liberate from the ventilator is poor. Machine Learning-based predictors using tabular data have been developed; however, these fail to capture the wide spectrum of data available. Here, we develop and validate a deep learning-based model using routinely collected chest X-rays to predict the outcome of attempted extubation. We included 2288 serial patients admitted to the Medical ICU at an urban academic medical center, who underwent invasive mechanical ventilation, with at least one intubated CXR, and a documented extubation attempt. The last CXR before extubation for each patient was taken and split 79/21 for training/testing sets, then transfer learning with k-fold cross-validation was used on a pre-trained ResNet50 deep learning architecture. The top three models were ensembled to form a final classifier. The Grad-CAM technique was used to visualize image regions driving predictions. The model achieved an AUC of 0.66, AUPRC of 0.94, sensitivity of 0.62, and specificity of 0.60. The model performance was improved compared to the Rapid Shallow Breathing Index (AUC 0.61) and the only identified previous study in this domain (AUC 0.55), but significant room for improvement and experimentation remains.
Collapse
Affiliation(s)
- Pranai Tandon
- Department of Medicine Division of Pulmonary, Critical Care, and Sleep Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Kim-Anh-Nhi Nguyen
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
| | - Masoud Edalati
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
| | - Prathamesh Parchure
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
| | - Ganesh Raut
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
| | - David L. Reich
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA (M.A.L.)
| | - Robert Freeman
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
| | - Matthew A. Levin
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA (M.A.L.)
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
- Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Prem Timsina
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
| | - Charles A. Powell
- Department of Medicine Division of Pulmonary, Critical Care, and Sleep Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Zahi A. Fayad
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Arash Kia
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (K.-A.-N.N.); (M.E.); (P.P.); (G.R.); (R.F.); (P.T.); (A.K.)
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA (M.A.L.)
| |
Collapse
|
2
|
Sun Y, Salerno S, Pan Z, Yang E, Sujimongkol C, Song J, Wang X, Han P, Zeng D, Kang J, Christiani DC, Li Y. Assessing the prognostic utility of clinical and radiomic features for COVID-19 patients admitted to ICU: challenges and lessons learned. HARVARD DATA SCIENCE REVIEW 2024; 6:10.1162/99608f92.9d86a749. [PMID: 38974963 PMCID: PMC11225107 DOI: 10.1162/99608f92.9d86a749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/09/2024] Open
Abstract
Severe cases of COVID-19 often necessitate escalation to the Intensive Care Unit (ICU), where patients may face grave outcomes, including mortality. Chest X-rays play a crucial role in the diagnostic process for evaluating COVID-19 patients. Our collaborative efforts with Michigan Medicine in monitoring patient outcomes within the ICU have motivated us to investigate the potential advantages of incorporating clinical information and chest X-ray images for predicting patient outcomes. We propose an analytical workflow to address challenges such as the absence of standardized approaches for image pre-processing and data utilization. We then propose an ensemble learning approach designed to maximize the information derived from multiple prediction algorithms. This entails optimizing the weights within the ensemble and considering the common variability present in individual risk scores. Our simulations demonstrate the superior performance of this weighted ensemble averaging approach across various scenarios. We apply this refined ensemble methodology to analyze post-ICU COVID-19 mortality, an occurrence observed in 21% of COVID-19 patients admitted to the ICU at Michigan Medicine. Our findings reveal substantial performance improvement when incorporating imaging data compared to models trained solely on clinical risk factors. Furthermore, the addition of radiomic features yields even larger enhancements, particularly among older and more medically compromised patients. These results may carry implications for enhancing patient outcomes in similar clinical contexts.
Collapse
Affiliation(s)
- Yuming Sun
- Biostatistics, University of Michigan, Ann Arbor, MI
| | | | - Ziyang Pan
- Biostatistics, University of Michigan, Ann Arbor, MI
| | - Eileen Yang
- Biostatistics, University of Michigan, Ann Arbor, MI
| | | | - Jiyeon Song
- Biostatistics, University of Michigan, Ann Arbor, MI
| | - Xinan Wang
- Environmental Health, Harvard T. H. Chan School of Public Health, Boston, MA
| | - Peisong Han
- Biostatistics, University of Michigan, Ann Arbor, MI
| | - Donglin Zeng
- Biostatistics, University of Michigan, Ann Arbor, MI
| | - Jian Kang
- Biostatistics, University of Michigan, Ann Arbor, MI
| | - David C. Christiani
- Environmental Health, Harvard T. H. Chan School of Public Health, Boston, MA
| | - Yi Li
- Biostatistics, University of Michigan, Ann Arbor, MI
| |
Collapse
|
3
|
Nguyen KAN, Tandon P, Ghanavati S, Cheetirala SN, Timsina P, Freeman R, Reich D, Levin MA, Mazumdar M, Fayad ZA, Kia A. A Hybrid Decision Tree and Deep Learning Approach Combining Medical Imaging and Electronic Medical Records to Predict Intubation Among Hospitalized Patients With COVID-19: Algorithm Development and Validation. JMIR Form Res 2023; 7:e46905. [PMID: 37883177 PMCID: PMC10636624 DOI: 10.2196/46905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 05/18/2023] [Accepted: 06/27/2023] [Indexed: 10/27/2023] Open
Abstract
BACKGROUND Early prediction of the need for invasive mechanical ventilation (IMV) in patients hospitalized with COVID-19 symptoms can help in the allocation of resources appropriately and improve patient outcomes by appropriately monitoring and treating patients at the greatest risk of respiratory failure. To help with the complexity of deciding whether a patient needs IMV, machine learning algorithms may help bring more prognostic value in a timely and systematic manner. Chest radiographs (CXRs) and electronic medical records (EMRs), typically obtained early in patients admitted with COVID-19, are the keys to deciding whether they need IMV. OBJECTIVE We aimed to evaluate the use of a machine learning model to predict the need for intubation within 24 hours by using a combination of CXR and EMR data in an end-to-end automated pipeline. We included historical data from 2481 hospitalizations at The Mount Sinai Hospital in New York City. METHODS CXRs were first resized, rescaled, and normalized. Then lungs were segmented from the CXRs by using a U-Net algorithm. After splitting them into a training and a test set, the training set images were augmented. The augmented images were used to train an image classifier to predict the probability of intubation with a prediction window of 24 hours by retraining a pretrained DenseNet model by using transfer learning, 10-fold cross-validation, and grid search. Then, in the final fusion model, we trained a random forest algorithm via 10-fold cross-validation by combining the probability score from the image classifier with 41 longitudinal variables in the EMR. Variables in the EMR included clinical and laboratory data routinely collected in the inpatient setting. The final fusion model gave a prediction likelihood for the need of intubation within 24 hours as well. RESULTS At a prediction probability threshold of 0.5, the fusion model provided 78.9% (95% CI 59%-96%) sensitivity, 83% (95% CI 76%-89%) specificity, 0.509 (95% CI 0.34-0.67) F1-score, 0.874 (95% CI 0.80-0.94) area under the receiver operating characteristic curve (AUROC), and 0.497 (95% CI 0.32-0.65) area under the precision recall curve (AUPRC) on the holdout set. Compared to the image classifier alone, which had an AUROC of 0.577 (95% CI 0.44-0.73) and an AUPRC of 0.206 (95% CI 0.08-0.38), the fusion model showed significant improvement (P<.001). The most important predictor variables were respiratory rate, C-reactive protein, oxygen saturation, and lactate dehydrogenase. The imaging probability score ranked 15th in overall feature importance. CONCLUSIONS We show that, when linked with EMR data, an automated deep learning image classifier improved performance in identifying hospitalized patients with severe COVID-19 at risk for intubation. With additional prospective and external validation, such a model may assist risk assessment and optimize clinical decision-making in choosing the best care plan during the critical stages of COVID-19.
Collapse
Affiliation(s)
- Kim-Anh-Nhi Nguyen
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Pranai Tandon
- Department of Medicine Division of Pulmonary, Critical Care, and Sleep Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Sahar Ghanavati
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Satya Narayana Cheetirala
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Prem Timsina
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Robert Freeman
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Hospital Administration, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - David Reich
- Hospital Administration, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Matthew A Levin
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Madhu Mazumdar
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Department of Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Zahi A Fayad
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Arash Kia
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| |
Collapse
|
4
|
Sun Y, Salerno S, He X, Pan Z, Yang E, Sujimongkol C, Song J, Wang X, Han P, Kang J, Sjoding MW, Jolly S, Christiani DC, Li Y. Use of machine learning to assess the prognostic utility of radiomic features for in-hospital COVID-19 mortality. Sci Rep 2023; 13:7318. [PMID: 37147440 PMCID: PMC10161188 DOI: 10.1038/s41598-023-34559-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 05/03/2023] [Indexed: 05/07/2023] Open
Abstract
As portable chest X-rays are an efficient means of triaging emergent cases, their use has raised the question as to whether imaging carries additional prognostic utility for survival among patients with COVID-19. This study assessed the importance of known risk factors on in-hospital mortality and investigated the predictive utility of radiomic texture features using various machine learning approaches. We detected incremental improvements in survival prognostication utilizing texture features derived from emergent chest X-rays, particularly among older patients or those with a higher comorbidity burden. Important features included age, oxygen saturation, blood pressure, and certain comorbid conditions, as well as image features related to the intensity and variability of pixel distribution. Thus, widely available chest X-rays, in conjunction with clinical information, may be predictive of survival outcomes of patients with COVID-19, especially older, sicker patients, and can aid in disease management by providing additional information.
Collapse
Affiliation(s)
- Yuming Sun
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Stephen Salerno
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Xinwei He
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Ziyang Pan
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Eileen Yang
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Chinakorn Sujimongkol
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Jiyeon Song
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Xinan Wang
- Department of Environmental Health and Epidemiology, Harvard T. H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, 02115, USA
| | - Peisong Han
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Jian Kang
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Michael W Sjoding
- Division of Pulmonary and Critical Care, Department of Internal Medicine, University of Michigan Medical School, 1500 East Medical Center Drive, Ann Arbor, MI, 48109, USA
| | - Shruti Jolly
- Department of Radiation Oncology, University of Michigan Rogel Cancer Center, 1500 East Medical Center Drive, Ann Arbor, MI, 48109, USA
| | - David C Christiani
- Department of Environmental Health and Epidemiology, Harvard T. H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, 02115, USA
- Division of Pulmonary and Critical Care, Department of Internal Medicine, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, 02114, USA
| | - Yi Li
- Department of Biostatistics, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA.
| |
Collapse
|
5
|
Buttia C, Llanaj E, Raeisi-Dehkordi H, Kastrati L, Amiri M, Meçani R, Taneri PE, Ochoa SAG, Raguindin PF, Wehrli F, Khatami F, Espínola OP, Rojas LZ, de Mortanges AP, Macharia-Nimietz EF, Alijla F, Minder B, Leichtle AB, Lüthi N, Ehrhard S, Que YA, Fernandes LK, Hautz W, Muka T. Prognostic models in COVID-19 infection that predict severity: a systematic review. Eur J Epidemiol 2023; 38:355-372. [PMID: 36840867 PMCID: PMC9958330 DOI: 10.1007/s10654-023-00973-x] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 01/28/2023] [Indexed: 02/26/2023]
Abstract
Current evidence on COVID-19 prognostic models is inconsistent and clinical applicability remains controversial. We performed a systematic review to summarize and critically appraise the available studies that have developed, assessed and/or validated prognostic models of COVID-19 predicting health outcomes. We searched six bibliographic databases to identify published articles that investigated univariable and multivariable prognostic models predicting adverse outcomes in adult COVID-19 patients, including intensive care unit (ICU) admission, intubation, high-flow nasal therapy (HFNT), extracorporeal membrane oxygenation (ECMO) and mortality. We identified and assessed 314 eligible articles from more than 40 countries, with 152 of these studies presenting mortality, 66 progression to severe or critical illness, 35 mortality and ICU admission combined, 17 ICU admission only, while the remaining 44 studies reported prediction models for mechanical ventilation (MV) or a combination of multiple outcomes. The sample size of included studies varied from 11 to 7,704,171 participants, with a mean age ranging from 18 to 93 years. There were 353 prognostic models investigated, with area under the curve (AUC) ranging from 0.44 to 0.99. A great proportion of studies (61.5%, 193 out of 314) performed internal or external validation or replication. In 312 (99.4%) studies, prognostic models were reported to be at high risk of bias due to uncertainties and challenges surrounding methodological rigor, sampling, handling of missing data, failure to deal with overfitting and heterogeneous definitions of COVID-19 and severity outcomes. While several clinical prognostic models for COVID-19 have been described in the literature, they are limited in generalizability and/or applicability due to deficiencies in addressing fundamental statistical and methodological concerns. Future large, multi-centric and well-designed prognostic prospective studies are needed to clarify remaining uncertainties.
Collapse
Affiliation(s)
- Chepkoech Buttia
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Emergency Department, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 16C, 3010 Bern, Switzerland
- Epistudia, Bern, Switzerland
| | - Erand Llanaj
- Department of Molecular Epidemiology, German Institute of Human Nutrition Potsdam-Rehbrücke, Nuthetal, Germany
- ELKH-DE Public Health Research Group of the Hungarian Academy of Sciences, Department of Public Health and Epidemiology, Faculty of Medicine, University of Debrecen, Debrecen, Hungary
- Epistudia, Bern, Switzerland
- German Center for Diabetes Research (DZD), München-Neuherberg, Germany
| | - Hamidreza Raeisi-Dehkordi
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Lum Kastrati
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Graduate School for Health Sciences, University of Bern, Bern, Switzerland
- Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Mojgan Amiri
- Department of Epidemiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Renald Meçani
- Department of Pediatrics, “Mother Teresa” University Hospital Center, Tirana, University of Medicine, Tirana, Albania
- Division of Endocrinology and Diabetology, Department of Internal Medicine, Medical University of Graz, Graz, Austria
| | - Petek Eylul Taneri
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- HRB-Trials Methodology Research Network College of Medicine, Nursing and Health Sciences University of Galway, Galway, Ireland
| | | | - Peter Francis Raguindin
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Swiss Paraplegic Research, Nottwil, Switzerland
- Faculty of Health Sciences, University of Lucerne, Lucerne, Switzerland
| | - Faina Wehrli
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
| | - Farnaz Khatami
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Graduate School for Health Sciences, University of Bern, Bern, Switzerland
- Department of Community Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Octavio Pano Espínola
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Department of Preventive Medicine and Public Health, University of Navarre, Pamplona, Spain
- Navarra Institute for Health Research, IdiSNA, Pamplona, Spain
| | - Lyda Z. Rojas
- Research Group and Development of Nursing Knowledge (GIDCEN-FCV), Research Center, Cardiovascular Foundation of Colombia, Floridablanca, Santander, Colombia
| | | | | | - Fadi Alijla
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Graduate School for Health Sciences, University of Bern, Bern, Switzerland
| | - Beatrice Minder
- Public Health and Primary Care Library, University Library of Bern, University of Bern, Bern, Switzerland
| | - Alexander B. Leichtle
- University Institute of Clinical Chemistry, Inselspital, Bern University Hospital, and Center for Artificial Intelligence in Medicine (CAIM), University of Bern, Bern, Switzerland
| | - Nora Lüthi
- Emergency Department, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 16C, 3010 Bern, Switzerland
| | - Simone Ehrhard
- Emergency Department, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 16C, 3010 Bern, Switzerland
| | - Yok-Ai Que
- Department of Intensive Care Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Laurenz Kopp Fernandes
- Deutsches Herzzentrum Berlin (DHZB), Berlin, Germany
- Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Wolf Hautz
- Emergency Department, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 16C, 3010 Bern, Switzerland
| | - Taulant Muka
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Epistudia, Bern, Switzerland
| |
Collapse
|
6
|
Elmahdy M, Sebro R. Radiomics analysis in medical imaging research. J Med Radiat Sci 2023; 70:3-7. [PMID: 36762402 PMCID: PMC9977659 DOI: 10.1002/jmrs.662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 01/21/2023] [Indexed: 02/11/2023] Open
Abstract
This article discusses the current research in the field of radiomics in medical imaging with emphasis on its role in fighting coronavirus disease 2019 (COVID-19). This article covers the building of radiomic models in a simple straightforward manner, while discussing radiomic models potential to help us face this pandemic.
Collapse
Affiliation(s)
- Mahmoud Elmahdy
- Department of RadiologyMayo ClinicJacksonvilleFloridaUSA,Center for Augmented IntelligenceMayo ClinicJacksonvilleFloridaUSA
| | - Ronnie Sebro
- Department of RadiologyMayo ClinicJacksonvilleFloridaUSA,Center for Augmented IntelligenceMayo ClinicJacksonvilleFloridaUSA,Department of Orthopedic SurgeryMayo ClinicJacksonvilleFloridaUSA,Department of BiostatisticsCentre for Quantitative Health SciencesJacksonvilleFloridaUSA
| |
Collapse
|
7
|
McCague C, Ramlee S, Reinius M, Selby I, Hulse D, Piyatissa P, Bura V, Crispin-Ortuzar M, Sala E, Woitek R. Introduction to radiomics for a clinical audience. Clin Radiol 2023; 78:83-98. [PMID: 36639175 DOI: 10.1016/j.crad.2022.08.149] [Citation(s) in RCA: 30] [Impact Index Per Article: 30.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 08/31/2022] [Indexed: 01/12/2023]
Abstract
Radiomics is a rapidly developing field of research focused on the extraction of quantitative features from medical images, thus converting these digital images into minable, high-dimensional data, which offer unique biological information that can enhance our understanding of disease processes and provide clinical decision support. To date, most radiomics research has been focused on oncological applications; however, it is increasingly being used in a raft of other diseases. This review gives an overview of radiomics for a clinical audience, including the radiomics pipeline and the common pitfalls associated with each stage. Key studies in oncology are presented with a focus on both those that use radiomics analysis alone and those that integrate its use with other multimodal data streams. Importantly, clinical applications outside oncology are also presented. Finally, we conclude by offering a vision for radiomics research in the future, including how it might impact our practice as radiologists.
Collapse
Affiliation(s)
- C McCague
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK.
| | - S Ramlee
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - M Reinius
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - I Selby
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - D Hulse
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - P Piyatissa
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - V Bura
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Department of Radiology and Medical Imaging, County Clinical Emergency Hospital, Cluj-Napoca, Romania
| | - M Crispin-Ortuzar
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Department of Oncology, University of Cambridge, Cambridge, UK
| | - E Sala
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - R Woitek
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Research Centre for Medical Image Analysis and Artificial Intelligence (MIAAI), Department of Medicine, Faculty of Medicine and Dentistry, Danube Private University, Krems, Austria
| |
Collapse
|
8
|
Subgroup State Prediction under Different Noise Levels Using MODWT and XGBoost. JOURNAL OF HEALTHCARE ENGINEERING 2023; 2023:6406275. [PMID: 36760834 PMCID: PMC9904931 DOI: 10.1155/2023/6406275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 11/30/2022] [Accepted: 01/13/2023] [Indexed: 02/04/2023]
Abstract
In medical states prediction, the observations of different individuals are generally assumed to follow an identical distribution, whereas precision medicine has a rigorous requirement for accurate subgroup analysis. In this research, an aggregated method is proposed by means of combining the results generated from different subgroup models and is compared with the original method for different denoising levels as well as the prediction gaps. The results using real data demonstrate the effectiveness of the aggregated method exhibiting superior performance such as 0.95 in AUC, 0.87 in F1, and 0.82 in sensitivity, particularly for the denoising level that is set to be 2. With respect to the variable importance, it is shown that some variables such as heart rate and lactate arterial become more important when the denoising level increases.
Collapse
|
9
|
An Extra Set of Intelligent Eyes: Application of Artificial Intelligence in Imaging of Abdominopelvic Pathologies in Emergency Radiology. Diagnostics (Basel) 2022; 12:diagnostics12061351. [PMID: 35741161 PMCID: PMC9221728 DOI: 10.3390/diagnostics12061351] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/19/2022] [Accepted: 05/26/2022] [Indexed: 11/25/2022] Open
Abstract
Imaging in the emergent setting carries high stakes. With increased demand for dedicated on-site service, emergency radiologists face increasingly large image volumes that require rapid turnaround times. However, novel artificial intelligence (AI) algorithms may assist trauma and emergency radiologists with efficient and accurate medical image analysis, providing an opportunity to augment human decision making, including outcome prediction and treatment planning. While traditional radiology practice involves visual assessment of medical images for detection and characterization of pathologies, AI algorithms can automatically identify subtle disease states and provide quantitative characterization of disease severity based on morphologic image details, such as geometry and fluid flow. Taken together, the benefits provided by implementing AI in radiology have the potential to improve workflow efficiency, engender faster turnaround results for complex cases, and reduce heavy workloads. Although analysis of AI applications within abdominopelvic imaging has primarily focused on oncologic detection, localization, and treatment response, several promising algorithms have been developed for use in the emergency setting. This article aims to establish a general understanding of the AI algorithms used in emergent image-based tasks and to discuss the challenges associated with the implementation of AI into the clinical workflow.
Collapse
|
10
|
Outcome Prediction for SARS-CoV-2 Patients Using Machine Learning Modeling of Clinical, Radiological, and Radiomic Features Derived from Chest CT Images. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094493] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
(1) Background: Chest Computed Tomography (CT) has been proposed as a non-invasive method for confirming the diagnosis of SARS-CoV-2 patients using radiomic features (RFs) and baseline clinical data. The performance of Machine Learning (ML) methods using RFs derived from semi-automatically segmented lungs in chest CT images was investigated regarding the ability to predict the mortality of SARS-CoV-2 patients. (2) Methods: A total of 179 RFs extracted from 436 chest CT images of SARS-CoV-2 patients, and 8 clinical and 6 radiological variables, were used to train and evaluate three ML methods (Least Absolute Shrinkage and Selection Operator [LASSO] regularized regression, Random Forest Classifier [RFC], and the Fully connected Neural Network [FcNN]) for their ability to predict mortality using the Area Under the Curve (AUC) of Receiver Operator characteristic (ROC) Curves. These three groups of variables were used separately and together as input for constructing and comparing the final performance of ML models. (3) Results: All the ML models using only RFs achieved an informative level regarding predictive ability, outperforming radiological assessment, without however reaching the performance obtained with ML based on clinical variables. The LASSO regularized regression and the FcNN performed equally, both being superior to the RFC. (4) Conclusions: Radiomic features based on semi-automatically segmented CT images and ML approaches can aid in identifying patients with a high risk of mortality, allowing a fast, objective, and generalizable method for improving prognostic assessment by providing a second expert opinion that outperforms human evaluation.
Collapse
|
11
|
Mortality Prediction of COVID-19 Patients Using Radiomic and Neural Network Features Extracted from a Wide Chest X-ray Sample Size: A Robust Approach for Different Medical Imbalanced Scenarios. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083903] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Aim: The aim of this study was to develop robust prognostic models for mortality prediction of COVID-19 patients, applicable to different sets of real scenarios, using radiomic and neural network features extracted from chest X-rays (CXRs) with a certified and commercially available software. Methods: 1816 patients from 5 different hospitals in the Province of Reggio Emilia were included in the study. Overall, 201 radiomic features and 16 neural network features were extracted from each COVID-19 patient’s radiography. The initial dataset was balanced to train the classifiers with the same number of dead and survived patients, randomly selected. The pipeline had three main parts: balancing procedure; three-step feature selection; and mortality prediction with radiomic features through three machine learning (ML) classification models: AdaBoost (ADA), Quadratic Discriminant Analysis (QDA) and Random Forest (RF). Five evaluation metrics were computed on the test samples. The performance for death prediction was validated on both a balanced dataset (Case 1) and an imbalanced dataset (Case 2). Results: accuracy (ACC), area under the ROC-curve (AUC) and sensitivity (SENS) for the best classifier were, respectively, 0.72 ± 0.01, 0.82 ± 0.02 and 0.84 ± 0.04 for Case 1 and 0.70 ± 0.04, 0.79 ± 0.03 and 0.76 ± 0.06 for Case 2. These results show that the prediction of COVID-19 mortality is robust in a different set of scenarios. Conclusions: Our large and varied dataset made it possible to train ML algorithms to predict COVID-19 mortality using radiomic and neural network features of CXRs.
Collapse
|
12
|
Pettit RW, Fullem R, Cheng C, Amos CI. Artificial intelligence, machine learning, and deep learning for clinical outcome prediction. Emerg Top Life Sci 2021; 5:ETLS20210246. [PMID: 34927670 PMCID: PMC8786279 DOI: 10.1042/etls20210246] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 12/03/2021] [Accepted: 12/07/2021] [Indexed: 12/12/2022]
Abstract
AI is a broad concept, grouping initiatives that use a computer to perform tasks that would usually require a human to complete. AI methods are well suited to predict clinical outcomes. In practice, AI methods can be thought of as functions that learn the outcomes accompanying standardized input data to produce accurate outcome predictions when trialed with new data. Current methods for cleaning, creating, accessing, extracting, augmenting, and representing data for training AI clinical prediction models are well defined. The use of AI to predict clinical outcomes is a dynamic and rapidly evolving arena, with new methods and applications emerging. Extraction or accession of electronic health care records and combining these with patient genetic data is an area of present attention, with tremendous potential for future growth. Machine learning approaches, including decision tree methods of Random Forest and XGBoost, and deep learning techniques including deep multi-layer and recurrent neural networks, afford unique capabilities to accurately create predictions from high dimensional, multimodal data. Furthermore, AI methods are increasing our ability to accurately predict clinical outcomes that previously were difficult to model, including time-dependent and multi-class outcomes. Barriers to robust AI-based clinical outcome model deployment include changing AI product development interfaces, the specificity of regulation requirements, and limitations in ensuring model interpretability, generalizability, and adaptability over time.
Collapse
Affiliation(s)
- Rowland W. Pettit
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
| | - Robert Fullem
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, U.S.A
| | - Chao Cheng
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
| | - Christopher I. Amos
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
- Dan L Duncan Comprehensive Cancer Center, Baylor College of Medicine, Houston, TX, U.S.A
| |
Collapse
|