1
|
Qiu J, Mitra J, Ghose S, Dumas C, Yang J, Sarachan B, Judson MA. A Multichannel CT and Radiomics-Guided CNN-ViT (RadCT-CNNViT) Ensemble Network for Diagnosis of Pulmonary Sarcoidosis. Diagnostics (Basel) 2024; 14:1049. [PMID: 38786347 PMCID: PMC11120014 DOI: 10.3390/diagnostics14101049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Revised: 05/10/2024] [Accepted: 05/15/2024] [Indexed: 05/25/2024] Open
Abstract
Pulmonary sarcoidosis is a multisystem granulomatous interstitial lung disease (ILD) with a variable presentation and prognosis. The early accurate detection of pulmonary sarcoidosis may prevent progression to pulmonary fibrosis, a serious and potentially life-threatening form of the disease. However, the lack of a gold-standard diagnostic test and specific radiographic findings poses challenges in diagnosing pulmonary sarcoidosis. Chest computed tomography (CT) imaging is commonly used but requires expert, chest-trained radiologists to differentiate pulmonary sarcoidosis from lung malignancies, infections, and other ILDs. In this work, we develop a multichannel, CT and radiomics-guided ensemble network (RadCT-CNNViT) with visual explainability for pulmonary sarcoidosis vs. lung cancer (LCa) classification using chest CT images. We leverage CT and hand-crafted radiomics features as input channels, and a 3D convolutional neural network (CNN) and vision transformer (ViT) ensemble network for feature extraction and fusion before a classification head. The 3D CNN sub-network captures the localized spatial information of lesions, while the ViT sub-network captures long-range, global dependencies between features. Through multichannel input and feature fusion, our model achieves the highest performance with accuracy, sensitivity, specificity, precision, F1-score, and combined AUC of 0.93 ± 0.04, 0.94 ± 0.04, 0.93 ± 0.08, 0.95 ± 0.05, 0.94 ± 0.04, and 0.97, respectively, in a five-fold cross-validation study with pulmonary sarcoidosis (n = 126) and LCa (n = 93) cases. A detailed ablation study showing the impact of CNN + ViT compared to CNN or ViT alone, and CT + radiomics input, compared to CT or radiomics alone, is also presented in this work. Overall, the AI model developed in this work offers promising potential for triaging the pulmonary sarcoidosis patients for timely diagnosis and treatment from chest CT.
Collapse
Affiliation(s)
- Jianwei Qiu
- GE HealthCare, Niskayuna, NY 12309, USA; (J.Q.); (S.G.); (B.S.)
| | - Jhimli Mitra
- GE HealthCare, Niskayuna, NY 12309, USA; (J.Q.); (S.G.); (B.S.)
| | - Soumya Ghose
- GE HealthCare, Niskayuna, NY 12309, USA; (J.Q.); (S.G.); (B.S.)
| | - Camille Dumas
- Department of Medical Imaging, Albany Medical College, Albany, NY 12208, USA; (C.D.); (J.Y.)
| | - Jun Yang
- Department of Medical Imaging, Albany Medical College, Albany, NY 12208, USA; (C.D.); (J.Y.)
| | - Brion Sarachan
- GE HealthCare, Niskayuna, NY 12309, USA; (J.Q.); (S.G.); (B.S.)
| | - Marc A. Judson
- Department of Medicine, Albany Medical College, Albany, NY 12208, USA;
| |
Collapse
|
2
|
Gerke AK. Treatment of Granulomatous Inflammation in Pulmonary Sarcoidosis. J Clin Med 2024; 13:738. [PMID: 38337432 PMCID: PMC10856377 DOI: 10.3390/jcm13030738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 01/24/2024] [Accepted: 01/25/2024] [Indexed: 02/12/2024] Open
Abstract
The management of pulmonary sarcoidosis is a complex interplay of disease characteristics, the impact of medications, and patient preferences. Foremost, it is important to weigh the risk of anti-granulomatous treatment with the benefits of lung preservation and improvement in quality of life. Because of its high spontaneous resolution rate, pulmonary sarcoidosis should only be treated in cases of significant symptoms due to granulomatous inflammation, lung function decline, or substantial inflammation on imaging that can lead to irreversible fibrosis. The longstanding basis of treatment has historically been corticosteroid therapy for the control of granulomatous inflammation. However, several corticosteroid-sparing options have increasing evidence for use in refractory disease, inability to taper steroids to an acceptable dose, or in those with toxicity to corticosteroids. Treatment of sarcoidosis should be individualized for each patient due to the heterogeneity of the clinical course, comorbid conditions, response to therapy, and tolerance of medication side effects.
Collapse
Affiliation(s)
- Alicia K Gerke
- Pulmonary and Critical Care Medicine, University of Iowa, 200 Hawkins Drive, Iowa City, IA 52242, USA
| |
Collapse
|
3
|
Judson MA, Qiu J, Dumas CL, Yang J, Sarachan B, Mitra J. An Artificial Intelligence Platform for the Radiologic Diagnosis of Pulmonary Sarcoidosis: An Initial Pilot Study of Chest Computed Tomography Analysis to Distinguish Pulmonary Sarcoidosis from a Negative Lung Cancer Screening Scan. Lung 2023; 201:611-616. [PMID: 37962584 DOI: 10.1007/s00408-023-00655-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 10/31/2023] [Indexed: 11/15/2023]
Abstract
PURPOSE To determine the reliability of an artificial intelligence, deep learning (AI/DL)-based method of chest computer tomography (CT) scan analysis to distinguish pulmonary sarcoidosis from negative lung cancer screening chest CT scans (Lung Imaging Reporting and Data System score 1, Lung-RADS score 1). METHODS Chest CT scans of pulmonary sarcoidosis were evaluated by a clinician experienced with sarcoidosis and a chest radiologist for clinical and radiologic evidence of sarcoidosis and exclusion of alternative or concomitant pulmonary diseases. The AI/DL based method used an ensemble network architecture combining Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs). The method was applied to 126 pulmonary sarcoidosis and 96 Lung-RADS score 1 CT scans. The analytic approach of training and validation of the AI/DL method used a fivefold cross-validation technique, where 4/5th of the available data set was used to train a diagnostic model and tested on the remaining 1/5th of the data set, and repeated 4 more times with non-overlapping validation/test data. The probability values were used to generate Receiver Operating Characteristic (ROC) curves to assess the model's discriminatory power. RESULTS The sensitivity, specificity, positive and negative predictive value of the AI/DL method for the 5 folds of the training/validation sets and the entire set of CT scans were all over 94% to distinguish pulmonary sarcoidosis from LUNG-RADS score 1 chest CT scans. The area under the curve for the corresponding ROC curves were all over 97%. CONCLUSION This AL/DL model shows promise to distinguish sarcoidosis from alternative pulmonary conditions using minimal radiologic data.
Collapse
Affiliation(s)
- Marc A Judson
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Albany Medical College, MC-91; 16 New Scotland, Albany, NY, 12208, USA.
| | | | - Camille L Dumas
- Cardiovascular Division, Department of Radiology, Albany Medical College, Albany, NY, USA
| | - Jun Yang
- Albany Medical College, Albany, NY, USA
| | | | | |
Collapse
|
4
|
Ahmed FR, Alsenany SA, Abdelaliem SMF, Deif MA. Development of a hybrid LSTM with chimp optimization algorithm for the pressure ventilator prediction. Sci Rep 2023; 13:20927. [PMID: 38017008 PMCID: PMC10684522 DOI: 10.1038/s41598-023-47837-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Accepted: 11/19/2023] [Indexed: 11/30/2023] Open
Abstract
The utilization of mechanical ventilation is of utmost importance in the management of individuals afflicted with severe pulmonary conditions. During periods of a pandemic, it becomes imperative to build ventilators that possess the capability to autonomously adapt parameters over the course of treatment. In order to fulfil this requirement, a research investigation was undertaken with the aim of forecasting the magnitude of pressure applied on the patient by the ventilator. The aforementioned forecast was derived from a comprehensive analysis of many variables, including the ventilator's characteristics and the patient's medical state. This analysis was conducted utilizing a sophisticated computational model referred to as Long Short-Term Memory (LSTM). To enhance the predictive accuracy of the LSTM model, the researchers utilized the Chimp Optimization method (ChoA) method. The integration of LSTM and ChoA led to the development of the LSTM-ChoA model, which successfully tackled the issue of hyperparameter selection for the LSTM model. The experimental results revealed that the LSTM-ChoA model exhibited superior performance compared to alternative optimization algorithms, namely whale grey wolf optimizer (GWO), optimization algorithm (WOA), and particle swarm optimization (PSO). Additionally, the LSTM-ChoA model outperformed regression models, including K-nearest neighbor (KNN) Regressor, Random and Forest (RF) Regressor, and Support Vector Machine (SVM) Regressor, in accurately predicting ventilator pressure. The findings indicate that the suggested predictive model, LSTM-ChoA, demonstrates a reduced mean square error (MSE) value. Specifically, when comparing ChoA with GWO, the MSE fell by around 14.8%. Furthermore, when comparing ChoA with PSO and WOA, the MSE decreased by approximately 60%. Additionally, the analysis of variance (ANOVA) findings revealed that the p-value for the LSTM-ChoA model was 0.000, which is less than the predetermined significance level of 0.05. This indicates that the results of the LSTM-ChoA model are statistically significant.
Collapse
Affiliation(s)
- Fatma Refaat Ahmed
- Department of Nursing, College of Health Sciences, University of Sharjah, Sharjah, UAE
- Critical Care and Emergency Nursing Department, Faculty of Nursing, Alexandria University, Alexandria, Egypt
| | - Samira Ahmed Alsenany
- Department of Community Health Nursing, College of Nursing, Princess Nourah bint Abdulrahman University, P.O. Box 84428, 11671, Riyadh, Saudi Arabia
| | - Sally Mohammed Farghaly Abdelaliem
- Department of Nursing Management and Education, College of Nursing, Princess Nourah bint Abdulrahman University, P.O. Box 84428, 11671, Riyadh, Saudi Arabia.
| | - Mohanad A Deif
- Department of Artificial Intelligence, College of Information Technology, Misr University for Science and Technology (MUST), 6th of October City, 12566, Egypt
| |
Collapse
|
5
|
Lew D, Klang E, Soffer S, Morgenthau AS. Current Applications of Artificial Intelligence in Sarcoidosis. Lung 2023; 201:445-454. [PMID: 37730926 DOI: 10.1007/s00408-023-00641-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 08/15/2023] [Indexed: 09/22/2023]
Abstract
PURPOSE Sarcoidosis is a complex disease which can affect nearly every organ system with manifestations ranging from asymptomatic imaging findings to sudden cardiac death. As such, diagnosis and prognostication are topics of continued investigation. Recent technological advancements have introduced multiple modalities of artificial intelligence (AI) to the study of sarcoidosis. Machine learning, deep learning, and radiomics have predominantly been used to study sarcoidosis. METHODS Articles were collected by searching online databases using keywords such as sarcoid, machine learning, artificial intelligence, radiomics, and deep learning. Article titles and abstracts were reviewed for relevance by a single reviewer. Articles written in languages other than English were excluded. CONCLUSIONS Machine learning may be used to help diagnose pulmonary sarcoidosis and prognosticate in cardiac sarcoidosis. Deep learning is most comprehensively studied for diagnosis of pulmonary sarcoidosis and has less frequently been applied to prognostication in cardiac sarcoidosis. Radiomics has primarily been used to differentiate sarcoidosis from malignancy. To date, the use of AI in sarcoidosis is limited by the rarity of this disease, leading to small, suboptimal training sets. Nevertheless, there are applications of AI that have been used to study other systemic diseases, which may be adapted for use in sarcoidosis. These applications include discovery of new disease phenotypes, discovery of biomarkers of disease onset and activity, and treatment optimization.
Collapse
Affiliation(s)
- Dana Lew
- Division of Internal Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Eyal Klang
- Department of Diagnostic Imaging, Sheba Medical Center, Ramat Gan, Israel
| | - Shelly Soffer
- Division of Internal Medicine, Assuta Medical Center, Ashdod, Israel
| | - Adam S Morgenthau
- Division of Pulmonary, Critical Care, and Sleep Medicine, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
| |
Collapse
|