Improved Analysis of COVID-19 Influenced Pneumonia from the Chest X-Rays Using Fine-Tuned Residual Networks

A Deep Learning Model for the Diagnosis and Discrimination of Gram-Positive and Gram-Negative Bacterial Pneumonia for Children Using Chest Radiography Images and Clinical Information

Purpose

This study aimed to develop a deep learning model based on chest radiography (CXR) images and clinical data to accurately classify gram-positive and gram-negative bacterial pneumonia in children to guide the use of antibiotics.

Methods

We retrospectively collected CXR images along with clinical information for gram-positive (n=447) and gram-negative (n=395) bacterial pneumonia in children from January 1, 2016, to June 30, 2021. Four types of machine learning models based on clinical data and six types of deep learning algorithm models based on image data were constructed, and multi-modal decision fusion was performed.

Results

In the machine learning models, CatBoost, which only used clinical data, had the best performance; its area under the receiver operating characteristic curve (AUC) was significantly higher than that of the other models (P<0.05). The incorporation of clinical information improved the performance of deep learning models that relied solely on image-based classification. Consequently, AUC and F1 increased by 5.6% and 10.2% on average, respectively. The best quality was achieved with ResNet101 (model accuracy: 0.75, recall rate: 0.84, AUC: 0.803, F1: 0.782).

Conclusion

Our study established a pediatric bacterial pneumonia model that utilizes CXR and clinical data to accurately classify cases of gram-negative and gram-positive bacterial pneumonia. The results confirmed that the addition of image data to the convolutional neural network model significantly improved its performance. While the CatBoost-based classifier had greater advantages owing to a smaller dataset, the quality of the Resnet101 model trained using multi-modal data was comparable to that of the CatBoost model, even with a limited number of samples.

Detection of Pneumonia from Chest X-ray Images Utilizing MobileNet Model

Pneumonia has been directly responsible for a huge number of deaths all across the globe. Pneumonia shares visual features with other respiratory diseases, such as tuberculosis, which can make it difficult to distinguish between them. Moreover, there is significant variability in the way chest X-ray images are acquired and processed, which can impact the quality and consistency of the images. This can make it challenging to develop robust algorithms that can accurately identify pneumonia in all types of images. Hence, there is a need to develop robust, data-driven algorithms that are trained on large, high-quality datasets and validated using a range of imaging techniques and expert radiological analysis. In this research, a deep-learning-based model is demonstrated for differentiating between normal and severe cases of pneumonia. This complete proposed system has a total of eight pre-trained models, namely, ResNet50, ResNet152V2, DenseNet121, DenseNet201, Xception, VGG16, EfficientNet, and MobileNet. These eight pre-trained models were simulated on two datasets having 5856 images and 112,120 images of chest X-rays. The best accuracy is obtained on the MobileNet model with values of 94.23% and 93.75% on two different datasets. Key hyperparameters including batch sizes, number of epochs, and different optimizers have all been considered during comparative interpretation of these models to determine the most appropriate model.

An Explainable AI-Enabled Framework for Interpreting Pulmonary Diseases from Chest Radiographs

Explainable Artificial Intelligence is a key component of artificially intelligent systems that aim to explain the classification results. The classification results explanation is essential for automatic disease diagnosis in healthcare. The human respiration system is badly affected by different chest pulmonary diseases. Automatic classification and explanation can be used to detect these lung diseases. In this paper, we introduced a CNN-based transfer learning-based approach for automatically explaining pulmonary diseases, i.e., edema, tuberculosis, nodules, and pneumonia from chest radiographs. Among these pulmonary diseases, pneumonia, which COVID-19 causes, is deadly; therefore, radiographs of COVID-19 are used for the explanation task. We used the ResNet50 neural network and trained the network on extensive training with the COVID-CT dataset and the COVIDNet dataset. The interpretable model LIME is used for the explanation of classification results. Lime highlights the input image's important features for generating the classification result. We evaluated the explanation using radiologists' highlighted images and identified that our model highlights and explains the same regions. We achieved improved classification results with our fine-tuned model with an accuracy of 93% and 97%, respectively. The analysis of our results indicates that this research not only improves the classification results but also provides an explanation of pulmonary diseases with advanced deep-learning methods. This research would assist radiologists with automatic disease detection and explanations, which are used to make clinical decisions and assist in diagnosing and treating pulmonary diseases in the early stage.