An Interpretable Object Detection-Based Model For The Diagnosis Of Neonatal Lung Diseases Using Ultrasound Images

Toward explainable deep learning in healthcare through transition matrix and user-friendly features

Modern artificial intelligence (AI) solutions often face challenges due to the "black box" nature of deep learning (DL) models, which limits their transparency and trustworthiness in critical medical applications. In this study, we propose and evaluate a scalable approach based on a transition matrix to enhance the interpretability of DL models in medical signal and image processing by translating complex model decisions into user-friendly and justifiable features for healthcare professionals. The criteria for choosing interpretable features were clearly defined, incorporating clinical guidelines and expert rules to align model outputs with established medical standards. The proposed approach was tested on two medical datasets: electrocardiography (ECG) for arrhythmia detection and magnetic resonance imaging (MRI) for heart disease classification. The performance of the DL models was compared with expert annotations using Cohen's Kappa coefficient to assess agreement, achieving coefficients of 0.89 for the ECG dataset and 0.80 for the MRI dataset. These results demonstrate strong agreement, underscoring the reliability of the approach in providing accurate, understandable, and justifiable explanations of DL model decisions. The scalability of the approach suggests its potential applicability across various medical domains, enhancing the generalizability and utility of DL models in healthcare while addressing practical challenges and ethical considerations.

Classification of lung pathologies in neonates using dual-tree complex wavelet transform

INTRODUCTION

Undiagnosed and untreated lung pathologies are among the leading causes of neonatal deaths in developing countries. Lung Ultrasound (LUS) has been widely accepted as a diagnostic tool for neonatal lung pathologies due to its affordability, portability, and safety. However, healthcare institutions in developing countries lack well-trained clinicians to interpret LUS images, which limits the use of LUS, especially in remote areas. An automated point-of-care tool that could screen and capture LUS morphologies associated with neonatal lung pathologies could aid in rapid and accurate diagnosis.

METHODS

We propose a framework for classifying the six most common neonatal lung pathologies using spatially localized line and texture patterns extracted via 2D dual-tree complex wavelet transform (DTCWT). We acquired 1550 LUS images from 42 neonates with varying numbers of lung pathologies. Furthermore, we balanced our data set to avoid bias towards a pathology class.

RESULTS

Using DTCWT and clinical features as inputs to a linear discriminant analysis (LDA), our approach achieved a per-image cross-validated classification accuracy of 74.39% for the imbalanced data set. Our classification accuracy improved to 92.78% after balancing our data set. Moreover, our proposed framework achieved a maximum per-subject cross-validated classification accuracy of 64.97% with an imbalanced data set while using a balanced data set improves its classification accuracy up to 81.53%.

CONCLUSION

Our work could aid in automating the diagnosis of lung pathologies among neonates using LUS. Rapid and accurate diagnosis of lung pathologies could help to decrease neonatal deaths in healthcare institutions that lack well-trained clinicians, especially in developing countries.

An Interpretable Neonatal Lung Ultrasound Feature Extraction and Lung Sliding Detection System Using Object Detectors

The objective of this study was to develop an interpretable system that could detect specific lung features in neonates. A challenging aspect of this work was that normal lungs showed the same visual features (as that of Pneumothorax (PTX)). M-mode is typically necessary to differentiate between the two cases, but its generation in clinics is time-consuming and requires expertise for interpretation, which remains limited. Therefore, our system automates M-mode generation by extracting Regions of Interest (ROIs) without human in the loop. Object detection models such as faster Region Based Convolutional Neural Network (fRCNN) and RetinaNet models were employed to detect seven common Lung Ultrasound (LUS) features. fRCNN predictions were then stored and further used to generate M-modes. Beyond static feature extraction, we used a Hough transform based statistical method to detect "lung sliding" in these M-modes. Results showed that fRCNN achieved a greater mean Average Precision (mAP) of 86.57% (Intersection-over-Union (IoU) = 0.2) than RetinaNet, which only displayed a mAP of 61.15%. The calculated accuracy for the generated RoIs was 97.59% for Normal videos and 96.37% for PTX videos. Using this system, we successfully classified 5 PTX and 6 Normal video cases with 100% accuracy. Automating the process of detecting seven prominent LUS features addresses the time-consuming manual evaluation of Lung ultrasound in a fast paced environment. Clinical impact: Our research work provides a significant clinical impact as it provides a more accurate and efficient method for diagnosing lung diseases in neonates.

Multi-Level Classification of Lung Pathologies in Neonates using Recurrence Features

The use of Lung Ultrasound (LUS) as a tool to diagnose and monitor lung diseases in neonates has increased in urban hospitals. LUS's main advantages compared to chest CT or X-rays is that it is less expensive, more accessible, and does not expose the patient to radiation. Performing LUS on neonates and diagnosing the LUS images require highly trained medical professional and clinicians. While availability of such specialists in general is not an issue in urban areas, there is lack of such personnel in rural and remote communities. Hence, an automated computer-aided screening approach as a first level diagnosis assistance in such scenarios might be of significant value. Many of the image morphologies used by clinicians in diagnosing the LUS have strong recurrence characteristics. Building upon this knowledge, in this paper, we propose a feature extraction method designed to quantify such recurrent features for classification of LUS images into 6 common neonatal lung conditions. These conditions were normal lung, chronic lung disease (CLD), transient tachypnea of the newborn (TTN), pneumothorax (PTX), respiratory distress syndrome (RDS), and consolidation (CON) that could be pneumonia or atelectasis. The proposed method extracts virtual scanlines from the LUS images and converts them into signals. Then using recurrence quantification analysis (RQA), features were extracted and fed to pattern classifiers. Using a simple linear classifier the proposed features can achieve a classification accuracy of 69.3% without clinical features and 77.6% with clinical features. Clinical Relevance- Development of an automated computer-aided screening tool for first level diagnosis assistance in neonatal LUS pathologies. Such a tool will be of significant value in rural and remote medical communities.