Deep learning-based computer-aided heart sound analysis in children with left-to-right shunt congenital heart disease

Cardiac murmur grading and risk analysis of cardiac diseases based on adaptable heterogeneous-modality multi-task learning

Cardiovascular disease (CVDs) has become one of the leading causes of death, posing a significant threat to human life. The development of reliable Artificial Intelligence (AI) assisted diagnosis algorithms for cardiac sounds is of great significance for early detection and treatment of CVDs. However, there is scarce research in this field. Existing research mainly faces three major challenges: (1) They mainly limited to murmur classification and cannot achieve murmur grading, but attempting both classification and grading may lead to negative effects between different multi-tasks. (2) They mostly pay attention to unstructured cardiac sound modality and do not consider the structured demographic modality, as it is difficult to balance the influence of heterogeneous modalities. (3) Deep learning methods lack interpretability, which makes it challenging to apply them clinically. To tackle these challenges, we propose a method for cardiac murmur grading and cardiac risk analysis based on heterogeneous modality adaptive multi-task learning. Specifically, a Hierarchical Multi-Task learning-based cardiac murmur detection and grading method (HMT) is proposed to prevent negative interference between different tasks. In addition, a cardiac risk analysis method based on Heterogeneous Multi-modal feature impact Adaptation (HMA) is also proposed, which transforms unstructured modality into structured modality representation, and utilizes an adaptive mode weight learning mechanism to balance the impact between unstructured modality and structured modality, thus enhancing the performance of cardiac risk prediction. Finally, we propose a multi-task interpretability learning module that incorporates an important evaluation using random masks. This module utilizes SHAP graphs to visualize crucial murmur segments in cardiac sound and employs a multi-factor risk decoupling model based on nomograms. And then we gain insights into the cardiac disease risk in both pre-decoupled multi-modality and post-decoupled single-modality scenarios, thus providing a solid foundation for AI assisted cardiac murmur grading and risk analysis. Experimental results on a large real-world CirCor DigiScope PCG dataset demonstrate that the proposed method outperforms the state-of-the-art (SOTA) method in murmur detection, grading, and cardiac risk analysis, while also providing valuable diagnostic evidence.

Identifying pediatric heart murmurs and distinguishing innocent from pathologic using deep learning

OBJECTIVE

To develop a deep learning algorithm to perform multi-class classification of normal pediatric heart sounds, innocent murmurs, and pathologic murmurs.

METHODS

We prospectively enrolled children under age 18 being evaluated by the Division of Pediatric Cardiology. Parents provided consent for a deidentified recording of their child's heart sounds with a digital stethoscope. Innocent murmurs were validated by a pediatric cardiologist and pathologic murmurs were validated by echocardiogram. To augment our collection of normal heart sounds, we utilized a public database of pediatric heart sound recordings (Oliveira, 2022). We propose two novel approaches for this audio classification task. We train a vision transformer on either Markov transition field or Gramian angular field image representations of the frequency spectrum. We benchmark our results against a ResNet-50 CNN trained on spectrogram images.

RESULTS

Our final dataset consisted of 366 normal heart sounds, 175 innocent murmurs, and 216 pathologic murmurs. Innocent murmurs collected include Still's murmur, venous hum, and flow murmurs. Pathologic murmurs included ventricular septal defect, tetralogy of Fallot, aortic regurgitation, aortic stenosis, pulmonary stenosis, mitral regurgitation and stenosis, and tricuspid regurgitation. We find that the Vision Transformer consistently outperforms the ResNet-50 on all three image representations, and that the Gramian angular field is the superior image representation for pediatric heart sounds. We calculated a one-vs-rest multi-class ROC curve for each of the three classes. Our best model achieves an area under the curve (AUC) value of 0.92 ± 0.05, 0.83 ± 0.04, and 0.88 ± 0.04 for identifying normal heart sounds, innocent murmurs, and pathologic murmurs, respectively.

CONCLUSION

We present two novel methods for pediatric heart sound classification, which outperforms the current standard of using a convolutional neural network trained on spectrogram images. To our knowledge, we are the first to demonstrate multi-class classification of pediatric murmurs. Multiclass output affords a more explainable and interpretable model, which can facilitate further model improvement in the downstream model development cycle and enhance clinician trust and therefore adoption.

A cluster-based ensemble approach for congenital heart disease prediction

BACKGROUND

One of the most prevalent birth disorders is congenital heart diseases (CHD). Although CHD risk factors have been the subject of numerous studies, their propensity to cause CHD has not been tested. Particularly few research has attempted to forecast CHD risk using population-based cross-sectional data, which is inherently imbalanced.

OBJECTIVE

The main goals of this study are to create a reliable data analysis model that can help with (i) a better understanding of congenital heart disease prediction in the presence of missing and unbalanced data and (ii) creating cohorts of expectant mothers with similar lifestyle characteristics.

METHODS

Clusters of patient cohorts are produced using the unsupervised data mining technique density-based spatial clustering of applications with noise (DBSCAN). For more accurate CHD prediction, a random forest model was trained using these clusters and their corresponding patterns. This study uses a dataset of 33,831 expectant mothers to make its prediction. Missing data were handled using the k-NN imputation approach, while extremely unbalanced data were balanced using SMOTE. These techniques are all data-driven and need little to no user or expert involvement.

RESULTS AND CONCLUSION

Using DBSCAN, three cohorts were found. The cluster information enhanced the random forest-based CHD prediction and revealed intricate factors that influence prediction accuracy. The proposed approach gave the highest results with 99 % accuracy and 0.91 AUC and performed better than the state-of-the-art methodologies. Hence, the suggested method using unsupervised learning can provide intricate information to the classifier and further enhance the performance of the classification.

The Lifelong Impact of Artificial Intelligence and Clinical Prediction Models on Patients With Tetralogy of Fallot

Medical advancements in the diagnosis, surgical techniques, perioperative care, and continued care throughout childhood have transformed the outlook for individuals with tetralogy of Fallot (TOF), improving survival and shifting the perspective towards lifelong care. However, with a growing population of survivors, longstanding challenges have been accentuated, and new challenges have surfaced, necessitating a re-evaluation of TOF care. Availability of prenatal diagnostics, insufficient information from traditional imaging techniques, previously unforeseen medical complications, and debates surrounding optimal timing and indications for reintervention are among the emerging issues. To address these challenges, the integration of artificial intelligence and machine learning holds great promise as they have the potential to revolutionize patient management and positively impact lifelong outcomes for individuals with TOF. Innovative applications of artificial intelligence and machine learning have spanned across multiple domains of TOF care, including screening and diagnosis, automated image processing and interpretation, clinical risk stratification, and planning and performing cardiac interventions. By embracing these advancements and incorporating them into routine clinical practice, personalized medicine could be delivered, leading to the best possible outcomes for patients. In this review, we provide an overview of these evolving applications and emphasize the challenges, limitations, and future potential for integrating them into clinical care.

Deep Learning for Echocardiography: Introduction for Clinicians and Future Vision: State-of-the-Art Review

Exponential growth in data storage and computational power is rapidly narrowing the gap between translating findings from advanced clinical informatics into cardiovascular clinical practice. Specifically, cardiovascular imaging has the distinct advantage in providing a great quantity of data for potentially rich insights, but nuanced interpretation requires a high-level skillset that few individuals possess. A subset of machine learning, deep learning (DL), is a modality that has shown promise, particularly in the areas of image recognition, computer vision, and video classification. Due to a low signal-to-noise ratio, echocardiographic data tend to be challenging to classify; however, utilization of robust DL architectures may help clinicians and researchers automate conventional human tasks and catalyze the extraction of clinically useful data from the petabytes of collected imaging data. The promise is extending far and beyond towards a contactless echocardiographic exam-a dream that is much needed in this time of uncertainty and social distancing brought on by a stunning pandemic culture. In the current review, we discuss state-of-the-art DL techniques and architectures that can be used for image and video classification, and future directions in echocardiographic research in the current era.

Technical characterisation of digital stethoscopes: towards scalable artificial intelligence-based auscultation

Digital stethoscopes can enable the development of integrated artificial intelligence (AI) systems that can remove the subjectivity of manual auscultation, improve diagnostic accuracy, and compensate for diminishing auscultatory skills. Developing scalable AI systems can be challenging, especially when acquisition devices differ and thus introduce sensor bias. To address this issue, a precise knowledge of these differences, i.e., frequency responses of these devices, is needed, but the manufacturers often do not provide complete device specifications. In this study, we reported an effective methodology for determining the frequency response of a digital stethoscope and used it to characterise three common digital stethoscopes: Littmann 3200, Eko Core, and Thinklabs One. Our results show significant inter-device variability in that the frequency responses of the three studied stethoscopes were distinctly different. A moderate intra-device variability was seen when comparing two separate units of Littmann 3200. The study highlights the need for normalisation across devices for developing successful AI-assisted auscultation and provides a technical characterisation approach as a first step to accomplish it.

Phonocardiogram transfer learning-based CatBoost model for diastolic dysfunction identification using multiple domain-specific deep feature fusion

Left ventricular diastolic dyfunction detection is particularly important in cardiac function screening. This paper proposed a phonocardiogram (PCG) transfer learning-based CatBoost model to detect diastolic dysfunction noninvasively. The Short-Time Fourier Transform (STFT), Mel Frequency Cepstral Coefficients (MFCCs), S-transform and gammatonegram were utilized to perform four different representations of spectrograms for learning the representative patterns of PCG signals in two-dimensional image modality. Then, four pre-trained convolutional neural networks (CNNs) such as VGG16, Xception, ResNet50 and InceptionResNetv2 were employed to extract multiple domain-specific deep features from PCG spectrograms using transfer learning, respectively. Further, principal component analysis and linear discriminant analysis (LDA) were applied to different feature subsets, respectively, and then these different selected features are fused and fed into CatBoost for classification and performance comparison. Finally, three typical machine learning classifiers such as multilayer perceptron, support vector machine and random forest were employed to compared with CatBoost. The hyperparameter optimization of the investigated models was determined through grid search. The visualized result of the global feature importance showed that deep features extracted from gammatonegram by ResNet50 contributed most to classification. Overall, the proposed multiple domain-specific feature fusion based CatBoost model with LDA achieved the best performance with an area under the curve of 0.911, accuracy of 0.882, sensitivity of 0.821, specificity of 0.927, F1-score of 0.892 on the testing set. The PCG transfer learning-based model developed in this study could aid in diastolic dysfunction detection and could contribute to non-invasive evaluation of diastolic function.

Artificial Intelligence in Pediatric Cardiology: A Scoping Review

The evolution of AI and data science has aided in mechanizing several aspects of medical care requiring critical thinking: diagnosis, risk stratification, and management, thus mitigating the burden of physicians and reducing the likelihood of human error. AI modalities have expanded feet to the specialty of pediatric cardiology as well. We conducted a scoping review searching the Scopus, Embase, and PubMed databases covering the recent literature between 2002-2022. We found that the use of neural networks and machine learning has significantly improved the diagnostic value of cardiac magnetic resonance imaging, echocardiograms, computer tomography scans, and electrocardiographs, thus augmenting the clinicians' diagnostic accuracy of pediatric heart diseases. The use of AI-based prediction algorithms in pediatric cardiac surgeries improves postoperative outcomes and prognosis to a great extent. Risk stratification and the prediction of treatment outcomes are feasible using the key clinical findings of each CHD with appropriate computational algorithms. Notably, AI can revolutionize prenatal prediction as well as the diagnosis of CHD using the EMR (electronic medical records) data on maternal risk factors. The use of AI in the diagnostics, risk stratification, and management of CHD in the near future is a promising possibility with current advancements in machine learning and neural networks. However, the challenges posed by the dearth of appropriate algorithms and their nascent nature, limited physician training, fear of over-mechanization, and apprehension of missing the 'human touch' limit the acceptability. Still, AI proposes to aid the clinician tomorrow with precision cardiology, paving a way for extremely efficient human-error-free health care.

Heart disease detection based on internet of things data using linear quadratic discriminant analysis and a deep graph convolutional neural network

Heart disease is an emerging health issue in the medical field, according to WHO every year around 10 billion people are affected with heart abnormalities. Arteries in the heart generate oxygenated blood to all body parts, however sometimes blood vessels become clogged or restrained due to cardiac issues. Past heart diagnosis applications are outdated and suffer from poor performance. Therefore, an intelligent heart disease diagnosis application design is required. In this research work, internet of things (IoT) sensor data with a deep learning-based heart diagnosis application is designed. The heart disease IoT sensor data is collected from the University of California Irvine machine learning repository free open-source dataset which is useful for training the deep graph convolutional network (DG_ConvoNet) deep learning network. The testing data has been collected from the Cleveland Clinic Foundation; it is a collection of 350 real-time clinical instances from heart patients through IoT sensors. The K-means technique is employed to remove noise in sensor data and clustered the unstructured data. The features are extracted to employ Linear Quadratic Discriminant Analysis. DG_ConvoNet is a deep learning process to classify and predict heart diseases. The diagnostic application achieves an accuracy of 96%, sensitivity of 80%, specificity of 73%, precision of 90%, F-Score of 79%, and area under the ROC curve of 75% implementing the proposed model.

Automated identification of innocent Still's murmur using a convolutional neural network

Background

Still's murmur is the most prevalent innocent heart murmur of childhood. Auscultation is the primary clinical tool to identify this murmur as innocent. Whereas pediatric cardiologists routinely perform this task, primary care providers are less successful in distinguishing Still's murmur from the murmurs of true heart disease. This results in a large number of children with a Still's murmur being referred to pediatric cardiologists.

Objectives

To develop a computer algorithm that can aid primary care providers to identify the innocent Still's murmur at the point of care, to substantially decrease over-referral.

Methods

The study included Still's murmurs, pathological murmurs, other innocent murmurs, and normal (i.e., non-murmur) heart sounds of 1,473 pediatric patients recorded using a commercial electronic stethoscope. The recordings with accompanying clinical diagnoses provided by a pediatric cardiologist were used to train and test the convolutional neural network-based algorithm.

Results

A comparative analysis showed that the algorithm using only the murmur sounds recorded at the lower left sternal border achieved the highest accuracy. The developed algorithm identified Still's murmur with 90.0% sensitivity and 98.3% specificity for the default decision threshold. The area under the receiver operating characteristic curve was 0.943.

Conclusions

Still's murmur can be identified with high accuracy with the algorithm we developed. Using this approach, the algorithm could help to reduce the rate of unnecessary pediatric cardiologist referrals and use of echocardiography for a common benign finding.