Detection of Snore from OSAHS Patients Based on Deep Learning

Automatically detecting OSAHS patients based on transfer learning and model fusion

Objective. Snoring is the most typical symptom of obstructive sleep apnea hypopnea syndrome (OSAHS) that can be used to develop a non-invasive approach for automatically detecting OSAHS patients.Approach. In this work, a model based on transfer learning and model fusion was applied to classify simple snorers and OSAHS patients. Three kinds of basic models were constructed based on pretrained Visual Geometry Group-16 (VGG16), pretrained audio neural networks (PANN), and Mel-frequency cepstral coefficient (MFCC). The XGBoost was used to select features based on feature importance, the majority voting strategy was applied to fuse these basic models and leave-one-subject-out cross validation was used to evaluate the proposed model.Main results. The results show that the fused model embedded with top-5 VGG16 features, top-5 PANN features, and MFCC feature can correctly identify OSAHS patients (AHI > 5) with 100% accuracy.Significance. The proposed fused model provides a good classification performance with lower computational cost and higher robustness that makes detecting OSAHS patients at home possible.

An audio-semantic multimodal model for automatic obstructive sleep Apnea-Hypopnea Syndrome classification via multi-feature analysis of snoring sounds

Introduction

Obstructive Sleep Apnea-Hypopnea Syndrome (OSAHS) is a common sleep-related breathing disorder that significantly impacts the daily lives of patients. Currently, the diagnosis of OSAHS relies on various physiological signal monitoring devices, requiring a comprehensive Polysomnography (PSG). However, this invasive diagnostic method faces challenges such as data fluctuation and high costs. To address these challenges, we propose a novel data-driven Audio-Semantic Multi-Modal model for OSAHS severity classification (i.e., ASMM-OSA) based on patient snoring sound characteristics.

Methods

In light of the correlation between the acoustic attributes of a patient's snoring patterns and their episodes of breathing disorders, we utilize the patient's sleep audio recordings as an initial screening modality. We analyze the audio features of snoring sounds during the night for subjects suspected of having OSAHS. Audio features were augmented via PubMedBERT to enrich their diversity and detail and subsequently classified for OSAHS severity using XGBoost based on the number of sleep apnea events.

Results

Experimental results using the OSAHS dataset from a collaborative university hospital demonstrate that our ASMM-OSA audio-semantic multimodal model achieves a diagnostic level in automatically identifying sleep apnea events and classifying the four-class severity (normal, mild, moderate, and severe) of OSAHS.

Discussion

Our proposed model promises new perspectives for non-invasive OSAHS diagnosis, potentially reducing costs and enhancing patient quality of life.

Automatic detection of obstructive sleep apnea based on speech or snoring sounds: a narrative review

Background and Objective

Obstructive sleep apnea (OSA) is a common chronic disorder characterized by repeated breathing pauses during sleep caused by upper airway narrowing or collapse. The gold standard for OSA diagnosis is the polysomnography test, which is time consuming, expensive, and invasive. In recent years, more cost-effective approaches for OSA detection based in predictive value of speech and snoring has emerged. In this paper, we offer a comprehensive summary of current research progress on the applications of speech or snoring sounds for the automatic detection of OSA and discuss the key challenges that need to be overcome for future research into this novel approach.

Methods

PubMed, IEEE Xplore, and Web of Science databases were searched with related keywords. Literature published between 1989 and 2022 examining the potential of using speech or snoring sounds for automated OSA detection was reviewed.

Key Content and Findings

Speech and snoring sounds contain a large amount of information about OSA, and they have been extensively studied in the automatic screening of OSA. By importing features extracted from speech and snoring sounds into artificial intelligence models, clinicians can automatically screen for OSA. Features such as formant, linear prediction cepstral coefficients, mel-frequency cepstral coefficients, and artificial intelligence algorithms including support vector machines, Gaussian mixture model, and hidden Markov models have been extensively studied for the detection of OSA.

Conclusions

Due to the significant advantages of noninvasive, low-cost, and contactless data collection, an automatic approach based on speech or snoring sounds seems to be a promising tool for the detection of OSA.

AHI estimation of OSAHS patients based on snoring classification and fusion model

Obstructive sleep apnea-hypopnea syndrome (OSAHS) is a chronic and common sleep-breathing disease that could negatively influence lives of patients and cause serious concomitant diseases. Polysomnography(PSG) is the gold standard for diagnosing OSAHS, but it is expensive and requires overnight hospitalization. Snoring is a typical symptom of OSAHS. This study proposes an effective OSAHS screening method based on snoring sound analysis. Snores were labeled as OSAHS related snoring sounds and simple snoring sounds according to real-time PSG records. Three models were used, including acoustic features combined with XGBoost, Mel-spectrum combined with convolution neural network (CNN), and Mel-spectrum combined with residual neural network (ResNet). Further, the three models were fused by soft voting to detect these two types of snoring sounds. The subject's apnea-hypopnea index (AHI) was estimated according to these recognized snoring sounds. The accuracy and recall of the proposed fusion model achieved 83.44% and 85.27% respectively, and the predicted AHI has a Pearson correlation coefficient of 0.913 (R2 = 0.834, p < 0.001) with PSG. The results demonstrate the validity of predicting AHI based on analysis of snoring sound and show great potential for monitoring OSAHS at home.

Pilot study of contactless sleep apnea detection based on snore signals with hardware implementation

Objective.Sleep apnea has a high incidence and is a potentially dangerous disease, and its early detection and diagnosis are challenging. Polysomnography (PSG) is considered the best approach for sleep apnea detection, but it requires cumbersome and complicated operations. Thus, it cannot satisfy the family healthcare needs.Approach.To facilitate the initial detection of sleep apnea in the home environment, we developed a sleep apnea classification model based on snoring and hybrid neural network, and implemented the well trained model in an embedded hardware platform. We used snore signals from 32 patients at Shenzhen People's Hospital. The Mel-Fbank features were extracted from snore signals to build a sleep apnea classification model based on Bi-LSTM with attention mechanism.Main results.The proposed model classified snore signals into four types: hypopnea, normal condition, obstructive sleep apnea, and central sleep apnea, with 83.52% and 62.31% accuracies, corresponding to the subject-dependence and subject-independence validation, respectively. After pruning and model quantization, at the cost of 0.81% and 0.95% accuracy loss of the subject dependence and subject independence classification, respectively, the number of model parameters and model storage space were reduced by 32.12% and 60.37%, respectively. The model exhibited accuracies of 82.71% and 61.36% based on the subject dependence and subject independence validations, respectively. When the well trained model was successfully porting and running on an STM32 ARM-embedded platform, the model accuracy was 58.85% for the four classifications based on leave-one-subject-out validation.Significance.The proposed sleep apnea detection model can be used in home healthcare for the initial detection of sleep apnea.

Automatic stridor detection using small training set via patch-wise few-shot learning for diagnosis of multiple system atrophy

Stridor is a rare but important non-motor symptom that can support the diagnosis and prediction of worse prognosis in multiple system atrophy. Recording sounds generated during sleep by video-polysomnography is recommended for detecting stridor, but the analysis is labor intensive and time consuming. A method for automatic stridor detection should be developed using technologies such as artificial intelligence (AI) or machine learning. However, the rarity of stridor hinders the collection of sufficient data from diverse patients. Therefore, an AI method with high diagnostic performance should be devised to address this limitation. We propose an AI method for detecting patients with stridor by combining audio splitting and reintegration with few-shot learning for diagnosis. We used video-polysomnography data from patients with stridor (19 patients with multiple system atrophy) and without stridor (28 patients with parkinsonism and 18 patients with sleep disorders). To the best of our knowledge, this is the first study to propose a method for stridor detection and attempt the validation of few-shot learning to process medical audio signals. Even with a small training set, a substantial improvement was achieved for stridor detection, confirming the clinical utility of our method compared with similar developments. The proposed method achieved a detection accuracy above 96% using data from only eight patients with stridor for training. Performance improvements of 4%-13% were achieved compared with a state-of-the-art AI baseline. Moreover, our method determined whether a patient had stridor and performed real-time localization of the corresponding audio patches, thus providing physicians with support for interpreting and efficiently employing the results of this method.

Application of artificial intelligence in the diagnosis of sleep apnea

STUDY OBJECTIVES

Machine learning (ML) models have been employed in the setting of sleep disorders. This review aims to summarize the existing data about the role of ML techniques in the diagnosis, classification, and treatment of sleep-related breathing disorders.

METHODS

A systematic search in Medline, EMBASE, and Cochrane databases through January 2022 was performed.

RESULTS

Our search strategy revealed 132 studies that were included in the systematic review. Existing data show that ML models have been successfully used for diagnostic purposes. Specifically, ML models showed good performance in diagnosing sleep apnea using easily obtained features from the electrocardiogram, pulse oximetry, and sound signals. Similarly, ML showed good performance for the classification of sleep apnea into obstructive and central categories, as well as predicting apnea severity. Existing data show promising results for the ML-based guided treatment of sleep apnea. Specifically, the prediction of outcomes following surgical treatment and optimization of continuous positive airway pressure therapy can be guided by ML models.

CONCLUSIONS

The adoption and implementation of ML in the field of sleep-related breathing disorders is promising. Advancements in wearable sensor technology and ML models can help clinicians predict, diagnose, and classify sleep apnea more accurately and efficiently.

CITATION

Bazoukis G, Bollepalli SC, Chung CT, et al. Application of artificial intelligence in the diagnosis of sleep apnea. J Clin Sleep Med. 2023;19(7):1337-1363.

Monitoring of Sleep Breathing States Based on Audio Sensor Utilizing Mel-Scale Features in Home Healthcare

Sleep-related breathing disorders (SBDs) will lead to poor sleep quality and increase the risk of cardiovascular and cerebrovascular diseases which may cause death in serious cases. This paper aims to detect breathing states related to SBDs by breathing sound signals. A moment waveform analysis is applied to locate and segment the breathing cycles. As the core of our study, a set of useful features of breathing signal is proposed based on Mel frequency cepstrum analysis. Finally, the normal and abnormal sleep breathing states can be distinguished by the extracted Mel-scale indexes. Young healthy testers and patients who suffered from obstructive sleep apnea are tested utilizing the proposed method. The average accuracy for detecting abnormal breathing states can reach 93.1%. It will be helpful to prevent SBDs and improve the sleep quality of home healthcare.

Tidal Volume Level Estimation Using Respiratory Sounds

Respiratory sounds have been used as a noninvasive and convenient method to estimate respiratory flow and tidal volume. However, current methods need calibration, making them difficult to use in a home environment. A respiratory sound analysis method is proposed to estimate tidal volume levels during sleep qualitatively. Respiratory sounds are filtered and segmented into one-minute clips, all clips are clustered into three categories: normal breathing/snoring/uncertain with agglomerative hierarchical clustering (AHC). Formant parameters are extracted to classify snoring clips into simple snoring and obstructive snoring with the K-means algorithm. For simple snoring clips, the tidal volume level is calculated based on snoring last time. For obstructive snoring clips, the tidal volume level is calculated by the maximum breathing pause interval. The performance of the proposed method is evaluated on an open dataset, PSG-Audio, in which full-night polysomnography (PSG) and tracheal sound were recorded simultaneously. The calculated tidal volume levels are compared with the corresponding lowest nocturnal oxygen saturation (LoO₂) data. Experiments show that the proposed method calculates tidal volume levels with high accuracy and robustness.

Auditory Property-Based Features and Artificial Neural Network Classifiers for the Automatic Detection of Low-Intensity Snoring/Breathing Episodes

The definitive diagnosis of obstructive sleep apnea syndrome (OSAS) is made using an overnight polysomnography (PSG) test. This test requires that a patient wears multiple measurement sensors during an overnight hospitalization. However, this setup imposes physical constraints and a heavy burden on the patient. Recent studies have reported on another technique for conducting OSAS screening based on snoring/breathing episodes (SBEs) extracted from recorded data acquired by a noncontact microphone. However, SBEs have a high dynamic range and are barely audible at intensities >90 dB. A method is needed to detect SBEs even in low-signal-to-noise-ratio (SNR) environments. Therefore, we developed a method for the automatic detection of low-intensity SBEs using an artificial neural network (ANN). However, when considering its practical use, this method required further improvement in terms of detection accuracy and speed. To accomplish this, we propose in this study a new method to detect low SBEs based on neural activity pattern (NAP)-based cepstral coefficients (NAPCC) and ANN classifiers. Comparison results of the leave-one-out cross-validation demonstrated that our proposed method is superior to previous methods for the classification of SBEs and non-SBEs, even in low-SNR conditions (accuracy: 85.99 ± 5.69% vs. 75.64 ± 18.8%).

A Comprehensive Review: Computational Models for Obstructive Sleep Apnea Detection in Biomedical Applications

Obstructive sleep apnea (OSA) is a sleep disorder characterized by periodic episodes of partial or complete upper airway obstruction caused by narrowing or collapse of the pharyngeal airway despite ongoing breathing efforts during sleep. Fall in the blood oxygen saturation and cortical arousals are prompted by this reduction in the airflow which lasts for at least 10 seconds. Impaired labor performance, debilitated quality of life, excessive daytime sleepiness, high snoring, and tiredness even after a whole night's sleep are the primary symptoms of OSA. In due course, the long-standing contributions of OSA culminate in hypertension, arrhythmia, cerebrovascular disease, and heart failure. The traditional diagnostic approach of OSA is the laboratory-based polysomnography (PSG) overnight sleep study, which is a tedious and labor-intensive process that exaggerates the discomfort to the patient. With the advent of computer-aided diagnosis (CAD), automatic detection of OSA has gained increasing interest among researchers in the area of sleep disorders as it influences both diagnostic and therapeutic decisions. The research literature on sleep apnea published during the last decade has been surveyed, focusing on the varied screening approaches accustomed to identifying OSA events and the developmental knowledge offered by multiple contributors from the software perspective. The current study presents an overview of the pathophysiology of OSA, the detection methods, physiological signals related to OSA, the different preprocessing, feature extraction, feature selection, and classification techniques employed for the detection and classification of OSA. Consequently, the research challenges and research gaps in the diagnosis of OSA are identified, critically analyzed, and presented in the best possible light.

Diagnosis of Obstructive Sleep Apnea from ECG Signals Using Machine Learning and Deep Learning Classifiers

Obstructive sleep apnea (OSA) is a well-known sleep ailment. OSA mostly occurs due to the shortage of oxygen for the human body, which causes several symptoms (i.e., low concentration, daytime sleepiness, and irritability). Discovering the existence of OSA at an early stage can save lives and reduce the cost of treatment. The computer-aided diagnosis (CAD) system can quickly detect OSA by examining the electrocardiogram (ECG) signals. Over-serving ECG using a visual procedure is challenging for physicians, time-consuming, expensive, and subjective. In general, automated detection of the ECG signal’s arrhythmia is a complex task due to the complexity of the data quantity and clinical content. Moreover, ECG signals are usually affected by noise (i.e., patient movement and disturbances generated by electric devices or infrastructure), which reduces the quality of the collected data. Machine learning (ML) and Deep Learning (DL) gain a higher interest in health care systems due to its ability of achieving an excellent performance compared to traditional classifiers. We propose a CAD system to diagnose apnea events based on ECG in an automated way in this work. The proposed system follows the following steps: (1) remove noise from the ECG signal using a Notch filter. (2) extract nine features from the ECG signal (3) use thirteen ML and four types of DL models for the diagnosis of sleep apnea. The experimental results show that our proposed approach offers a good performance of DL classifiers to detect OSA. The proposed model achieves an accuracy of 86.25% in the validation stage.