1
|
Abdulsadig RS, Rodriguez-Villegas E. A comparative study in class imbalance mitigation when working with physiological signals. Front Digit Health 2024; 6:1377165. [PMID: 38595932 PMCID: PMC11002073 DOI: 10.3389/fdgth.2024.1377165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 03/14/2024] [Indexed: 04/11/2024] Open
Abstract
Class imbalance is a common challenge that is often faced when dealing with classification tasks aiming to detect medical events that are particularly infrequent. Apnoea is an example of such events. This challenge can however be mitigated using class rebalancing algorithms. This work investigated 10 widely used data-level class imbalance mitigation methods aiming towards building a random forest (RF) model that attempts to detect apnoea events from photoplethysmography (PPG) signals acquired from the neck. Those methods are random undersampling (RandUS), random oversampling (RandOS), condensed nearest-neighbors (CNNUS), edited nearest-neighbors (ENNUS), Tomek's links (TomekUS), synthetic minority oversampling technique (SMOTE), Borderline-SMOTE (BLSMOTE), adaptive synthetic oversampling (ADASYN), SMOTE with TomekUS (SMOTETomek) and SMOTE with ENNUS (SMOTEENN). Feature-space transformation using PCA and KernelPCA was also examined as a potential way of providing better representations of the data for the class rebalancing methods to operate. This work showed that RandUS is the best option for improving the sensitivity score (up to 11%). However, it could hinder the overall accuracy due to the reduced amount of training data. On the other hand, augmenting the data with new artificial data points was shown to be a non-trivial task that needs further development, especially in the presence of subject dependencies, as was the case in this work.
Collapse
Affiliation(s)
- Rawan S. Abdulsadig
- Wearable Technologies Lab, Department of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom
| | | |
Collapse
|
2
|
Almarshad MA, Al-Ahmadi S, Islam MS, BaHammam AS, Soudani A. Adoption of Transformer Neural Network to Improve the Diagnostic Performance of Oximetry for Obstructive Sleep Apnea. SENSORS (BASEL, SWITZERLAND) 2023; 23:7924. [PMID: 37765980 PMCID: PMC10536445 DOI: 10.3390/s23187924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 09/03/2023] [Accepted: 09/14/2023] [Indexed: 09/29/2023]
Abstract
Scoring polysomnography for obstructive sleep apnea diagnosis is a laborious, long, and costly process. Machine learning approaches, such as deep neural networks, can reduce scoring time and costs. However, most methods require prior filtering and preprocessing of the raw signal. Our work presents a novel method for diagnosing obstructive sleep apnea using a transformer neural network with learnable positional encoding, which outperforms existing state-of-the-art solutions. This approach has the potential to improve the diagnostic performance of oximetry for obstructive sleep apnea and reduce the time and costs associated with traditional polysomnography. Contrary to existing approaches, our approach performs annotations at one-second granularity. Allowing physicians to interpret the model's outcome. In addition, we tested different positional encoding designs as the first layer of the model, and the best results were achieved using a learnable positional encoding based on an autoencoder with structural novelty. In addition, we tried different temporal resolutions with various granularity levels from 1 to 360 s. All experiments were carried out on an independent test set from the public OSASUD dataset and showed that our approach outperforms current state-of-the-art solutions with a satisfactory AUC of 0.89, accuracy of 0.80, and F1-score of 0.79.
Collapse
Affiliation(s)
- Malak Abdullah Almarshad
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
- Computer Science Department, College of Computer and Information Sciences, Al-Imam Mohammad Ibn Saud Islamic University, Riyadh 11432, Saudi Arabia
| | - Saad Al-Ahmadi
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
| | - Md Saiful Islam
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
| | - Ahmed S. BaHammam
- The University Sleep Disorders Center, Department of Medicine, College of Medicine, King Saud University, Riyadh 11324, Saudi Arabia
- Strategic Technologies Program of the National Plan for Sciences and Technology and Innovation in the Kingdom of Saudi Arabia, Riyadh 11324, Saudi Arabia
| | - Adel Soudani
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia (M.S.I.)
| |
Collapse
|
3
|
Alarcón ÁS, Madrid NM, Seepold R, Ortega JA. Obstructive sleep apnea event detection using explainable deep learning models for a portable monitor. Front Neurosci 2023; 17:1155900. [PMID: 37521695 PMCID: PMC10375719 DOI: 10.3389/fnins.2023.1155900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 06/16/2023] [Indexed: 08/01/2023] Open
Abstract
Background Polysomnography (PSG) is the gold standard for detecting obstructive sleep apnea (OSA). However, this technique has many disadvantages when using it outside the hospital or for daily use. Portable monitors (PMs) aim to streamline the OSA detection process through deep learning (DL). Materials and methods We studied how to detect OSA events and calculate the apnea-hypopnea index (AHI) by using deep learning models that aim to be implemented on PMs. Several deep learning models are presented after being trained on polysomnography data from the National Sleep Research Resource (NSRR) repository. The best hyperparameters for the DL architecture are presented. In addition, emphasis is focused on model explainability techniques, concretely on Gradient-weighted Class Activation Mapping (Grad-CAM). Results The results for the best DL model are presented and analyzed. The interpretability of the DL model is also analyzed by studying the regions of the signals that are most relevant for the model to make the decision. The model that yields the best result is a one-dimensional convolutional neural network (1D-CNN) with 84.3% accuracy. Conclusion The use of PMs using machine learning techniques for detecting OSA events still has a long way to go. However, our method for developing explainable DL models demonstrates that PMs appear to be a promising alternative to PSG in the future for the detection of obstructive apnea events and the automatic calculation of AHI.
Collapse
Affiliation(s)
- Ángel Serrano Alarcón
- School of Informatics, Reutlingen University, Reutlingen, Germany
- Computer Languages and Systems, University of Seville, Sevilla, Spain
| | | | - Ralf Seepold
- Computer Science, HTWG Konstanz, Konstanz, Germany
| | | |
Collapse
|
4
|
Sharma M, Kumar K, Kumar P, Tan RS, Rajendra Acharya U. Pulse oximetry SpO2signal for automated identification of sleep apnea: a review and future trends. Physiol Meas 2022; 43. [PMID: 36215979 DOI: 10.1088/1361-6579/ac98f0] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 10/10/2022] [Indexed: 02/07/2023]
Abstract
Sleep apnea (SA) is characterized by intermittent episodes of apnea or hypopnea paused or reduced breathing, respectively each lasting at least ten seconds that occur during sleep. SA has an estimated global prevalence of 200 million and is associated with medical comorbidity, and sufferers are also more likely to sustain traffic- and work-related injury due to daytime somnolence. SA is amenable to treatment if detected early. Polysomnography (PSG) involving multi-channel signal acquisition is the reference standard for diagnosing SA but is onerous and costly. For home-based detection of SA, single-channelSpO2signal acquisition using portable pulse oximeters is feasible. Machine (ML) and deep learning (DL) models have been developed for automated classification of SA versus no SA usingSpO2signals alone. In this work, we review studies published between 2012 and 2022 on the use of ML and DL forSpO2signal-based diagnosis of SA. A literature search based on PRISMA recommendations yielded 297 publications, of which 31 were selected after considering the inclusion and exclusion criteria. There were 20 ML and 11 DL models; their methods, differences, results, merits, and limitations were discussed. Many studies reported encouraging performance, which indicates the utility ofSpO2signals in wearable devices for home-based SA detection.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Kamlesh Kumar
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Prince Kumar
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Ru-San Tan
- Department of Cardiology, National Heart Centre Singapore, Singapore 169609, Singapore
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 639798, Singapore.,Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan.,Department of Biomedical Engineering, School of Science and Technology, Singapore 639798, Singapore
| |
Collapse
|
5
|
Xu S, Faust O, Seoni S, Chakraborty S, Barua PD, Loh HW, Elphick H, Molinari F, Acharya UR. A review of automated sleep disorder detection. Comput Biol Med 2022; 150:106100. [PMID: 36182761 DOI: 10.1016/j.compbiomed.2022.106100] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 09/04/2022] [Accepted: 09/12/2022] [Indexed: 12/22/2022]
Abstract
Automated sleep disorder detection is challenging because physiological symptoms can vary widely. These variations make it difficult to create effective sleep disorder detection models which support hu-man experts during diagnosis and treatment monitoring. From 2010 to 2021, authors of 95 scientific papers have taken up the challenge of automating sleep disorder detection. This paper provides an expert review of this work. We investigated whether digital technology and Artificial Intelligence (AI) can provide automated diagnosis support for sleep disorders. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines during the content discovery phase. We compared the performance of proposed sleep disorder detection methods, involving differ-ent datasets or signals. During the review, we found eight sleep disorders, of which sleep apnea and insomnia were the most studied. These disorders can be diagnosed using several kinds of biomedical signals, such as Electrocardiogram (ECG), Polysomnography (PSG), Electroencephalogram (EEG), Electromyogram (EMG), and snore sound. Subsequently, we established areas of commonality and distinctiveness. Common to all reviewed papers was that AI models were trained and tested with labelled physiological signals. Looking deeper, we discovered that 24 distinct algorithms were used for the detection task. The nature of these algorithms evolved, before 2017 only traditional Machine Learning (ML) was used. From 2018 onward, both ML and Deep Learning (DL) methods were used for sleep disorder detection. The strong emergence of DL algorithms has considerable implications for future detection systems because these algorithms demand significantly more data for training and testing when compared with ML. Based on our review results, we suggest that both type and amount of labelled data is crucial for the design of future sleep disorder detection systems because this will steer the choice of AI algorithm which establishes the desired decision support. As a guiding principle, more labelled data will help to represent the variations in symptoms. DL algorithms can extract information from these larger data quantities more effectively, therefore; we predict that the role of these algorithms will continue to expand.
Collapse
Affiliation(s)
- Shuting Xu
- Cogninet Brain Team, Sydney, NSW, 2010, Australia
| | - Oliver Faust
- Anglia Ruskin University, East Rd, Cambridge CB1 1PT, UK.
| | - Silvia Seoni
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, 2351, Australia; Centre for Advanced Modelling and Geospatial Lnformation Systems (CAMGIS), Faculty of Engineer and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Sydney, NSW, 2010, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia; School of Business (Information System), University of Southern Queensland, Australia
| | - Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore
| | | | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - U Rajendra Acharya
- School of Business (Information System), University of Southern Queensland, Australia; School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore; Department of Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taichung, Taiwan.
| |
Collapse
|
6
|
Jiménez-García J, García M, Gutiérrez-Tobal GC, Kheirandish-Gozal L, Vaquerizo-Villar F, Álvarez D, del Campo F, Gozal D, Hornero R. A 2D convolutional neural network to detect sleep apnea in children using airflow and oximetry. Comput Biol Med 2022; 147:105784. [DOI: 10.1016/j.compbiomed.2022.105784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 04/19/2022] [Accepted: 06/26/2022] [Indexed: 11/03/2022]
|