1
|
Mahjoory K, Bahmer A, Henry MJ. Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention. PLoS Comput Biol 2024; 20:e1012376. [PMID: 39116183 PMCID: PMC11335149 DOI: 10.1371/journal.pcbi.1012376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 08/20/2024] [Accepted: 07/30/2024] [Indexed: 08/10/2024] Open
Abstract
Human listeners have the ability to direct their attention to a single speaker in a multi-talker environment. The neural correlates of selective attention can be decoded from a single trial of electroencephalography (EEG) data. In this study, leveraging the source-reconstructed and anatomically-resolved EEG data as inputs, we sought to employ CNN as an interpretable model to uncover task-specific interactions between brain regions, rather than simply to utilize it as a black box decoder. To this end, our CNN model was specifically designed to learn pairwise interaction representations for 10 cortical regions from five-second inputs. By exclusively utilizing these features for decoding, our model was able to attain a median accuracy of 77.56% for within-participant and 65.14% for cross-participant classification. Through ablation analysis together with dissecting the features of the models and applying cluster analysis, we were able to discern the presence of alpha-band-dominated inter-hemisphere interactions, as well as alpha- and beta-band dominant interactions that were either hemisphere-specific or were characterized by a contrasting pattern between the right and left hemispheres. These interactions were more pronounced in parietal and central regions for within-participant decoding, but in parietal, central, and partly frontal regions for cross-participant decoding. These findings demonstrate that our CNN model can effectively utilize features known to be important in auditory attention tasks and suggest that the application of domain knowledge inspired CNNs on source-reconstructed EEG data can offer a novel computational framework for studying task-relevant brain interactions.
Collapse
Affiliation(s)
- Keyvan Mahjoory
- Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Andreas Bahmer
- RheinMain University of Applied Sciences Campus Ruesselsheim, Wiesbaden, Germany
| | - Molly J. Henry
- Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Psychology, Toronto Metropolitan University, Toronto, Ontario, Canada
| |
Collapse
|
2
|
Zhu H, Xu Y, Wu Y, Shen N, Wang L, Chen C, Chen W. A Sequential End-to-End Neonatal Sleep Staging Model with Squeeze and Excitation Blocks and Sequential Multi-Scale Convolution Neural Networks. Int J Neural Syst 2024; 34:2450013. [PMID: 38369905 DOI: 10.1142/s0129065724500138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Automatic sleep staging offers a quick and objective assessment for quantitatively interpreting sleep stages in neonates. However, most of the existing studies either do not encompass any temporal information, or simply apply neural networks to exploit temporal information at the expense of high computational overhead and modeling ambiguity. This limits the application of these methods to multiple scenarios. In this paper, a sequential end-to-end sleep staging model, SeqEESleepNet, which is competent for parallelly processing sequential epochs and has a fast training rate to adapt to different scenarios, is proposed. SeqEESleepNet consists of a sequence epoch generation (SEG) module, a sequential multi-scale convolution neural network (SMSCNN) and squeeze and excitation (SE) blocks. The SEG module expands independent epochs into sequential signals, enabling the model to learn the temporal information between sleep stages. SMSCNN is a multi-scale convolution neural network that can extract both multi-scale features and temporal information from the signal. Subsequently, the followed SE block can reassign the weights of features through mapping and pooling. Experimental results exhibit that in a clinical dataset, the proposed method outperforms the state-of-the-art approaches, achieving an overall accuracy, F1-score, and Kappa coefficient of 71.8%, 71.8%, and 0.684 on a three-class classification task with a single channel EEG signal. Based on our overall results, we believe the proposed method could pave the way for convenient multi-scenario neonatal sleep staging methods.
Collapse
Affiliation(s)
- Hangyu Zhu
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai 200433, P. R. China
| | - Yan Xu
- Department of Neurology, Children's Hospital of Fudan University, National Children's Medical Center, Shanghai, P. R. China
| | - Yonglin Wu
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai 200433, P. R. China
| | - Ning Shen
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai 200433, P. R. China
| | - Laishuan Wang
- Department of Neurology, Children's Hospital of Fudan University, National Children's Medical Center, Shanghai, P. R. China
| | - Chen Chen
- Human Phenome Institute, Fudan University, 825 Zhangheng Road, Shanghai 201203, P. R. China
| | - Wei Chen
- Center for Intelligent Medical Electronics, School of Information Science and Technology, Fudan University, Shanghai 200433, P. R. China
| |
Collapse
|
3
|
Keles E, Bagci U. The past, current, and future of neonatal intensive care units with artificial intelligence: a systematic review. NPJ Digit Med 2023; 6:220. [PMID: 38012349 PMCID: PMC10682088 DOI: 10.1038/s41746-023-00941-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 10/05/2023] [Indexed: 11/29/2023] Open
Abstract
Machine learning and deep learning are two subsets of artificial intelligence that involve teaching computers to learn and make decisions from any sort of data. Most recent developments in artificial intelligence are coming from deep learning, which has proven revolutionary in almost all fields, from computer vision to health sciences. The effects of deep learning in medicine have changed the conventional ways of clinical application significantly. Although some sub-fields of medicine, such as pediatrics, have been relatively slow in receiving the critical benefits of deep learning, related research in pediatrics has started to accumulate to a significant level, too. Hence, in this paper, we review recently developed machine learning and deep learning-based solutions for neonatology applications. We systematically evaluate the roles of both classical machine learning and deep learning in neonatology applications, define the methodologies, including algorithmic developments, and describe the remaining challenges in the assessment of neonatal diseases by using PRISMA 2020 guidelines. To date, the primary areas of focus in neonatology regarding AI applications have included survival analysis, neuroimaging, analysis of vital parameters and biosignals, and retinopathy of prematurity diagnosis. We have categorically summarized 106 research articles from 1996 to 2022 and discussed their pros and cons, respectively. In this systematic review, we aimed to further enhance the comprehensiveness of the study. We also discuss possible directions for new AI models and the future of neonatology with the rising power of AI, suggesting roadmaps for the integration of AI into neonatal intensive care units.
Collapse
Affiliation(s)
- Elif Keles
- Northwestern University, Feinberg School of Medicine, Department of Radiology, Chicago, IL, USA.
| | - Ulas Bagci
- Northwestern University, Feinberg School of Medicine, Department of Radiology, Chicago, IL, USA
- Northwestern University, Department of Biomedical Engineering, Chicago, IL, USA
- Department of Electrical and Computer Engineering, Chicago, IL, USA
| |
Collapse
|
4
|
Abbasi SF, Abbas A, Ahmad I, Alshehri MS, Almakdi S, Ghadi YY, Ahmad J. Automatic neonatal sleep stage classification: A comparative study. Heliyon 2023; 9:e22195. [PMID: 38058619 PMCID: PMC10695968 DOI: 10.1016/j.heliyon.2023.e22195] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 09/21/2023] [Accepted: 11/06/2023] [Indexed: 12/08/2023] Open
Abstract
Sleep is an essential feature of living beings. For neonates, it is vital for their mental and physical development. Sleep stage cycling is an important parameter to assess neonatal brain and physical development. Therefore, it is crucial to administer newborn's sleep in the neonatal intensive care unit (NICU). Currently, Polysomnography (PSG) is used as a gold standard method for classifying neonatal sleep patterns, but it is expensive and requires a lot of human involvement. Over the last two decades, multiple researchers are working on automatic sleep stage classification algorithms using electroencephalography (EEG), electrocardiography (ECG), and video. In this study, we present a comprehensive review of existing algorithms for neonatal sleep, their limitations and future recommendations. Additionally, a brief comparison of the extracted features, classification algorithms and evaluation parameters is reported in the proposed study.
Collapse
Affiliation(s)
- Saadullah Farooq Abbasi
- Department of Electronic, Electrical and System Engineering, University of Birmingham, Birmingham, United Kingdom
| | - Awais Abbas
- Department of Electronic, Electrical and System Engineering, University of Birmingham, Birmingham, United Kingdom
| | - Iftikhar Ahmad
- James Watt School of Engineering, University of Glasgow, United Kingdom
| | - Mohammed S. Alshehri
- Department of Computer Science, College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| | - Sultan Almakdi
- Department of Computer Science, College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| | - Yazeed Yasin Ghadi
- Department of Computer Science, Al Ain University, Abu Dhabi P.O. Box 112612, United Arab Emirates
| | - Jawad Ahmad
- School of Computing, Engineering and the Built Environment, Edinburgh Napier University, Edinburgh EH10 5DT, UK
| |
Collapse
|
5
|
Abbasi SF, Abbasi QH, Saeed F, Alghamdi NS. A convolutional neural network-based decision support system for neonatal quiet sleep detection. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:17018-17036. [PMID: 37920045 DOI: 10.3934/mbe.2023759] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/04/2023]
Abstract
Sleep plays an important role in neonatal brain and physical development, making its detection and characterization important for assessing early-stage development. In this study, we propose an automatic and computationally efficient algorithm to detect neonatal quiet sleep (QS) using a convolutional neural network (CNN). Our study used 38-hours of electroencephalography (EEG) recordings, collected from 19 neonates at Fudan Children's Hospital in Shanghai, China (Approval No. (2020) 22). To train and test the CNN, we extracted 12 prominent time and frequency domain features from 9 bipolar EEG channels. The CNN architecture comprised two convolutional layers with pooling and rectified linear unit (ReLU) activation. Additionally, a smoothing filter was applied to hold the sleep stage for 3 minutes. Through performance testing, our proposed method achieved impressive results, with 94.07% accuracy, 89.70% sensitivity, 94.40% specificity, 79.82% F1-score and a 0.74 kappa coefficient when compared to human expert annotations. A notable advantage of our approach is its computational efficiency, with the entire training and testing process requiring only 7.97 seconds. The proposed algorithm has been validated using leave one subject out (LOSO) validation, which demonstrates its consistent performance across a diverse range of neonates. Our findings highlight the potential of our algorithm for real-time neonatal sleep stage classification, offering a fast and cost-effective solution. This research opens avenues for further investigations in early-stage development monitoring and the assessment of neonatal health.
Collapse
Affiliation(s)
- Saadullah Farooq Abbasi
- Department of Biomedical Engineering, Riphah International University, Islamabad 44000, Pakistan
| | - Qammer Hussain Abbasi
- James Watt School of Engineering, University of Glasgow, Glasgow, G4 0PE, United Kingdom
| | - Faisal Saeed
- DAAI Research Group, Department of Computing and Data Science, School of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK
| | - Norah Saleh Alghamdi
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| |
Collapse
|
6
|
Somaskandhan P, Leppänen T, Terrill PI, Sigurdardottir S, Arnardottir ES, Ólafsdóttir KA, Serwatko M, Sigurðardóttir SÞ, Clausen M, Töyräs J, Korkalainen H. Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls. Front Neurol 2023; 14:1162998. [PMID: 37122306 PMCID: PMC10140398 DOI: 10.3389/fneur.2023.1162998] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 03/23/2023] [Indexed: 05/02/2023] Open
Abstract
Introduction Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort. Methods A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers. Results The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75). Conclusion The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.
Collapse
Affiliation(s)
- Pranavan Somaskandhan
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- *Correspondence: Pranavan Somaskandhan,
| | - Timo Leppänen
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| | - Philip I. Terrill
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
| | - Sigridur Sigurdardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Erna Sif Arnardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
- Internal Medicine Services, Landspitali–The National University Hospital of Iceland, Reykjavik, Iceland
| | - Kristín A. Ólafsdóttir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Marta Serwatko
- Department of Clinical Engineering, Landspitali University Hospital, Reykjavik, Iceland
| | - Sigurveig Þ. Sigurðardóttir
- Department of Immunology, Landspitali University Hospital, Reykjavik, Iceland
- Faculty of Medicine, University of Iceland, Reykjavik, Iceland
| | - Michael Clausen
- Department of Allergy, Landspitali University Hospital, Reykjavik, Iceland
- Children's Hospital Reykjavik, Reykjavik, Iceland
| | - Juha Töyräs
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Science Service Center, Kuopio University Hospital, Kuopio, Finland
| | - Henri Korkalainen
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
7
|
Montazeri S, Nevalainen P, Stevenson NJ, Vanhatalo S. Sleep State Trend (SST), a bedside measure of neonatal sleep state fluctuations based on single EEG channels. Clin Neurophysiol 2022; 143:75-83. [PMID: 36155385 DOI: 10.1016/j.clinph.2022.08.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 07/27/2022] [Accepted: 08/31/2022] [Indexed: 11/03/2022]
Abstract
OBJECTIVE To develop and validate an automated method for bedside monitoring of sleep state fluctuations in neonatal intensive care units. METHODS A deep learning-based algorithm was designed and trained using 53 EEG recordings from a long-term (a)EEG monitoring in 30 near-term neonates. The results were validated using an independent dataset from 30 polysomnography recordings. In addition, we constructed Sleep State Trend (SST), a bedside-ready means for visualizing classifier outputs. RESULTS The accuracy of quiet sleep detection in the training data was 90%, and the accuracy was comparable (85-86 %) in all bipolar derivations available from the 4-electrode recordings. The algorithm generalized well to a polysomnography dataset, showing 81% overall accuracy despite different signal derivations. SST allowed an intuitive, clear visualization of the classifier output. CONCLUSIONS Fluctuations in sleep states can be detected at high fidelity from a single EEG channel, and the results can be visualized as a transparent and intuitive trend in the bedside monitors. SIGNIFICANCE The Sleep State Trend (SST) may provide caregivers and clinical studies a real-time view of sleep state fluctuations and its cyclicity.
Collapse
Affiliation(s)
- Saeed Montazeri
- BABA Center, Department of Clinical Neurophysiology, HUS diagnostic center, Children's Hospital, University of Helsinki and Helsinki University Hospital, Helsinki, Finland; Department of Physiology, University of Helsinki, Helsinki, Finland.
| | - Päivi Nevalainen
- BABA Center, Department of Clinical Neurophysiology, HUS diagnostic center, Children's Hospital, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Nathan J Stevenson
- Brain Modeling Group, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| | - Sampsa Vanhatalo
- BABA Center, Department of Clinical Neurophysiology, HUS diagnostic center, Children's Hospital, University of Helsinki and Helsinki University Hospital, Helsinki, Finland; Department of Physiology, University of Helsinki, Helsinki, Finland
| |
Collapse
|
8
|
Sentner T, Wang X, de Groot ER, van Schaijk L, Tataranno ML, Vijlbrief DC, Benders MJNL, Bartels R, Dudink J. The Sleep Well Baby project: an automated real-time sleep–wake state prediction algorithm in preterm infants. Sleep 2022; 45:6617657. [PMID: 35749799 PMCID: PMC9548667 DOI: 10.1093/sleep/zsac143] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 05/31/2022] [Indexed: 11/29/2022] Open
Abstract
Study Objectives Sleep is an important driver of early brain development. However, sleep is often disturbed in preterm infants admitted to the neonatal intensive care unit (NICU). We aimed to develop an automated algorithm based on routinely measured vital parameters to classify sleep–wake states of preterm infants in real-time at the bedside. Methods In this study, sleep–wake state observations were obtained in 1-minute epochs using a behavioral scale developed in-house while vital signs were recorded simultaneously. Three types of vital parameter data, namely, heart rate, respiratory rate, and oxygen saturation, were collected at a low-frequency sampling rate of 0.4 Hz. A supervised machine learning workflow was used to train a classifier to predict sleep–wake states. Independent training (n = 37) and validation datasets were validation n = 9) datasets were used. Finally, a setup was designed for real-time implementation at the bedside. Results The macro-averaged area-under-the-receiver-operator-characteristic (AUROC) of the automated sleep staging algorithm ranged between 0.69 and 0.82 for the training data, and 0.61 and 0.78 for the validation data. The algorithm provided the most accurate prediction for wake states (AUROC = 0.80). These findings were well validated on an independent sample (AUROC = 0.77). Conclusions With this study, to the best of our knowledge, a reliable, nonobtrusive, and real-time sleep staging algorithm was developed for the first time for preterm infants. Deploying this algorithm in the NICU environment may assist and adapt bedside clinical work based on infants’ sleep–wake states, potentially promoting the early brain development and well-being of preterm infants.
Collapse
Affiliation(s)
- Thom Sentner
- Digital Health, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Xiaowan Wang
- Department of Neonatology, Wilhelmina Children’s Hospital, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Eline R de Groot
- Department of Neonatology, Wilhelmina Children’s Hospital, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Lieke van Schaijk
- Digital Health, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Maria Luisa Tataranno
- Department of Neonatology, Wilhelmina Children’s Hospital, University Medical Center Utrecht , Utrecht , The Netherlands
- Brain Center Rudolf Magnus, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Daniel C Vijlbrief
- Department of Neonatology, Wilhelmina Children’s Hospital, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Manon J N L Benders
- Department of Neonatology, Wilhelmina Children’s Hospital, University Medical Center Utrecht , Utrecht , The Netherlands
- Brain Center Rudolf Magnus, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Richard Bartels
- Digital Health, University Medical Center Utrecht , Utrecht , The Netherlands
| | - Jeroen Dudink
- Department of Neonatology, Wilhelmina Children’s Hospital, University Medical Center Utrecht , Utrecht , The Netherlands
- Brain Center Rudolf Magnus, University Medical Center Utrecht , Utrecht , The Netherlands
| |
Collapse
|
9
|
Hermans T, Thewissen L, Gewillig M, Cools B, Jansen K, Pillay K, De Vos M, Van Huffel S, Naulaers G, Dereymaeker A. Functional brain maturation and sleep organisation in neonates with congenital heart disease. Eur J Paediatr Neurol 2022; 36:115-122. [PMID: 34954621 DOI: 10.1016/j.ejpn.2021.12.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 11/23/2021] [Accepted: 12/11/2021] [Indexed: 11/19/2022]
Abstract
OBJECTIVE Neonates with Congenital Heart Disease (CHD) have structural delays in brain development. To evaluate whether functional brain maturation and sleep-wake physiology is also disturbed, the Functional Brain Age (FBA) and sleep organisation on EEG during the neonatal period is investigated. METHODS We compared 15 neonates with CHD who underwent multichannel EEG with healthy term newborns of the same postmenstrual age, including subgroup analysis for d-Transposition of the Great Arteries (d-TGA) (n = 8). To estimate FBA, a prediction tool using quantitative EEG features as input, was applied. Second, the EEG was automatically classified into the 4 neonatal sleep stages. Neonates with CHD underwent neurodevelopmental testing using the Bayley Scale of Infant Development-III at 24 months. RESULTS Preoperatively, the FBA was delayed in CHD infants and more so in d-TGA infants. The FBA was positively correlated with motor scores. Sleep organisation was significantly altered in neonates with CHD. The duration of the sleep cycle and the proportion of Active Sleep Stage 1 was decreased, again more marked in the d-TGA infants. Neonates with d-TGA spent less time in High Voltage Slow Wave Sleep and more in Tracé Alternant compared to healthy terms. Both FBA and sleep organisation normalised postoperatively. The duration of High Voltage Slow Wave Sleep remained positively correlated with motor scores in d-TGA infants. INTERPRETATION Altered early brain function and sleep is present in neonates with CHD. These results are intruiging, as inefficient neonatal sleep has been linked with adverse long-term outcome. Identifying how these rapid alterations in brain function are mitigated through improvements in cerebral oxygenation, surgery, drugs and nutrition may have relevance for clinical practice and outcome.
Collapse
Affiliation(s)
- Tim Hermans
- Division STADIUS, Department of Electrical Engineering (ESAT), KU Leuven (University of Leuven), Leuven, Belgium
| | - Liesbeth Thewissen
- Department of Development and Regeneration, Neonatal Intensive Care Unit, University Hospitals Leuven, KU Leuven (University of Leuven), Leuven, Belgium
| | - Marc Gewillig
- Department of Cardiovascular Science, Paediatric Cardiology, University Hospitals Leuven, KU Leuven (University of Leuven), Leuven, Belgium
| | - Bjorn Cools
- Department of Cardiovascular Science, Paediatric Cardiology, University Hospitals Leuven, KU Leuven (University of Leuven), Leuven, Belgium
| | - Katrien Jansen
- Department of Development and Regeneration, Child Neurology, University Hospitals Leuven, KU Leuven (University of Leuven), Leuven, Belgium
| | - Kirubin Pillay
- Department of Paediatrics, John Radcliffe Hospital, University of Oxford, Oxford, United Kingdom
| | - Maarten De Vos
- Division STADIUS, Department of Electrical Engineering (ESAT), KU Leuven (University of Leuven), Leuven, Belgium
| | - Sabine Van Huffel
- Division STADIUS, Department of Electrical Engineering (ESAT), KU Leuven (University of Leuven), Leuven, Belgium
| | - Gunnar Naulaers
- Department of Development and Regeneration, Neonatal Intensive Care Unit, University Hospitals Leuven, KU Leuven (University of Leuven), Leuven, Belgium
| | - Anneleen Dereymaeker
- Department of Development and Regeneration, Neonatal Intensive Care Unit, University Hospitals Leuven, KU Leuven (University of Leuven), Leuven, Belgium.
| |
Collapse
|
10
|
Islam MN, Sulaiman N, Farid FA, Uddin J, Alyami SA, Rashid M, P.P. Abdul Majeed A, Moni MA. Diagnosis of hearing deficiency using EEG based AEP signals: CWT and improved-VGG16 pipeline. PeerJ Comput Sci 2021; 7:e638. [PMID: 34712786 PMCID: PMC8507488 DOI: 10.7717/peerj-cs.638] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 06/21/2021] [Indexed: 05/14/2023]
Abstract
Hearing deficiency is the world's most common sensation of impairment and impedes human communication and learning. Early and precise hearing diagnosis using electroencephalogram (EEG) is referred to as the optimum strategy to deal with this issue. Among a wide range of EEG control signals, the most relevant modality for hearing loss diagnosis is auditory evoked potential (AEP) which is produced in the brain's cortex area through an auditory stimulus. This study aims to develop a robust intelligent auditory sensation system utilizing a pre-train deep learning framework by analyzing and evaluating the functional reliability of the hearing based on the AEP response. First, the raw AEP data is transformed into time-frequency images through the wavelet transformation. Then, lower-level functionality is eliminated using a pre-trained network. Here, an improved-VGG16 architecture has been designed based on removing some convolutional layers and adding new layers in the fully connected block. Subsequently, the higher levels of the neural network architecture are fine-tuned using the labelled time-frequency images. Finally, the proposed method's performance has been validated by a reputed publicly available AEP dataset, recorded from sixteen subjects when they have heard specific auditory stimuli in the left or right ear. The proposed method outperforms the state-of-art studies by improving the classification accuracy to 96.87% (from 57.375%), which indicates that the proposed improved-VGG16 architecture can significantly deal with AEP response in early hearing loss diagnosis.
Collapse
Affiliation(s)
- Md Nahidul Islam
- Faculty of Electrical and Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Norizam Sulaiman
- Faculty of Electrical and Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Fahmid Al Farid
- Faculty of Computing and Informatics, Multimedia University, Malaysia
| | - Jia Uddin
- Technology Studies Department, Endicott College, Woosong university, Daejeon, South Korea
| | - Salem A. Alyami
- Department of Mathematics and Statistics, Imam Mohammad Ibn Saud Islamic University, Riyadh, Saudi Arabia
| | - Mamunur Rashid
- Faculty of Electrical and Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Anwar P.P. Abdul Majeed
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
- Centre for Software Development & Integrated Computing, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Mohammad Ali Moni
- School of Health and Rehabilitation Sciences, Faculty of Health and Behavioural Sciences, The University of Queensland St Lucia, Australia
| |
Collapse
|
11
|
Lin B, Deng S, Gao H, Yin J. A Multi-Scale Activity Transition Network for Data Translation in EEG Signals Decoding. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2021; 18:1699-1709. [PMID: 32931434 DOI: 10.1109/tcbb.2020.3024228] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Electroencephalogram (EEG) is a non-invasive collection method for brain signals. It has broad prospects in brain-computer interface (BCI) applications. Recent advances have shown the effectiveness of the widely used convolutional neural network (CNN) in EEG decoding. However, some studies reveal that a slight disturbance to the inputs, e.g., data translation, can change CNN's outputs. Such instability is dangerous for EEG-based BCI applications because signals in practice are different from training data. In this study, we propose a multi-scale activity transition network (MSATNet) to alleviate the influence of the translation problem in convolution-based models. MSATNet provides an activity state pyramid consisting of multi-scale recurrent neural networks to capture the relationship between brain activities, which is a translation-invariant feature. In the experiment, Kullback-Leibler divergence is applied to measure the degree of translation. The comprehensive results demonstrate that our method surpasses the AUC of 0.0080, 0.0254, 0.0393 in 1, 5, and 10 KL divergence compared to competitors with various convolution structures.
Collapse
|
12
|
Ansari AH, Pillay K, Dereymaeker A, Jansen K, Van Huffel S, Naulaers G, De Vos M. A Deep Shared Multi-Scale Inception Network Enables Accurate Neonatal Quiet Sleep Detection with Limited EEG Channels. IEEE J Biomed Health Inform 2021; 26:1023-1033. [PMID: 34329177 DOI: 10.1109/jbhi.2021.3101117] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In this paper, we introduce a new variation of the Convolutional Neural Network Inception block, called Sinc, for sleep stage classification in premature newborn babies using electroencephalogram (EEG). In practice, there are many medical centres where only a limited number of EEG channels are recorded. Existing automated algorithms mainly use multi-channel EEGs which perform poorly when fewer numbers of channels are available. The proposed Sinc utilizes multi-scale analysis to place emphasis on the temporal EEG information to be less dependent on the number of EEG channels. In Sinc, we increase the receptive fields through Inception while by additionally sharing the filters that have similar receptive fields, overfitting is controlled and the number of trainable parameters dramatically reduced. To train and test this model, 96 longitudinal EEG recordings from 26 premature infants are used. The Sinc-based model significantly outperforms state-of-the-art neonatal quiet sleep detection algorithms, with mean Kappa 0.77 0.01 (with 8-channel EEG) and 0.75 0.01 (with a single bipolar channel EEG). This is the first study using Inception-based networks for EEG analysis that utilizes filter sharing to improve efficiency and trainability. The suggested network can successfully detect quiet sleep stages with even a single EEG channel making it more practical especially in the hospital setting where cerebral function monitoring is predominantly used.
Collapse
|
13
|
Tataranno ML, Vijlbrief DC, Dudink J, Benders MJNL. Precision Medicine in Neonates: A Tailored Approach to Neonatal Brain Injury. Front Pediatr 2021; 9:634092. [PMID: 34095022 PMCID: PMC8171663 DOI: 10.3389/fped.2021.634092] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 04/14/2021] [Indexed: 11/27/2022] Open
Abstract
Despite advances in neonatal care to prevent neonatal brain injury and neurodevelopmental impairment, predicting long-term outcome in neonates at risk for brain injury remains difficult. Early prognosis is currently based on cranial ultrasound (CUS), MRI, EEG, NIRS, and/or general movements assessed at specific ages, and predicting outcome in an individual (precision medicine) is not yet possible. New algorithms based on large databases and machine learning applied to clinical, neuromonitoring, and neuroimaging data and genetic analysis and assays measuring multiple biomarkers (omics) can fulfill the needs of modern neonatology. A synergy of all these techniques and the use of automatic quantitative analysis might give clinicians the possibility to provide patient-targeted decision-making for individualized diagnosis, therapy, and outcome prediction. This review will first focus on common neonatal neurological diseases, associated risk factors, and most common treatments. After that, we will discuss how precision medicine and machine learning (ML) approaches could change the future of prediction and prognosis in this field.
Collapse
Affiliation(s)
| | | | | | - Manon J. N. L. Benders
- Department of Neonatology, Wilhelmina Children's Hospital/University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands
| |
Collapse
|
14
|
Awais M, Long X, Yin B, Farooq Abbasi S, Akbarzadeh S, Lu C, Wang X, Wang L, Zhang J, Dudink J, Chen W. A Hybrid DCNN-SVM Model for Classifying Neonatal Sleep and Wake States Based on Facial Expressions in Video. IEEE J Biomed Health Inform 2021; 25:1441-1449. [PMID: 33857007 DOI: 10.1109/jbhi.2021.3073632] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Sleep is a natural phenomenon controlled by the central nervous system. The sleep-wake pattern, which functions as an essential indicator of neurophysiological organization in the neonatal period, has profound meaning in the prediction of cognitive diseases and brain maturity. In recent years, unobtrusive sleep monitoring and automatic sleep staging have been intensively studied for adults, but much less for neonates. This work aims to investigate a novel video-based unobtrusive method for neonatal sleep-wake classification by analyzing the behavioral changes in the neonatal facial region. A hybrid model is proposed to monitor the sleep-wake patterns of human neonates. The model combines two algorithms: deep convolutional neural network (DCNN) and support vector machine (SVM), where DCNN works as a trainable feature extractor and SVM as a classifier. Data was collected from nineteen Chinese neonates at the Children's Hospital of Fudan University, Shanghai, China. The classification results are compared with the gold standard of video-electroencephalography scored by pediatric neurologists. Validations indicate that the proposed hybrid DCNN-SVM model achieved reliable performances in classifying neonatal sleep and wake states in RGB video frames (with the face region detected), with an accuracy of 93.8 ± 2.2% and an F1-score 0.93 ± 0.3.
Collapse
|
15
|
Lavanga M, Bollen B, Caicedo A, Dereymaeker A, Jansen K, Ortibus E, Van Huffel S, Naulaers G. The effect of early procedural pain in preterm infants on the maturation of electroencephalogram and heart rate variability. Pain 2021; 162:1556-1566. [PMID: 33110029 PMCID: PMC8054544 DOI: 10.1097/j.pain.0000000000002125] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2020] [Revised: 10/19/2020] [Accepted: 10/21/2020] [Indexed: 01/18/2023]
Abstract
ABSTRACT Preterm infants show a higher incidence of cognitive, social, and behavioral problems, even in the absence of major medical complications during their stay in the neonatal intensive care unit (NICU). Several authors suggest that early-life experience of stress and procedural pain could impact cerebral development and maturation resulting in an altered development of cognition, behavior, or motor patterns in later life. However, it remains very difficult to assess this impact of procedural pain on physiological development. This study describes the maturation of electroencephalogram (EEG) signals and heart rate variability in a prospective cohort of 92 preterm infants (<34 weeks gestational age) during their NICU stay. We took into account the number of noxious, ie, skin-breaking, procedures they were subjected in the first 5 days of life, which corresponded to a median age of 31 weeks and 4 days. Using physiological signal modelling, this study shows that a high exposure to early procedural pain, measured as skin-breaking procedures, increased the level of discontinuity in both EEG and heart rate variability in preterm infants. These findings have also been confirmed in a subset of the most vulnerable preterm infants with a gestational age lower than 29 weeks. We conclude that a high level of early pain exposure in the NICU increases the level of functional dysmaturity, which can ultimately impact preterm infants' future developmental outcome.
Collapse
Affiliation(s)
- Mario Lavanga
- Department of Electrical Engineering (ESAT), Division STADIUS, KU Leuven, Leuven, Belgium
| | - Bieke Bollen
- Department of Development and Regeneration, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - Alexander Caicedo
- Department of Applied Mathematics and Computer Science, School of Engineering, Science and Technology, Universidad Del Rosario, Bogota', Colombia
| | - Anneleen Dereymaeker
- Department of Development and Regeneration, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - Katrien Jansen
- Department of Development and Regeneration, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - Els Ortibus
- Department of Development and Regeneration, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - Sabine Van Huffel
- Department of Electrical Engineering (ESAT), Division STADIUS, KU Leuven, Leuven, Belgium
| | - Gunnar Naulaers
- Department of Development and Regeneration, Faculty of Medicine, KU Leuven, Leuven, Belgium
| |
Collapse
|
16
|
Vandecappelle S, Deckers L, Das N, Ansari AH, Bertrand A, Francart T. EEG-based detection of the locus of auditory attention with convolutional neural networks. eLife 2021; 10:e56481. [PMID: 33929315 PMCID: PMC8143791 DOI: 10.7554/elife.56481] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2020] [Accepted: 04/28/2021] [Indexed: 01/16/2023] Open
Abstract
In a multi-speaker scenario, the human auditory system is able to attend to one particular speaker of interest and ignore the others. It has been demonstrated that it is possible to use electroencephalography (EEG) signals to infer to which speaker someone is attending by relating the neural activity to the speech signals. However, classifying auditory attention within a short time interval remains the main challenge. We present a convolutional neural network-based approach to extract the locus of auditory attention (left/right) without knowledge of the speech envelopes. Our results show that it is possible to decode the locus of attention within 1-2 s, with a median accuracy of around 81%. These results are promising for neuro-steered noise suppression in hearing aids, in particular in scenarios where per-speaker envelopes are unavailable.
Collapse
Affiliation(s)
- Servaas Vandecappelle
- Department of Neurosciences, Experimental Oto-rhino-laryngologyLeuvenBelgium
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data AnalyticsLeuvenBelgium
| | - Lucas Deckers
- Department of Neurosciences, Experimental Oto-rhino-laryngologyLeuvenBelgium
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data AnalyticsLeuvenBelgium
| | - Neetha Das
- Department of Neurosciences, Experimental Oto-rhino-laryngologyLeuvenBelgium
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data AnalyticsLeuvenBelgium
| | - Amir Hossein Ansari
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data AnalyticsLeuvenBelgium
| | - Alexander Bertrand
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data AnalyticsLeuvenBelgium
| | - Tom Francart
- Department of Neurosciences, Experimental Oto-rhino-laryngologyLeuvenBelgium
| |
Collapse
|
17
|
Vandecappelle S, Deckers L, Das N, Ansari AH, Bertrand A, Francart T. EEG-based detection of the locus of auditory attention with convolutional neural networks. eLife 2021; 10:56481. [PMID: 33929315 DOI: 10.1101/475673] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2020] [Accepted: 04/28/2021] [Indexed: 05/27/2023] Open
Abstract
In a multi-speaker scenario, the human auditory system is able to attend to one particular speaker of interest and ignore the others. It has been demonstrated that it is possible to use electroencephalography (EEG) signals to infer to which speaker someone is attending by relating the neural activity to the speech signals. However, classifying auditory attention within a short time interval remains the main challenge. We present a convolutional neural network-based approach to extract the locus of auditory attention (left/right) without knowledge of the speech envelopes. Our results show that it is possible to decode the locus of attention within 1-2 s, with a median accuracy of around 81%. These results are promising for neuro-steered noise suppression in hearing aids, in particular in scenarios where per-speaker envelopes are unavailable.
Collapse
Affiliation(s)
- Servaas Vandecappelle
- Department of Neurosciences, Experimental Oto-rhino-laryngology, Leuven, Belgium
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
| | - Lucas Deckers
- Department of Neurosciences, Experimental Oto-rhino-laryngology, Leuven, Belgium
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
| | - Neetha Das
- Department of Neurosciences, Experimental Oto-rhino-laryngology, Leuven, Belgium
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
| | - Amir Hossein Ansari
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
| | - Alexander Bertrand
- Department of Electrical Engineering (ESAT), Stadius Center for Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
| | - Tom Francart
- Department of Neurosciences, Experimental Oto-rhino-laryngology, Leuven, Belgium
| |
Collapse
|
18
|
Cai Q, An J, Gao Z. A multiplex visibility graph motif‐based convolutional neural network for characterizing sleep stages using EEG signals. BRAIN SCIENCE ADVANCES 2021. [DOI: 10.26599/bsa.2020.9050016] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Sleep is an essential integrant in everyone’s daily life; therefore, it is an important but challenging problem to characterize sleep stages from electroencephalogram (EEG) signals. The network motif has been developed as a useful tool to investigate complex networks. In this study, we developed a multiplex visibility graph motif‐based convolutional neural network (CNN) for characterizing sleep stages using EEG signals and then introduced the multiplex motif entropy as the quantitative index to distinguish the six sleep stages. The independent samples t‐test shows that the multiplex motif entropy values have significant differences among the six sleep stages. Furthermore, we developed a CNN model and employed the multiplex motif sequence as the input of the model to classify the six sleep stages. Notably, the classification accuracy of the six‐state stage detection was 85.27%. Results demonstrated the effectiveness of the multiplex motif in characterizing the dynamic features underlying different sleep stages, whereby they further provide an essential strategy for future sleep‐stage detection research.
Collapse
Affiliation(s)
- Qing Cai
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Jianpeng An
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Zhongke Gao
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| |
Collapse
|
19
|
Lavanga M, Smets L, Bollen B, Jansen K, Ortibus E, Huffel SV, Naulaers G, Caicedo A. A perinatal stress calculator for the neonatal intensive care unit: an unobtrusive approach. Physiol Meas 2020; 41:075012. [PMID: 32521528 DOI: 10.1088/1361-6579/ab9b66] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
OBJECTIVE Early experience of pain and stress in the neonatal intensive care unit is known to have an effect on the neurodevelopment of the infant. However, an automated method to quantify the procedural pain or perinatal stress in premature patients does not exist. APPROACH In the current study, EEG and ECG data were collected for more than 3 hours from 136 patients in order to quantify stress exposure. Specifically, features extracted from the EEG and heart-rate variability in both quiet and non-quiet sleep segments were used to develop a subspace linear-discriminant analysis stress classifier. MAIN RESULTS The main novelty of the study lies in the absence of intrusive methods or pain elicitation protocols to develop the stress classifier. Three main findings can be reported. First, we developed different stress classifiers for the different age groups and stress intensities, obtaining an area under the curve in the range [0.78-0.93] for non-quiet sleep and [0.77-0.96] for quiet sleep. Second, a dysmature EEG was found in patients under stress. Third, an enhanced cortical connectivity and increased brain-heart communication was correlated with a higher stress load, while the autonomic activity did not seem to be associated to stress exposure. SIGNIFICANCE The results shed a light on the pain and stress processing in preterm neonates, suggesting that software tools to investigate dysmature EEG might be helpful to assess stress load in premature patients. These results could be the foundation to assess the impact of stress on infants' development and to tune preventive care.
Collapse
Affiliation(s)
- M Lavanga
- Department of Electrical Engineering (ESAT), STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, KU Leuven, Kasteelpark Arenberg 10, box 2446, 3001, Leuven, Belgium. Authors contributed equally to this work
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Hakimi N, Jodeiri A, Mirbagheri M, Setarehdan SK. Proposing a convolutional neural network for stress assessment by means of derived heart rate from functional near infrared spectroscopy. Comput Biol Med 2020; 121:103810. [PMID: 32568682 DOI: 10.1016/j.compbiomed.2020.103810] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2020] [Revised: 05/03/2020] [Accepted: 05/03/2020] [Indexed: 02/01/2023]
Abstract
BACKGROUND Stress is known as one of the major factors threatening human health. A large number of studies have been performed in order to either assess or relieve stress by analyzing the brain and heart-related signals. METHOD In this study, a method based on the Convolutional Neural Network (CNN) approach is proposed to assess stress induced by the Montreal Imaging Stress Task. The proposed model is trained on the heart rate signal derived from functional Near-Infrared Spectroscopy (fNIRS), which is referred to as HRF. In this regard, fNIRS signals of 20 healthy volunteers were recorded using a configuration of 23 channels located on the prefrontal cortex. The proposed deep learning system consists of two main parts where in the first part, the one-dimensional convolutional neural network is employed to build informative activation maps, and then in the second part, a stack of deep fully connected layers is used to predict the stress existence probability. Thereafter, the employed CNN method is compared with the Dense Neural Network, Support Vector Machine, and Random Forest regarding various classification metrics. RESULTS Results clearly showed the superiority of CNN over all other methods. Additionally, the trained HRF model significantly outperforms the model trained on the filtered fNIRS signals, where the HRF model could achieve 98.69 ± 0.45% accuracy, which is 10.09% greater than the accuracy obtained by the fNIRS model. CONCLUSIONS Employment of the proposed deep learning system trained on the HRF measurements leads to higher stress classification accuracy than the accuracy reported in the existing studies where the same experimental procedure has been done. Besides, the proposed method suggests better stability with lower variation in prediction. Furthermore, its low computational cost opens up the possibility to be applied in real-time monitoring of stress assessment.
Collapse
Affiliation(s)
- Naser Hakimi
- Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran; Department of Neonatology, Wilhelmina Children's Hospital, University Medical Center Utrecht, the Netherlands; Artinis Medical Systems B.V., Elst, the Netherlands.
| | - Ata Jodeiri
- Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
| | - Mahya Mirbagheri
- Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
| | - S Kamaledin Setarehdan
- Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
| |
Collapse
|
21
|
Pillay K, Dereymaeker A, Jansen K, Naulaers G, De Vos M. Applying a data-driven approach to quantify EEG maturational deviations in preterms with normal and abnormal neurodevelopmental outcomes. Sci Rep 2020; 10:7288. [PMID: 32350387 PMCID: PMC7190650 DOI: 10.1038/s41598-020-64211-0] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2019] [Accepted: 04/11/2020] [Indexed: 12/02/2022] Open
Abstract
Premature babies are subjected to environmental stresses that can affect brain maturation and cause abnormal neurodevelopmental outcome later in life. Better understanding this link is crucial to developing a clinical tool for early outcome estimation. We defined maturational trajectories between the Electroencephalography (EEG)-derived ‘brain-age’ and postmenstrual age (the age since the last menstrual cycle of the mother) from longitudinal recordings during the baby’s stay in the Neonatal Intensive Care Unit. Data consisted of 224 recordings (65 patients) separated for normal and abnormal outcome at 9–24 months follow-up. Trajectory deviations were compared between outcome groups using the root mean squared error (RMSE) and maximum trajectory deviation (δmax). 113 features were extracted (per sleep state) to train a data-driven model that estimates brain-age, with the most prominent features identified as potential maturational and outcome-sensitive biomarkers. RMSE and δmax showed significant differences between outcome groups (cluster-based permutation test, p < 0.05). RMSE had a median (IQR) of 0.75 (0.60–1.35) weeks for normal outcome and 1.35 (1.15–1.55) for abnormal outcome, while δmax had a median of 0.90 (0.70–1.70) and 1.90 (1.20–2.90) weeks, respectively. Abnormal outcome trajectories were associated with clinically defined dysmature and disorganised EEG patterns, cementing the link between early maturational trajectories and neurodevelopmental outcome.
Collapse
Affiliation(s)
- Kirubin Pillay
- Institute of Biomedical Engineering (IBME), Department of Engineering Science, University of Oxford, Oxford, United Kingdom. .,Department of Paediatrics, John Radcliffe Hospital, University of Oxford, Oxford, United Kingdom.
| | - Anneleen Dereymaeker
- Department of Development and Regeneration, University Hospitals Leuven, Neonatal Intensive Care Unit, KU Leuven (University of Leuven), Leuven, Belgium
| | - Katrien Jansen
- Department of Development and Regeneration, University Hospitals Leuven, Neonatal Intensive Care Unit, KU Leuven (University of Leuven), Leuven, Belgium.,Department of Development and Regeneration, University Hospitals Leuven, Child Neurology, University of Leuven (KU Leuven), Leuven, Belgium
| | - Gunnar Naulaers
- Department of Development and Regeneration, University Hospitals Leuven, Neonatal Intensive Care Unit, KU Leuven (University of Leuven), Leuven, Belgium
| | - Maarten De Vos
- Institute of Biomedical Engineering (IBME), Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
22
|
Fraiwan L, Alkhodari M. Neonatal sleep stage identification using long short-term memory learning system. Med Biol Eng Comput 2020; 58:1383-1391. [PMID: 32281071 DOI: 10.1007/s11517-020-02169-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Accepted: 03/21/2020] [Indexed: 11/28/2022]
Abstract
Neonatal sleep analysis at the neonatal intensive care units (NICU) is critical for the diagnosis of any brain growth risks during the early stages of life. In this paper, an investigation is carried out on the use of a long short-term memory (LSTM) learning system in automatic sleep stage scoring in neonates. The developed algorithm automatically classifies sleep stages based on inputs from a single channel EEG recording. Up to this date, only a single study have developed an approach for automatic sleep stage scoring in neonatal sleep signals using deep neural network (DNN). A total of 5095 sleep stages signals acquired from EEG recordings of the University of Pittsburgh are used in this study. The sleep stages are annotated by a medical doctor from the Pediatric Neurology Department of Case Western Reserve University for three neonatal sleep stages including the awake (W), active sleep (AS), and quiet sleep (QS) stages on every 60-s epoch. The signals are pre-processed through normalization and filtering. The resulted signals are divided following 4-, 6-, and 10-fold cross-validation schemes. The training and classification process is done using a bi-directional LSTM network classifier built with pre-defined training parameters. At the end, the developed algorithm is evaluated along with a complete summary table that reports the results of this study and other state-of-the-art studies. The current study achieved high levels of Cohen's kappa (κ), accuracy, and F1 score with 91.37%, 96.81%, and 94.43%, respectively. Based on the confusion matrix, the overall true positives percentage reached 95.21%. The developed algorithm gave promising results in automatic sleep stage scoring in neonatal sleep signals. Future work include LSTM architecture and training parameters improvements to enhance the overall accuracy of the classifier.
Collapse
Affiliation(s)
- Luay Fraiwan
- Department of Electrical and Computer Engineering, Abu Dhabi University, Abu Dhabi, United Arab Emirates. .,Department of Biomedical Engineering, Jordan University of Science and Technology, Irbid, Jordan.
| | - Mohanad Alkhodari
- Department of Electrical and Computer Engineering, Abu Dhabi University, Abu Dhabi, United Arab Emirates
| |
Collapse
|
23
|
Werth J, Radha M, Andriessen P, Aarts RM, Long X. Deep learning approach for ECG-based automatic sleep state classification in preterm infants. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101663] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
24
|
Ansari AH, De Wel O, Pillay K, Dereymaeker A, Jansen K, Van Huffel S, Naulaers G, De Vos M. A convolutional neural network outperforming state-of-the-art sleep staging algorithms for both preterm and term infants. J Neural Eng 2020; 17:016028. [PMID: 31689694 DOI: 10.1088/1741-2552/ab5469] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
OBJECTIVE To classify sleep states using electroencephalogram (EEG) that reliably works over a wide range of preterm ages, as well as term age. APPROACH A convolutional neural network is developed to perform 2- and 4-class sleep classification in neonates. The network takes as input an 8-channel 30 s EEG segment and outputs the sleep state probabilities. Apart from simple downsampling of the input and smoothing of the output, the suggested network is an end-to-end algorithm that avoids the need for hand-crafted feature selection or complex pre/post processing steps. To train and test this method, 113 EEG recordings from 42 infants are used. MAIN RESULTS For quiet sleep detection (the 2-class problem), mean kappa between the network estimate and the ground truth annotated by EEG human experts is 0.76. The sensitivity and specificity are 90% and 88%, respectively. For 4-class classification, mean kappa is 0.64. The averaged sensitivity and specificity (1 versus all) respectively equal 72% and 91%. The results outperform current state-of-the-art methods for which kappa ranges from 0.66 to 0.70 in preterm and from 0.51 to 0.61 in term infants, based on training and testing using the same database. SIGNIFICANCE The proposed method has the highest reported accuracy for EEG sleep state classification for both preterm and term age neonates.
Collapse
Affiliation(s)
- Amir H Ansari
- Department of Electrical Engineering (ESAT), STADIUS, KU Leuven, Belgium. imec, Leuven, Belgium
| | | | | | | | | | | | | | | |
Collapse
|
25
|
De Wel O, Lavanga M, Caicedo A, Jansen K, Naulaers G, Van Huffel S. Decomposition of a Multiscale Entropy Tensor for Sleep Stage Identification in Preterm Infants. ENTROPY 2019. [PMCID: PMC7514268 DOI: 10.3390/e21100936] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Established sleep cycling is one of the main hallmarks of early brain development in preterm infants, therefore, automated classification of the sleep stages in preterm infants can be used to assess the neonate’s cerebral maturation. Tensor algebra is a powerful tool to analyze multidimensional data and has proven successful in many applications. In this paper, a novel unsupervised algorithm to identify neonatal sleep stages based on the decomposition of a multiscale entropy tensor is presented. The method relies on the difference in electroencephalography(EEG) complexity between the neonatal sleep stages and is evaluated on a dataset of 97 EEG recordings. An average sensitivity, specificity, accuracy and area under the receiver operating characteristic curve of 0.80, 0.79, 0.79 and 0.87 was obtained if the rank of the tensor decomposition is selected based on the age of the infant.
Collapse
Affiliation(s)
- Ofelie De Wel
- Department of Electrical Engineering (ESAT), STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, KU Leuven, 3001 Leuven, Belgium; (M.L.); (S.V.H.)
- Correspondence:
| | - Mario Lavanga
- Department of Electrical Engineering (ESAT), STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, KU Leuven, 3001 Leuven, Belgium; (M.L.); (S.V.H.)
| | - Alexander Caicedo
- Department of Applied Mathematics and Computer Science, Universidad del Rosario, Bogotá 111711, Colombia;
| | - Katrien Jansen
- Department of Development and Regeneration, Neonatal Intensive Care Unit, University Hospitals Leuven, 3000 Leuven, Belgium; (K.J.); (G.N.)
- Department of Development and Regeneration, Child Neurology, University Hospitals Leuven, 3000 Leuven, Belgium
| | - Gunnar Naulaers
- Department of Development and Regeneration, Neonatal Intensive Care Unit, University Hospitals Leuven, 3000 Leuven, Belgium; (K.J.); (G.N.)
| | - Sabine Van Huffel
- Department of Electrical Engineering (ESAT), STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, KU Leuven, 3001 Leuven, Belgium; (M.L.); (S.V.H.)
| |
Collapse
|
26
|
Cabon S, Porée F, Simon A, Met-Montot B, Pladys P, Rosec O, Nardi N, Carrault G. Audio- and video-based estimation of the sleep stages of newborns in Neonatal Intensive Care Unit. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2019.04.011] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
|
27
|
Werth J, Serteyn A, Andriessen P, Aarts RM, Long X. Automated preterm infant sleep staging using capacitive electrocardiography. Physiol Meas 2019; 40:055003. [DOI: 10.1088/1361-6579/ab1224] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|