Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls

Introduction

Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort.

Methods

A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers.

Results

The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75).

Conclusion

The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.

The Sleep Revolution project: the concept and objectives

Obstructive sleep apnea is linked to severe health consequences such as hypertension, daytime sleepiness, and cardiovascular disease. Nearly a billion people are estimated to have obstructive sleep apnea with a substantial economic burden. However, the current diagnostic parameter of obstructive sleep apnea, the apnea-hypopnea index, correlates poorly with related comorbidities and symptoms. Obstructive sleep apnea severity is measured by counting respiratory events, while other physiologically relevant consequences are ignored. Furthermore, as the clinical methods for analysing polysomnographic signals are outdated, laborious, and expensive, most patients with obstructive sleep apnea remain undiagnosed. Therefore, more personalised diagnostic approaches are urgently needed. The Sleep Revolution, funded by the European Union's Horizon 2020 Research and Innovation Programme, aims to tackle these shortcomings by developing machine learning tools to better estimate obstructive sleep apnea severity and phenotypes. This allows for improved personalised treatment options, including increased patient participation. Also, implementing these tools will alleviate the costs and increase the availability of sleep studies by decreasing manual scoring labour. Finally, the project aims to design a digital platform that functions as a bridge between researchers, patients, and clinicians, with an electronic sleep diary, objective cognitive tests, and questionnaires in a mobile application. These ambitious goals will be achieved through extensive collaboration between 39 centres, including expertise from sleep medicine, computer science, and industry and by utilising tens of thousands of retrospectively and prospectively collected sleep recordings. With the commitment of the European Sleep Research Society and Assembly of National Sleep Societies, the Sleep Revolution has the unique possibility to create new standardised guidelines for sleep medicine.