EEG-based detection of the locus of auditory attention with convolutional neural networks

Abdul Majeed A, Moni MA. Diagnosis of hearing deficiency using EEG based AEP signals: CWT and improved-VGG16 pipeline

Hearing deficiency is the world's most common sensation of impairment and impedes human communication and learning. Early and precise hearing diagnosis using electroencephalogram (EEG) is referred to as the optimum strategy to deal with this issue. Among a wide range of EEG control signals, the most relevant modality for hearing loss diagnosis is auditory evoked potential (AEP) which is produced in the brain's cortex area through an auditory stimulus. This study aims to develop a robust intelligent auditory sensation system utilizing a pre-train deep learning framework by analyzing and evaluating the functional reliability of the hearing based on the AEP response. First, the raw AEP data is transformed into time-frequency images through the wavelet transformation. Then, lower-level functionality is eliminated using a pre-trained network. Here, an improved-VGG16 architecture has been designed based on removing some convolutional layers and adding new layers in the fully connected block. Subsequently, the higher levels of the neural network architecture are fine-tuned using the labelled time-frequency images. Finally, the proposed method's performance has been validated by a reputed publicly available AEP dataset, recorded from sixteen subjects when they have heard specific auditory stimuli in the left or right ear. The proposed method outperforms the state-of-art studies by improving the classification accuracy to 96.87% (from 57.375%), which indicates that the proposed improved-VGG16 architecture can significantly deal with AEP response in early hearing loss diagnosis.

A Deep Shared Multi-Scale Inception Network Enables Accurate Neonatal Quiet Sleep Detection with Limited EEG Channels

In this paper, we introduce a new variation of the Convolutional Neural Network Inception block, called Sinc, for sleep stage classification in premature newborn babies using electroencephalogram (EEG). In practice, there are many medical centres where only a limited number of EEG channels are recorded. Existing automated algorithms mainly use multi-channel EEGs which perform poorly when fewer numbers of channels are available. The proposed Sinc utilizes multi-scale analysis to place emphasis on the temporal EEG information to be less dependent on the number of EEG channels. In Sinc, we increase the receptive fields through Inception while by additionally sharing the filters that have similar receptive fields, overfitting is controlled and the number of trainable parameters dramatically reduced. To train and test this model, 96 longitudinal EEG recordings from 26 premature infants are used. The Sinc-based model significantly outperforms state-of-the-art neonatal quiet sleep detection algorithms, with mean Kappa 0.77 0.01 (with 8-channel EEG) and 0.75 0.01 (with a single bipolar channel EEG). This is the first study using Inception-based networks for EEG analysis that utilizes filter sharing to improve efficiency and trainability. The suggested network can successfully detect quiet sleep stages with even a single EEG channel making it more practical especially in the hospital setting where cerebral function monitoring is predominantly used.

EEG-Based Auditory Attention Detection and Its Possible Future Applications for Passive BCI

The ability to discriminate and attend one specific sound source in a complex auditory environment is a fundamental skill for efficient communication. Indeed, it allows us to follow a family conversation or discuss with a friend in a bar. This ability is challenged in hearing-impaired individuals and more precisely in those with a cochlear implant (CI). Indeed, due to the limited spectral resolution of the implant, auditory perception remains quite poor in a noisy environment or in presence of simultaneous auditory sources. Recent methodological advances allow now to detect, on the basis of neural signals, which auditory stream within a set of multiple concurrent streams an individual is attending to. This approach, called EEG-based auditory attention detection (AAD), is based on fundamental research findings demonstrating that, in a multi speech scenario, cortical tracking of the envelope of the attended speech is enhanced compared to the unattended speech. Following these findings, other studies showed that it is possible to use EEG/MEG (Electroencephalography/Magnetoencephalography) to explore auditory attention during speech listening in a Cocktail-party-like scenario. Overall, these findings make it possible to conceive next-generation hearing aids combining customary technology and AAD. Importantly, AAD has also a great potential in the context of passive BCI, in the educational context as well as in the context of interactive music performances. In this mini review, we firstly present the different approaches of AAD and the main limitations of the global concept. We then expose its potential applications in the world of non-clinical passive BCI.

A convolutional neural network outperforming state-of-the-art sleep staging algorithms for both preterm and term infants

OBJECTIVE

To classify sleep states using electroencephalogram (EEG) that reliably works over a wide range of preterm ages, as well as term age.

APPROACH

A convolutional neural network is developed to perform 2- and 4-class sleep classification in neonates. The network takes as input an 8-channel 30 s EEG segment and outputs the sleep state probabilities. Apart from simple downsampling of the input and smoothing of the output, the suggested network is an end-to-end algorithm that avoids the need for hand-crafted feature selection or complex pre/post processing steps. To train and test this method, 113 EEG recordings from 42 infants are used.

MAIN RESULTS

For quiet sleep detection (the 2-class problem), mean kappa between the network estimate and the ground truth annotated by EEG human experts is 0.76. The sensitivity and specificity are 90% and 88%, respectively. For 4-class classification, mean kappa is 0.64. The averaged sensitivity and specificity (1 versus all) respectively equal 72% and 91%. The results outperform current state-of-the-art methods for which kappa ranges from 0.66 to 0.70 in preterm and from 0.51 to 0.61 in term infants, based on training and testing using the same database.

SIGNIFICANCE

The proposed method has the highest reported accuracy for EEG sleep state classification for both preterm and term age neonates.

A Tutorial on Auditory Attention Identification Methods

Auditory attention identification methods attempt to identify the sound source of a listener's interest by analyzing measurements of electrophysiological data. We present a tutorial on the numerous techniques that have been developed in recent decades, and we present an overview of current trends in multivariate correlation-based and model-based learning frameworks. The focus is on the use of linear relations between electrophysiological and audio data. The way in which these relations are computed differs. For example, canonical correlation analysis (CCA) finds a linear subset of electrophysiological data that best correlates to audio data and a similar subset of audio data that best correlates to electrophysiological data. Model-based (encoding and decoding) approaches focus on either of these two sets. We investigate the similarities and differences between these linear model philosophies. We focus on (1) correlation-based approaches (CCA), (2) encoding/decoding models based on dense estimation, and (3) (adaptive) encoding/decoding models based on sparse estimation. The specific focus is on sparsity-driven adaptive encoding models and comparing the methodology in state-of-the-art models found in the auditory literature. Furthermore, we outline the main signal processing pipeline for how to identify the attended sound source in a cocktail party environment from the raw electrophysiological data with all the necessary steps, complemented with the necessary MATLAB code and the relevant references for each step. Our main aim is to compare the methodology of the available methods, and provide numerical illustrations to some of them to get a feeling for their potential. A thorough performance comparison is outside the scope of this tutorial.