Exploration of face-perceptual ability by EEG induced deep learning algorithm

Salient Arithmetic Data Extraction from Brain Activity via an Improved Deep Network

Interpretation of neural activity in response to stimulations received from the surrounding environment is necessary to realize automatic brain decoding. Analyzing the brain recordings corresponding to visual stimulation helps to infer the effects of perception occurring by vision on brain activity. In this paper, the impact of arithmetic concepts on vision-related brain records has been considered and an efficient convolutional neural network-based generative adversarial network (CNN-GAN) is proposed to map the electroencephalogram (EEG) to salient parts of the image stimuli. The first part of the proposed network consists of depth-wise one-dimensional convolution layers to classify the brain signals into 10 different categories according to Modified National Institute of Standards and Technology (MNIST) image digits. The output of the CNN part is fed forward to a fine-tuned GAN in the proposed model. The performance of the proposed CNN part is evaluated via the visually provoked 14-channel MindBigData recorded by David Vivancos, corresponding to images of 10 digits. An average accuracy of 95.4% is obtained for the CNN part for classification. The performance of the proposed CNN-GAN is evaluated based on saliency metrics of SSIM and CC equal to 92.9% and 97.28%, respectively. Furthermore, the EEG-based reconstruction of MNIST digits is accomplished by transferring and tuning the improved CNN-GAN's trained weights.

Machine learning and EEG can classify passive viewing of discrete categories of visual stimuli but not the observation of pain

Previous studies have demonstrated the potential of machine learning (ML) in classifying physical pain from non-pain states using electroencephalographic (EEG) data. However, the application of ML to EEG data to categorise the observation of pain versus non-pain images of human facial expressions or scenes depicting pain being inflicted has not been explored. The present study aimed to address this by training Random Forest (RF) models on cortical event-related potentials (ERPs) recorded while participants passively viewed faces displaying either pain or neutral expressions, as well as action scenes depicting pain or matched non-pain (neutral) scenarios. Ninety-one participants were recruited across three samples, which included a model development group (n = 40) and a cross-subject validation group (n = 51). Additionally, 25 participants from the model development group completed a second experimental session, providing a within-subject temporal validation sample. The analysis of ERPs revealed an enhanced N170 component in response to faces compared to action scenes. Moreover, an increased late positive potential (LPP) was observed during the viewing of pain scenes compared to neutral scenes. Additionally, an enhanced P3 response was found when participants viewed faces displaying pain expressions compared to neutral expressions. Subsequently, three RF models were developed to classify images into faces and scenes, neutral and pain scenes, and neutral and pain expressions. The RF model achieved classification accuracies of 75%, 64%, and 69% for cross-validation, cross-subject, and within-subject classifications, respectively, along with reasonably calibrated predictions for the classification of face versus scene images. However, the RF model was unable to classify pain versus neutral stimuli above chance levels when presented with subsequent tasks involving images from either category. These results expand upon previous findings by externally validating the use of ML in classifying ERPs related to different categories of visual images, namely faces and scenes. The results also indicate the limitations of ML in distinguishing pain and non-pain connotations using ERP responses to the passive viewing of visually similar images.

Automatic detection of abnormal EEG signals using multiscale features with ensemble learning

Electroencephalogram (EEG) is an economical and convenient auxiliary test to aid in the diagnosis and analysis of brain-related neurological diseases. In recent years, machine learning has shown great potential in clinical EEG abnormality detection. However, existing methods usually fail to consider the issue of feature redundancy when extracting the relevant EEG features. In addition, the importance of utilizing the patient age information in EEG detection is ignored. In this paper, a new framework is proposed for distinguishing an unknown EEG recording as either normal or abnormal by identifying different types of EEG-derived significant features. In the proposed framework, different hierarchical salient features are extracted using a time-wise multi-scale aggregation strategy, based on a selected group of statistical characteristics calculated from the optimum discrete wavelet transform coefficients. We also fuse the age information with multi-scale features for further improving discrimination. The integrated features are classified using three ensemble learning classifiers, CatBoost, LightGBM, and random forest. Experimental results show that our method with CatBoost classifier can yield superior performance vis-a-vis competing techniques, which indicates the great promise of our methodology in EEG pathology detection.

Classification of ERP signal from amnestic mild cognitive impairment with type 2 diabetes mellitus using single-scale multi-input convolution neural network

BACKGROUND

The application of deep learning models to electroencephalogram (EEG) signal classification has recently become a popular research topic. Several deep learning models have been proposed to classify EEG signals in patients with various neurological diseases. However, no effective deep learning model for event-related potential (ERP) signal classification is yet available for amnestic mild cognitive impairment (aMCI) with type 2 diabetes mellitus (T2DM).

METHOD

This study proposed a single-scale multi-input convolutional neural network (SSMICNN) method to classify ERP signals between aMCI patients with T2DM and the control group. Firstly, the 18-electrode ERP signal on alpha, beta, and theta frequency bands was extracted by using the fast Fourier transform, and then the mean, sum of squares, and absolute value feature of each frequency band were calculated. Finally, these three features are converted into multispectral images respectively and used as the input of the SSMICNN network to realize the classification task.

RESULTS

The results show that the SSMICNN can fuse MSI formed by different features, SSMICNN enriches the feature quantity of the neural network input layer and has excellent robustness, and the errors of SSMICNN can be simultaneously transmitted to the three convolution channels in the back-propagation phase. Comparison with Existing Method(s): SSMICNN could more effectively identify ERP signals from aMCI with T2DM from the control group compared to existing classification methods, including convolution neural network, support vector machine, and logistic regression.

CONCLUSIONS

The combination of SSMICNN and MSI can be used as an effective biological marker to distinguish aMCI patients with T2DM from the control group.