Weighted ordinal connection based functional network classification for schizophrenia disease detection using EEG signal

A brain connectivity network (BCN) is an advanced approach to examining brain functionality in various conditions. However, the predictability of the BCN is affected by the connectivity measure used for the network construction. Various connectivity measures available in the literature differ according to the domain of their working data. The application of random connectivity measures might result in an inefficient BCN that ultimately hampers its predictability. Therefore, selecting an appropriate functional connectivity metric is crucial in clinical as well as cognitive neuroscience. In parallel to this, an effective network identifier plays a vital role in distinguishing different brain states. Hence, the objective of this paper is two-fold, which includes identifying suitable connectivity measures and proposing an efficient network identifier. For this, the weighted BCN (WBCN) is constructed using multiple connectivity measures like correlation coefficient (r), coherence (COH), phase-locking value (PLV), and mutual information (MI) from electroencephalogram (EEG) signals. The most recent technique for feature extraction, i.e., weighted ordinal connections, has been applied to EEG-based BCN. EEG signals data has been taken from the schizophrenia disease database. Further, several classification algorithms such as k-nearest neighbours (KNN), support vector machine (SVM) with linear, radial basis function and polynomial kernels, random forest (RF), and 1D convolutional neural network (CNN1D) are used to classify the brain states based on extracted features. In classification, 90% accuracy is achieved by the CNN1D classifier with WBCN based on the coherence connectivity measure. The study also provides a structural analysis of the BCN.

Multimodal Emotion Classification Method and Analysis of Brain Functional Connectivity Networks

Since multimodal emotion classification in different human states has rarely been studied, this paper explores the emotional mechanisms of the brain functional connectivity networks after emotional stimulation. We devise a multimodal emotion classification method fusing a brain functional connectivity network based on electroencephalography (EEG) and eye gaze (ECFCEG) to study emotional mechanisms. First, the nonlinear phase lag index (PLI) and phase-locked value (PLV) are calculated to construct the multiband brain functional connectivity networks, which are then converted into binary brain networks, and the seven features of the binary brain networks are extracted. At the same time, the features of the eye gaze signals are extracted. Then, a fusion algorithm called kernel canonical correlation analysis, based on feature level and randomization (FRKCCA), is executed for feature-level fusion (FLF) of brain functional connectivity networks and eye gaze. Finally, support vector machines (SVMs) are utilized to classify positive and negative emotions in multiple frequency bands with single modal features and multimodal features. The experimental results demonstrate that multimodal complementary representation properties can effectively improve the accuracy of emotion classification, achieving a classification accuracy of 91.32±1.81%. The classification accuracy of pupil diameter in the valence dimension is higher than that of additional features. In addition, the average emotion classification effect of the valence dimension is preferable to that of arousal. Our findings demonstrate that the brain functional connectivity networks of the right brain exhibit a deficiency. In particular, the information processing ability of the right temporal (RT) and right posterior (RP) regions is weak in the low frequency after emotional stimulation; Conversely, phase synchronization of the brain functional connectivity networks based on PLI is stronger than that of PLV.

Classification of alcoholic EEG signals using wavelet scattering transform-based features

Following the research question and the relevant dataset, feature extraction is the most important component of machine learning and data science pipelines. The wavelet scattering transform (WST) is a recently developed knowledge-based feature extraction technique and is structurally like a convolutional neural network (CNN). It preserves information in high-frequency, is insensitive to signal deformations, and generates low variance features of real-valued signals generally required in classification tasks. With data from a publicly-available UCI database, we investigated the ability of WST-based features extracted from multichannel electroencephalogram (EEG) signals to discriminate 1.0-s EEG records of 20 male subjects with alcoholism and 20 male healthy subjects. Using record-wise 10-fold cross-validation, we found that WST-based features, inputted to a support vector machine (SVM) classifier, were able to correctly classify all alcoholic and normal EEG records. Similar performances were achieved with 1D CNN. In contrast, the highest independent-subject-wise mean 10-fold cross-validation performance was achieved with WST-based features fed to a linear discriminant (LDA) classifier. The results achieved with two 10-fold cross-validation approaches suggest that the WST together with a conventional classifier is an alternative to CNN for classification of alcoholic and normal EEGs. WST-based features from occipital and parietal regions were the most informative at discriminating between alcoholic and normal EEG records.

Detection of microsleep states from the EEG: a comparison of feature reduction methods

Microsleeps are brief lapses in consciousness with complete suspension of performance. They are the cause of fatal accidents in many transport sectors requiring sustained attention, especially driving. A microsleep-warning device, using wireless EEG electrodes, could be used to rouse a user from an imminent microsleep. High-dimensional datasets, especially in EEG-based classification, present challenges as there are often a large number of potentially useful features for detecting the phenomenon of interest. Thus, it is often important to reduce the dimension of the original data prior to training the classifier. In this study, linear dimensionality reduction methods-principal component analysis (PCA) and probabilistic PCA (PPCA)-were compared with eight non-linear dimensionality reduction methods (kernel PCA, classical multi-dimensional scaling, isometric mapping, nearest neighbour estimation, stochastic neighbourhood embedding, autoencoder, stochastic proximity embedding, and Laplacian eigenmaps) on previously collected behavioural and EEG data from eight healthy non-sleep-deprived volunteers performing a 1D-visuomotor tracking task for 1 h. The effectiveness of the feature reduction algorithms was evaluated by visual inspection of class separation on 3D scatterplots, by trustworthiness scores, and by microsleep detection performance on a stacked-generalisation-based linear discriminant analysis (LDA) system estimating the microsleep/responsive state at 1 Hz based on the reduced features. On trustworthiness, PPCA outperformed PCA, but PCA outperformed all of the non-linear techniques. The trustworthiness score for each feature reduction method also correlated strongly with microsleep-state detection performance, providing strong validation of the ability of trustworthiness to estimate the relative effectiveness of feature reduction approaches, in terms of predicting performance, and ability to do so independently of the gold standard. Graphical abstract Proposed microsleep detection system.

Reservoir computing approaches to microsleep detection

The detection of microsleeps in a wide range of professionals working in high-risk occupations is very important to workplace safety. A microsleep classifier is presented that employs a reservoir computing (RC) methodology. Specifically, echo state networks (ESN) are used to enhance previous benchmark performances on microsleep detection. A clustered design using a novel ESN-based leaky integrator is presented. The effectiveness of this design lies with the simplicity of using a fine-grained architecture, containing up to 8 neurons per cluster, to capture individualized state dynamics and achieve optimal performance. This is the first study to have implemented and evaluated EEG-based microsleep detection using RC models for the detection of microsleeps from the EEG. Microsleep state detection was achieved using a cascaded ESN classifier with leaky-integrator neurons employing 60 principal components from 544 power spectral features. This resulted in a leave-one-subject-out average detection in performance of Φ= 0.51 ± 0.07 (mean ± SE), AUC-ROC = 0.88 ± 0.03, and AUC-PR = 0.44 ± 0.09. Although performance of EEG-based microsleep detection systems is still considered modest, this refined method achieved a new benchmark in microsleep detection.

The Effect of the Graphic Structures of Humanoid Robot on N200 and P300 Potentials

Humanoid robots are widely used in brain computer interface (BCI). Using a humanoid robot stimulus could increase the amplitude of event-related potentials (ERPs), which improves BCI performance. Since a humanoid robot contains many human elements, the element that increases the ERPs amplitude is unclear, and how to test the effect of it on the brain is a problem. This study used different graphic structures of an NAO humanoid robot to design three types of robot stimuli: a global robot, its local information, and its topological action. Ten subjects first conducted an odd-ball-based BCI (OD-BCI) by applying these stimuli. Then, they accomplished a delayed matching-to-sample task (DMST) that was used to specialize the encoding and retrieval phases of the OD-BCI task. In the retrieval phase of the DMST, the global stimulus induces the largest N200 and P300 potentials with the shortest latencies in the frontal, central, and occipital areas. This finding is in accordance with the P300 and classification performance of the OD-BCI task. When induced by the local stimulus, the subjects responded faster and more accurately in the retrieval phase of the DMST than in the other two conditions, indicating that the local stimulus improved the subject's responses. These results indicate that the OD-BCI task causes subject's retrieval work when the subject recognizes and outputs the stimulus. The global stimulus that contains topological and local elements could make brain react faster and induce larger ERPs, this finding could be used during the development of visual stimuli to improve BCI performance.

Detection and Prediction of Microsleeps from EEG using Spatio-Temporal Patterns

A microsleep is a brief lapse in performance due to an involuntary sleep-related loss of consciousness. These episodes are of particular importance in occupations requiring extended unimpaired visuomotor performance, such as driving. Detection and even prediction of microsleeps has the potential to prevent catastrophic events and fatal accidents. In this study, we examined detection and prediction of microsleeps using EEG data of 8 subjects who performed two 1-h sessions of continuous 1-D tracking. A regularized spatio-temporal filtering and classification (RSTFC) method was used to extract features from 5-s EEG segments. These features were then used to train three different linear classifiers: linear discriminant analysis (LDA), sparse Bayesian learning (SBL), and variational Bayesian logistic regression (VBLR). The performance of microsleep state detection and prediction was evaluated using leave-one-subject-out cross-validation. The detection performance measures were AUC_ROC 0.96, AUC_PR 0.52, and phi 0.47. As expected, prediction of microsleep states with a 0.25-s ahead prediction time resulted in slightly lower performances compared to the detection. Prediction performance measures were substantially higher than those achieved with log-power spectral features, i.e., AUC_ROC 0.95 (cf. 0.90), AUC_PR 0.50 (cf. 0.36), and phi 0.46 (cf. 0.34).

Deep Learning with Convolutional Neural Network for detecting microsleep states from EEG: A comparison between the oversampling technique and cost-based learning

Any occupation which involves critical decision making in real-time requires attention and concentration. When repetitive and expanded working periods are encountered, it can result in microsleeps. Microsleeps are complete lapses in which a subject involuntarily stops responding to the task that they are currently performing due to temporary interruptions in visual-motor and cognitive coordination. Microsleeps can last up to 15 s while performing a particular task. In this study, the ability of a convolutional neural network (CNN) to detect microsleep states from 16-channel EEG data from 8 subjects, performing a 1D visuomotor was explored. The data were highly imbalanced. When averaged across 8 subjects there were 17 responsive states for every microsleep state. Two approaches were used to handle the CNN training with data imbalance - oversampling the minority class and cost-based learning. The EEG was analysed using a 4-s epoch with a step size of 0.25 s. Leave-one-subject-out cross-validation was used to evaluate the performance. The performance measures used for assessing the detection capability of the CNN were: sensitivity, precision, phi, geometric mean (GM), AUC_ROC, and AUC_PR. The performance measures obtained using the oversampling and cost-based learning methods were: AUC_ROC = 0.90/0.90, AUC_PR = 0.41/0.41 and a phi = 0.42/0.40, respectively. Although the performances were similar, the cost-based learning method had a considerably shorter training time than the oversampling method.