EEG characteristic analysis of coach bus drivers based on brain connectivity as revealed via a graph theoretical network

Graph theoretical brain connectivity measures to investigate neural correlates of music rhythms associated with fear and anger

The present study tests the hypothesis that emotions of fear and anger are associated with distinct psychophysiological and neural circuitry according to discrete emotion model due to contrasting neurotransmitter activities, despite being included in the same affective group in many studies due to similar arousal-valance scores of them in emotion models. EEG data is downloaded from OpenNeuro platform with access number of ds002721. Brain connectivity estimations are obtained by using both functional and effective connectivity estimators in analysis of short (2 sec) and long (6 sec) EEG segments across the cortex. In tests, discrete emotions and resting-states are identified by frequency band specific brain network measures and then contrasting emotional states are deep classified with 5-fold cross-validated Long Short Term Memory Networks. Logistic regression modeling has also been examined to provide robust performance criteria. Commonly, the best results are obtained by using Partial Directed Coherence in Gamma (31.5 - 60.5 H z ) sub-bands of short EEG segments. In particular, Fear and Anger have been classified with accuracy of 91.79%. Thus, our hypothesis is supported by overall results. In conclusion, Anger is found to be characterized by increased transitivity and decreased local efficiency in addition to lower modularity in Gamma-band in comparison to fear. Local efficiency refers functional brain segregation originated from the ability of the brain to exchange information locally. Transitivity refer the overall probability for the brain having adjacent neural populations interconnected, thus revealing the existence of tightly connected cortical regions. Modularity quantifies how well the brain can be partitioned into functional cortical regions. In conclusion, PDC is proposed to graph theoretical analysis of short EEG epochs in presenting robust emotional indicators sensitive to perception of affective sounds.

Real driving environment EEG-based detection of driving fatigue using the wavelet scattering network

BACKGROUND

Driving fatigue is one of the main factors leading to traffic accidents. So, it is necessary to detect driver fatigue accurately and quickly.

NEW METHOD

To precisely detect driving fatigue in a real driving environment, this paper adopts a classification method for driving fatigue based on the wavelet scattering network (WSN). Firstly, electroencephalogram (EEG) signals of 12 subjects in the real driving environment are collected and categorized into two states: fatigue and awake. Secondly, the WSN algorithm extracts wavelet scattering coefficients of EEG signals, and these coefficients are used as input in support vector machine (SVM) as feature vectors for classification.

RESULTS

The results showed that the average classification accuracy of 12 subjects reached 99.33%; the average precision rate reached 99.28%; the average recall rate reached 98.27%; the average F1 score reached 98.74%; and the average classification accuracy of the public data set SEED-VIG reached 99.39%. The average precision, recall rate and F1 score reached 99.27%, 98.41% and 98.83% respectively.

COMPARISON WITH EXISTING METHODS

In addition, the WSN algorithm is compared with traditional convolutional neural network (CNN), Sparse-deep belief networks (SDBN), Spatio-temporal convolutional neural networks (STCNN), Long short-term memory (LSTM), and other methods, and it is found that WSN has higher classification accuracy.

CONCLUSION

Furthermore, this method has good versatility, providing excellent recognition effect on small sample data sets, and fast running time, making it convenient for real-time online monitoring of driver fatigue. Therefore, the WSN algorithm is promising in efficiently detecting driving fatigue state of drivers in real environments, contributing to improved traffic safety.

Study on the Effect of Judgment Excitation Mode to Relieve Driving Fatigue Based on MF-DFA

Driving fatigue refers to a phenomenon in which a driver’s physiological and psychological functions become unbalanced after a long period of continuous driving, and their driving skills decline objectively. The hidden dangers of driving fatigue to traffic safety should not be underestimated. In this work, we propose a judgment excitation mode (JEM), which adds secondary cognitive tasks to driving behavior through dual-channel human–computer interaction, so as to delay the occurrence of driving fatigue. We used multifractal detrended fluctuation analysis (MF-DFA) to study the dynamic properties of subjects’ EEG, and analyzed the effect of JEM on fatigue retardation by Hurst exponent value and multifractal spectrum width value. The results show that the multifractal properties of the two driving modes (normal driving mode and JEM) are significantly different. The JEM we propose can effectively delay the occurrence of driving fatigue, and has good prospects for future practical applications.

Research on driving fatigue detection based on basic scale entropy and MVAR-PSI

In long-term continuous driving, driving fatigue is the main cause of traffic accidents. Therefore, accurate and rapid detection of driver mental fatigue is of great significance to traffic safety. In our study, the electroencephalogram (EEG) signals of subjects were preprocessed to remove interference signals. The Butterworth band-pass filter is used to extract the EEG signals ofαandβrhythms, and then the basic scale entropy ofαandβrhythms is used as driving fatigue characteristics. In addition, combined with the fast multiple autoregressive (MVAR) model and phase slope index (PSI), short-term data is used to accurately estimate the effective connectivity of EEG signals between different channels, and analyzed the causality flow direction in the left and right prefrontal regions of drivers at different driving stages. Further comprehensive analysis of the driver's driving fatigue state in the continuous driving phase. Finally, the correlation coefficient value between the parameter pairs (basic scale entropy, clustering coefficient, global efficiency) is calculated. The results showed that the causality flow outflow degree of prefrontal lobe decreased during the transition from sober driving state to tired driving state. The left and right prefrontal lobes were the source of causality in sober driving state, and gradually became the target of causality with the occurrence of driving fatigue. The results showed that when transitioning from a waking state to a fatigued driving state, the causal flow direction out-degree value of the prefrontal cortex on a declining curve, and the left and right prefrontal cortex exhibited the causal source in the awake driving state, which gradually changed into the causal target along with the occurrence of driving fatigue. The three parameters of basic scale entropy, clustering coefficient and global efficiency are used as driving fatigue characteristics, and every two parameters have strong correlation. It shows that the combination of basic scale entropy and MVAR-PSI method can effectively detect the driver's long-term driving fatigue state in continuous driving mode.

EEG-based brain functional connectivity representation using amplitude locking value for fatigue-driving recognition

It has been shown that brain functional networks constructed from electroencephalographic signals (EEG) continuously change topology as brain fatigue increases, and extracting the topological properties of the network can characterize the degree of brain fatigue. However, the traditional brain function network construction process often selects only the amplitude or phase components of the signal to measure the relationship between brain regions, and the use of a single component of the signal to construct a brain function network for analysis is rather one-sided. Therefore, we propose a method of functional synchronization analysis of brain regions. This method takes the EEG signal based on empirical modal decomposition (EMD) to obtain multiple intrinsic modal components (IMF) and inputs them into the Hilbert transform to obtain the instantaneous amplitude, and then calculates the amplitude locking value (ALV) to measure the synchronization relationship between all pairs of channels. The topological properties of the brain functional network are extracted to classify awake and fatigue states. The brain functional network is constructed based on the adjacency matrix of each waveform obtained from the ALV between all pairs of channels to realize the synchronization analysis between brain regions. Moreover, we achieved a satisfactory classification accuracy (82.84%) using the discriminative connection features in the Alpha band. In this study, we analyzed the functional network of ALV brain in fatigue and awake state, and the results showed that the connections between brain regions in fatigue state were significantly increased, and the connections between brain regions in the awake state were significantly decreased, and the information interaction between brain regions was more orderly and efficient.

Abnormality of Functional Connections in the Resting State Brains of Schizophrenics

To explore the change of brain connectivity in schizophrenics (SCZ), the resting-state EEG source functional connections of SCZ and healthy control (HC) were investigated in this paper. Different band single-layer networks, multilayer networks, and improved multilayer networks were constructed and their topological attributes were extracted. The topological attributes of SCZ and HC were automatically distinguished using ensemble learning methods called Ensemble Learning based on Trees and Soft voting method, and the effectiveness of different network construction methods was compared based on the classification accuracy. The results showed that the classification accuracy was 89.38% for α band network, 82.5% for multilayer network, and 86.88% for improved multilayer network. Comparing patients with SCZ to those with Alzheimer's disease (AD), the classification accuracy of improved multilayer network was the highest, which was 88.12%. The power spectrum in the α band of SCZ was significantly lower than HC, whereas there was no significant difference between SCZ and AD. This indicated that the improved multilayer network can effectively distinguish SCZ and other groups not only when their power spectrum was significantly different. The results also suggested that the improved multilayer topological attributes were regarded as biological markers in the clinical diagnosis of patients with schizophrenia and even other mental disorders.

Research on Driving Fatigue Alleviation Using Interesting Auditory Stimulation Based on VMD-MMSE

The accurate detection and alleviation of driving fatigue are of great significance to traffic safety. In this study, we tried to apply the modified multi-scale entropy (MMSE) approach, based on variational mode decomposition (VMD), to driving fatigue detection. Firstly, the VMD was used to decompose EEG into multiple intrinsic mode functions (IMFs), then the best IMFs and scale factors were selected using the least square method (LSM). Finally, the MMSE features were extracted. Compared with the traditional sample entropy (SampEn), the VMD-MMSE method can identify the characteristics of driving fatigue more effectively. The VMD-MMSE characteristics combined with a subjective questionnaire (SQ) were used to analyze the change trends of driving fatigue under two driving modes: normal driving mode and interesting auditory stimulation mode. The results show that the interesting auditory stimulation method adopted in this paper can effectively relieve driving fatigue. In addition, the interesting auditory stimulation method, which simply involves playing interesting auditory information on the vehicle-mounted player, can effectively relieve driving fatigue. Compared with traditional driving fatigue-relieving methods, such as sleeping and drinking coffee, this interesting auditory stimulation method can relieve fatigue in real-time when the driver is driving normally.

Complex networks and deep learning for EEG signal analysis

Electroencephalogram (EEG) signals acquired from brain can provide an effective representation of the human's physiological and pathological states. Up to now, much work has been conducted to study and analyze the EEG signals, aiming at spying the current states or the evolution characteristics of the complex brain system. Considering the complex interactions between different structural and functional brain regions, brain network has received a lot of attention and has made great progress in brain mechanism research. In addition, characterized by autonomous, multi-layer and diversified feature extraction, deep learning has provided an effective and feasible solution for solving complex classification problems in many fields, including brain state research. Both of them show strong ability in EEG signal analysis, but the combination of these two theories to solve the difficult classification problems based on EEG signals is still in its infancy. We here review the application of these two theories in EEG signal research, mainly involving brain-computer interface, neurological disorders and cognitive analysis. Furthermore, we also develop a framework combining recurrence plots and convolutional neural network to achieve fatigue driving recognition. The results demonstrate that complex networks and deep learning can effectively implement functional complementarity for better feature extraction and classification, especially in EEG signal analysis.

Research on Recognition of Motor Imagination Based on Connectivity Features of Brain Functional Network

Feature extraction is essential for classifying different motor imagery (MI) tasks in a brain-computer interface. To improve classification accuracy, we propose a novel feature extraction method in which the connectivity increment rate (CIR) of the brain function network (BFN) is extracted. First, the BFN is constructed on the basis of the threshold matrix of the Pearson correlation coefficient of the mu rhythm among the channels. In addition, a weighted BFN is constructed and expressed by the sum of the existing edge weights to characterize the cerebral cortex activation degree in different movement patterns. Then, on the basis of the topological structures of seven mental tasks, three regional networks centered on the C3, C4, and Cz channels are constructed, which are consistent with correspondence between limb movement patterns and cerebral cortex in neurophysiology. Furthermore, the CIR of each regional functional network is calculated to form three-dimensional vectors. Finally, we use the support vector machine to learn a classifier for multiclass MI tasks. Experimental results show a significant improvement and demonstrate the success of the extracted feature CIR in dealing with MI classification. Specifically, the average classification performance reaches 88.67% which is higher than other competing methods, indicating that the extracted CIR is effective for MI classification.

EEG Feature Extraction Based on a Bilevel Network: Minimum Spanning Tree and Regional Network

Feature extraction is essential for classifying different motor imagery (MI) tasks in a brain–computer interface (BCI). Although the methods of brain network analysis have been widely studied in the BCI field, these methods are limited by differences in network size, density, and standardization. To address this issue and improve classification accuracy, we propose a novel method, in which the hybrid features of the brain function based on the bilevel network are extracted. Minimum spanning tree (MST) based on electroencephalogram (EEG) signal nodes in different MIs is constructed as the first network layer to solve the global network connectivity problem. In addition, the regional network in different movement patterns is constructed as the second network layer to determine the network characteristics, which is consistent with the correspondence between limb movement patterns and cerebral cortex in neurophysiology. We attempt to apply MST to the classification of the MI EEG signals, and the bilevel network has better interpretability. Thereafter, a vector is formed by combining the MST fundamental features with the directional features of the regional network. Our method is validated using the BCI Competition IV Dataset I. Experimental results verify the feasibility of the bilevel network framework. Furthermore, the average classification performance of the proposed method reaches 89.50%, which is higher than that of other competing methods, thereby indicating that the bilevel network is effective for MI classification.

Study on the Effect of Man-Machine Response Mode to Relieve Driving Fatigue Based on EEG and EOG

Rapid and accurate detection of driver fatigue is of great significance to improve traffic safety. In the present work, we propose the man-machine response mode (MRM) to relieve driver fatigue caused by long-term driving. In this paper, the characteristics of the complex brain network, which can effectively reflect brain activity information, were used to detect the change of driving fatigue over time. Combined with the traditional eye movement characteristics and a subjective questionnaire (SQ), the changes in driving fatigue characteristics were comprehensively analyzed. The results show that driving fatigue can be effectively delayed using the MRM. Additionally, the response equipment is low in cost and practical, so it will be practical to use in actual driving situations in the future.