Optimal imaging of multi-channel EEG features based on a novel clustering technique for driver fatigue detection

Driver drowsiness detection methods using EEG signals: a systematic review

Electroencephalography (EEG) is a complex signal that may require several years of training, advanced signal processing, and feature extraction methodologies to interpret correctly. Recently, many methods have been used to extract and classify EEG data. This study reviews 62 papers that used EEG signals to detect driver drowsiness, published between January 2018 and 2022. We extract trends and highlight interesting approaches from this large body of literature to inform future research and formulate recommendations. To find relevant papers published in scientific journals, conferences, and electronic preprint repositories, researchers searched major databases covering the domains of science and engineering. For each investigation, many data items about (1) the data, (2) the channels used, (3) the extraction and classification procedure, and (4) the outcomes were extracted. These items were then analyzed one by one to uncover trends. Our analysis reveals that the amount of EEG data used across studies varies. We saw that more than half the studies used simulation driving experimental. About 21% of the studies used support vector machine (SVM), while 19% used convolutional neural networks (CNN). Overall, we can conclude that drowsiness and fatigue impair driving performance, resulting in drivers who are more exposed to risky situations.

A Recognition Method for Road Hypnosis Based on Physiological Characteristics

Road hypnosis is a state which is easy to appear frequently in monotonous scenes and has a great influence on traffic safety. The effective detection for road hypnosis can improve the intelligent vehicle. In this paper, the simulated experiment and vehicle experiment are designed and carried out to obtain the physiological characteristics data of road hypnosis. A road hypnosis recognition model based on physiological characteristics is proposed. Higher-order spectra are used to preprocess the electrocardiogram (ECG) and electromyography (EMG) data, which can be further fused by principal component analysis (PCA). The Linear Discriminant Analysis (LDA), Quadratic Discriminant Analysis (QDA), and K-Nearest Neighbor (KNN) models are constructed to identify road hypnosis. The proposed model has good identification performance on road hypnosis. It provides more alternative methods and technical support for real-time and accurate identification of road hypnosis. It is of great significance to improve the intelligence and active safety of intelligent vehicles.

Single-trial motor imagery electroencephalogram intention recognition by optimal discriminant hyperplane and interpretable discriminative rectangle mixture model

Spatial filtering is widely used in brain-computer interface (BCI) systems to augmented signal characteristics of electroencephalogram (EEG) signals. In this study, a spatial domain filtering based EEG feature extraction method, optimal discriminant hyperplane-common spatial subspace decomposition (ODH-CSSD) is proposed. Specifically, the multi-dimensional EEG features were extracted from the original EEG signals by common space subspace decomposition (CSSD) algorithm, and the optimal feature criterion was established to find the multi-dimensional optimal projection space. A classic method of data dimension optimizing is using the eigenvectors of a lumped covariance matrix corresponding to the maximum eigenvalues. Then, the cost function is defined as the extreme value of the discriminant criterion, and the orthogonal N discriminant vectors corresponding to the N extreme value of the criterion are solved and constructed into the N-dimensional optimal feature space. Finally, the multi-dimensional EEG features are projected into the N-dimensional optimal projection space to obtain the optimal N-dimensional EEG features. Moreover, this study involves the extraction of two-dimensional and three-dimensional optimal EEG features from motor imagery EEG datasets, and the optimal EEG features are identified using the interpretable discriminative rectangular mixture model (DRMM). Experimental results show that the accuracy of DRMM to identify two-dimensional optimal features is more than 0.91, and the highest accuracy even reaches 0.975. Meanwhile, DRMM has the most stable recognition accuracy for two-dimensional optimal features, and its average clustering accuracy reaches 0.942, the gap between the accuracy of the DRMM with the accuracy of the FCM and K-means can reach 0.26. And the optimal three-dimensional features, for most subjects, the clustering accuracy of DRMM is higher than that of FCM and K-means. In general, the decision rectangle obtained by DRMM can clearly explain the difference of each cluster, notably, the optimization of multidimensional EEG features by optimal projection is superior to Fisher's ratio, and this method provides an alternative for the application of BCI.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-021-09768-w.

Functional Connectivity Analysis and Detection of Mental Fatigue Induced by Different Tasks Using Functional Near-Infrared Spectroscopy

Objectives

The objective of this study was to investigate common functional near-infrared spectroscopy (fNIRS) features of mental fatigue induced by different tasks. In addition to distinguishing fatigue from non-fatigue state, the early signs of fatigue were also studied so as to give an early warning of fatigue.

Methods

fNIRS data from 36 participants were used to investigate the common character of functional connectivity network corresponding to mental fatigue, which was induced by psychomotor vigilance test (PVT), cognitive work, or simulated driving. To analyze the network reorganizations quantitatively, clustering coefficient, characteristic path length, and small worldness were calculated in five sub-bands (0.6–2.0, 0.145–0.600, 0.052–0.145, 0.021–0.052, and 0.005–0.021 Hz). Moreover, we applied a random forest method to classify three fatigue states.

Results

In a moderate fatigue state: the functional connectivity strength between brain regions increased overall in 0.021–0.052 Hz, and an asymmetrical pattern of connectivity (right hemisphere > left hemisphere) was presented. In 0.052–0.145 Hz, the connectivity strength decreased overall, the clustering coefficient decreased, and the characteristic path length increased significantly. In severe fatigue state: in 0.021–0.052 Hz, the brain network began to deviate from a small-world pattern. The classification accuracy of fatigue and non-fatigue was 85.4%. The classification accuracy of moderate fatigue and severe fatigue was 82.8%.

Conclusion

The preliminary research demonstrates the feasibility of detecting mental fatigue induced by different tasks, by applying the functional network features of cerebral hemoglobin signal. This universal and robust method has the potential to detect early signs of mental fatigue and prevent relative human error in various working environments.

A Hybrid Driver Fatigue and Distraction Detection Model Using AlexNet Based on Facial Features

Modern cities have imposed a fast-paced lifestyle where more drivers on the road suffer from fatigue and sleep deprivation. Consequently, road accidents have increased, becoming one of the leading causes of injuries and death among young adults and children. These accidents can be prevented if fatigue symptoms are diagnosed and detected sufficiently early. For this reason, we propose and compare two AlexNet CNN-based models to detect drivers’ fatigue behaviors, relying on head position and mouth movements as behavioral measures. We used two different approaches. The first approach is transfer learning, specifically, fine-tuning AlexNet, which allowed us to take advantage of what the model had already learned without developing it from scratch. The newly trained model was able to predict drivers’ drowsiness behaviors. The second approach is the use of AlexNet to extract features by training the top layers of the network. These features were reduced using non-negative matrix factorization (NMF) and classified with a support vector machine (SVM) classifier. The experiments showed that our proposed transfer learning model achieved an accuracy of 95.7%, while the feature extraction SVM-based model performed better, with an accuracy of 99.65%. Both models were trained on a simulated NTHU Driver Drowsiness Detection dataset.