Real-time EEG-based detection of driving fatigue using a novel semi-dry electrode with self-replenishment of conductive fluid

A novel semi-dry electrode that can realize self-replenishment of conductive liquid is proposed in this study. Driving fatigue is detected by extracting the refined composite multiscale fluctuation dispersion entropy (RCMFDE) features in electroencephalogram (EEG) signals collected by this electrode. The results show that the new semi-dry electrode can automatically complete the conductive fluid supplement according to its own humidity conditions, which not only notably improves the effective working time, but also significantly reduces the skin impedance. By comparing with the classical entropy algorithms, the computational speed and the stability of the RCMFDE method are Substantially enhanced.

EEG spatial inter-channel connectivity analysis: A GCN-based dual stream approach to distinguish mental fatigue status

Mental fatigue is defined as a decline in the ability and efficiency of mental activities. A lot of research suggests that the transition from alertness to fatigue is accompanied by alterations in correlation patterns among various brain regions. However, conventional methods for detecting mental fatigue seldom emphases inter-channel connectivity in the spatial domain. To fill this gap, this paper explores the spatial inter-channel connectivity in alertness and fatigue, employing spectral graph convolutional networks (GCN) for mental fatigue detection. We utilized Pearson correlation coefficients (PCC) to establish temporal connections and magnitude-squared coherence (MSC) for spectral connections. Topological features of the brain network were then analysed. To enhance the learning of spatial inter-channel connectivity, a dual-graph strategy transforms edge features into node features, serving as inputs to the spectral GCN. By simultaneously learning PCC and MSC features, the model results indicate significant differences in some brain network characteristics between alert and fatigue states. It confirms that the synchronicity of brain operations differs in the alert state compared to mental fatigue, and indicates that fatigue states can influence correlation patterns among different brain regions. Our approach is evaluated on a self-designed experimental dataset containing 7 subjects, demonstrating a classification accuracy of 89.59 % in group-level experiments and 95.24 % at the subject level. Additionally, on the public dataset SEED-VIG containing 23 subjects, our method achieves an accuracy of 86.58 %. In summary, this paper proposes a neural network approach based on a dynamic functional connectivity network. The network integrates both temporal and spectral connections with the goal of simultaneously learning spatial inter-channel connectivity in time and frequency domains. This effectively accomplishes fatigue state detection, highlighting that fatigue significantly influences correlations among different brain regions.

Research on low-power driving fatigue monitoring method based on spiking neural network

Fatigue driving is one of the leading causes of traffic accidents, and the rapid and accurate detection of driver fatigue is of paramount importance for enhancing road safety. However, the application of deep learning models in fatigue driving detection has long been constrained by high computational costs and power consumption. To address this issue, this study proposes an approach that combines Self-Organizing Map (SOM) and Spiking Neural Networks (SNN) to develop a low-power model capable of accurately recognizing the driver's mental state. Initially, spatial features are extracted from electroencephalogram (EEG) signals using the SOM network. Subsequently, the extracted weight vectors are encoded and fed into the SNN for fatigue driving classification. The research results demonstrate that the proposed method effectively considers the spatiotemporal characteristics of EEG signals, achieving efficient fatigue detection. Simultaneously, this approach successfully reduces the model's power consumption. When compared to traditional artificial neural networks, our method reduces energy consumption by approximately 12.21-42.59%.

The architecture of functional brain network modulated by driving under train running noise exposure

A noisy environment can considerably impact drivers' attention and fatigue, endangering driving safety. Consequently, this study designed a simulated driving experimental scenario to analyse the effects of noise generated during urban rail transit train operation on drivers' functional brain networks. The experiment recruited 16 participants, and the simulated driving scenario was conducted at noise levels of 50, 60, 70, and 80 dB. Functional connectivity between all electrode pairs across various frequency bands was evaluated using the weighted phase lag index (WPLI), and a brain network based on this was constructed. Graph theoretic analysis employed network global efficiency, degree, and clustering coefficient as metrics. Significant increases in the WPLI values of theta and alpha frequency bands were observed in high noise environments (70 dB, 80 dB), as well as enhanced brain synchronisation. Furthermore, concerning the topological metrics of brain networks, it was observed that the global efficiency of brain networks in theta and alpha frequency ranges, as well as the node degree and clustering coefficients, experienced substantial growth in high noise environments (70 dB, 80 dB) as opposed to 50 dB and 60 dB. This finding indicates that high-noise environments impact the reorganisation of functional brain networks, leading to a preference for network structures with improved global efficiency. Such findings may improve our understanding of the neural mechanisms of driving under noise exposure, and thus potentially reduce road accidents to some extent.

EEG Information Transfer Changes in Different Daily Fatigue Levels During Drowsy Driving

A significant issue for traffic safety has been drowsy driving for decades. A number of studies have investigated the effects of acute fatigue on spectral power; and recent research has revealed that drowsy driving is associated with a variety of brain connections in a specific cortico-cortical pathway. In spite of this, it is still unclear how different brain regions are connected in drowsy driving at different levels of daily fatigue. This study identified the brain connectivity-behavior relationship among three different daily fatigue levels (low-, median- and high-fatigue) with the EEG data transfer entropy. According to the results, only low- and medium-fatigue groups demonstrated an inverted U-shaped change in connectivity from high performance to poor behavioral performance. In addition, from low- to high-fatigue groups, connectivity magnitude decreased in the frontal region and increased in the occipital region. These study results suggest that brain connectivity and driving behavior would be affected by different levels of daily fatigue.

Resting-state EEG recorded with gel-based vs. consumer dry electrodes: spectral characteristics and across-device correlations

Introduction

Recordings of electroencephalographic (EEG) rhythms and their analyses have been instrumental in basic neuroscience, clinical diagnostics, and the field of brain-computer interfaces (BCIs). While in the past such measurements have been conducted mostly in laboratory settings, recent advancements in dry electrode technology pave way to a broader range of consumer and medical application because of their greater convenience compared to gel-based electrodes.

Methods

Here we conducted resting-state EEG recordings in two groups of healthy participants using three dry-electrode devices, the PSBD Headband, the PSBD Headphones and the Muse Headband, and one standard gel electrode-based system, the NVX. We examined signal quality for various spatial and spectral ranges which are essential for cognitive monitoring and consumer applications.

Results

Distinctive characteristics of signal quality were found, with the PSBD Headband showing sensitivity in low-frequency ranges and replicating the modulations of delta, theta and alpha power corresponding to the eyes-open and eyes-closed conditions, and the NVX system performing well in capturing high-frequency oscillations. The PSBD Headphones were more prone to low-frequency artifacts compared to the PSBD Headband, yet recorded modulations in the alpha power and had a strong alignment with the NVX at the higher EEG frequencies. The Muse Headband had several limitations in signal quality.

Discussion

We suggest that while dry-electrode technology appears to be appropriate for the EEG rhythm-based applications, the potential benefits of these technologies in terms of ease of use and accessibility should be carefully weighed against the capacity of each given system.

A Window Into the Tired Brain: Neurophysiological Dynamics of Visuospatial Working Memory Under Fatigue

OBJECTIVE

We examine the spatiotemporal dynamics of neural activity and its correlates in heart rate and its variability (HR/HRV) during a fatiguing visuospatial working memory task.

BACKGROUND

The neural and physiological drivers of fatigue are complex, coupled, and poorly understood. Investigations that combine the fidelity of neural indices and the field-readiness of physiological measures can facilitate measurements of fatigue states in operational settings.

METHOD

Sixteen healthy adults, balanced by sex, completed a 60-minute fatiguing visuospatial working memory task. Changes in task performance, subjective measures of effort and fatigue, cerebral hemodynamics, and HR/HRV were analyzed. Peak brain activation, functional and effective connections within relevant brain networks were contrasted against spectral and temporal features of HR/HRV.

RESULTS

Task performance elicited increased neural activation in regions responsible for maintaining working memory capacity. With the onset of time-on-task effects, resource utilization was seen to increase beyond task-relevant networks. Over time, functional connections in the prefrontal cortex were seen to weaken, with changes in the causal relationships between key regions known to drive working memory. HR/HRV indices were seen to closely follow activity in the prefrontal cortex.

CONCLUSION

This investigation provided a window into the neurophysiological underpinnings of working memory under the time-on-task effect. HR/HRV was largely shown to mirror changes in cortical networks responsible for working memory, therefore supporting the possibility of unobtrusive state recognition under ecologically valid conditions.

APPLICATIONS

Findings here can inform the development of a fieldable index for cognitive fatigue.

Self-Attentive Channel-Connectivity Capsule Network for EEG-Based Driving Fatigue Detection

Deep neural networks have recently been successfully extended to EEG-based driving fatigue detection. Nevertheless, most existing models fail to reveal the intrinsic inter-channel relations that are known to be beneficial for EEG-based classification. Additionally, these models require substantial data for training, which is often impractical due to the high cost of data collection. To simultaneously address these two issues, we propose a Self-Attentive Channel-Connectivity Capsule Network (SACC-CapsNet) for EEG-based driving fatigue detection in this paper. SACC-CapsNet starts with a temporal-channel attention module to investigate the critical temporal information and important channels for driving fatigue detection, refining the input EEG signals. Subsequently, the refined EEG data are transformed into a channel covariance matrix to capture the inter-channel relations, followed by selective kernel attention to extract the highly discriminative channel-connectivity features. Finally, a capsule neural network is employed to effectively learn the relationships between connectivity features, which is more suitable for limited data. To confirm the effectiveness of SACC-CapsNet, we collected 24-channel EEG data from 31 subjects (mean age=23.13±2.68 years, male/female=18/13) in a simulated fatigue driving environment. Extensive experiments were conducted with the acquired data, and the comparison results show that our proposed model outperforms state-of-the-art methods. Additionally, the channel covariance matrix learned from SACC-CapsNet reveals that the frontal pole is most informative for detecting driving fatigue, followed by the parietal and central regions. Intriguingly, the temporal-channel attention module can enhance the significance of these critical regions, and the reconstructed channel covariance matrix generated by the decoder network of SACC-CapsNet can effectively preserve valuable information about them.

Artificial Proprioceptive Reflex Warning Using EMG in Advanced Driving Assistance System

A frequent cause of auto accidents is disregarding the proximal traffic of an ego-vehicle during lane changing. Presumably, in a split-second-decision situation we may prevent an accident by predicting the intention of a driver before her action onset using the neural signals data, meanwhile building the perception of surroundings of a vehicle using optical sensors. The prediction of an intended action fused with the perception can generate an instantaneous signal that may replenish the driver's ignorance about the surroundings. This study examines electromyography (EMG) signals to predict intention of a driver along perception building stack of an autonomous driving system (ADS) in building an advanced driving assistant system (ADAS). EMG are classified into left-turn and right-turn intended actions and lanes and object detection with camera and Lidar are used to detect vehicles approaching from behind. A warning issued before the action onset, can alert a driver and may save her from a fatal accident. The use of neural signals for intended action prediction is a novel addition to camera, radar and Lidar based ADAS systems. Furthermore, the study demonstrates efficacy of the proposed idea with experiments designed to classify online and offline EMG data in real-world settings with computation time and the latency of communicated warnings.

An EEG study of human trust in autonomous vehicles based on graphic theoretical analysis

With the development of autonomous vehicle technology, human-centered transport research will likely shift to the interaction between humans and vehicles. This study focuses on the human trust variation in autonomous vehicles (AVs) as the technology becomes increasingly intelligent. This study uses electroencephalogram data to analyze human trust in AVs during simulated driving conditions. Two driving conditions, the semi-autonomous and the autonomous, which correspond to the two highest levels of automatic driving, are used for the simulation, accompanied by various driving and car conditions. The graph theoretical analysis (GTA) is the primary method for data analysis. In semi-autonomous driving mode, the local efficiency and cluster coefficient are lower in car-normal conditions than in car-malfunction conditions with the car approaching. This finding suggests that the human brain has a strong information processing ability while facing predictable potential hazards. However, when it comes to a traffic light with a car malfunctioning under the semi-autonomous driving mode, the characteristic path length is higher for the car malfunction manifesting a weak information processing ability while facing unpredictable potential hazards. Furthermore, in fully automatic driving conditions, participants cannot do anything and need low-level brain function to take emergency actions as lower local efficiency and small worldness for car malfunction. Our results shed light on the design of the human-machine interaction and human factor engineering on the high level of an autonomous vehicle.

Assessment of 3D Visual Discomfort Based on Dynamic Functional Connectivity Analysis with HMM in EEG

Stereoscopic displays can induce visual discomfort despite their wide application. Electroencephalography (EEG) technology has been applied to assess 3D visual discomfort, because it can capture brain activities with high temporal resolution. Previous studies explored the frequency and temporal features relevant to visual discomfort in EEG data. Recently, it was demonstrated that functional connectivity between brain regions fluctuates with time. However, the relationship between 3D visual discomfort and dynamic functional connectivity (DFC) remains unknown. Although HMM showed advantages over the sliding window method in capturing the temporal fluctuations of DFC at a single time point in functional magnetic resonance imaging (fMRI) data, it is unclear whether HMM works well in revealing the time-varying functional connectivity of EEG data. In this study, the hidden Markov model (HMM) was introduced to DFC analysis of EEG data for the first time and was used to investigate the DFC features that can be used to assess 3D visual discomfort. The results indicated that state 2, with strong connections between electrodes, occurred more frequently in the early period, whereas state 4, with overall weak connections between electrodes, occurred more frequently in the late period for both visual comfort and discomfort stimuli. Moreover, the 3D visual discomfort stimuli caused subjects to stay in state 4 more frequently, especially in the later period, in contrast to the 3D visual comfort stimuli. The results suggest that the increasing occurrence of state 4 was possibly related to visual discomfort and that the occurrence frequency of state 4 may be used to assess visual discomfort.

NDCN-Brain: An Extensible Dynamic Functional Brain Network Model

As an extension of the static network, the dynamic functional brain network can show continuous changes in the brain’s connections. Then, limited by the length of the fMRI signal, it is difficult to show every instantaneous moment in the construction of a dynamic network and there is a lack of effective prediction of the dynamic changes of the network after the signal ends. In this paper, an extensible dynamic brain function network model is proposed. The model utilizes the ability of extracting and predicting the instantaneous state of the dynamic network of neural dynamics on complex networks (NDCN) and constructs a dynamic network model structure that can provide more than the original signal range. Experimental results show that every snapshot in the network obtained by the proposed method has a usable network structure and that it also has a good classification result in the diagnosis of cognitive impairment diseases.

Dynamic Reorganization of Functional Connectivity During Post-break Task Reengagement

Because of the undesired fatigue-related consequences, accumulating efforts have been made to find an effective intervention to alleviate the suboptimal cognitive function caused by mental fatigue. Nonetheless, limitations of intervention and evaluation methods may hinder the revealing of underlying neural mechanisms of fatigue recovery. Through the newly-developed dynamic functional connectivity (FC) analysis framework, this study aims to investigate the effects of two types of mid-task interventions (i.e., rest-break and moderate-intensity exercise-break) on the dynamic reorganization of FC during the execution of psychomotor vigilance test (PVT). Using a sliding window approach, temporal brain networks within each frequency band (i.e., δ, θ, α, & β) were estimated before and immediate after the intervention, and towards the end of the task to investigate the immediate and delayed effects respectively during post-break task reengagement. Behaviourally, similar beneficial effects of exercise- and rest-break on performance were observed, manifested by the immediate improvements after both interventions and a long-lasting influence towards the end of tasks. Moreover, temporal brain networks assessment showed significant immediate decreases of fluctuability, which followed by an increase of fluctuability towards the end of intervention tasks. Furthermore, the temporal nodal measure revealed the channels with significant differences across tasks were mainly resided in the fronto-parietal areas that exhibited interesting frequency-dependent distribution. The observations of immediate and delayed dynamic FC reorganizations extend previous fatigue-related intervention and static FC studies, and provide new insight into the dynamic characteristics of FC during post-break task reengagement.

Driving-Induced Neurological Biomarkers in an Advanced Driver-Assistance System

Physiological signals are immediate and sensitive to neurological changes resulting from the mental workload induced by various driving environments and are considered a quantifying tool for understanding the association between neurological outcomes and driving cognitive workloads. Neurological assessment, outside of a highly-equipped clinical setting, requires an ambulatory electroencephalography (EEG) headset. This study aimed to quantify neurological biomarkers during a resting state and two different scenarios of driving states in a virtual driving environment. We investigated the neurological responses of seventeen healthy male drivers. EEG data were measured in an initial resting state, city-roadways driving state, and expressway driving state using a portable EEG headset in a driving simulator. During the experiment, the participants drove while experiencing cognitive workloads due to various driving environments, such as road traffic conditions, lane changes of surrounding vehicles, the speed limit, etc. The power of the beta and gamma bands decreased, and the power of the delta waves, theta, and frontal theta asymmetry increased in the driving state relative to the resting state. Delta-alpha ratio (DAR) and delta-theta ratio (DTR) showed a strong correlation with a resting state, city-roadways driving state, and expressway driving state. Binary machine-learning (ML) classification models showed a near-perfect accuracy between the resting state and driving state. Moderate classification performances were observed between the resting state, city-roadways state, and expressway state in multi-class classification. An EEG-based neurological state prediction approach may be utilized in an advanced driver-assistance system (ADAS).

Flexible brain transitions between hierarchical network segregation and integration associated with cognitive performance during a multisource interference task

Cognition involves locally segregated and globally integrated processing. This process is hierarchically organized and linked to evidence from hierarchical modules in brain networks. However, researchers have not clearly determined how flexible transitions between these hierarchical processes are associated with cognitive behavior. Here, we designed a multisource interference task (MSIT) and introduced the nested-spectral partition (NSP) method to detect hierarchical modules in brain functional networks. By defining hierarchical segregation and integration across multiple levels, we showed that the MSIT requires higher network segregation in the whole brain and most functional systems but generates higher integration in the control system. Meanwhile, brain networks have more flexible transitions between segregated and integrated configurations in the task state. Crucially, higher functional flexibility in the resting state, less flexibility in the task state and more efficient switching of the brain from resting to task states were associated with better task performance. Our hierarchical modular analysis was more effective at detecting alterations in functional organization and the phenotype of cognitive performance than graph-based network measures at a single level.

Toward practical driving fatigue detection using three frontal EEG channels: a proof-of-concept study

Objective. Although various driving fatigue detection strategies have been introduced, the limited practicability is still an obstacle for the real application of these technologies. This study is based on the newly proposed non-hair-bearing (NHB) method to achieve practical driving fatigue detection with fewer channels from NHB areas and more efficient electroencephalogram (EEG) features.Approach. EEG data were recorded from 20 healthy subjects (15 males, age = 22.2 ± 3.2 years) in a 90 min simulated driving task using a remote wireless cap. Behaviorally, subjects demonstrated a salient fatigue effect, as reflected by a monotonic increase in reaction time. Using a sliding-window approach, we determined the vigilant and fatigued states at individual level to reduce the inter-subject differences in behavioral impairment and brain activity. Multiple EEG features, including power-spectrum density (PSD), functional connectivity (FC), and entropy, were estimated in a pairwise manner, which were set as input for fatigue classification.Main results. Intriguingly, this data-driven approach showed that the best classification performance was achieved using three EEG channel pairs located in the NHB area. The mixed features of the frontal NHB area lead to the high within-subject detection rate of driving fatigue (92.7% ± 0.92%) with satisfactory generalizability for fatigue classification across different subjects (77.13% ± 0.85%). Moreover, we found the most prominent contributing features were PSD of different frequency bands within the frontal NHB area and FC within the frontal NHB area and between frontal and parietal areas.Significance. In summary, the current work provided objective evidence to support the effectiveness of the NHB method and further improved the performance, thereby moving a step forward towards practical driving fatigue detection in real-world scenarios.