EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation

Classification of mental workload with EEG analysis by using effective connectivity and a hybrid model of CNN and LSTM

Estimation of mental workload from electroencephalogram (EEG) signals aims to accurately measure the cognitive demands placed on an individual during multitasking mental activities. By analyzing the brain activity of the subject, we can determine the level of mental effort required to perform a task and optimize the workload to prevent cognitive overload or underload. This information can be used to enhance performance and productivity in various fields such as healthcare, education, and aviation. In this paper, we propose a method that uses EEG and deep neural networks to estimate the mental workload of human subjects during multitasking mental activities. Notably, our proposed method employs subject-independent classification. We use the "STEW" dataset, which consists of two tasks, namely "No task" and "simultaneous capacity (SIMKAP)-based multitasking activity". We estimate the different workload levels of two tasks using a composite framework consisting of brain connectivity and deep neural networks. After the initial preprocessing of EEG signals, an analysis of the relationships between the 14 EEG channels is conducted to evaluate effective brain connectivity. This assessment illustrates the information flow between various brain regions, utilizing the direct Directed Transfer Function (dDTF) method. Then, we propose a deep hybrid model based on pre-trained Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) for the classification of workload levels. The accuracy of the proposed deep model achieved 83.12% according to the subject-independent leave-subject-out (LSO) approach. The pre-trained CNN + LSTM approaches to EEG data have been found to be an accurate method for assessing the mental workload.

Rapid Mental Workload Detection of Air Traffic Controllers with Three EEG Sensors

Air traffic controllers' mental workload significantly impacts their operational efficiency and safety. Detecting their mental workload rapidly and accurately is crucial for preventing aviation accidents. This study introduces a mental workload detection model for controllers based on power spectrum features related to gamma waves. The model selects the feature with the highest classification accuracy, β + θ + α + γ, and utilizes the mRMR (Max-Relevance and Min-Redundancy) algorithm for channel selection. Furthermore, the channels that were less affected by ICA processing were identified, and the reliability of this result was demonstrated by artifact analysis brought about by EMG, ECG, etc. Finally, a model for rapid mental workload detection for controllers was developed and the detection rate for the 34 subjects reached 1, and the accuracy for the remaining subjects was as low as 0.986. In conclusion, we validated the usability of the mRMR algorithm in channel selection and proposed a rapid method for detecting mental workload in air traffic controllers using only three EEG channels. By reducing the number of EEG channels and shortening the data processing time, this approach simplifies equipment application and maintains detection accuracy, enhancing practical usability.

Soft computing applications in the field of human factors and ergonomics: A review of the past decade of research

The main objectives of this study were to 1) review the literature on the applications of soft computing concepts to the field of human factors and ergonomics (HFE) between 2013 and 2022 and 2) highlight future developments and trends. Multiple soft computing methods and techniques have been investigated for their ability to address various applications in HFE effectively. These techniques include fuzzy logic, artificial neural networks, genetic algorithms, and their combinations. Applications of these methods in HFE have been highlighted in one hundred and four articles selected from 406 papers. The results of this study help address the challenges of complexity, vagueness, and imprecision in human factors and ergonomics research through the application of soft computing methodologies.

Survey on the research direction of EEG-based signal processing

Electroencephalography (EEG) is increasingly important in Brain-Computer Interface (BCI) systems due to its portability and simplicity. In this paper, we provide a comprehensive review of research on EEG signal processing techniques since 2021, with a focus on preprocessing, feature extraction, and classification methods. We analyzed 61 research articles retrieved from academic search engines, including CNKI, PubMed, Nature, IEEE Xplore, and Science Direct. For preprocessing, we focus on innovatively proposed preprocessing methods, channel selection, and data augmentation. Data augmentation is classified into conventional methods (sliding windows, segmentation and recombination, and noise injection) and deep learning methods [Generative Adversarial Networks (GAN) and Variation AutoEncoder (VAE)]. We also pay attention to the application of deep learning, and multi-method fusion approaches, including both conventional algorithm fusion and fusion between conventional algorithms and deep learning. Our analysis identifies 35 (57.4%), 18 (29.5%), and 37 (60.7%) studies in the directions of preprocessing, feature extraction, and classification, respectively. We find that preprocessing methods have become widely used in EEG classification (96.7% of reviewed papers) and comparative experiments have been conducted in some studies to validate preprocessing. We also discussed the adoption of channel selection and data augmentation and concluded several mentionable matters about data augmentation. Furthermore, deep learning methods have shown great promise in EEG classification, with Convolutional Neural Networks (CNNs) being the main structure of deep neural networks (92.3% of deep learning papers). We summarize and analyze several innovative neural networks, including CNNs and multi-structure fusion. However, we also identified several problems and limitations of current deep learning techniques in EEG classification, including inappropriate input, low cross-subject accuracy, unbalanced between parameters and time costs, and a lack of interpretability. Finally, we highlight the emerging trend of multi-method fusion approaches (49.2% of reviewed papers) and analyze the data and some examples. We also provide insights into some challenges of multi-method fusion. Our review lays a foundation for future studies to improve EEG classification performance.

Influencing factors and mechanism of high-speed railway passenger overall comfort: Insights from source functional brain network and subjective report

Overall comfort is the priority for the high-speed railway (HSR) passengers, while its influencing factors and mechanism are not yet apparent. According to the source functional brain network and subjective report, this study revealed the potential influencing factors and mechanisms of passengers overall comfort in high-speed railway environments. Here, an ergonomics field test with 20 subjects was conducted where subjective reports and electroencephalography (EEG) were collected. The electric-source imaging and functional connectivity were used to build the source functional brain network from EEG and network indices were extracted. Statistics analysis results showed that static comfort played the most critical role in the overall comfort, followed by emotional valence, emotional arousal, aural pressure comfort, vibration comfort, and noise comfort. Thermal and visual comfort were insignificant due to the well-designed heating, ventilation, and air conditioning (HVAC) and lighting system of HSR. In addition, the source functional brain network of passengers who felt uncomfortable had the higher clustering coefficient, assortativity coefficient and global efficiency, which meant greater activation of brain compared with passengers who were in a state of comfort. According to the local attributes indices analysis, most key brain regions were located in the frontal and hippocampus, which revealed emotion and spatial perception contribute to the whole comfort degradation process. This work proposed novel insights into HSR passengers overall comfort according to subjective and objective methods. Our findings demonstrate emotional regulation and seat improvements are key factors for future improvement of HSR passengers overall comfort.

The Application of Electroencephalogram in Driving Safety: Current Status and Future Prospects

The driver is one of the most important factors in the safety of the transportation system. The driver's perceptual characteristics are closely related to driving behavior, while electroencephalogram (EEG) as the gold standard for evaluating human perception is non-deceptive. It is essential to study driving characteristics by analyzing the driver's brain activity pattern, effectively acquiring driver perceptual characteristics, creating a direct connection between the driver's brain and external devices, and realizing information interchange. This paper first introduces the theories related to EEG, then reviews the applications of EEG in scenarios such as fatigue driving, distracted driving, and emotional driving. The limitations of existing research have been identified and the prospect of EEG application in future brain-computer interface automotive assisted driving systems have been proposed. This review provides guidance for researchers to use EEG to improve driving safety. It also offers valuable suggestions for future research.