1
|
Qi G, Liu R, Guan W, Huang A. Augmented Recognition of Distracted Driving State Based on Electrophysiological Analysis of Brain Network. CYBORG AND BIONIC SYSTEMS 2024; 5:0130. [PMID: 38966123 PMCID: PMC11222012 DOI: 10.34133/cbsystems.0130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 04/25/2024] [Indexed: 07/06/2024] Open
Abstract
In this study, we propose an electrophysiological analysis-based brain network method for the augmented recognition of different types of distractions during driving. Driver distractions, such as cognitive processing and visual disruptions during driving, lead to distinct alterations in the electroencephalogram (EEG) signals and the extracted brain networks. We designed and conducted a simulated experiment comprising 4 distracted driving subtasks. Three connectivity indices, including both linear and nonlinear synchronization measures, were chosen to construct the brain network. By computing connectivity strengths and topological features, we explored the potential relationship between brain network configurations and states of driver distraction. Statistical analysis of network features indicates substantial differences between normal and distracted states, suggesting a reconfiguration of the brain network under distracted conditions. Different brain network features and their combinations are fed into varied machine learning classifiers to recognize the distracted driving states. The results indicate that XGBoost demonstrates superior adaptability, outperforming other classifiers across all selected network features. For individual networks, features constructed using synchronization likelihood (SL) achieved the highest accuracy in distinguishing between cognitive and visual distraction. The optimal feature set from 3 network combinations achieves an accuracy of 95.1% for binary classification and 88.3% for ternary classification of normal, cognitively distracted, and visually distracted driving states. The proposed method could accomplish the augmented recognition of distracted driving states and may serve as a valuable tool for further optimizing driver assistance systems with distraction control strategies, as well as a reference for future research on the brain-computer interface in autonomous driving.
Collapse
Affiliation(s)
- Geqi Qi
- Key Laboratory of Transport Industry of Big Data Application Technologies for Comprehensive Transport, Ministry of Transport,
Beijing Jiaotong University, Beijing, China
- Key Laboratory of Brain-Machine Intelligence for Information Behavior—Ministry of Education,
Shanghai International Studies University, Shanghai, China
| | - Rui Liu
- Key Laboratory of Transport Industry of Big Data Application Technologies for Comprehensive Transport, Ministry of Transport,
Beijing Jiaotong University, Beijing, China
| | - Wei Guan
- Key Laboratory of Transport Industry of Big Data Application Technologies for Comprehensive Transport, Ministry of Transport,
Beijing Jiaotong University, Beijing, China
- School of Systems Science,
Beijing Jiaotong University, Beijing, China
| | - Ailing Huang
- Key Laboratory of Transport Industry of Big Data Application Technologies for Comprehensive Transport, Ministry of Transport,
Beijing Jiaotong University, Beijing, China
| |
Collapse
|
2
|
Liang J, Wang Z, Han J, Zhang L. EEG-based driving intuition and collision anticipation using joint temporal-frequency multi-layer dynamic brain network. Front Neurosci 2024; 18:1421010. [PMID: 38988769 PMCID: PMC11233801 DOI: 10.3389/fnins.2024.1421010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Accepted: 06/12/2024] [Indexed: 07/12/2024] Open
Abstract
Intuition plays a crucial role in human driving decision-making, and this rapid and unconscious cognitive process is essential for improving traffic safety. We used the first proposed multi-layer network analysis method, "Joint Temporal-Frequency Multi-layer Dynamic Brain Network" (JTF-MDBN), to study the EEG data from the initial and advanced phases of driving intuition training in the theta, alpha, and beta bands. Additionally, we conducted a comparative study between these two phases using multi-layer metrics as well as local and global metrics of single layers. The results show that brain region activity is more stable in the advanced phase of intuition training compared to the initial phase. Particularly in the alart state task, the JTF-MDBN demonstrated stronger connection strength. Multi-layer network analysis indicates that modularity is significantly higher for the non-alert state task than the alert state task in the alpha and beta bands. In the W4 time window (1 second before a collision), we identified significant features that can differentiate situations where a car collision is imminent from those where no collision occurs. Single-layer network analysis also revealed statistical differences in node strength and local efficiency for some EEG channels in the alpha and beta bands during the W4 and W5 time windows. Using these biomarkers to predict vehicle collision risk, the classification accuracy of a linear kernel SVM reached up to 87.5%, demonstrating the feasibility of predicting driving collisions through brain network biomarkers. These findings are important for the study of human intuition and the development of brain-computer interface-based intelligent driving hazard perception assistance systems.
Collapse
Affiliation(s)
- Jialong Liang
- Academy for Engineering and Technology, Fudan University, Shanghai, China
| | - Zhe Wang
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Engineering Research Center of AI and Robotics, Fudan University, Shanghai, China
| | - Jinghang Han
- School of Data Science, Fudan University, Shanghai, China
| | - Lihua Zhang
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Engineering Research Center of AI and Robotics, Fudan University, Shanghai, China
| |
Collapse
|
3
|
Sengupta P, Lakshminarayanan K. Cortical activation and BCI performance during brief tactile imagery: A comparative study with motor imagery. Behav Brain Res 2024; 459:114760. [PMID: 37979923 DOI: 10.1016/j.bbr.2023.114760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 11/06/2023] [Accepted: 11/11/2023] [Indexed: 11/20/2023]
Abstract
Brain-computer interfaces (BCIs) rely heavily on motor imagery (MI) for operation, yet tactile imagery (TI) presents a novel approach that may be advantageous in situations where visual feedback is impractical. The current study aimed to compare the cortical activity and digit classification performance induced by TI and MI to assess the viability of TI for use in BCIs. Twelve right-handed participants engaged in trials of TI and MI, focusing on their left and right index digits. Event-related desynchronization (ERD) in the mu and beta bands was analyzed, and classification accuracy was determined through an artificial neural network (ANN). Comparable ERD patterns were observed in both TI and MI, with significant decreases in ERD during imagery tasks. The ANN demonstrated high classification accuracy, with TI achieving a mean±SD of 79.30 ± 3.91 % and MI achieving 81.10 ± 2.96 %, with no significant difference between the two (p = 0.11). The study found that TI induces substantial ERD comparable to MI and maintains high classification accuracy, supporting its potential as an effective mental strategy for BCIs. This suggests that TI could be a valuable alternative in BCI applications, particularly for individuals unable to rely on visual cues.
Collapse
Affiliation(s)
- Puja Sengupta
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Technology, School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Kishor Lakshminarayanan
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Technology, School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.
| |
Collapse
|
4
|
Ju U. Task and Resting-State Functional Connectivity Predict Driving Violations. Brain Sci 2023; 13:1236. [PMID: 37759837 PMCID: PMC10526865 DOI: 10.3390/brainsci13091236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 08/17/2023] [Accepted: 08/22/2023] [Indexed: 09/29/2023] Open
Abstract
Aberrant driving behaviors cause accidents; however, there is a lack of understanding of the neural mechanisms underlying these behaviors. To address this issue, a task and resting-state functional connectivity was used to predict aberrant driving behavior and associated personality traits. The study included 29 right-handed participants with driving licenses issued for more than 1 year. During the functional magnetic resonance imaging experiment, participants first recorded their resting state and then watched a driving video while continuously rating the risk and speed on each block. Functional connectome-based predictive modeling was employed for whole brain tasks and resting-state functional connectivity to predict driving behavior (violation, error, and lapses), sensation-seeking, and impulsivity. Resting state and task-based functional connectivity were found to significantly predict driving violations, with resting state significantly predicting lapses and task-based functional connectivity showing a tendency to predict errors. Conversely, neither impulsivity nor sensation-seeking was associated with functional connectivity. The results suggest a significant association between aberrant driving behavior, but a nonsignificant association between impulsivity and sensation-seeking, and task-based or resting state functional connectivity. This could provide a deeper understanding of the neural processing underlying reckless driving that may ultimately be used to prevent accidents.
Collapse
Affiliation(s)
- Uijong Ju
- Department of Information Display, Kyung Hee University, Seoul 02447, Republic of Korea
| |
Collapse
|
5
|
Jiang Y, Zhang X, Guo Z, Jiang N. Altered functional connectivity during visual working memory state in patients with mild cognitive impairment. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082612 DOI: 10.1109/embc40787.2023.10340865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Patients with mild cognitive impairment (MCI) suffer from severe memory function impairment, especially working memory [1]. Based on Electroencephalogram (EEG), this study used power spectral density and large-scale network analysis to reveal the frequency changes of brain areas and the diverse network patterns during the visual WM coding stages between MCI and normal controls (NC). The results showed, compared to NC, the left and right prefrontal lobes and central regions has significant synchronization in the θ frequency band, while the left temporal lobe has significant desynchronization during the working memory coding state among MCI. Brain network analysis revealed the diverse network patterns during the WM coding stage between two group. Compared with the NC, the brain of MCI patients reduced the top-down visual network connection flow derived from frontal lobe to parietal lobe, and recruited a more up-down mechanism with a much stronger information flow from frontal lobe to occipital lobe during the WM coding state. This result provides a new perspective for the neural mechanism of WM deficits in MCI patients.Clinical Relevance-Abnormal EEG rhythm and connectivity of brain regions may be important indicators of WM disorders in patients with MCI.
Collapse
|
6
|
Zhu S, Yang J, Ding P, Wang F, Gong A, Fu Y. Optimization of SSVEP-BCI Virtual Reality Stereo Stimulation Parameters Based on Knowledge Graph. Brain Sci 2023; 13:brainsci13050710. [PMID: 37239182 DOI: 10.3390/brainsci13050710] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 04/16/2023] [Accepted: 04/20/2023] [Indexed: 05/28/2023] Open
Abstract
The steady-state visually evoked potential (SSVEP) is an important type of BCI that has various potential applications, including in virtual environments using virtual reality (VR). However, compared to VR research, the majority of visual stimuli used in the SSVEP-BCI are plane stimulation targets (PSTs), with only a few studies using stereo stimulation targets (SSTs). To explore the parameter optimization of the SSVEP-BCI virtual SSTs, this paper presents a parameter knowledge graph. First, an online VR stereoscopic stimulation SSVEP-BCI system is built, and a parameter dictionary for VR stereoscopic stimulation parameters (shape, color, and frequency) is established. The online experimental results of 10 subjects under different parameter combinations were collected, and a knowledge graph was constructed to optimize the SST parameters. The best classification performances of the shape, color, and frequency parameters were sphere (91.85%), blue (94.26%), and 13Hz (95.93%). With various combinations of virtual reality stereo stimulation parameters, the performance of the SSVEP-BCI varies. Using the knowledge graph of the stimulus parameters can help intuitively and effectively select appropriate SST parameters. The knowledge graph of the stereo target stimulation parameters presented in this work is expected to offer a way to convert the application of the SSVEP-BCI and VR.
Collapse
Affiliation(s)
- Shixuan Zhu
- School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650032, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650032, China
| | - Jingcheng Yang
- School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650032, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650032, China
| | - Peng Ding
- School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650032, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650032, China
| | - Fan Wang
- School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650032, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650032, China
| | - Anmin Gong
- College of Information Engineering, Engineering University of PAP, Xi'an 710018, China
| | - Yunfa Fu
- School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650032, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650032, China
| |
Collapse
|
7
|
Lakshminarayanan K, Shah R, Daulat SR, Moodley V, Yao Y, Sengupta P, Ramu V, Madathil D. Evaluation of EEG Oscillatory Patterns and Classification of Compound Limb Tactile Imagery. Brain Sci 2023; 13:brainsci13040656. [PMID: 37190621 DOI: 10.3390/brainsci13040656] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 04/10/2023] [Accepted: 04/12/2023] [Indexed: 05/17/2023] Open
Abstract
Objective: The purpose of this study was to investigate the cortical activity and digit classification performance during tactile imagery (TI) of a vibratory stimulus at the index, middle, and thumb digits within the left hand in healthy individuals. Furthermore, the cortical activities and classification performance of the compound TI were compared with similar compound motor imagery (MI) with the same digits as TI in the same subjects. Methods: Twelve healthy right-handed adults with no history of upper limb injury, musculoskeletal condition, or neurological disorder participated in the study. The study evaluated the event-related desynchronization (ERD) response and brain-computer interface (BCI) classification performance on discriminating between the digits in the left-hand during the imagery of vibrotactile stimuli to either the index, middle, or thumb finger pads for TI and while performing a motor activity with the same digits for MI. A supervised machine learning technique was applied to discriminate between the digits within the same given limb for both imagery conditions. Results: Both TI and MI exhibited similar patterns of ERD in the alpha and beta bands at the index, middle, and thumb digits within the left hand. While TI had significantly lower ERD for all three digits in both bands, the classification performance of TI-based BCI (77.74 ± 6.98%) was found to be similar to the MI-based BCI (78.36 ± 5.38%). Conclusions: The results of this study suggest that compound tactile imagery can be a viable alternative to MI for BCI classification. The study contributes to the growing body of evidence supporting the use of TI in BCI applications, and future research can build on this work to explore the potential of TI-based BCI for motor rehabilitation and the control of external devices.
Collapse
Affiliation(s)
- Kishor Lakshminarayanan
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Engineering, School of Electronics Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Rakshit Shah
- Department of Chemical and Biomedical Engineering, Cleveland State University, Cleveland, OH 44115, USA
| | - Sohail R Daulat
- Department of Physiology, University of Arizona College of Medicine, Tucson, AZ 85724, USA
| | - Viashen Moodley
- Arizona Center for Hand to Shoulder Surgery, Phoenix, AZ 85004, USA
| | - Yifei Yao
- Soft Tissue Biomechanics Laboratory, Med-X Research Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, China
| | - Puja Sengupta
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Engineering, School of Electronics Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Vadivelan Ramu
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Engineering, School of Electronics Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Deepa Madathil
- Jindal Institute of Behavioral Sciences, O. P. Jindal Global University, Sonipat 131001, Haryana, India
| |
Collapse
|
8
|
Nguyen KH, Ebbatson M, Tran Y, Craig A, Nguyen H, Chai R. Source-Space Brain Functional Connectivity Features in Electroencephalogram-Based Driver Fatigue Classification. SENSORS (BASEL, SWITZERLAND) 2023; 23:2383. [PMID: 36904587 PMCID: PMC10007183 DOI: 10.3390/s23052383] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 02/10/2023] [Accepted: 02/19/2023] [Indexed: 06/18/2023]
Abstract
This study examined the brain source space functional connectivity from the electroencephalogram (EEG) activity of 48 participants during a driving simulation experiment where they drove until fatigue developed. Source-space functional connectivity (FC) analysis is a state-of-the-art method for understanding connections between brain regions that may indicate psychological differences. Multi-band FC in the brain source space was constructed using the phased lag index (PLI) method and used as features to train an SVM classification model to classify driver fatigue and alert conditions. With a subset of critical connections in the beta band, a classification accuracy of 93% was achieved. Additionally, the source-space FC feature extractor demonstrated superiority over other methods, such as PSD and sensor-space FC, in classifying fatigue. The results suggested that source-space FC is a discriminative biomarker for detecting driving fatigue.
Collapse
Affiliation(s)
- Khanh Ha Nguyen
- School of Science, Computing and Engineering Technologies, Swinburne University of Technology, Melbourne, VIC 3122, Australia
| | - Matthew Ebbatson
- School of Engineering, Swinburne University of Technology, Melbourne, VIC 3122, Australia
| | - Yvonne Tran
- Department of Linguistics, Macquarie University Hearing, Macquarie University, Sydney, NSW 2109, Australia
| | - Ashley Craig
- Faculty of Medicine and Health, The University of Sydney, Sydney, NSW 2006, Australia
- John Walsh Centre for Rehabilitation Research, Kolling Institute, Northern Sydney Local Health District, St Leonards, Sydney, NSW 2065, Australia
| | - Hung Nguyen
- School of Science, Computing and Engineering Technologies, Swinburne University of Technology, Melbourne, VIC 3122, Australia
| | - Rifai Chai
- School of Science, Computing and Engineering Technologies, Swinburne University of Technology, Melbourne, VIC 3122, Australia
| |
Collapse
|