1
|
Pi-Ruano M, Fort A, Tejero P, Jallais C, Roca J. Audiovisual messages may improve the processing of traffic information and driver attention during partially automated driving: An EEG study. Cogn Res Princ Implic 2024; 9:61. [PMID: 39256289 PMCID: PMC11387282 DOI: 10.1186/s41235-024-00580-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 07/19/2024] [Indexed: 09/12/2024] Open
Abstract
Partially autonomous vehicles can help minimize human errors. However, being free from some driving subtasks can result in a low vigilance state, which can affect the driver's attention towards the road. The present study first tested whether drivers of partially autonomous vehicles would benefit from the addition of auditory versions of the messages presented in variable message signs (VMS), particularly, when they find themselves in a monotonous driving situation. A second aim was to test whether the addition of auditory messages would also produce an indirect effect on the driver's vigilance, improving performance on other driving subtasks not related to the message processing. Forty-three volunteers participated in a driving simulator study. They completed two tasks: (a) a VMS task, where they had to regain manual control of the car if the VMS message was critical, and (b) a car-following task, where they had to pay attention to the preceding car to respond to occasional brake events. Behavioral and EEG data were registered. Overall, results indicated that the addition of audio messages helped drivers process VMS information more effectively and maintain a higher level of vigilance throughout the driving time. These findings would provide useful information for the development of partially automated vehicles, as their design must guarantee that the driver remains attentive enough to assume control when necessary.
Collapse
Affiliation(s)
- Marina Pi-Ruano
- ERI-Lectura (UVEG), Avenida Blasco Ibáñez, 21, 46010, Valencia, Spain.
- Departamento de Psicología Evolutiva y de la Educación (UVEG), Avenida Blasco Ibáñez, 21, 46010, Valencia, Spain.
| | - Alexandra Fort
- LESCOT (Univ. Eiffel), 25 Avenue François Mitterrand, Case24. Cité Des Mobilités, 69675, Bron Cedex, France
| | - Pilar Tejero
- ERI-Lectura (UVEG), Avenida Blasco Ibáñez, 21, 46010, Valencia, Spain
- Departamento de Psicología Básica (UVEG), Avenida Blasco Ibáñez, 21, 46010, Valencia, Spain
| | - Christophe Jallais
- LESCOT (Univ. Eiffel), 25 Avenue François Mitterrand, Case24. Cité Des Mobilités, 69675, Bron Cedex, France
| | - Javier Roca
- ERI-Lectura (UVEG), Avenida Blasco Ibáñez, 21, 46010, Valencia, Spain
- Departamento de Psicología Evolutiva y de la Educación (UVEG), Avenida Blasco Ibáñez, 21, 46010, Valencia, Spain
| |
Collapse
|
2
|
Löffler BS, Stecher HI, Meiser A, Fudickar S, Hein A, Herrmann CS. Attempting to counteract vigilance decrement in older adults with brain stimulation. FRONTIERS IN NEUROERGONOMICS 2023; 4:1201702. [PMID: 38234473 PMCID: PMC10790873 DOI: 10.3389/fnrgo.2023.1201702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 11/23/2023] [Indexed: 01/19/2024]
Abstract
Introduction Against the background of demographic change and the need for enhancement techniques for an aging society, we set out to repeat a study that utilized 40-Hz transcranial alternating current stimulation (tACS) to counteract the slowdown of reaction times in a vigilance experiment but with participants aged 65 years and older. On an oscillatory level, vigilance decrement is linked to rising occipital alpha power, which has been shown to be downregulated using gamma-tACS. Method We applied tACS on the visual cortex and compared reaction times, error rates, and alpha power of a group stimulated with 40 Hz to a sham and a 5-Hz-stimulated control group. All groups executed two 30-min-long blocks of a visual task and were stimulated according to group in the second block. We hypothesized that the expected increase in reaction times and alpha power would be reduced in the 40-Hz group compared to the control groups in the second block (INTERVENTION). Results Statistical analysis with linear mixed models showed that reaction times increased significantly over time in the first block (BASELINE) with approximately 3 ms/min for the SHAM and 2 ms/min for the 5-Hz and 40-Hz groups, with no difference between the groups. The increase was less pronounced in the INTERVENTION block (1 ms/min for SHAM and 5-Hz groups, 3 ms/min for the 40-Hz group). Differences among groups in the INTERVENTION block were not significant if the 5-Hz or the 40-Hz group was used as the base group for the linear mixed model. Statistical analysis with a generalized linear mixed model showed that alpha power was significantly higher after the experiment (1.37 μV2) compared to before (1 μV2). No influence of stimulation (40 Hz, 5 Hz, or sham) could be detected. Discussion Although the literature has shown that tACS offers potential for older adults, our results indicate that findings from general studies cannot simply be transferred to an old-aged group. We suggest adjusting stimulation parameters to the neurophysiological features expected in this group. Next to heterogeneity and cognitive fitness, the influence of motivation and medication should be considered.
Collapse
Affiliation(s)
- Birte S. Löffler
- Assistance Systems and Medical Device Technology, Department of Health Services Research, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Heiko I. Stecher
- Experimental Psychology Lab, Department of Psychology, European Medical School, Cluster of Excellence “Hearing4all”, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Arnd Meiser
- Experimental Psychology Lab, Department of Psychology, European Medical School, Cluster of Excellence “Hearing4all”, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Sebastian Fudickar
- Assistance Systems and Medical Device Technology, Department of Health Services Research, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Andreas Hein
- Assistance Systems and Medical Device Technology, Department of Health Services Research, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Christoph S. Herrmann
- Experimental Psychology Lab, Department of Psychology, European Medical School, Cluster of Excellence “Hearing4all”, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
- Research Center Neurosensory Science, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| |
Collapse
|
3
|
Choy CS, Fang Q, Neville K, Ding B, Kumar A, Mahmoud SS, Gu X, Fu J, Jelfs B. Virtual reality and motor imagery for early post-stroke rehabilitation. Biomed Eng Online 2023; 22:66. [PMID: 37407988 PMCID: PMC10320905 DOI: 10.1186/s12938-023-01124-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Accepted: 06/05/2023] [Indexed: 07/07/2023] Open
Abstract
BACKGROUND Motor impairment is a common consequence of stroke causing difficulty in independent movement. The first month of post-stroke rehabilitation is the most effective period for recovery. Movement imagination, known as motor imagery, in combination with virtual reality may provide a way for stroke patients with severe motor disabilities to begin rehabilitation. METHODS The aim of this study is to verify whether motor imagery and virtual reality help to activate stroke patients' motor cortex. 16 acute/subacute (< 6 months) stroke patients participated in this study. All participants performed motor imagery of basketball shooting which involved the following tasks: listening to audio instruction only, watching a basketball shooting animation in 3D with audio, and also performing motor imagery afterwards. Electroencephalogram (EEG) was recorded for analysis of motor-related features of the brain such as power spectral analysis in the [Formula: see text] and [Formula: see text] frequency bands and spectral entropy. 18 EEG channels over the motor cortex were used for all stroke patients. RESULTS All results are normalised relative to all tasks for each participant. The power spectral densities peak near the [Formula: see text] band for all participants and also the [Formula: see text] band for some participants. Tasks with instructions during motor imagery generally show greater power spectral peaks. The p-values of the Wilcoxon signed-rank test for band power comparison from the 18 EEG channels between different pairs of tasks show a 0.01 significance of rejecting the band powers being the same for most tasks done by stroke subjects. The motor cortex of most stroke patients is more active when virtual reality is involved during motor imagery as indicated by their respective scalp maps of band power and spectral entropy. CONCLUSION The resulting activation of stroke patient's motor cortices in this study reveals evidence that it is induced by imagination of movement and virtual reality supports motor imagery. The framework of the current study also provides an efficient way to investigate motor imagery and virtual reality during post-stroke rehabilitation.
Collapse
Affiliation(s)
- Chi S. Choy
- School of Engineering, RMIT University, Melbourne, Australia
| | - Qiang Fang
- Department of Biomedical Engineering, Shantou University, Shantou, China
| | - Katrina Neville
- School of Engineering, RMIT University, Melbourne, Australia
| | - Bingrui Ding
- Department of Biomedical Engineering, Shantou University, Shantou, China
| | - Akshay Kumar
- Department of Biomedical Engineering, Shantou University, Shantou, China
| | | | - Xudong Gu
- Rehabilitation Center, Jiaxing 2nd Hospital, Jiaxing, 314000 China
| | - Jianming Fu
- Rehabilitation Center, Jiaxing 2nd Hospital, Jiaxing, 314000 China
| | - Beth Jelfs
- Department of Electrical, Electronic & Systems Engineering, University of Birmingham, Birmingham, UK
| |
Collapse
|
4
|
Wang H, Chen D, Huang Y, Zhang Y, Qiao Y, Xiao J, Xie N, Fan H. Assessment of Vigilance Level during Work: Fitting a Hidden Markov Model to Heart Rate Variability. Brain Sci 2023; 13:brainsci13040638. [PMID: 37190603 DOI: 10.3390/brainsci13040638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 04/02/2023] [Accepted: 04/03/2023] [Indexed: 05/17/2023] Open
Abstract
This study aimed to enhance the real-time performance and accuracy of vigilance assessment by developing a hidden Markov model (HMM). Electrocardiogram (ECG) signals were collected and processed to remove noise and baseline drift. A group of 20 volunteers participated in the study. Their heart rate variability (HRV) was measured to train parameters of the modified hidden Markov model for a vigilance assessment. The data were collected to train the model using the Baum-Welch algorithm and to obtain the state transition probability matrix A^ and the observation probability matrix B^. Finally, the data of three volunteers with different transition patterns of mental state were selected randomly and the Viterbi algorithm was used to find the optimal state, which was compared with the actual state. The constructed vigilance assessment model had a high accuracy rate, and the accuracy rate of data prediction for these three volunteers exceeded 80%. Our approach can be used in wearable products to improve their vigilance level assessment functionality or in other fields that have key positions with high concentration requirements and monotonous repetitive work.
Collapse
Affiliation(s)
- Hanyu Wang
- Key Laboratory for Industrial Design and Ergonomics of Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an 710072, China
| | - Dengkai Chen
- Key Laboratory for Industrial Design and Ergonomics of Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an 710072, China
| | - Yuexin Huang
- Key Laboratory for Industrial Design and Ergonomics of Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an 710072, China
- Design Conceptualization and Communication, Faculty of Industrial Design Engineering, Delft University of Technology, 2628 CE Delft, The Netherlands
| | - Yahan Zhang
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University, Shanghai 200080, China
| | - Yidan Qiao
- Key Laboratory for Industrial Design and Ergonomics of Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an 710072, China
| | - Jianghao Xiao
- Key Laboratory for Industrial Design and Ergonomics of Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an 710072, China
| | - Ning Xie
- Key Laboratory for Industrial Design and Ergonomics of Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an 710072, China
| | - Hao Fan
- Institute of Modern Industrial Design, Zhejiang University, Hangzhou 310007, China
| |
Collapse
|
5
|
Effects of Auditory Pre-Stimulation on Cognitive Task Performance in a Noisy Environment. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12125823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
The accident rate due to human errors in industrial fields has been consistently high over the past few decades, and noise has been emerging as one of the main causes of human errors. In recent years, auditory pre-stimulation has been considered as a means of preventing human errors by improving workers’ cognitive task performance. However, most previous studies demonstrated the effectiveness of the auditory pre-stimulation in a quiet environment. Accordingly, studies on the effects of pre-stimulation in a noisy environment are still lacking. Therefore, this study aimed to empirically investigate: (1) the effects of noisy environments on the performances of cognitive tasks related to different functions of working memory and (2) the effects of auditory pre-stimulation on the performances of cognitive tasks in a field-noise environment. To accomplish these research objectives, two major experiments were conducted. In the first experiment, a total of 24 participants performed each of three basic short-term/working memory (STM/WM) tasks under two different experimental conditions (quiet-noise environment and field-noise environment) depending on the presence or absence of field noise. In the second experiment, the participants performed each of the three basic STM/WM tasks in a field-noise environment after they were provided with one of four different auditory pre-stimulations (quiet noise, white noise, field noise, and mixed (white and field) noise). The three STM/WM tasks were the Corsi block-tapping, Digit span, and 3-back tasks, corresponding to the visuospatial sketchpad, the phonological loop, and the central executive of WM, respectively. The major findings were that: (1) the field-noise environment did not affect the scores of the Corsi block-tapping and 3-back tasks, significantly affecting only the Digit span task score (decreased by 15.2%, p < 0.01); and (2) the Digit span task performance in the field-noise environment was improved by 17.9% (p < 0.05) when mixed noise was provided as a type of auditory pre-stimulation. These findings may be useful for the work-space designs that prevent/minimize human errors and industrial accidents by improving the cognitive task performance of workers in field-noise environments.
Collapse
|
6
|
Al-Ezzi A, Al-Shargabi AA, Al-Shargie F, Zahary AT. Complexity Analysis of EEG in Patients With Social Anxiety Disorder Using Fuzzy Entropy and Machine Learning Techniques. IEEE ACCESS 2022; 10:39926-39938. [DOI: 10.1109/access.2022.3165199] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2024]
Affiliation(s)
- Abdulhakim Al-Ezzi
- Electrical and Electronic Engineering Department, Centre for Intelligent Signal and Imaging Research (CISIR), Universiti Teknologi PETRONAS, Bandar, Seri Iskandar, Perak, Malaysia
| | - Amal A. Al-Shargabi
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| | - Fares Al-Shargie
- Department of Electrical Engineering, American University of Sharjah, Sharjah, United Arab Emirates
| | - Ammar T. Zahary
- Department of Computer Science, Faculty of Computing and IT, University of Science and Technology, Sana’a, Yemen
| |
Collapse
|
7
|
Hassanin O, Al-Shargie F, Tariq U, Al-Nashash H. Asymmetry of Regional Phase Synchrony Cortical Networks Under Cognitive Alertness and Vigilance Decrement States. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2378-2387. [PMID: 34735348 DOI: 10.1109/tnsre.2021.3125420] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This study investigates intra-regional connectivity and regional hemispheric asymmetry under two vigilance states: alertness and vigilance decrement. The vigilance states were induced on nine healthy subjects while performing 30 min in-congruent Stroop color-word task (I-SCWT). We measured brain activity using Electroencephalography (EEG) signals with 64-channels. We quantified the regional network connectivity using the phase-locking value (PLV) with graph theory analysis (GTA) and Support Vector Machines (SVM). Results showed that the vigilance decrement state was associated with impaired information processing within the frontal and central regions in delta and theta frequency bands. Meanwhile, the hemispheric asymmetry results showed that the laterality shifted to the right-temporal in delta, right-central, parietal, and left frontal in theta, right-frontal and left-central, temporal and parietal in alpha, and right-parietal and left temporal in beta frequency bands. These findings represent the first demonstration of intra-regional connectivity and hemispheric asymmetry changes as a function of cognitive vigilance states. The overall results showed that vigilance decrement is region and frequency band-specific. Our SVM model achieved the highest classification accuracy of 99.73% in differentiating between the two vigilance states based on the frontal and central connectivity networks measures.
Collapse
|
8
|
Katmah R, Al-Shargie F, Tariq U, Babiloni F, Al-Mughairbi F, Al-Nashash H. A Review on Mental Stress Assessment Methods Using EEG Signals. SENSORS (BASEL, SWITZERLAND) 2021; 21:5043. [PMID: 34372280 PMCID: PMC8347831 DOI: 10.3390/s21155043] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/13/2021] [Accepted: 07/19/2021] [Indexed: 01/19/2023]
Abstract
Mental stress is one of the serious factors that lead to many health problems. Scientists and physicians have developed various tools to assess the level of mental stress in its early stages. Several neuroimaging tools have been proposed in the literature to assess mental stress in the workplace. Electroencephalogram (EEG) signal is one important candidate because it contains rich information about mental states and condition. In this paper, we review the existing EEG signal analysis methods on the assessment of mental stress. The review highlights the critical differences between the research findings and argues that variations of the data analysis methods contribute to several contradictory results. The variations in results could be due to various factors including lack of standardized protocol, the brain region of interest, stressor type, experiment duration, proper EEG processing, feature extraction mechanism, and type of classifier. Therefore, the significant part related to mental stress recognition is choosing the most appropriate features. In particular, a complex and diverse range of EEG features, including time-varying, functional, and dynamic brain connections, requires integration of various methods to understand their associations with mental stress. Accordingly, the review suggests fusing the cortical activations with the connectivity network measures and deep learning approaches to improve the accuracy of mental stress level assessment.
Collapse
Affiliation(s)
- Rateb Katmah
- Biomedical Engineering Graduate Program, American University of Sharjah, Sharjah 26666, United Arab Emirates;
| | - Fares Al-Shargie
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Usman Tariq
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Fabio Babiloni
- Department of Molecular Medicine, University of Sapienza Rome, 00185 Rome, Italy;
- College Computer Science and Technology, University Hangzhou Dianzi, Hangzhou 310018, China
| | - Fadwa Al-Mughairbi
- College of Medicines and Health Sciences, United Arab Emirates University, Al-Ain 15551, United Arab Emirates;
| | - Hasan Al-Nashash
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| |
Collapse
|