1
|
Jiang M, Chaichanasittikarn O, Seet M, Ng D, Vyas R, Saini G, Dragomir A. Modulating Driver Alertness via Ambient Olfactory Stimulation: A Wearable Electroencephalography Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:1203. [PMID: 38400361 PMCID: PMC10892239 DOI: 10.3390/s24041203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 01/31/2024] [Accepted: 02/07/2024] [Indexed: 02/25/2024]
Abstract
Poor alertness levels and related changes in cognitive efficiency are common when performing monotonous tasks such as extended driving. Recent studies have investigated driver alertness decrement and possible strategies for modulating alertness with the goal of improving reaction times to safety critical events. However, most studies rely on subjective measures in assessing alertness changes, while the use of olfactory stimuli, which are known to be strong modulators of cognitive states, has not been commensurately explored in driving alertness settings. To address this gap, in the present study we investigated the effectiveness of olfactory stimuli in modulating the alertness state of drivers and explored the utility of electroencephalography (EEG) in developing objective brain-based tools for assessing the resulting changes in cortical activity. Olfactory stimulation induced a significant differential effect on braking reaction time. The corresponding effect to the cortical activity was characterized using EEG-derived metrics and the devised machine learning framework yielded a high discriminating accuracy (92.1%). Furthermore, neural activity in the alpha frequency band was found to be significantly associated with the observed drivers' behavioral changes. Overall, our results demonstrate the potential of olfactory stimuli to modulate the alertness state and the efficiency of EEG in objectively assessing the resulting cognitive changes.
Collapse
Affiliation(s)
- Mengting Jiang
- N.1 Institute for Health, National University of Singapore, 28 Medical Drive, #05-COR, Singapore 117456, Singapore
- Laboratoire des Systèmes Perceptifs, Département d’Études Cognitives, École Normale Supérieure, PSL University, CNRS, 75005 Paris, France
| | - Oranatt Chaichanasittikarn
- N.1 Institute for Health, National University of Singapore, 28 Medical Drive, #05-COR, Singapore 117456, Singapore
| | - Manuel Seet
- N.1 Institute for Health, National University of Singapore, 28 Medical Drive, #05-COR, Singapore 117456, Singapore
| | - Desmond Ng
- International Operations, Procter & Gamble, 70 Biopolis Street, Singapore 138547, Singapore
| | - Rahul Vyas
- International Operations, Procter & Gamble, 70 Biopolis Street, Singapore 138547, Singapore
| | - Gaurav Saini
- International Operations, Procter & Gamble, 70 Biopolis Street, Singapore 138547, Singapore
| | - Andrei Dragomir
- N.1 Institute for Health, National University of Singapore, 28 Medical Drive, #05-COR, Singapore 117456, Singapore
| |
Collapse
|
2
|
Alyan E, Arnau S, Reiser JE, Getzmann S, Karthaus M, Wascher E. Blink-related EEG activity measures cognitive load during proactive and reactive driving. Sci Rep 2023; 13:19379. [PMID: 37938617 PMCID: PMC10632495 DOI: 10.1038/s41598-023-46738-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 11/04/2023] [Indexed: 11/09/2023] Open
Abstract
Assessing drivers' cognitive load is crucial for driving safety in challenging situations. This research employed the occurrence of drivers' natural eye blinks as cues in continuously recorded EEG data to assess the cognitive workload while reactive or proactive driving. Twenty-eight participants performed either a lane-keeping task with varying levels of crosswind (reactive) or curve road (proactive). The blink event-related potentials (bERPs) and spectral perturbations (bERSPs) were analyzed to assess cognitive load variations. The study found that task load during reactive driving did not significantly impact bERPs or bERSPs, possibly due to enduring alertness for vehicle control. The proactive driving revealed significant differences in the occipital N1 component with task load, indicating the necessity to adapt the attentional resources allocation based on road demands. Also, increased steering complexity led to decreased frontal N2, parietal P3, occipital P2 amplitudes, and alpha power, requiring more cognitive resources for processing relevant information. Interestingly, the proactive and reactive driving scenarios demonstrated a significant interaction at the parietal P2 and occipital N1 for three difficulty levels. The study reveals that EEG measures related to natural eye blink behavior provide insights into the effect of cognitive load on different driving tasks, with implications for driver safety.
Collapse
Affiliation(s)
- Emad Alyan
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany.
| | - Stefan Arnau
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Julian Elias Reiser
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Stephan Getzmann
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Melanie Karthaus
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Edmund Wascher
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| |
Collapse
|
3
|
Pershin I, Candrian G, Münger M, Baschera GM, Rostami M, Eich D, Müller A. Vigilance described by the time-on-task effect in EEG activity during a cued Go/NoGo task. Int J Psychophysiol 2023; 183:92-102. [PMID: 36455720 DOI: 10.1016/j.ijpsycho.2022.11.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 11/19/2022] [Accepted: 11/25/2022] [Indexed: 11/30/2022]
Abstract
Vigilance refers to the ability to maintain attention and to remain alert to stimuli in prolonged and monotonous tasks. Vigilance decrement describes the decline in performance in the course of such sustained attention tasks. Time-related alterations in attention have been found to be associated with changes in EEG. We investigated these time-on-task effects on the basis of changes in the conventional EEG spectral bands with the aim of finding a compound measure of vigilance. 148 healthy adults performed a cued Go/NoGo task that lasted approximately 21 min. Behavioural performance was examined by comparing the number of errors in the first and last quarters of the task using paired t-test. EEG data were epoched per trial, and time-on-task effects were modelled by using multiple linear regression, with frequency spectra band power values as independent variables and trial number as the dependent variable. Behavioural performance decreased in terms of omission errors only. Performance of the models, expressed by predicted R-squared, was between 0.10 and 0.27, depending on the particular task condition. The time-on-task EEG spectral changes were characterized by broad changes in the alpha and frontal changes in the beta and gamma bands. We were able to identify a set of EEG spectral features that predict time-on-task. Our output is considered to be a measure of vigilance, reflecting the allocation of mental resources for the maintenance of attention.
Collapse
Affiliation(s)
- Ilia Pershin
- Brain and Trauma Foundation Grisons, Chur, Switzerland.
| | - Gian Candrian
- Brain and Trauma Foundation Grisons, Chur, Switzerland
| | - Marionna Münger
- Brain and Trauma Foundation Grisons, Chur, Switzerland; University of Zurich, Zurich, Switzerland
| | | | - Maryam Rostami
- Brain and Trauma Foundation Grisons, Chur, Switzerland; University of Tehran, Tehran, Iran
| | | | | |
Collapse
|
4
|
Nilsson EJ, Bärgman J, Ljung Aust M, Matthews G, Svanberg B. Let Complexity Bring Clarity: A Multidimensional Assessment of Cognitive Load Using Physiological Measures. FRONTIERS IN NEUROERGONOMICS 2022; 3:787295. [PMID: 38235474 PMCID: PMC10790847 DOI: 10.3389/fnrgo.2022.787295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 01/07/2022] [Indexed: 01/19/2024]
Abstract
The effects of cognitive load on driver behavior and traffic safety are unclear and in need of further investigation. Reliable measures of cognitive load for use in research and, subsequently, in the development and implementation of driver monitoring systems are therefore sought. Physiological measures are of interest since they can provide continuous recordings of driver state. Currently, however, a few issues related to their use in this context are not usually taken into consideration, despite being well-known. First, cognitive load is a multidimensional construct consisting of many mental responses (cognitive load components) to added task demand. Yet, researchers treat it as unidimensional. Second, cognitive load does not occur in isolation; rather, it is part of a complex response to task demands in a specific operational setting. Third, physiological measures typically correlate with more than one mental state, limiting the inferences that can be made from them individually. We suggest that acknowledging these issues and studying multiple mental responses using multiple physiological measures and independent variables will lead to greatly improved measurability of cognitive load. To demonstrate the potential of this approach, we used data from a driving simulator study in which a number of physiological measures (heart rate, heart rate variability, breathing rate, skin conductance, pupil diameter, eye blink rate, eye blink duration, EEG alpha power, and EEG theta power) were analyzed. Participants performed a cognitively loading n-back task at two levels of difficulty while driving through three different traffic scenarios, each repeated four times. Cognitive load components and other coinciding mental responses were assessed by considering response patterns of multiple physiological measures in relation to multiple independent variables. With this approach, the construct validity of cognitive load is improved, which is important for interpreting results accurately. Also, the use of multiple measures and independent variables makes the measurements (when analyzed jointly) more diagnostic-that is, better able to distinguish between different cognitive load components. This in turn improves the overall external validity. With more detailed, diagnostic, and valid measures of cognitive load, the effects of cognitive load on traffic safety can be better understood, and hence possibly mitigated.
Collapse
Affiliation(s)
- Emma J. Nilsson
- Volvo Cars Safety Centre, Volvo Car Corporation, Gothenburg, Sweden
- Department of Mechanics and Maritime Sciences, Chalmers University of Technology, Gothenburg, Sweden
| | - Jonas Bärgman
- Department of Mechanics and Maritime Sciences, Chalmers University of Technology, Gothenburg, Sweden
| | | | - Gerald Matthews
- Department of Psychology, George Mason University, Fairfax, VA, United States
| | - Bo Svanberg
- Volvo Cars Safety Centre, Volvo Car Corporation, Gothenburg, Sweden
| |
Collapse
|
5
|
Zhang Y, Zhu S. Study on the Effect of Driving Time on Fatigue of Grassland Road Based on EEG. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:9957828. [PMID: 34306602 PMCID: PMC8285183 DOI: 10.1155/2021/9957828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Revised: 05/08/2021] [Accepted: 06/17/2021] [Indexed: 12/04/2022]
Abstract
In order to study the change law of the fatigue degree of grassland expressway drivers over time, this paper takes the semidesert grassland landscape of Xilinhot city as the experimental environment and takes the provincial highway S101 (K278-K424) as an example to design an actual driving test. Taking Urumqi, Inner Mongolia Autonomous Region, as the experimental section, combined with the Biopac MP150 multichannel physiological instrument and its auxiliary knowledge software and mathematical statistics methods, the relationship between EEG and time was studied. The test results show that the primary fatigue factor F 1 and the secondary fatigue factor F 2 can summarize the fatigue law characterized by 96.42% of EEG information. During 130 minutes of driving on the prairie highway, the periods of high fatigue were 105 minutes and 125 minutes, respectively. Driving fatigue can be divided into three stages over time: 5-65 min fatigue-free stage, 70-85 min fatigue transition stage, and 90-130 min fatigue stage. Fatigue changes over time. The law follows the Gaussian function and the sine function.
Collapse
Affiliation(s)
- Yule Zhang
- College of Energy and Transportation Engineering, Inner Mongolia Agricultural University, Hohhot 010000, China
| | - Shoulin Zhu
- College of Energy and Transportation Engineering, Inner Mongolia Agricultural University, Hohhot 010000, China
| |
Collapse
|
6
|
Arif S, Khan MJ, Naseer N, Hong KS, Sajid H, Ayaz Y. Vector Phase Analysis Approach for Sleep Stage Classification: A Functional Near-Infrared Spectroscopy-Based Passive Brain-Computer Interface. Front Hum Neurosci 2021; 15:658444. [PMID: 33994983 PMCID: PMC8121150 DOI: 10.3389/fnhum.2021.658444] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 03/09/2021] [Indexed: 11/13/2022] Open
Abstract
A passive brain-computer interface (BCI) based upon functional near-infrared spectroscopy (fNIRS) brain signals is used for earlier detection of human drowsiness during driving tasks. This BCI modality acquired hemodynamic signals of 13 healthy subjects from the right dorsolateral prefrontal cortex (DPFC) of the brain. Drowsiness activity is recorded using a continuous-wave fNIRS system and eight channels over the right DPFC. During the experiment, sleep-deprived subjects drove a vehicle in a driving simulator while their cerebral oxygen regulation (CORE) state was continuously measured. Vector phase analysis (VPA) was used as a classifier to detect drowsiness state along with sleep stage-based threshold criteria. Extensive training and testing with various feature sets and classifiers are done to justify the adaptation of threshold criteria for any subject without requiring recalibration. Three statistical features (mean oxyhemoglobin, signal peak, and the sum of peaks) along with six VPA features (trajectory slopes of VPA indices) were used. The average accuracies for the five classifiers are 90.9% for discriminant analysis, 92.5% for support vector machines, 92.3% for nearest neighbors, 92.4% for both decision trees, and ensembles over all subjects' data. Trajectory slopes of CORE vector magnitude and angle: m(|R|) and m(∠R) are the best-performing features, along with ensemble classifier with the highest accuracy of 95.3% and minimum computation time of 40 ms. The statistical significance of the results is validated with a p-value of less than 0.05. The proposed passive BCI scheme demonstrates a promising technique for online drowsiness detection using VPA along with sleep stage classification.
Collapse
Affiliation(s)
- Saad Arif
- School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad, Pakistan
| | - Muhammad Jawad Khan
- School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad, Pakistan.,National Center of Artificial Intelligence (NCAI), Islamabad, Pakistan
| | - Noman Naseer
- Department of Mechatronics Engineering, Air University, Islamabad, Pakistan
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Hasan Sajid
- School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad, Pakistan.,National Center of Artificial Intelligence (NCAI), Islamabad, Pakistan
| | - Yasar Ayaz
- School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad, Pakistan.,National Center of Artificial Intelligence (NCAI), Islamabad, Pakistan
| |
Collapse
|
7
|
Arnau S, Löffler C, Rummel J, Hagemann D, Wascher E, Schubert A. Inter‐trial alpha power indicates mind wandering. Psychophysiology 2020; 57:e13581. [DOI: 10.1111/psyp.13581] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Revised: 02/12/2020] [Accepted: 03/17/2020] [Indexed: 12/31/2022]
Affiliation(s)
- Stefan Arnau
- Leibniz Research Centre for Working Environment and Human Factors Dortmund (IfADo) Dortmund Germany
| | | | - Jan Rummel
- Institute of Psychology Heidelberg University Heidelberg Germany
| | - Dirk Hagemann
- Institute of Psychology Heidelberg University Heidelberg Germany
| | - Edmund Wascher
- Leibniz Research Centre for Working Environment and Human Factors Dortmund (IfADo) Dortmund Germany
| | | |
Collapse
|
8
|
Lohani M, Payne BR, Strayer DL. A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving. Front Hum Neurosci 2019; 13:57. [PMID: 30941023 PMCID: PMC6434408 DOI: 10.3389/fnhum.2019.00057] [Citation(s) in RCA: 94] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2018] [Accepted: 02/01/2019] [Indexed: 11/13/2022] Open
Abstract
As driving functions become increasingly automated, motorists run the risk of becoming cognitively removed from the driving process. Psychophysiological measures may provide added value not captured through behavioral or self-report measures alone. This paper provides a selective review of the psychophysiological measures that can be utilized to assess cognitive states in real-world driving environments. First, the importance of psychophysiological measures within the context of traffic safety is discussed. Next, the most commonly used physiology-based indices of cognitive states are considered as potential candidates relevant for driving research. These include: electroencephalography and event-related potentials, optical imaging, heart rate and heart rate variability, blood pressure, skin conductance, electromyography, thermal imaging, and pupillometry. For each of these measures, an overview is provided, followed by a discussion of the methods for measuring it in a driving context. Drawing from recent empirical driving and psychophysiology research, the relative strengths and limitations of each measure are discussed to highlight each measures' unique value. Challenges and recommendations for valid and reliable quantification from lab to (less predictable) real-world driving settings are considered. Finally, we discuss measures that may be better candidates for a near real-time assessment of motorists' cognitive states that can be utilized in applied settings outside the lab. This review synthesizes the literature on in-vehicle psychophysiological measures to advance the development of effective human-machine driving interfaces and driver support systems.
Collapse
Affiliation(s)
- Monika Lohani
- Department of Educational Psychology, University of Utah, Salt Lake City, UT, United States
| | - Brennan R. Payne
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - David L. Strayer
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
9
|
Getzmann S, Arnau S, Karthaus M, Reiser JE, Wascher E. Age-Related Differences in Pro-active Driving Behavior Revealed by EEG Measures. Front Hum Neurosci 2018; 12:321. [PMID: 30131687 PMCID: PMC6090568 DOI: 10.3389/fnhum.2018.00321] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Accepted: 07/23/2018] [Indexed: 01/22/2023] Open
Abstract
Healthy aging is associated with a decline in cognitive functions. This may become an issue when complex tasks have to be performed like driving a car in a demanding traffic situation. On the other hand, older people are able to compensate for age-related deficits, e.g., by deploying extra mental effort and other compensatory strategies. The present study investigated the interplay of age, task workload, and mental effort using EEG measures and a proactive driving task, in which 16 younger and 16 older participants had to keep a virtual car on track on a curvy road. Total oscillatory power and relative power in Theta and Alpha bands were analyzed, as well as event-related potentials (ERPs) to task-irrelevant regular and irregular sound stimuli. Steering variability and Theta power increased with increasing task load (i.e., with shaper bends of the road), while Alpha power decreased. This pattern of workload and mental effort was found in both age groups. However, only in the older group a relationship between steering variability and Theta power occurred: better steering performance was associated with higher Theta power, reflecting higher mental effort. Higher Theta power while driving was also associated with a stronger increase in reported subjective fatigue in the older group. In the younger group, lower steering variability came along with lower ERP responses to deviant sound stimuli, reflecting reduced processing of task-irrelevant environmental stimuli. In sum, better performance in proactive driving (i.e., more alert steering behavior) was associated with increased mental effort in the older group, and higher attentional focus on the task in the younger group, indicating age-specific strategies in the way younger and older drivers manage demanding (driving) tasks.
Collapse
Affiliation(s)
- Stephan Getzmann
- Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund, Dortmund, Germany
| | - Stefan Arnau
- Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund, Dortmund, Germany
| | - Melanie Karthaus
- Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund, Dortmund, Germany
| | - Julian Elias Reiser
- Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund, Dortmund, Germany
| | - Edmund Wascher
- Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund, Dortmund, Germany
| |
Collapse
|