1
|
Tao X, Gao D, Zhang W, Liu T, Du B, Zhang S, Qin Y. A multimodal physiological dataset for driving behaviour analysis. Sci Data 2024; 11:378. [PMID: 38609440 PMCID: PMC11014944 DOI: 10.1038/s41597-024-03222-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 04/03/2024] [Indexed: 04/14/2024] Open
Abstract
Physiological signal monitoring and driver behavior analysis have gained increasing attention in both fundamental research and applied research. This study involved the analysis of driving behavior using multimodal physiological data collected from 35 participants. The data included 59-channel EEG, single-channel ECG, 4-channel EMG, single-channel GSR, and eye movement data obtained via a six-degree-of-freedom driving simulator. We categorized driving behavior into five groups: smooth driving, acceleration, deceleration, lane changing, and turning. Through extensive experiments, we confirmed that both physiological and vehicle data met the requirements. Subsequently, we developed classification models, including linear discriminant analysis (LDA), MMPNet, and EEGNet, to demonstrate the correlation between physiological data and driving behaviors. Notably, we propose a multimodal physiological dataset for analyzing driving behavior(MPDB). The MPDB dataset's scale, accuracy, and multimodality provide unprecedented opportunities for researchers in the autonomous driving field and beyond. With this dataset, we will contribute to the field of traffic psychology and behavior.
Collapse
Affiliation(s)
- Xiaoming Tao
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Dingcheng Gao
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Wenqi Zhang
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Tianqi Liu
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Bing Du
- University of Science and Technology Beijing, School of Computer and Communication Engineering, Beijing, 100083, China
| | - Shanghang Zhang
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
| | - Yanjun Qin
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China.
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China.
| |
Collapse
|
2
|
Alyan E, Arnau S, Reiser JE, Getzmann S, Karthaus M, Wascher E. Blink-related EEG activity measures cognitive load during proactive and reactive driving. Sci Rep 2023; 13:19379. [PMID: 37938617 PMCID: PMC10632495 DOI: 10.1038/s41598-023-46738-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 11/04/2023] [Indexed: 11/09/2023] Open
Abstract
Assessing drivers' cognitive load is crucial for driving safety in challenging situations. This research employed the occurrence of drivers' natural eye blinks as cues in continuously recorded EEG data to assess the cognitive workload while reactive or proactive driving. Twenty-eight participants performed either a lane-keeping task with varying levels of crosswind (reactive) or curve road (proactive). The blink event-related potentials (bERPs) and spectral perturbations (bERSPs) were analyzed to assess cognitive load variations. The study found that task load during reactive driving did not significantly impact bERPs or bERSPs, possibly due to enduring alertness for vehicle control. The proactive driving revealed significant differences in the occipital N1 component with task load, indicating the necessity to adapt the attentional resources allocation based on road demands. Also, increased steering complexity led to decreased frontal N2, parietal P3, occipital P2 amplitudes, and alpha power, requiring more cognitive resources for processing relevant information. Interestingly, the proactive and reactive driving scenarios demonstrated a significant interaction at the parietal P2 and occipital N1 for three difficulty levels. The study reveals that EEG measures related to natural eye blink behavior provide insights into the effect of cognitive load on different driving tasks, with implications for driver safety.
Collapse
Affiliation(s)
- Emad Alyan
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany.
| | - Stefan Arnau
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Julian Elias Reiser
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Stephan Getzmann
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Melanie Karthaus
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| | - Edmund Wascher
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, 44139, Dortmund, Germany
| |
Collapse
|
3
|
Getzmann S, Reiser JE, Gajewski PD, Schneider D, Karthaus M, Wascher E. Cognitive aging at work and in daily life-a narrative review on challenges due to age-related changes in central cognitive functions. Front Psychol 2023; 14:1232344. [PMID: 37621929 PMCID: PMC10445145 DOI: 10.3389/fpsyg.2023.1232344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 07/28/2023] [Indexed: 08/26/2023] Open
Abstract
Demographic change is leading to an increasing proportion of older employees in the labor market. At the same time, work activities are becoming more and more complex and require a high degree of flexibility, adaptability, and cognitive performance. Cognitive control mechanism, which is subject to age-related changes and is important in numerous everyday and work activities, plays a special role. Executive functions with its core functions updating, shifting, and inhibition comprises cognitive control mechanisms that serve to plan, coordinate, and achieve higher-level goals especially in inexperienced and conflicting actions. In this review, influences of age-related changes in cognitive control are demonstrated with reference to work and real-life activities, in which the selection of an information or response in the presence of competing but task-irrelevant stimuli or responses is particularly required. These activities comprise the understanding of spoken language under difficult listening conditions, dual-task walking, car driving in critical traffic situations, and coping with work interruptions. Mechanisms for compensating age-related limitations in cognitive control and their neurophysiological correlates are discussed with a focus on EEG measures. The examples illustrate how to access influences of age and cognitive control on and in everyday and work activities, focusing on its functional role for the work ability and well-being of older people.
Collapse
Affiliation(s)
- Stephan Getzmann
- Leibniz Research Center for Working Environment and Human Factors at the Technical University of Dortmund (IfADo), Dortmund, Germany
| | | | | | | | | | | |
Collapse
|
4
|
Wascher E, Alyan E, Karthaus M, Getzmann S, Arnau S, Reiser JE. Tracking drivers' minds: Continuous evaluation of mental load and cognitive processing in a realistic driving simulator scenario by means of the EEG. Heliyon 2023; 9:e17904. [PMID: 37539180 PMCID: PMC10395282 DOI: 10.1016/j.heliyon.2023.e17904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 06/10/2023] [Accepted: 06/30/2023] [Indexed: 08/05/2023] Open
Abstract
Driving safety strongly depends on the driver's mental states and attention to the driving situation. Previous studies demonstrate a clear relationship between EEG measures and mental states, such as alertness and drowsiness, but often only map their mental state for a longer period of time. In this driving simulation study, we exploit the high temporal resolution of the EEG to capture fine-grained modulations in cognitive processes occurring before and after eye activity in the form of saccades, fixations, and eye blinks. A total of 15 subjects drove through an approximately 50-km course consisting of highway, country road, and urban passages. Based on the ratio of brain oscillatory alpha and theta activity, the total distance was classified into 10-m-long sections with low, medium, and high task loads. Blink-evoked and fixation-evoked event-related potentials, spectral perturbations, and lateralizations were analyzed as neuro-cognitive correlates of cognition and attention. Depending on EEG-based estimation of task load, these measures showed distinct patterns associated with driving behavior parameters such as speed and steering acceleration and represent a temporally highly resolved image of specific cognitive processes during driving. In future applications, combinations of these EEG measures could form the basis for driver warning systems which increase overall driving safety by considering rapid fluctuations in driver's attention and mental states.
Collapse
Affiliation(s)
- Edmund Wascher
- Corresponding author. IfADo – Leibniz Research Centre for Working Environment and Human Factors Ardeystr. 67 D-44139 Dortmund Germany.
| | | | | | | | | | | |
Collapse
|
5
|
Doniec R, Konior J, Sieciński S, Piet A, Irshad MT, Piaseczna N, Hasan MA, Li F, Nisar MA, Grzegorzek M. Sensor-Based Classification of Primary and Secondary Car Driver Activities Using Convolutional Neural Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:5551. [PMID: 37420718 DOI: 10.3390/s23125551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 06/06/2023] [Accepted: 06/09/2023] [Indexed: 07/09/2023]
Abstract
To drive safely, the driver must be aware of the surroundings, pay attention to the road traffic, and be ready to adapt to new circumstances. Most studies on driving safety focus on detecting anomalies in driver behavior and monitoring cognitive capabilities in drivers. In our study, we proposed a classifier for basic activities in driving a car, based on a similar approach that could be applied to the recognition of basic activities in daily life, that is, using electrooculographic (EOG) signals and a one-dimensional convolutional neural network (1D CNN). Our classifier achieved an accuracy of 80% for the 16 primary and secondary activities. The accuracy related to activities in driving, including crossroad, parking, roundabout, and secondary activities, was 97.9%, 96.8%, 97.4%, and 99.5%, respectively. The F1 score for secondary driving actions (0.99) was higher than for primary driving activities (0.93-0.94). Furthermore, using the same algorithm, it was possible to distinguish four activities related to activities of daily life that were secondary activities when driving a car.
Collapse
Affiliation(s)
- Rafał Doniec
- Department of Biosensors and Processing of Biomedical Signals, Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
| | - Justyna Konior
- Department of Biosensors and Processing of Biomedical Signals, Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
| | - Szymon Sieciński
- Department of Biosensors and Processing of Biomedical Signals, Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Artur Piet
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Muhammad Tausif Irshad
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of Information Technology, University of the Punjab, Lahore 54000, Pakistan
| | - Natalia Piaseczna
- Department of Biosensors and Processing of Biomedical Signals, Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
| | - Md Abid Hasan
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Frédéric Li
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Muhammad Adeel Nisar
- Department of Information Technology, University of the Punjab, Lahore 54000, Pakistan
| | - Marcin Grzegorzek
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of Knowledge Engineering, University of Economics in Katowice, Bogucicka 3, 40-287 Katowice, Poland
| |
Collapse
|
6
|
Ali Y, Haque MM. Modelling braking behaviour of distracted young drivers in car-following interactions: A grouped random parameters duration model with heterogeneity-in-means. ACCIDENT; ANALYSIS AND PREVENTION 2023; 185:107015. [PMID: 36889237 DOI: 10.1016/j.aap.2023.107015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 01/27/2023] [Accepted: 02/21/2023] [Indexed: 06/18/2023]
Abstract
Braking is an important characteristic of driving behaviour that has a direct relationship with rear-end collisions in a car-following task. Braking becomes more crucial when drivers' cognitive workload increases because of using mobile phones whilst driving. This study, therefore, investigates and compares the effects of using mobile phones whilst driving on braking behaviour. Thirty-two young licenced drivers, evenly split by gender, faced a safety-critical event, that is, leader's hard braking, in a car-following situation. Each participant drove the CARRS-Q Advanced Driving Simulator and was required to respond to a braking event in the simulated environment in three phone conditions: baseline (no phone conversation), handheld, and hands-free. A random parameters duration modelling approach is employed to (i) model drivers' braking (or deceleration) times using a parametric survival model, (ii) capture unobserved heterogeneity associated with braking times, and (iii) account for repeated experiment design. The model identifies the handheld phone condition as a random parameter whilst vehicle dynamics variables, hands-free phone condition, and driver-specific variables are found as fixed parameters. The model suggests that most distracted drivers (in the handheld condition) reduce their initial speeds more slowly than undistracted drivers, reflecting their delayed initial braking that may lead to abrupt braking to avoid a rear-end collision. Further, another group of distracted drivers exhibits faster braking (in the handheld condition), recognising the risk associated with mobile phone usage and delayed initial braking. Provisional licence holders are found to be slower in reducing their initial speeds than open licence holders, indicating their risk-taking behaviour because of their less experience and more sensitivity to mobile phone distraction. Overall, mobile phone distraction appears to impair the braking behaviour of young drivers, which poses significant safety concerns for traffic streams.
Collapse
Affiliation(s)
- Yasir Ali
- Loughborough University, School of Architecture, Building, and Civil Engineering, Leicestershire LE11 3TU, United Kingdom.
| | - Md Mazharul Haque
- Queensland University of Technology, School of Civil and Environmental Engineering, Faculty of Engineering, Brisbane, QLD 4000, Australia.
| |
Collapse
|
7
|
Zhang Q, Xu L, Yan Y, Li G, Qiao D, Tian J. Distracted driving behavior in patients with insomnia. ACCIDENT; ANALYSIS AND PREVENTION 2023; 183:106971. [PMID: 36657234 DOI: 10.1016/j.aap.2023.106971] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2022] [Revised: 12/29/2022] [Accepted: 01/12/2023] [Indexed: 06/17/2023]
Abstract
Insomnia is one of the most common sleep disorders and is characterized by a subjective perception of difficulty falling asleep. Drivers with insomnia are vulnerable to distraction and exhibit higher levels of risk while driving. This study investigated the effect of two sources of in-vehicle distractions on the driving performance of drivers with insomnia and good sleepers by analyzing different driving behavior measures. Twenty-one drivers with insomnia and twenty-one healthy volunteers were recruited to complete simulated driving dual tasks. The primary task required the participants to perform: (a) a lane-keeping task, and (b) a lane-change task. The secondary task required the participants to deal with: (a) baseline (non-task), (b) internal distraction task, and (c) external distraction task. The internal distraction task required participants to complete quantitative reasoning tasks, while the external distraction task was a 0-back test. The relationship between distracted driving ability and cognitive function was also investigated. The results demonstrate that for lane-keeping tasks, drivers with insomnia had significantly higher standard deviations (SD) for speed, throttle position, acceleration, and lateral position than healthy drivers under internal distraction, but the driving performance did not differ significantly between groups under internal distraction or baseline. In the lane-change task, drivers with insomnia had higher SDs for steering wheel angle, steer angular velocity, lateral acceleration, and lateral speed than healthy drivers under external distraction. Moreover, external distraction impaired driving behavior in the healthy group, while internal distraction impaired driving ability in both groups. Healthy drivers with cognitive impairment displayed impaired lane-keeping abilities under internal distractions and impaired lane-changing abilities under external distractions. Driving performance in the insomnia group was not significantly associated with cognitive function. The results demonstrate that insomnia and distraction impair driving ability, and driver performance is affected differently by the distraction source (internal or external). The driving ability of healthy drivers with decreased cognition was impaired, but not that of insomniacs.The findings of this study provide new insights for preventing and estimating the potential influence of distracted driving behavior in individuals with insomnia.
Collapse
Affiliation(s)
- Qianran Zhang
- Laboratory of Computation and Analytics of Complex Management Systems (CACMS), Tianjin University, Tianjin, China; College of Management and Economics, Tianjin University, Tianjin, China
| | - Lin Xu
- Department of Neurology, Tianjin Medical University General Hospital, Tianjin, China.
| | - Yingying Yan
- Laboratory of Computation and Analytics of Complex Management Systems (CACMS), Tianjin University, Tianjin, China; College of Management and Economics, Tianjin University, Tianjin, China
| | - Geng Li
- College of Management and Economics, Tianjin University, Tianjin, China.
| | - Dandan Qiao
- Department of Geriatrics, Beijing Luhe Hospital, Capital Medical University
| | - Junfang Tian
- Laboratory of Computation and Analytics of Complex Management Systems (CACMS), Tianjin University, Tianjin, China; College of Management and Economics, Tianjin University, Tianjin, China
| |
Collapse
|
8
|
García-Herrero S, Febres JD, Boulagouas W, Gutiérrez JM, Mariscal Saldaña MÁ. Assessment of the Influence of Technology-Based Distracted Driving on Drivers' Infractions and Their Subsequent Impact on Traffic Accidents Severity. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18137155. [PMID: 34281092 PMCID: PMC8297255 DOI: 10.3390/ijerph18137155] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 06/27/2021] [Accepted: 06/29/2021] [Indexed: 11/25/2022]
Abstract
Multitasking while driving negatively affects driving performance and threatens people’s lives every day. Moreover, technology-based distractions are among the top driving distractions that are proven to divert the driver’s attention away from the road and compromise their safety. This study employs recent data on road traffic accidents that occurred in Spain and uses a machine-learning algorithm to analyze, in the first place, the influence of technology-based distracted driving on drivers’ infractions considering the gender and age of the drivers and the zone and the type of vehicle. It assesses, in the second place, the impact of drivers’ infractions on the severity of traffic accidents. Findings show that (i) technology-based distractions are likely to increase the probability of committing aberrant infractions and speed infractions; (ii) technology-based distracted young drivers are more likely to speed and commit aberrant infractions; (iii) distracted motorcycles and squad riders are found more likely to speed; (iv) the probability of committing infractions by distracted drivers increases on streets and highways; and, finally, (v) drivers’ infractions lead to serious injuries.
Collapse
Affiliation(s)
- Susana García-Herrero
- Escuela Politécnica Superior, Universidad de Burgos, 09006 Burgos, Spain; (W.B.); (M.Á.M.S.)
- Correspondence:
| | - Juan Diego Febres
- Department of Chemistry and Exact Sciences, Universidad Técnica Particular de Loja, 110107 Loja, Ecuador;
| | - Wafa Boulagouas
- Escuela Politécnica Superior, Universidad de Burgos, 09006 Burgos, Spain; (W.B.); (M.Á.M.S.)
| | | | | |
Collapse
|
9
|
Ortega CAC, Mariscal MA, Boulagouas W, Herrera S, Espinosa JM, García-Herrero S. Effects of Mobile Phone Use on Driving Performance: An Experimental Study of Workload and Traffic Violations. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18137101. [PMID: 34281034 PMCID: PMC8297239 DOI: 10.3390/ijerph18137101] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 06/28/2021] [Accepted: 06/29/2021] [Indexed: 11/24/2022]
Abstract
The use of communication technologies, e.g., mobile phones, has increased dramatically in recent years, and their use among drivers has become a great risk to traffic safety. The present study assessed the workload and road ordinary violations, utilizing driving data collected from 39 young participants who underwent a dual-task while driving a simulator, i.e., respond to a call, text on WhatsApp, and check Instagram. Findings confirmed that there are significant differences in the driving performance of young drivers in terms of vehicle control (i.e., lateral distance and hard shoulder line violations) between distracted and non-distracted drivers. Furthermore, the overall workload score of young drivers increases with the use of their mobile phones while driving. The obtained results contribute to a better understanding of the driving performance of distracted young drivers and thus they could be useful for further improvements to traffic safety strategies.
Collapse
Affiliation(s)
- Carlos A. Catalina Ortega
- Escuela Politécnica Superior, Universidad de Burgos, 09001 Burgos, Spain; (C.A.C.O.); (M.A.M.); (W.B.); (J.M.E.)
| | - Miguel A. Mariscal
- Escuela Politécnica Superior, Universidad de Burgos, 09001 Burgos, Spain; (C.A.C.O.); (M.A.M.); (W.B.); (J.M.E.)
| | - Wafa Boulagouas
- Escuela Politécnica Superior, Universidad de Burgos, 09001 Burgos, Spain; (C.A.C.O.); (M.A.M.); (W.B.); (J.M.E.)
| | - Sixto Herrera
- Departamento de Matemática Aplicada y Ciencias de la Computación, ETS de Ingenieros de Caminos, Canales y Puertos, Universidad de Cantabria, 39005 Santander, Spain;
| | - Juan M. Espinosa
- Escuela Politécnica Superior, Universidad de Burgos, 09001 Burgos, Spain; (C.A.C.O.); (M.A.M.); (W.B.); (J.M.E.)
| | - Susana García-Herrero
- Escuela Politécnica Superior, Universidad de Burgos, 09001 Burgos, Spain; (C.A.C.O.); (M.A.M.); (W.B.); (J.M.E.)
- Correspondence:
| |
Collapse
|