A Context-Aware EEG Headset System for Early Detection of Driver Drowsiness

Continuous real-time detection and management of comprehensive mental states using wireless soft multifunctional bioelectronics

Quantitatively measuring human mental states that profoundly affect cognition, behavior, and recovery would revolutionize personalized digital healthcare. Detecting fatigue, stress, and sleep is particularly important due to their interdependence: persistent fatigue can induce cognitive stress, while chronic stress impairs sleep quality, creating a harmful feedback loop. Here, we introduce a wireless, soft, multifunctional bioelectronic system offering the continuous real-time detection and management of comprehensive mental states. The all-in-one wearable device, mounted on the forehead, measures clinical-grade brain and cardiorespiratory signals. This membrane biopatch is imperceptible, flexible, and reusable, providing ultimate user comfort while detecting high-fidelity electroencephalogram, electrooculogram, pulse rate, and blood oxygen saturation. A set of in vivo studies with human subjects demonstrates that the soft device has great skin-conformal contact and minimized motion artifacts, capturing clinical-quality data with different activities, even during sleep. The developed signal processing methods and deep-learning algorithms offer automated, real-time classification of driving drowsiness, stress conditions, and sleep quality. The bioelectronics platforms in this study have the potential to revolutionize digital healthcare, particularly personalized medicine and at-home health monitoring.

Psychophysiological models of hypovigilance detection: A scoping review

Hypovigilance represents a major contributor to accidents. In operational contexts, the burden of monitoring/managing vigilance often rests on operators. Recent advances in sensing technologies allow for the development of psychophysiology-based (hypo)vigilance prediction models. Still, these models remain scarcely applied to operational situations and need better understanding. The current scoping review provides a state of knowledge regarding psychophysiological models of hypovigilance detection. Records evaluating vigilance measuring tools with gold standard comparisons and hypovigilance prediction performances were extracted from MEDLINE, PsychInfo, and Inspec. Exclusion criteria comprised aspects related to language, non-empirical papers, and sleep studies. The Quality Assessment tool for Diagnostic Accuracy Studies (QUADAS) and the Prediction model Risk Of Bias ASsessment Tool (PROBAST) were used for bias evaluation. Twenty-one records were reviewed. They were mainly characterized by participant selection and analysis biases. Papers predominantly focused on driving and employed several common psychophysiological techniques. Yet, prediction methods and gold standards varied widely. Overall, we outline the main strategies used to assess hypovigilance, their principal limitations, and we discuss applications of these models.

Drowsiness Detection Using Ocular Indices from EEG Signal

Drowsiness is one of the main causes of road accidents and endangers the lives of road users. Recently, there has been considerable interest in utilizing features extracted from electroencephalography (EEG) signals to detect driver drowsiness. However, in most of the work performed in this area, the eyeblink or ocular artifacts present in EEG signals are considered noise and are removed during the preprocessing stage. In this study, we examined the possibility of extracting features from the EEG ocular artifacts themselves to perform classification between alert and drowsy states. In this study, we used the BLINKER algorithm to extract 25 blink-related features from a public dataset comprising raw EEG signals collected from 12 participants. Different machine learning classification models, including the decision tree, the support vector machine (SVM), the K-nearest neighbor (KNN) method, and the bagged and boosted tree models, were trained based on the seven selected features. These models were further optimized to improve their performance. We were able to show that features from EEG ocular artifacts are able to classify drowsy and alert states, with the optimized ensemble-boosted trees yielding the highest accuracy of 91.10% among all classic machine learning models.

Development of an EEG Headband for Stress Measurement on Driving Simulators

In this paper, we designed from scratch, realized, and characterized a six-channel EEG wearable headband for the measurement of stress-related brain activity during driving. The headband transmits data over WiFi to a laptop, and the rechargeable battery life is 10 h of continuous transmission. The characterization manifested a measurement error of 6 μV in reading EEG channels, and the bandwidth was in the range [0.8, 44] Hz, while the resolution was 50 nV exploiting the oversampling technique. Thanks to the full metrological characterization presented in this paper, we provide important information regarding the accuracy of the sensor because, in the literature, commercial EEG sensors are used even if their accuracy is not provided in the manuals. We set up an experiment using the driving simulator available in our laboratory at the University of Udine; the experiment involved ten volunteers who had to drive in three scenarios: manual, autonomous vehicle with a “gentle” approach, and autonomous vehicle with an “aggressive” approach. The aim of the experiment was to assess how autonomous driving algorithms impact EEG brain activity. To our knowledge, this is the first study to compare different autonomous driving algorithms in terms of drivers’ acceptability by means of EEG signals. The obtained results demonstrated that the estimated power of beta waves (related to stress) is higher in the manual with respect to autonomous driving algorithms, either “gentle” or “aggressive”.

Electroencephalogram-Based Approaches for Driver Drowsiness Detection and Management: A Review

Drowsiness is not only a core challenge to safe driving in traditional driving conditions but also a serious obstacle for the wide acceptance of added services of self-driving cars (because drowsiness is, in fact, one of the most representative early-stage symptoms of self-driving carsickness). In view of the importance of detecting drivers’ drowsiness, this paper reviews the algorithms of electroencephalogram (EEG)-based drivers’ drowsiness detection (DDD). To facilitate the review, the EEG-based DDD approaches are organized into a tree structure taxonomy, having two main categories, namely “detection only (open-loop)” and “management (closed-loop)”, both aimed at designing better DDD systems that ensure early detection, reliability and practical utility. To achieve this goal, we addressed seven questions, the answers of which helped in developing an EEG-based DDD system that is superior to the existing ones. A basic assumption in this review article is that although driver drowsiness and carsickness-induced drowsiness are caused by different factors, the brain network that regulates drowsiness is the same.

Screening of non-restorative sleep by quantitative EEG

Background

Non-restorative sleep is the major cause of excessive daytime sleepiness and causes injures of the central nervous system. The most common cause of Excessive day sleepiness in a clinical setting is obstructive sleep apnea. Sleepiness scales can assess multiple aspects of the sleep and include subjective and objective measures. The present study aim to disclose the capability of quantitative electroencephalography to screen, as well as to know the pathogenesis of non-restorative sleep in patients with excessive day time sleepiness.

Results

Twenty obstructive sleep apnea patients and 20 healthy control subjects were recruited. All patients were subjected to Epworth sleepiness scale and polysomnography. Quantitative electroencephalography and Karolinska sleepiness scale were done before and after sleep for patients as well as controls. The patients group revealed a significant power reduction in delta and alpha bands, comparing before and after sleep records. Interestingly, there was a significant change in delta power in the temporal delta waves power. Yet, the changes were opposite among cases (significant decrease) versus controls (significant increase). In addition, there were significant correlations between sleepiness scales; Epworth sleepiness scale and Karolinska Sleepiness Scale scores, and alpha band results in quantitative electroencephalography.

Conclusion

Quantitative electroencephalography with further research, could provide us with clues to the pathogenesis of EDS and non-restorative sleep accompanying OSA and an objective screening tool.

Fatigue Monitoring Through Wearables: A State-of-the-Art Review

The objective measurement of fatigue is of critical relevance in areas such as occupational health and safety as fatigue impairs cognitive and motor performance, thus reducing productivity and increasing the risk of injury. Wearable systems represent highly promising solutions for fatigue monitoring as they enable continuous, long-term monitoring of biomedical signals in unattended settings, with the required comfort and non-intrusiveness. This is a p rerequisite for the development of accurate models for fatigue monitoring in real-time. However, monitoring fatigue through wearable devices imposes unique challenges. To provide an overview of the current state-of-the-art in monitoring variables associated with fatigue via wearables and to detect potential gaps and pitfalls in current knowledge, a systematic review was performed. The Scopus and PubMed databases were searched for articles published in English since 2015, having the terms "fatigue," "drowsiness," "vigilance," or "alertness" in the title, and proposing wearable device-based systems for non-invasive fatigue quantification. Of the 612 retrieved articles, 60 satisfied the inclusion criteria. Included studies were mainly of short duration and conducted in laboratory settings. In general, researchers developed fatigue models based on motion (MOT), electroencephalogram (EEG), photoplethysmogram (PPG), electrocardiogram (ECG), galvanic skin response (GSR), electromyogram (EMG), skin temperature (T_sk), eye movement (EYE), and respiratory (RES) data acquired by wearable devices available in the market. Supervised machine learning models, and more specifically, binary classification models, are predominant among the proposed fatigue quantification approaches. These models were considered to perform very well in detecting fatigue, however, little effort was made to ensure the use of high-quality data during model development. Together, the findings of this review reveal that methodological limitations have hindered the generalizability and real-world applicability of most of the proposed fatigue models. Considerably more work is needed to fully explore the potential of wearables for fatigue quantification as well as to better understand the relationship between fatigue and changes in physiological variables.

Driver sleepiness detection with deep neural networks using electrophysiological data

OBJECTIVE

The objective of this paper is to present a driver sleepiness detection model based on electrophysiological data and a neural network consisting of Convolutional Neural Networks and a Long Short Term Memory architecture.

APPROACH

The model was developed and evaluated on data from 12 different experiments with 269 drivers and 1187 driving sessions during daytime (low sleepiness condition) and night-time (high sleepiness condition), collected during naturalistic driving conditions on real roads in Sweden or in an advanced moving-base driving simulator. Electrooculographic and electroencephalographic time series data, split up in 16634 2.5-minute data segments was used as input to the deep neural network. This probably constitutes the largest labelled driver sleepiness dataset in the world. The model outputs a binary decision as alert (defined as ≤6 on the Karolinska Sleepiness Scale, KSS) or sleepy (KSS≥8) or a regression output corresponding to KSS ϵ [1-5,6,7,8,9].

MAIN RESULTS

The subject-independent mean absolute error (MAE) was 0.78. Binary classification accuracy for the regression model was 82.6% as compared to 82.0% for a model that was trained specifically for the binary classification task. Data from the eyes were more informative than data from the brain. A combined input improved performance for some models, but the gain was very limited.

SIGNIFICANCE

Improved classification results were achieved with the regression model compared to the classification model. This suggests that the implicit order of the KSS ratings, i.e. the progression from alert to sleepy, provides important information for robust modelling of driver sleepiness, and that class labels should not simply be aggregated into an alert and a sleepy class. Furthermore, the model consistently showed better results than a model trained on manually extracted features based on expert knowledge, indicating that the model can detect sleepiness that is not covered by traditional algorithms.

On-Road Detection of Driver Fatigue and Drowsiness during Medium-Distance Journeys

BACKGROUND

The detection of driver fatigue as a cause of sleepiness is a key technology capable of preventing fatal accidents. This research uses a fatigue-related sleepiness detection algorithm based on the analysis of the pulse rate variability generated by the heartbeat and validates the proposed method by comparing it with an objective indicator of sleepiness (PERCLOS). Methods: changes in alert conditions affect the autonomic nervous system (ANS) and therefore heart rate variability (HRV), modulated in the form of a wave and monitored to detect long-term changes in the driver's condition using real-time control. Results: the performance of the algorithm was evaluated through an experiment carried out in a road vehicle. In this experiment, data was recorded by three participants during different driving sessions and their conditions of fatigue and sleepiness were documented on both a subjective and objective basis. The validation of the results through PERCLOS showed a 63% adherence to the experimental findings. Conclusions: the present study confirms the possibility of continuously monitoring the driver's status through the detection of the activation/deactivation states of the ANS based on HRV. The proposed method can help prevent accidents caused by drowsiness while driving.

A Systemic Review of Available Low-Cost EEG Headsets Used for Drowsiness Detection

Drowsiness is a leading cause of traffic and industrial accidents, costing lives and productivity. Electroencephalography (EEG) signals can reflect awareness and attentiveness, and low-cost consumer EEG headsets are available on the market. The use of these devices as drowsiness detectors could increase the accessibility of safety and productivity-enhancing devices for small businesses and developing countries. We conducted a systemic review of currently available, low-cost, consumer EEG-based drowsiness detection systems. We sought to determine whether consumer EEG headsets could be reliably utilized as rudimentary drowsiness detection systems. We included documented cases describing successful drowsiness detection using consumer EEG-based devices, including the Neurosky MindWave, InteraXon Muse, Emotiv Epoc, Emotiv Insight, and OpenBCI. Of 46 relevant studies, ~27 reported an accuracy score. The lowest of these was the Neurosky Mindwave, with a minimum of 31%. The second lowest accuracy reported was 79.4% with an OpenBCI study. In many cases, algorithmic optimization remains necessary. Different methods for accuracy calculation, system calibration, and different definitions of drowsiness made direct comparisons problematic. However, even basic features, such as the power spectra of EEG bands, were able to consistently detect drowsiness. Each specific device has its own capabilities, tradeoffs, and limitations. Widely used spectral features can achieve successful drowsiness detection, even with low-cost consumer devices; however, reliability issues must still be addressed in an occupational context.

Automatic classification methods for detecting drowsiness using wavelet packet transform extracted time-domain features from single-channel EEG signal

BACKGROUND

Detecting human drowsiness during some critical works like vehicle driving, crane operating, mining blasting, etc. is one of the safeguards to prevent accidents. Among several drowsiness detection (DD) methods, a combination of neuroscience and computer science knowledge has a better ability to differentiate awake and sleep states. Most of the current models are implemented using multi-sensors electroencephalogram (EEG) signals, multi-domain features, predefined features selection algorithms. Therefore, there is great interest in the method of detecting drowsiness on embedded platforms with improved accuracy using generalized best features.

NEW-METHOD

Single-channel EEG based drowsiness detection (DD) model is proposed in this by utilizing wavelet packet transform (WPT) to extract the time-domain features from considered channel EEG. The dimension of the feature vector is reduced by the proposed novel feature selection method.

RESULTS

The proposed model on freely available real-time sleep analysis EEG and Simulated Virtual Driving Driver (SVDD) EEG achieves 94.45% and 85.3% accuracy, respectively.

COMPARISON-WITH-EXISTING-METHOD

The results show that the proposed DD method produces better accuracy compared to the state-of-the-art using the physiological dataset with the proposed time-domain sub-band-based features and feature selection method. This task of detecting drowsiness by analyzing the 5-seconds EEG signal with four features is an improvement to my previous work on detecting drowsiness using a 30-seconds EEG signal with 66 features.

CONCLUSIONS

Time-domain features obtained from EEG time-domain sub-bands collected using WPT achieving excellent accuracy rate by selecting unique optimization features for all subjects by the proposed feature selection algorithm.

3D Printable Dry EEG Electrodes with Coiled-Spring Prongs

Various dry electroencephalography (EEG) electrodes have been developed. Dry EEG electrodes need to be pressed onto the scalp; therefore, there is a tradeoff between keeping the contact impedance low and maintaining comfort. We propose an approach to solve this tradeoff through the printing of complex-shaped electrodes by using a stereolithography 3D printer. To show the feasibility of our approach, we fabricated electrodes that have flexible fingers (prongs) with springs. Although dry electrodes with flexible prongs have been proposed, a suitable spring constant has not been obtained. In this study, the spring constant of our electrodes was determined from a contact model between the electrodes and the scalp. The mechanical properties and reproductivity of the electrodes were found to be sufficient. Finally, we measured the alpha waves when a participant opened/closed his eyes by using our electrodes.

An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing

Drowsy driving is one of the main causes of traffic accidents. To reduce such accidents, early detection of drowsy driving is needed. In previous studies, it was shown that driver drowsiness affected driving performance, behavioral indices, and physiological indices. The purpose of this study is to investigate the feasibility of classification of the alert states of drivers, particularly the slightly drowsy state, based on hybrid sensing of vehicle-based, behavioral, and physiological indicators with consideration for the implementation of these identifications into a detection system. First, we measured the drowsiness level, driving performance, physiological signals (from electroencephalogram and electrocardiogram results), and behavioral indices of a driver using a driving simulator and driver monitoring system. Next, driver alert and drowsy states were identified by machine learning algorithms, and a dataset was constructed from the extracted indices over a period of 10 s. Finally, ensemble algorithms were used for classification. The results showed that the ensemble algorithm can obtain 82.4% classification accuracy using hybrid methods to identify the alert and slightly drowsy states, and 95.4% accuracy classifying the alert and moderately drowsy states. Additionally, the results show that the random forest algorithm can obtain 78.7% accuracy when classifying the alert vs. slightly drowsy states if physiological indicators are excluded and can obtain 89.8% accuracy when classifying the alert vs. moderately drowsy states. These results represent the feasibility of highly accurate early detection of driver drowsiness and the feasibility of implementing a driver drowsiness detection system based on hybrid sensing using non-contact sensors.

Topics and trends in artificial intelligence assisted human brain research

Artificial intelligence (AI) assisted human brain research is a dynamic interdisciplinary field with great interest, rich literature, and huge diversity. The diversity in research topics and technologies keeps increasing along with the tremendous growth in application scope of AI-assisted human brain research. A comprehensive understanding of this field is necessary to assess research efficacy, (re)allocate research resources, and conduct collaborations. This paper combines the structural topic modeling (STM) with the bibliometric analysis to automatically identify prominent research topics from the large-scale, unstructured text of AI-assisted human brain research publications in the past decade. Analyses on topical trends, correlations, and clusters reveal distinct developmental trends of these topics, promising research orientations, and diverse topical distributions in influential countries/regions and research institutes. These findings help better understand scientific and technological AI-assisted human brain research, provide insightful guidance for resource (re)allocation, and promote effective international collaborations.

EEG-based Classification of Microsleep by Means of Feature Selection: An Application in Aviation

This paper presents a method for classification of microsleep (MS) from baseline utilizing linear and non-linear features derived from electroencephalography (EEG), which is recorded from five brain regions: frontal, central, parietal, occipital, and temporal. The EEG is acquired from sixteen commercially-rated pilots during the window of circadian low (2:00 am-6:00 am). MS events are annotated using the Driver Monitoring System and further verified using electrooculogram (EOG). A total of 55 features are extracted from EEG. A subset of these features is then selected using a wrapper-based method. The selected features are fed into a linear or quadratic discriminant analysis (LDA or QDA) classifier to automatically differentiate baseline from MS states. The overall classification performance of the best-proposed algorithm is 87.11% in terms of F1 score. This preliminary result highlights the potential of the proposed method towards automatic drowsiness detection which could assist mitigating aviation accidents in the future, pending hardware development to record such EEG signals from the confines of the aviation headset.

An iterative cross-subject negative-unlabeled learning algorithm for quantifying passive fatigue

OBJECTIVE

This paper proposes an iterative negative-unlabeled (NU) learning algorithm for cross-subject detection of passive fatigue from labelled alert (negative) and unlabeled driving EEG data.

APPROACH

Unlike other studies which used manual labeling of the fatigue state, the proposed algorithm (PA) first iteratively uses 29 subjects' alert data and unlabeled driving data to identify the most fatigued block of EEG data in each subject in a cross-subject manner. Subsequently, the PA computes subjects' driving fatigue score. Repeated measures correlations of the score to EEG band powers are then performed.

MAIN RESULTS

The PA yields an averaged accuracy of 93.77%  ±  8.15% across subjects in detecting fatigue, which is significantly better than the various baselines. The fatigue scores obtained are also significantly positively correlated with theta band power and negatively correlated with beta band power that are known to respectively increase and decrease in presence of passive fatigue. There is a strong negative correlation with alpha band power as well.

SIGNIFICANCE

The proposed iterative NU learning algorithm is capable of labelling and quantifying the most fatigued block in a cross-subject manner despite the lack of ground truth in the fatigue levels of unlabeled driving EEG data. Together with the significant correlations with theta, alpha and beta band power, the results show promise in the application of the proposed algorithm to detect fatigue from EEG.

Detection of Driver Braking Intention Using EEG Signals During Simulated Driving

In this work, we developed a novel system to detect the braking intention of drivers in emergency situations using electroencephalogram (EEG) signals. The system acquired eight-channel EEG and motion-sensing data from a custom-designed EEG headset during simulated driving. A novel method for accurately labeling the training data during an extremely short period after the onset of an emergency stimulus was introduced. Two types of features, including EEG band power-based and autoregressive (AR)-based, were investigated. It turned out that the AR-based feature in combination with artificial neural network classifier provided better detection accuracy of the system. Experimental results for ten subjects indicated that the proposed system could detect the emergency braking intention approximately 600 ms before the onset of the executed braking event, with high accuracy of 91%. Thus, the proposed system demonstrated the feasibility of developing a brain-controlled vehicle for real-world applications.

A Comprehensive Survey of Driving Monitoring and Assistance Systems

Improving a vehicle driver's performance decreases the damage caused by, and chances of, road accidents. In recent decades, engineers and researchers have proposed several strategies to model and improve driving monitoring and assistance systems (DMAS). This work presents a comprehensive survey of the literature related to driving processes, the main reasons for road accidents, the methods of their early detection, and state-of-the-art strategies developed to assist drivers for a safe and comfortable driving experience. The studies focused on the three main elements of the driving process, viz. driver, vehicle, and driving environment are analytically reviewed in this work, and a comprehensive framework of DMAS, major research areas, and their interaction is explored. A well-designed DMAS improves the driving experience by continuously monitoring the critical parameters associated with the driver, vehicle, and surroundings by acquiring and processing the data obtained from multiple sensors. A discussion on the challenges associated with the current and future DMAS and their potential solutions is also presented.

Prediction of drowsiness events in night shift workers during morning driving

The morning commute home is an especially vulnerable time for workers engaged in night shift work due to the heightened risk of experiencing drowsy driving. One strategy to manage this risk is to monitor the driver's state in real time using an in vehicle monitoring system and to alert drivers when they are becoming sleepy. The primary objective of this study is to build and evaluate predictive models for drowsiness events occurring in morning drives using a variety of physiological and performance data gathered under a real driving scenario. We used data collected from 16 night shift workers who drove an instrumented vehicle for approximately two hours on a test track on two occasions: after a night shift and after a night of rest. Drowsiness was defined by two outcome events: performance degradation (Lane-Crossing models) and electroencephalogram (EEG) characterized sleep episodes (Microsleep Models). For each outcome, we assessed the accuracy of sets of predictors, including or not including a driver factor, eyelid measures, and driving performance measures. We also compared the predictions using different time intervals relative to the events (e.g., 1-min prior to the event through 10-min prior). By examining the Area Under the receiver operating characteristic Curve (AUC), accuracy, sensitivity, and specificity of the predictive models, the results showed that the inclusion of an individual driver factor improved AUC and prediction accuracy for both outcomes. Eyelid measures improved the prediction for the Lane-Crossing models, but not for Microsleep models. Prediction performance was not changed by adding driving performance predictors or by increasing the time to the event for either outcome. The best models for both measures of drowsiness were those considering driver individual differences and eyelid measures, suggesting that these indicators should be strongly considered when predicting drowsiness events. The results of this paper can benefit the development of real-time drowsiness detection and help to manage drowsiness to avoid related motor-vehicle crashes and loss.

Driver Drowsiness Detection Based on Steering Wheel Data Applying Adaptive Neuro-Fuzzy Feature Selection

This paper presents a novel feature selection method to design a non-invasive driver drowsiness detection system based on steering wheel data. The proposed feature selector can select the most related features to the drowsiness level to improve the classification accuracy. This method is based on the combination of the filter and wrapper feature selection algorithms using adaptive neuro-fuzzy inference system (ANFIS). In this method firstly, four different filter indexes are applied on extracted features from steering wheel data. After that, output values of each filter index are imported as inputs to a fuzzy inference system to determine the importance degree of each feature and select the most important features. Then, the selected features are imported to a support vector machine (SVM) for binary classification to classify the driving conditions in two classes of drowsy and awake. Finally, the classifier accuracy is exploited to adjust parameters of an adaptive fuzzy system using a particle swarm optimization (PSO) algorithm. The experimental data were collected from about 20.5 h of driving in the simulator. The results show that the drowsiness detection system is working with a high accuracy and also confirm that this method is more accurate than the recent available algorithms.

Use of the Stockwell Transform in the Detection of P300 Evoked Potentials with Low-Cost Brain Sensors

The evoked potential is a neuronal activity that originates when a stimulus is presented. To achieve its detection, various techniques of brain signal processing can be used. One of the most studied evoked potentials is the P300 brain wave, which usually appears between 300 and 500 ms after the stimulus. Currently, the detection of P300 evoked potentials is of great importance due to its unique properties that allow the development of applications such as spellers, lie detectors, and diagnosis of psychiatric disorders. The present study was developed to demonstrate the usefulness of the Stockwell transform in the process of identifying P300 evoked potentials using a low-cost electroencephalography (EEG) device with only two brain sensors. The acquisition of signals was carried out using the Emotiv EPOC^® device—a wireless EEG headset. In the feature extraction, the Stockwell transform was used to obtain time-frequency information. The algorithms of linear discriminant analysis and a support vector machine were used in the classification process. The experiments were carried out with 10 participants; men with an average age of 25.3 years in good health. In general, a good performance (75⁻92%) was obtained in identifying P300 evoked potentials.

Driver drowsiness detection using the in-ear EEG

Driver drowsiness monitoring is one of the most demanded technologies for active prevention of severe road accidents. Electroencephalogram (EEG) and several peripheral signals have been suggested for the drowsiness monitoring. However, each type of signal has partial limitations in terms of either convenience or accuracy. Recent emerged concept of in-ear EEG raises expectations due to reduced obtrusiveness. It is yet unclear whether the in-ear EEG is effective enough for drowsiness detection in comparison with on-scalp EEG or peripheral signals. In this work, we evaluated performance of the in-ear EEG in drivers' alertness-drowsiness classification for the first time. Simultaneously, we also tested three peripheral signals including electrocardiogram (ECG), photoplethysmogram (PPG), and galvanic skin response (GSR) which have advantage in convenience of measurement. The classification analysis using the in-ear EEG resulted in high classification accuracy comparable to that of the individual on-scalp EEG channels. The ECG, PPG and GSR showed competitive performance but only when used together in pairwise combinations. Our results suggest that the in-ear EEG would be viable alternative to the single channel EEG or the individual peripheral signals for the drowsiness monitoring.

A systematic review of hybrid brain-computer interfaces: Taxonomy and usability perspectives

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation.

Online Detection of Driver Fatigue Using Steering Wheel Angles for Real Driving Conditions

This paper presents a drowsiness on-line detection system for monitoring driver fatigue level under real driving conditions, based on the data of steering wheel angles (SWA) collected from sensors mounted on the steering lever. The proposed system firstly extracts approximate entropy (ApEn) features from fixed sliding windows on real-time steering wheel angles time series. After that, this system linearizes the ApEn features series through an adaptive piecewise linear fitting using a given deviation. Then, the detection system calculates the warping distance between the linear features series of the sample data. Finally, this system uses the warping distance to determine the drowsiness state of the driver according to a designed binary decision classifier. The experimental data were collected from 14.68 h driving under real road conditions, including two fatigue levels: “wake” and “drowsy”. The results show that the proposed system is capable of working online with an average 78.01% accuracy, 29.35% false detections of the “awake” state, and 15.15% false detections of the “drowsy” state. The results also confirm that the proposed method based on SWA signal is valuable for applications in preventing traffic accidents caused by driver fatigue.

Research on the Relationship between Reaction Ability and Mental State for Online Assessment of Driving Fatigue

Background: Driving fatigue affects the reaction ability of a driver. The aim of this research is to analyze the relationship between driving fatigue, physiological signals and driver’s reaction time. Methods: Twenty subjects were tested during driving. Data pertaining to reaction time and physiological signals including electroencephalograph (EEG) were collected from twenty simulation experiments. Grey correlation analysis was used to select the input variable of the classification model. A support vector machine was used to divide the mental state into three levels. The penalty factor for the model was optimized using a genetic algorithm. Results: The results show that α/β has the greatest correlation to reaction time. The classification results show an accuracy of 86%, a sensitivity of 87.5% and a specificity of 85.53%. The average increase of reaction time is 16.72% from alert state to fatigued state. Females have a faster decrease in reaction ability than males as driving fatigue accumulates. Elderly drivers have longer reaction times than the young. Conclusions: A grey correlation analysis can be used to improve the classification accuracy of the support vector machine (SVM) model. This paper provides basic research that online detection of fatigue can be performed using only a simple device, which is more comfortable for users.