Using Fixation-Related Potentials for Inspecting Natural Interactions

Tracking drivers' minds: Continuous evaluation of mental load and cognitive processing in a realistic driving simulator scenario by means of the EEG

Driving safety strongly depends on the driver's mental states and attention to the driving situation. Previous studies demonstrate a clear relationship between EEG measures and mental states, such as alertness and drowsiness, but often only map their mental state for a longer period of time. In this driving simulation study, we exploit the high temporal resolution of the EEG to capture fine-grained modulations in cognitive processes occurring before and after eye activity in the form of saccades, fixations, and eye blinks. A total of 15 subjects drove through an approximately 50-km course consisting of highway, country road, and urban passages. Based on the ratio of brain oscillatory alpha and theta activity, the total distance was classified into 10-m-long sections with low, medium, and high task loads. Blink-evoked and fixation-evoked event-related potentials, spectral perturbations, and lateralizations were analyzed as neuro-cognitive correlates of cognition and attention. Depending on EEG-based estimation of task load, these measures showed distinct patterns associated with driving behavior parameters such as speed and steering acceleration and represent a temporally highly resolved image of specific cognitive processes during driving. In future applications, combinations of these EEG measures could form the basis for driver warning systems which increase overall driving safety by considering rapid fluctuations in driver's attention and mental states.

A passive BCI for monitoring the intentionality of the gaze-based moving object selection

OBJECTIVE

The use of an electroencephalogram (EEG) anticipation-related component, the expectancy wave (E-wave), in brain-machine interaction was proposed more than 50 years ago. This possibility was not explored for decades, but recently it was shown that voluntary attempts to select items using eye fixations, but not spontaneous eye fixations, are accompanied by the E-wave. Thus, the use of the E-wave detection was proposed for the enhancement of gaze interaction technology, which has a strong need for a mean to decide if a gaze behaviour is voluntary or not. Here, we attempted at estimating whether this approach can be used in the context of moving object selection through smooth pursuit eye movements.

APPROACH

18 participants selected, one by one, items which moved on a computer screen, by gazing at them. In separate runs, the participants performed tasks not related to voluntary selection but also provoking smooth pursuit. A low-cost consumer-grade eye tracker was used for item selection.

MAIN RESULTS

A component resembling the E-wave was found in the averaged EEG segments time-locked to voluntary selection events of every participant. Linear discriminant analysis with shrinkage regularization (sLDA) classified the intentional and spontaneous smooth pursuit eye movements, using single-trial 300 ms long EEG segments, significantly above chance in eight participants. When the classifier output was averaged over ten subsequent data segments, median group ROC AUC of 0.75 was achieved.

SIGNIFICANCE

The results suggest the possible usefulness of the E-wave detection in the gaze-based selection of moving items, e.g., in video games. This technique might be more effective when trial data can be averaged, thus it could be considered for use in passive interfaces, for example, in estimating the degree of the user's involvement during gaze-based interaction.