Workload assessment of computer gaming using a single-stimulus event-related potential paradigm

Cognitive workload estimation using physiological measures: a review

Estimating cognitive workload levels is an emerging research topic in the cognitive neuroscience domain, as participants' performance is highly influenced by cognitive overload or underload results. Different physiological measures such as Electroencephalography (EEG), Functional Magnetic Resonance Imaging, Functional near-infrared spectroscopy, respiratory activity, and eye activity are efficiently used to estimate workload levels with the help of machine learning or deep learning techniques. Some reviews focus only on EEG-based workload estimation using machine learning classifiers or multimodal fusion of different physiological measures for workload estimation. However, a detailed analysis of all physiological measures for estimating cognitive workload levels still needs to be discovered. Thus, this survey highlights the in-depth analysis of all the physiological measures for assessing cognitive workload. This survey emphasizes the basics of cognitive workload, open-access datasets, the experimental paradigm of cognitive tasks, and different measures for estimating workload levels. Lastly, we emphasize the significant findings from this review and identify the open challenges. In addition, we also specify future scopes for researchers to overcome those challenges.

Detecting and Predicting Pilot Mental Workload Using Heart Rate Variability: A Systematic Review

Measuring pilot mental workload (MWL) is crucial for enhancing aviation safety. However, MWL is a multi-dimensional construct that could be affected by multiple factors. Particularly, in the context of a more automated cockpit setting, the traditional methods of assessing pilot MWL may face challenges. Heart rate variability (HRV) has emerged as a potential tool for detecting pilot MWL during real-flight operations. This review aims to investigate the relationship between HRV and pilot MWL and to assess the performance of machine-learning-based MWL detection systems using HRV parameters. A total of 29 relevant papers were extracted from three databases for review based on rigorous eligibility criteria. We observed significant variability across the reviewed studies, including study designs and measurement methods, as well as machine-learning techniques. Inconsistent results were observed regarding the differences in HRV measures between pilots under varying levels of MWL. Furthermore, for studies that developed HRV-based MWL detection systems, we examined the diverse model settings and discovered that several advanced techniques could be used to address specific challenges. This review serves as a practical guide for researchers and practitioners who are interested in employing HRV indicators for evaluating MWL and wish to incorporate cutting-edge techniques into their MWL measurement approaches.

Does artistic training affect color perception? A study of ERPs and EROs in experiencing colors of different brightness

Color is a visual cue that can convey emotions and attract attention, and there is no doubt that brightness is an important element of color differentiation. To examine the impact of art training on color perception, 44 participants were assigned to two groups-one for those with and one for those without art training-in an EEG experiment. While the participants had their electroencephalographic data recorded, they scored their emotional responses to color stimuli of different brightness levels based on the Munsell color system. The behavioral results revealed that in both groups, high-brightness colors were rated more positively than low-brightness colors. Furthermore, event-related potential results for the artist group showed that high-brightness colors enhanced P2 and P3 amplitudes. Moreover, non-artists had longer N2 latency than artists, and there was a significant Group × Brightness interaction separately for the N2 and P3 components. Simple effect analysis showed that N2 and P3 amplitudes were substantially higher for high-brightness stimuli than for lower-brightness stimuli in the artistic group, but this was not the case in the non-artist group. Additionally, evoked event-related oscillation results showed that in both groups, high-brightness stimuli also elicited large delta, theta, and alpha as well as low gamma responses. These results indicate that high-brightness color stimuli elicit more positive emotions and stronger neurological reactions and that artistic training may have a positive effect on top-down visual perception.

Fixation-related potentials during mobile map assisted navigation in the real world: The effect of landmark visualization style

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of those landmarks during route navigation. We utilized a real-world mobile electroencephalography approach to this question by combining several tools developed to overcome the challenges typically encountered in real-world neuroscience research. We coregistered eye-movement and EEG recordings from 45 participants as they navigated through a real-world environment using a mobile map. Analyses of fixation event-related potentials revealed that the amplitude of the parietal P200 component was enhanced when participants fixated landmarks in the real world that were visualized on the mobile map in a realistic style, and that frontal P200 latencies were prolonged for landmarks depicted in either a realistic or abstract style compared with features of the environment that were not presented on the map, but only for the male participants. In contrast, we did not observe any significant effects of landmark visualization style on visual P1-N1 peaks or the parietal late positive component. Overall, the findings indicate that the cognitive matching process between landmarks seen in the environment and those previously seen on a map is facilitated by more realistic map display, while low-level perceptual processing of landmarks and recall of associated information are unaffected by map visualization style.

Evaluation of a headphones-fitted EEG system for the recording of auditory evoked potentials and mental workload assessment

Advancements in portable neuroimaging technologies open up new opportunities to gain insight into the neural dynamics and cognitive processes underlying day-to-day behaviors. In this study, we evaluated the relevance of a headphone- mounted electroencephalogram (EEG) system for monitoring mental workload. The participants (N = 12) were instructed to pay attention to auditory alarms presented sporadically while performing the Multi-Attribute Task Battery (MATB) whose difficulty was staged across three conditions to manipulate mental workload. The P300 Event-Related Potentials (ERP) elicited by the presentation of auditory alarms were used as probes of attentional resources available. The amplitude and latency of P300 ERPs were compared across experimental conditions. Our findings indicate that the P300 ERP component can be captured using a headphone-mounted EEG system. Moreover, neural responses to alarm could be used to classify mental workload with high accuracy (over 80%) at a single-trial level. Our analyses indicated that the signal-to-noise ratio acquired by the sponge-based sensors remained stable throughout the recordings. These results highlight the potential of portable neuroimaging technology for the development of neuroassistive applications while underscoring the current limitations and challenges associated with the integration of EEG sensors in everyday-life wearable technologies. Overall, our study contributes to the growing body of research exploring the feasibility and validity of wearable neuroimaging technologies for the study of human cognition and behavior in real-world settings.

Task-independent auditory probes reveal changes in mental workload during simulated quadrotor UAV training

Objective

The event-related potential (ERP) methods based on laboratory control scenes have been widely used to measure the level of mental workload during operational tasks. In this study, both task difficulty and test time were considered. Auditory probes (ignored task-irrelevant background sounds) were used to explore the changes in mental workload of unmanned aerial vehicle (UAV) operators during task execution and their ERP representations.

Approach

51 students participated in a 10-day training and test of simulated quadrotor UAV. During the experiment, background sound was played to induce ERP according to the requirements of oddball paradigm, and the relationship between mental workload and the amplitudes of N200 and P300 in ERP was explored.

Main results

Our study shows that the mental workload during operational task training is multi-dimensional, and its changes are affected by bottom-up perception and top-down cognition. The N200 component of the ERP evoked by the auditory probe corresponds to the bottom-up perceptual part; while the P300 component corresponds to the top-down cognitive part, which is positively correlated with the improvement of skill level.

Significance

This paper describes the relationship between ERP induced by auditory probes and mental workload from the perspective of multi-resource theory and human information processing. This suggests that the auditory probe can be used to reveal the mental workload during the training of operational tasks, which not only provides a possible reference for measuring the mental workload, but also provides a possibility for identifying the development of the operator's skill level and evaluating the training effect.

A study on neural changes induced by sauna bathing: Neural basis of the "totonou" state

Saunas are becoming increasingly popular worldwide, being an activity that promotes relaxation and health. Intense feelings of happiness have been reported shortly after enjoying a hot sauna and cold water, what is known in Japan as the "totonou" state. However, no research has investigated what occurs in the brain during the "totonou" state. In the present study, participants underwent a sauna phase, consisting of three sets of alternating hot sauna, cold water, and rest. We elucidated changes in brain activity and mood in the "totonou" state by measuring and comparing brain activity and emotional scales before and after the sauna phase and during the rest phase in each set. We found significant increases in theta and alpha power during rest and after the sauna phase compared to before the sauna phase. Moreover, in an auditory oddball task, the p300 amplitude decreased significantly and MMN amplitude increased significantly after the sauna phase. The increase in MMN indicates higher activation of the pre-attentional auditory process, leading to a decrease in attention-related brain activity P300. Hence, the brain reaches in a more efficient state. Further, the response time in behavioral tasks decreased significantly. In addition, the participants' subjective responses to the questionnaire showed significant changes in physical relaxation and other indicators after being in the sauna. Finally, we developed an artificial intelligence classifier, obtaining an average accuracy of brain state classification of 88.34%. The results have potential for future application.

Virtual Reality Sickness Reduces Attention During Immersive Experiences

In this paper, we show that Virtual Reality (VR) sickness is associated with a reduction in attention, which was detected with the P3b Event-Related Potential (ERP) component from electroencephalography (EEG) measurements collected in a dual-task paradigm. We hypothesized that sickness symptoms such as nausea, eyestrain, and fatigue would reduce the users' capacity to pay attention to tasks completed in a virtual environment, and that this reduction in attention would be dynamically reflected in a decrease of the P3b amplitude while VR sickness was experienced. In a user study, participants were taken on a tour through a museum in VR along paths with varying amounts of rotation, shown previously to cause different levels of VR sickness. While paying attention to the virtual museum (the primary task), participants were asked to silently count tones of a different frequency (the secondary task). Control measurements for comparison against the VR sickness conditions were taken when the users were not wearing the Head-Mounted Display (HMD) and while they were immersed in VR but not moving through the environment. This exploratory study shows, across multiple analyses, that the effect mean amplitude of the P3b collected during the task is associated with both sickness severity measured after the task with a questionnaire (SSQ) and with the number of counting errors on the secondary task. Thus, VR sickness may impair attention and task performance, and these changes in attention can be tracked with ERP measures as they happen, without asking participants to assess their sickness symptoms in the moment.

Biomarkers of professional cybersportsmen: Event related potentials and cognitive tests study

"Faster, higher, stronger" is the motto of any professional athlete. Does that apply to brain dynamics as well? In our paper, we performed a series of EEG experiments on Visually Evoked Potentials and a series of cognitive tests-reaction time and visual search, with professional eSport players in Counter-Strike: Global Offensive (CS:GO) and novices (control group) in order to find important differences between them. EEG data were studied in a temporal domain by Event-Related Potentials (ERPs) and in a frequency domain by Variational Mode Decomposition. The EEG analysis showed that the brain reaction of eSport players is faster (P300 latency is earlier on average by 20-70 ms, p < 0.005) and stronger (P300 peak amplitude is higher on average by 7-9 mkV, p < 0.01). Professional eSport players also exhibit stronger stimulus-locked alpha-band power. Besides, the Spearman correlation analysis showed a significant correlation between hours spend in CS:GO and mean amplitude of P200 and N200 for the professional players. The comparison of cognitive test results showed the superiority of the professional players to the novices in reaction time (faster) and choice reaction time-faster reaction, but similar correctness, while a significant difference in visual search skills was not detected. Thus, significant differences in EEG signals (in spectrograms and ERPs) and cognitive test results (reaction time) were detected between the professional players and the control group. Cognitive tests could be used to separate skilled players from novices, while EEG testing can help to understand the skilled player's level. The results can contribute to understanding the impact of eSport on a player's cognitive state and associating eSport with a real sport. Moreover, the presented results can be useful for evaluating eSport team members and making training plans.

Measuring cognitive load of digital interface combining event-related potential and BubbleView

Helmet mounted display systems (HMDs) are high-performance display devices for modern aircraft. We propose a novel method combining event-related potentials (ERPs) and BubbleView to measure cognitive load under different HMD interfaces. The distribution of the subjects' attention resources is reflected by analyzing the BubbleView, and the input of the subjects' attention resources on the interface is reflected by analyzing the ERP's P3b and P2 components. The results showed that the HMD interface with more symmetry and a simple layout had less cognitive load, and subjects paid more attention to the upper portion of the interface. Combining the experimental data of ERP and BubbleView, we can obtain a more comprehensive, objective, and reliable HMD interface evaluation result. This approach has significant implications for the design of digital interfaces and can be utilized for the iterative evaluation of HMD interfaces.

How do different ambient temperatures and vehicle speeds affect the cognitive performance of male drivers? Evidence from ERP

OBJECTIVE

Excessive cold or overheating can cause a decline in driver performance and even serious traffic accidents, but the influence mechanism of ambient temperature and vehicle speeds on drivers' cognitive performance is still unclear. This research developed an easy driving simulator experiment to study driver performance under different ambient temperatures and vehicle speeds.

METHOD

Simulated driving tasks were performed by 30 male participants at different speeds in low, medium, and high-temperature environments. A behavioral experiment was adopted, and the average reaction time of emergency braking was used as the evaluation index of driver performance.

RESULTS

Both ambient temperature and vehicle speed had a statistically significant relationship with driver's braking reaction time, and the interaction effect was significant.

CONCLUSION

Drivers' cognitive efforts in medium-temperature environments were significantly lower than that at high and low temperatures. Compared with previous studies, this study also monitored differences in the activity of drivers' brain regions in three ambient temperatures, providing a physiological basis for measuring drivers' cognitive efforts.

Neural signatures for the n-back task with different loads: An event-related potential study

The n-back task is widely used in working memory (WM) research. However, it remains unclear how the electrophysiological correlates of WM processes, the P2, N2, P300, and negative slow wave (NSW), are affected by differences in load. Specifically, while previous work has examined the P300, less attention has been paid to the other components assessing the load of the n-back paradigm. The present study aims to investigate whether other sub-processes in WM (such as inhibitory control) are as sensitive to n-back load changes as the update process by observing changes in the above event-related potential (ERP) components. The results showed poorer behavioral performance with increasing WM load. Greater NSW and smaller P300 amplitudes were elicited by n-back task with a higher load compared to that with lower load. In contrast, there was no significant effect of the n-back load on the amplitudes of P2 and N2. These findings suggest that the updating process and the maintenance process are sensitive to the n-back load change. Therefore, changes in the updating and maintenance processes should be considered when using the n-back task to manipulate the WM load in experiments. The present study may contribute to the understanding of the complexity of WM loads. Additionally, a theoretical basis for follow-up research to explore ways of improving WM performance with high load is provided.

Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

OBJECTIVE

We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed.

BACKGROUND

Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics.

RESULTS

Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior.

CONCLUSION

Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.

Multi-Subject Analysis for Brain Developmental Patterns Discovery via Tensor Decomposition of MEG Data

Identification of informative signatures from electrophysiological signals is important for understanding brain developmental patterns, where techniques such as magnetoencephalography (MEG) are particularly useful. However, less attention has been given to fully utilizing the multidimensional nature of MEG data for extracting components that describe these patterns. Tensor factorizations of MEG yield components that encapsulate the data's multidimensional nature, providing parsimonious models identifying latent brain patterns for meaningful summarization of neural processes. To address the need for meaningful MEG signatures for studies of pediatric cohorts, we propose a tensor-based approach for extracting developmental signatures of multi-subject MEG data. We employ the canonical polyadic (CP) decomposition for estimating latent spatiotemporal components of the data, and use these components for group level statistical inference. Using CP decomposition along with hierarchical clustering, we were able to extract typical early and late latency event-related field (ERF) components that were discriminative of high and low performance groups ([Formula: see text]) and significantly correlated with major cognitive domains such as attention, episodic memory, executive function, and language comprehension. We demonstrate that tensor-based group level statistical inference of MEG can produce signatures descriptive of the multidimensional MEG data. Furthermore, these features can be used to study group differences in brain patterns and cognitive function of healthy children. We provide an effective tool that may be useful for assessing child developmental status and brain function directly from electrophysiological measurements and facilitate the prospective assessment of cognitive processes.

Neuroaesthetic exploration on the cognitive processing behind repeating graphics

Repeating graphics are common research objects in modern design education. However, we do not exactly know the attentional processes underlying graphic artifacts consisting of repeating rhythms. In this experiment, the event-related potential, a neuroscientific measure, was used to study the neural correlates of repeating graphics within graded orderliness. We simulated the competitive identification process of people recognizing artifacts with graded repeating rhythms from a scattered natural environment with the oddball paradigm. In the earlier attentional processing related to the P2 component around the Fz electrode within the 150-250 ms range, a middle-grade repeating rhythm (Target 1) did not show a difference from a high-grade repeating rhythm (Target 2). However, in the later cognitive processes related to the P3b component around the Pz electrode within the 300-450 ms range, Target 1 had longer peak latency than Target 2, based on similar waveforms. Thus, we may suppose that the arrangement of the repeating graphics did not influence the earlier attentional processing but affected the later cognitive part, such as the categorization task in the oddball paradigm. Furthermore, as evidenced by the standard deviation wave across the trials, we suggest that the growing standard deviation value might represent the gradual loss of attentional focus to the task after the stimulus onset and that the zero-growth level may represent similar brain activity between trials.

Processing of task-irrelevant sounds during typical everyday activities in children

Our ability to focus on a task and ignore task-irrelevant stimuli is critical for efficient cognitive functioning. Attention control is especially required in the auditory modality as sound has privileged access to perception and consciousness. Despite this important function, little is known about auditory attention during typical everyday activities in childhood. We investigated the impact of task-irrelevant sounds on attention during three everyday activities - playing a game, reading a book, watching a movie. During these activities, environmental novel sounds were presented within a sequence of standard sounds to 7-8-year-old children and adults. We measured ERPs reflecting early sound processing and attentional orienting and theta power evoked by standard and novel sounds during these activities. Playing a game versus reading or watching reduced early encoding of sounds in children and affected ongoing information processing and attention allocation in both groups. In adults, theta power was reduced during playing at mid-central brain areas. Results show a pattern of immature neuronal mechanisms underlying perception and attention of task-irrelevant sounds in 7-8-year-old children. While the type of activity affected the processing of irrelevant sounds in both groups, early stimulus encoding processes were more sensitive to the type of activities in children.

The Effect of Cognitive Load on Auditory Susceptibility During Automated Driving

OBJECTIVE

We experimentally test the effect of cognitive load on auditory susceptibility during automated driving.

BACKGROUND

In automated vehicles, auditory alerts are frequently used to request human intervention. To ensure safe operation, human drivers need to be susceptible to auditory information. Previous work found reduced susceptibility during manual driving and in a lesser amount during automated driving. However, in practice, drivers also perform nondriving tasks during automated driving, of which the associated cognitive load may further reduce susceptibility to auditory information. We therefore study the effect of cognitive load during automated driving on auditory susceptibility.

METHOD

Twenty-four participants were driven in a simulated automated car. Concurrently, they performed a task with two levels of cognitive load: repeat a noun or generate a verb that expresses the use of this noun. Every noun was followed by a probe stimulus to elicit a neurophysiological response: the frontal P3 (fP3), which is a known indicator for the level of auditory susceptibility.

RESULTS

The fP3 was significantly lower during automated driving with cognitive load compared with without. The difficulty level of the cognitive task (repeat or generate) showed no effect.

CONCLUSION

Engaging in other tasks during automated driving decreases auditory susceptibility as indicated by a reduced fP3.

APPLICATION

Nondriving task can create additional cognitive load. Our study shows that performing such tasks during automated driving reduces the susceptibility for auditory alerts. This can inform designers of semi-automated vehicles (SAE levels 3 and 4), where human intervention might be needed.

Investigation of the optimal time interval between task-irrelevant auditory probes for evaluating mental workload in the shortest possible time

Event-related brain potentials (ERPs) elicited by auditory stimuli unrelated to a current visual-cognitive task (i.e., task-irrelevant auditory probes) can be used to evaluate the level of mental workload. Towards the evaluation of workload in the shortest possible time, the present study with a multiple-stimulus paradigm (Takeda and Kimura, 2014, Int. J. Psychophysiol.) examined whether manipulating time intervals between probes could improve the temporal resolution in evaluating workload. Probes were presented in four interval conditions as a combination of two mean interval lengths [long (600 ms) vs. short (300 ms)] and two interval variabilities [variable (five levels) vs. fixed], while participants were performing a driving game at slow and fast speeds (i.e., imposing low and high workload, respectively). For each interval condition, the minimum data length required to obtain a significant difference in the amplitude of ERPs (i.e., auditory N1 and P2) between the slow and fast driving tasks was estimated. The N1 difference was significant in all four interval conditions but the required minimum data lengths to observe this difference did not greatly differ across the interval conditions (about 60-90 s). The P2 difference was significant only in the long-variable condition and the required minimum data length was about 120 s. These results suggest that, at least with a multiple-stimulus paradigm, manipulations of time intervals between probes did not greatly improve the temporal resolution in evaluating mental workload; at present, long-variable intervals would be optimal for evaluating mental workload in detail.

Psychosis Biotypes: Replication and Validation from the B-SNIP Consortium

Current clinical phenomenological diagnosis in psychiatry neither captures biologically homologous disease entities nor allows for individualized treatment prescriptions based on neurobiology. In this report, we studied two large samples of cases with schizophrenia, schizoaffective, and bipolar I disorder with psychosis, presentations with clinical features of hallucinations, delusions, thought disorder, affective, or negative symptoms. A biomarker approach to subtyping psychosis cases (called psychosis Biotypes) captured neurobiological homology that was missed by conventional clinical diagnoses. Two samples (called "B-SNIP1" with 711 psychosis and 274 healthy persons, and the "replication sample" with 717 psychosis and 198 healthy persons) showed that 44 individual biomarkers, drawn from general cognition (BACS), motor inhibitory (stop signal), saccadic system (pro- and anti-saccades), and auditory EEG/ERP (paired-stimuli and oddball) tasks of psychosis-relevant brain functions were replicable (r's from .96-.99) and temporally stable (r's from .76-.95). Using numerical taxonomy (k-means clustering) with nine groups of integrated biomarker characteristics (called bio-factors) yielded three Biotypes that were virtually identical between the two samples and showed highly similar case assignments to subgroups based on cross-validations (88.5%-89%). Biotypes-1 and -2 shared poor cognition. Biotype-1 was further characterized by low neural response magnitudes, while Biotype-2 was further characterized by overactive neural responses and poor sensory motor inhibition. Biotype-3 was nearly normal on all bio-factors. Construct validation of Biotype EEG/ERP neurophysiology using measures of intrinsic neural activity and auditory steady state stimulation highlighted the robustness of these outcomes. Psychosis Biotypes may yield meaningful neurobiological targets for treatments and etiological investigations.

Simultaneous Classification of Both Mental Workload and Stress Level Suitable for an Online Passive Brain-Computer Interface

Research studies on EEG-based mental workload detection for a passive BCI generally focus on classifying cognitive states associated with the performance of tasks at different levels of difficulty, with no other aspects of the user's mental state considered. However, in real-life situations, different aspects of the user's state such as their cognitive (e.g., level of mental workload) and affective (e.g., level of stress/anxiety) states will often change simultaneously, and performance of a BCI system designed considering just one state may be unreliable. Moreover, multiple mental states may be relevant to the purposes of the BCI-for example both mental workload and stress level might be related to an aircraft pilot's risk of error-and the simultaneous prediction of states may be critical in maximizing the practical effectiveness of real-life online BCI systems. In this study we investigated the feasibility of performing simultaneous classification of mental workload and stress level in an online passive BCI. We investigated both subject-specific and cross-subject classification approaches, the latter with and without the application of a transfer learning technique to align the distributions of data from the training and test subjects. Using cross-subject classification with transfer learning in a simulated online analysis, we obtained accuracies of 77.5 ± 6.9% and 84.1 ± 5.9%, across 18 participants for mental workload and stress level detection, respectively.

Do Attentional Lapses Account for the Worst Performance Rule?

The worst performance rule (WPR) describes the phenomenon that individuals’ slowest responses in a task are often more predictive of their intelligence than their fastest or average responses. To explain this phenomenon, it was previously suggested that occasional lapses of attention during task completion might be associated with particularly slow reaction times. Because less intelligent individuals should experience lapses of attention more frequently, reaction time distribution should be more heavily skewed for them than for more intelligent people. Consequently, the correlation between intelligence and reaction times should increase from the lowest to the highest quantile of the response time distribution. This attentional lapses account has some intuitive appeal, but has not yet been tested empirically. Using a hierarchical modeling approach, we investigated whether the WPR pattern would disappear when including different behavioral, self-report, and neural measurements of attentional lapses as predictors. In a sample of N = 85, we found that attentional lapses accounted for the WPR, but effect sizes of single covariates were mostly small to very small. We replicated these results in a reanalysis of a much larger previously published data set. Our findings render empirical support to the attentional lapses account of the WPR.

Cross-Task Consistency of Electroencephalography-Based Mental Workload Indicators: Comparisons Between Power Spectral Density and Task-Irrelevant Auditory Event-Related Potentials

Mental workload (MWL) estimators based on ongoing electroencephalography (EEG) and event-related potentials (ERPs) have shown great potentials to build adaptive aiding systems for human-machine systems by estimating MWL in real time. However, extracting EEG features which are consistent in indicating MWL across different tasks is still one of the critical challenges. This study attempts to compare the cross-task consistency in indexing MWL variations between two commonly used EEG-based MWL indicators, power spectral density (PSD) of ongoing EEG and task-irrelevant auditory ERPs (tir-aERPs). The verbal N-back and the multi-attribute task battery (MATB), both with two difficulty levels, were employed in the experiment, along with task-irrelevant auditory probes. EEG was recorded from 17 subjects when they were performing the tasks. The tir-aERPs elicited by the auditory probes and the relative PSDs of ongoing EEG between two consecutive auditory probes were extracted and statistically analyzed to reveal the effects of MWL and task type. Discriminant analysis and support vector machine were employed to examine the generalization of tir-aERP and PSD features in indexing MWL variations across different tasks. The results showed that the amplitudes of tir-aERP components, N1, early P3a, late P3a, and the reorienting negativity, significantly decreased with the increasing MWL in both N-back and MATB. Task type had no obvious influence on the amplitudes and topological layout of the MWL-sensitive tir-aERP features. The relative PSDs in θ, α, and low β bands were also sensitive to MWL variations. However, the MWL-sensitive PSD features and their topological patterns were significantly affected by task type. The cross-task classification results based on tir-aERP features also significantly outperformed the PSD features. These results suggest that the tir-aERPs should be potentially more consistent MWL indicators across very different task types when compared to PSD. The current study may provide new insights to our understanding of the common and distinctive neuropsychological essences of MWL across different tasks.

Working With Environmental Noise and Noise-Cancelation: A Workload Assessment With EEG and Subjective Measures

As working and learning environments become open and flexible, people are also potentially surrounded by ambient noise, which causes an increase in mental workload. The present study uses electroencephalogram (EEG) and subjective measures to investigate if noise-canceling technologies can fade out external distractions and free up mental resources. Therefore, participants had to solve spoken arithmetic tasks that were read out via headphones in three sound environments: a quiet environment (no noise), a noisy environment (noise), and a noisy environment but with active noise-canceling headphones (noise-canceling). Our results of brain activity partially confirm an assumed lower mental load in no noise and noise-canceling compared to noise test condition. The mean P300 activation at Cz resulted in a significant differentiation between the no noise and the other two test conditions. Subjective data indicate an improved situation for the participants when using the noise-canceling technology compared to “normal” headphones but shows no significant discrimination. The present results provide a foundation for further investigations into the relationship between noise-canceling technology and mental workload. Additionally, we give recommendations for an adaptation of the test design for future studies.

EEG and behavioral correlates of attentional processing while walking and navigating naturalistic environments

The capacity to regulate one's attention in accordance with fluctuating task demands and environmental contexts is an essential feature of adaptive behavior. Although the electrophysiological correlates of attentional processing have been extensively studied in the laboratory, relatively little is known about the way they unfold under more variable, ecologically-valid conditions. Accordingly, this study employed a 'real-world' EEG design to investigate how attentional processing varies under increasing cognitive, motor, and environmental demands. Forty-four participants were exposed to an auditory oddball task while (1) sitting in a quiet room inside the lab, (2) walking around a sports field, and (3) wayfinding across a university campus. In each condition, participants were instructed to either count or ignore oddball stimuli. While behavioral performance was similar across the lab and field conditions, oddball count accuracy was significantly reduced in the campus condition. Moreover, event-related potential components (mismatch negativity and P3) elicited in both 'real-world' settings differed significantly from those obtained under laboratory conditions. These findings demonstrate the impact of environmental factors on attentional processing during simultaneously-performed motor and cognitive tasks, highlighting the value of incorporating dynamic and unpredictable contexts within naturalistic designs.

Tablet PC use directly affects children's perception and attention

Children currently grow up with a marked increase in interactive digital mobile media. To what extent digital media directly modulate children’s perception and attention is largely unknown. We investigated the processing of task-irrelevant auditory information while 37 children aged 6;8–9;1-years played the identical card game on a tablet PC or with the experimenter in reality. The sound sequence included repeated standard sounds and occasionally novel sounds. Event-related potentials in the EEG, that reflect sound-related processes of perception and attention, were measured. Sounds evoked increased amplitudes of the ERP components P1, P2 and P3a during the interaction with the tablet PC compared to the human interaction. This indicates enhanced early processing of task-irrelevant information and increased allocation of attention to sounds throughout the interaction with a tablet PC compared to a human partner. Results suggest direct effects of typical situations, where children interact with a tablet PC, on neuronal mechanisms that drive perception and attention in the developing brain. More research into this phenomena is required to make specific suggestions for developing digital interactive learning programs.

The Effects of Driving Experience on the P300 Event-Related Potential during the Perception of Traffic Scenes

The incidence of human-error-related traffic collisions is markedly reduced among drivers who have few years of driving experience compared with those with little driving experience or fewer driving opportunities, even if they have a driver's license. This study analyzes the effect of driving experience on the perception of the traffic scenes through electroencephalograms (EEGs). Primarily, we focused on visual attention during driving, the essential visual function in the visual search and human gaze, and evaluated the P300, which is involved in attention, to explore the effect of driving experience on the visual attention of traffic scenes, not for improving visual ability. In the results, the P300 response was observed in both experienced and beginner drivers when they paid visual attention to the visual target. Furthermore, the latency for the peak amplitude of the P300 response among experienced drivers was markedly faster than that in beginner drivers, suggesting that the P300 latency is a piece of crucial information for driving experience on visual attention.

Efficacy of a Single-Task ERP Measure to Evaluate Cognitive Workload During a Novel Exergame

This study aimed to validate the efficacy of single-task event-related potential (ERP) measures of cognitive workload to be implemented in exergame-based rehabilitation. Twenty-four healthy participants took part in a novel gamified balance task where task-irrelevant auditory tones were presented in the background to generate ERPs in the participants’ electroencephalogram (EEG) as a measure of cognitive workload. For the balance task, a computer-based tilt-ball game was combined with a balance board. Participants played the game by shifting their weight to tilt the balance board, which moved a virtual ball to score goals. The game was manipulated by adjusting the size of the goalposts to set three predefined levels of game difficulty (easy, medium, and hard). The participant’s experience of game difficulty was evaluated based on the number of goals scored and their subjective reporting of perceived difficulty. Participants experienced a significant difference in the three levels of task difficulty based on the number of goals scored and perceived difficulty (p < 0.001). Post hoc analysis revealed the lowest performance for the hardest level. The mean amplitude of the N1 ERP component was used to measure the cognitive workload associated with the three difficulty levels. The N1 component’s amplitude decreased significantly (p < 0.001), with an increase in the task difficulty. Moreover, the amplitude of the N1 component for the hard level was significantly smaller compared to medium (p = 0.0003) and easy (p < 0.001) levels. These results support the efficacy of the N1 ERP component to measure cognitive workload in dynamic and real-life scenarios such as exergames and other rehabilitation exercises.

Mental workload classification based on ignored auditory probes and spatial covariance

Objective.Estimation of mental workload (MWL) levels by electroencephalography (EEG)-based mental state monitoring systems has been widely explored. Using event-related potentials (ERPs), elicited by ignored auditory probes, minimizes intrusiveness and has shown high performance for estimating MWL level when tested in laboratory situations. However, when facing real-world applications, the characteristics of ERP waveforms, like latency and amplitude, are often affected by noise, which leads to a decrease in classification performance. One approach to mitigating this is using spatial covariance, which is less sensitive to latency and amplitude distortion. In this study, we used ignored auditory probes in a single-stimulus paradigm and tested Riemannian processed covariance-based features for MWL level estimation in a realistic flight-control task.Approach.We recorded EEG data with an eight-channel system from participants while they performed a simulated drone-control task and manipulated MWL levels (high and low) by task difficulty. We compared support vector machine classification performance based on frequency band power features versus features generated via the Riemannian log map operator from spatial covariance matrices. We also compared accuracy of using data segmented as auditory ERPs versus non-ERPs, for which data windows did not overlap with the ERPs.Main results.Classification accuracy of both types of features showed no significant difference between ERPs and non-ERPs. When we ignore auditory stimuli to perform continuous decoding, covariance-based features in the gamma band had area under the receiver-operating-characteristic curve (AUC) of 0.883, which was significantly higher than band power features (AUC = 0.749).Significance.This study demonstrates that Riemannian-processed covariance features are viable for MWL classification under a realistic experimental scenario.

Real-time prediction of short-timescale fluctuations in cognitive workload

Human operators often experience large fluctuations in cognitive workload over seconds timescales that can lead to sub-optimal performance, ranging from overload to neglect. Adaptive automation could potentially address this issue, but to do so it needs to be aware of real-time changes in operators' spare cognitive capacity, so it can provide help in times of peak demand and take advantage of troughs to elicit operator engagement. However, it is unclear whether rapid changes in task demands are reflected in similarly rapid fluctuations in spare capacity, and if so what aspects of responses to those demands are predictive of the current level of spare capacity. We used the ISO standard detection response task (DRT) to measure cognitive workload approximately every 4 s in a demanding task requiring monitoring and refueling of a fleet of simulated unmanned aerial vehicles (UAVs). We showed that the DRT provided a valid measure that can detect differences in workload due to changes in the number of UAVs. We used cross-validation to assess whether measures related to task performance immediately preceding the DRT could predict detection performance as a proxy for cognitive workload. Although the simple occurrence of task events had weak predictive ability, composite measures that tapped operators' situational awareness with respect to fuel levels were much more effective. We conclude that cognitive workload does vary rapidly as a function of recent task events, and that real-time predictive models of operators' cognitive workload provide a potential avenue for automation to adapt without an ongoing need for intrusive workload measurements.

Inverse effects of time-on-task in task-related and task-unrelated theta activity

The phenomenon of mental fatigue has recently been investigated extensively by means of the EEG. Studies deploying spectral analysis consistently reported an increase of spectral power in the lower frequencies with increasing time-on-task, whereas event-related studies observed decreases in various measures related to task engagement and attentional resources. The results from these two lines of research cannot be aligned easily. (Frontal) theta power has been linked to cognitive control and was found to increase with time-on-task. In contrast, theoretical frameworks on mental fatigue suggest a decline in task-engagement as causal for the performance decline observed in mental fatigue. The goal of the present study was to investigate mental fatigue in time-frequency space using linear regression on single-trial data in order to obtain a better understanding about how time-on-task affects theta oscillatory activity. A data-driven analysis approach indicated an increase of alpha and theta power during the intertrial interval. In contrast, task-related theta activity declined. This reduction of stimulus-locked theta power may be interpreted as a reduction of task engagement with increasing mental fatigue. The increase of theta spectral power in the intertrial interval, moreover, could possibly be explained by an increased idling of cognitive control networks. Alternatively, it might be the case that the increase of theta power with time-on-task is a by-product an alpha power increase. As alpha peak frequency systematically decreases with time-on-task, the theta band might be affected as well.

Hyperfocus: the forgotten frontier of attention

'Hyperfocus' is a phenomenon that reflects one's complete absorption in a task, to a point where a person appears to completely ignore or 'tune out' everything else. Hyperfocus is most often mentioned in the context of autism, schizophrenia, and attention deficit hyperactivity disorder, but research into its effect on cognitive and neural functioning is limited. We propose that hyperfocus is a critically important aspect of cognition, particularly with regard to clinical populations, and that it warrants significant investigation. Hyperfocus, though ostensibly self-explanatory, is poorly defined within the literature. In many cases, hyperfocus goes undefined, relying on the assumption that the reader inherently knows what it entails. Thus, there is no single consensus to what constitutes hyperfocus. Moreover, some studies do not refer to hyperfocus by name, but describe processes that may be related. In this paper, we review how hyperfocus (as well as possibly related phenomena) has been defined and measured, the challenges associated with hyperfocus research, and assess how hyperfocus affects both neurotypical and clinical populations. Using this foundation, we provide constructive criticism about previously used methods and analyses. We also propose an operational definition of hyperfocus for researchers to use moving forward.

A New Technique to Measure the Level of Interest Using Heartbeat-Evoked Brain Potential

Abstract. Interest is a positive emotion related to attention. The event-related brain potential (ERP) probe technique is a useful method to evaluate the level of interest in dynamic stimuli. However, even in the irrelevant probe technique, the probe is presented as a physical stimulus and steals the observer’s attentional resources, although no overt response is required. Therefore, the probe might become a problematic distractor, preventing deep immersion of participants. Heartbeat-evoked brain potential (HEP) is a brain activity, time-locked to a cardiac event. No probe is required to obtain HEP data. Thus, we aimed to investigate whether the HEP can be used to evaluate the level of interest. Twenty-four participants (12 males and 12 females) watched attractive and unattractive individuals of the opposite sex in interesting and uninteresting videos (7 min each), respectively. We performed two techniques each for both the interesting and the uninteresting videos: the ERP probe and the HEP techniques. In the former, somatosensory stimuli were presented as task-irrelevant probes while participants watched videos: frequent (80%) and infrequent (20%) stimuli were presented at each wrist in random order. In the latter, participants watched videos without the probe. The P2 amplitude in response to the somatosensory probe was smaller and the positive wave amplitudes of HEP were larger while watching the videos of attractive individuals than while watching the videos of unattractive ones. These results indicate that the HEP technique is a useful method to evaluate the level of interest without an external probe stimulus.

Applications of EEG indices for the quantification of human cognitive performance: A systematic review and bibliometric analysis

BACKGROUND

Neuroergonomics combines neuroscience with ergonomics to study human performance using recorded brain signals. Such neural signatures of performance can be measured using a variety of neuroimaging techniques, including functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), and electroencephalography (EEG). EEG has an excellent temporal resolution, and EEG indices are highly sensitive to human brain activity fluctuations.

OBJECTIVE

The focus of this systematic review was to explore the applications of EEG indices for quantifying human performance in a variety of cognitive tasks at the macro and micro scales. To identify trends and the state of the field, we examined global patterns among selected articles, such as journal contributions, highly cited papers, affiliations, and high-frequency keywords. Moreover, we discussed the most frequently used EEG indices and synthesized current knowledge regarding the EEG signatures of associated human performance measurements.

METHODS

In this systematic review, we analyzed articles published in English (from peer-reviewed journals, proceedings, and conference papers), Ph.D. dissertations, textbooks, and reference books. All articles reviewed herein included exclusively EEG-based experimental studies in healthy participants. We searched Web-of-Science and Scopus databases using specific sets of keywords.

RESULTS

Out of 143 papers, a considerable number of cognitive studies focused on quantifying human performance with respect to mental fatigue, mental workload, mental effort, visual fatigue, emotion, and stress. An increasing trend for publication in this area was observed, with the highest number of publications in 2017. Most studies applied linear methods (e.g., EEG power spectral density and the amplitude of event-related potentials) to evaluate human cognitive performance. A few papers utilized nonlinear methods, such as fractal dimension, largest Lyapunov exponent, and signal entropy. More than 50% of the studies focused on evaluating an individual's mental states while operating a vehicle. Several different methods of artifact removal have also been noted. Based on the reviewed articles, research gaps, trends, and potential directions for future research were explored.

CONCLUSION

This systematic review synthesized current knowledge regarding the application of EEG indices for quantifying human performance in a wide variety of cognitive tasks. This knowledge is useful for understanding the global patterns of applications of EEG indices for the analysis and design of cognitive tasks.

Neurophysiological markers of cognitive deficits and recovery in concussed adolescents

OBJECTIVE

The present study sought to determine: 1) whether concussed adolescents exhibited deficits in neurocognitive functioning as reflected by neurophysiological alterations; 2) if neurophysiological alterations could be linked to supplementary data such as the number of previous concussions and days since injury; and 3) if deficits in psychological health and behavioural tests increased during diagnosis duration.

METHODS

Twenty-six concussed adolescents were compared to twenty-eight healthy controls with no prior concussions. Self-report inventories evaluated depressive and concussive symptomatology, while behavioral tests evaluated cognitive ability qualitatively. To assess neurophysiological markers of cognitive function, two separate auditory oddball tasks were employed: 1) an active oddball task measuring executive control and attention as reflected by the N2b and P300, respectively; and 2) a passive oddball task assessing the early, automatic pre-conscious awareness processes as reflected by the MMN.

RESULTS

Concussed adolescents displayed delayed N2b and attenuated P300 responses relative to controls; showed elevated levels of depressive and concussive symptomatology; scored average-to- low-average in behavioral tests; and exhibited N2b response latencies that correlated with number of days since injury.

CONCLUSION

These findings demonstrate that concussed adolescents exhibit clear deficiencies in neurocognitive function, and that N2b response latency may be a marker of concussion recovery.

A novel approach to validate the efficacy of single task ERP paradigms to measure cognitive workload

The present study examined the utility of a single-task paradigm to evaluate cognitive workload. The cognitive workload from twenty-five healthy participants was measured during a tilt-ball game while tones were presented in the background to generate event-related potentials (ERPs) in electroencephalographic (EEG) data. In the game, participants were instructed to move the ball to highlighted targets and avoid moving obstacles. The game's difficulty level was manipulated (easy, medium, hard) by adjusting the number and speed of the moving obstacles. The difficulty levels were presented in a random order during multiple short runs to minimize the effects of habituation, fatigue, and boredom. The behavioral results showed that greater task difficulty resulted in a significant decrease (p < 0.001) in game performance, i.e., participants achieved few targets with a high collision rate. To evaluate cognitive workload, we measured the amplitude of early ERP components (N1, P1, and P2) corresponding to the involuntary attention orienting response. The amplitude of the N1 component decreased significantly (p = 0.029) with an increase in cognitive workload. These findings suggest that the early ERP component, specifically the N1, corresponds to attention orienting response, and that the task difficulty modulates it. This study provided evidence that the inverse relationship between ERP components and cognitive workload can be reliably assessed by controlling for other factors such as habituation or boredom during a single task paradigm.

Effects of one-pedal automobile operation on the driver's emotional state and cognitive workload

A one-pedal system for operating an electric vehicle allows drivers to flexibly accelerate and decelerate (and even stop) by using just an accelerator pedal. Based on previous findings, one-pedal operation is considered to have the potential to increase positive emotions and decrease cognitive workload. To test this possibility, the present study compared the emotional state and cognitive workload between one-pedal and conventional two-pedal operation. Participants drove a vehicle on public roads, and driving enjoyment (i.e., pleasure and immersion) and the cognitive workload (i.e., ease and effortlessness) were assessed by means of questionnaires. In addition, physiological variations associated with driving pleasure and difficulty were assessed by electroencephalography (EEG). Both the questionnaire and EEG results revealed an increase in driving enjoyment in one-pedal operation. On the other hand, only the EEG results suggested a decrease in the cognitive workload in one-pedal operation; the questionnaire results did not show a significant difference between the pedal conditions. These findings support the notion that one-pedal operation has a positive influence on the driver's mental state, though its influence on the cognitive workload will require further investigation. We discuss future directions toward a better understanding of the effects of one-pedal operation on the driver's mental state.

Cognitive-motor interference in the wild: Assessing the effects of movement complexity on task switching using mobile EEG

Adaptively changing between different tasks while in locomotion is a fundamental prerequisite of modern daily life. The cognitive processes underlying dual tasking have been investigated extensively using EEG. Due to technological restrictions, however, this was not possible for dual-task scenarios including locomotion. With new technological opportunities, this became possible and cognitive-motor interference can be studied, even in outside-the-lab environments. In the present study, participants carried out a cognitive-motor interference task as they responded to cued, auditory task-switch stimuli while performing locomotive tasks with increasing complexity (standing, walking, traversing an obstacle course). We observed increased subjective workload ratings as well as decreased behavioural performance for increased movement complexity and cognitive task difficulty. A higher movement load went along with a decrease of parietal P2, N2 and P3 amplitudes and frontal Theta power. A higher cognitive load, on the other hand, was reflected by decreased frontal CNV amplitudes. Additionally, a connectivity analysis using inter-site phase coherence revealed that higher movement as well as cognitive task difficulty had an impairing effect on fronto-parietal connectivity. In conclusion, subjective ratings, behavioural performance and electrophysiological results indicate that less cognitive resources were available to be deployed towards the execution of the cognitive task when in locomotion compared to standing still. Connectivity results also show a scarcity of attentional resources when switching a task during the highest movement complexity condition. Summarized, all findings indicate a central role of attentional control regarding cognitive-motor dual tasking and an inherent limitation of cognitive resources.

30+ years of P300 brain-computer interfaces

Brain-computer interfaces (BCIs) directly measure brain activity with no physical movement and translate the neural signals into messages. BCIs that employ the P300 event-related brain potential often have used the visual modality. The end user is presented with flashing stimuli that indicate selections for communication, control, or both. Counting each flash that corresponds to a specific target selection while ignoring other flashes will elicit P300s to only the target selection. P300 BCIs also have been implemented using auditory or tactile stimuli. P300 BCIs have been used with a variety of applications for severely disabled end users in their homes without frequent expert support. P300 BCI research and development has made substantial progress, but challenges remain before these tools can become practical devices for impaired patients and perhaps healthy people.

Behavioural and neuro-electrical correlates of cognitive performance in young mobile gamers of endless runner and match three genres

Video game players have been shown to significantly out-perform non-video game players on a wide range of cognitive tasks. Exposure to specific genres of video games may also have a significant bearing in impacting certain task-specific domains of cognition. However, there is limited availability of scientific literature exploring the role of mobile game sub-genres on the cognitive abilities of an individual. The present study was therefore conducted to assess and compare the impact of playing either endless running video games (ERGs) or match three video games (MTGs) on behavioral and neuro-electrical correlates of cognitive performance in young adults, by using reaction time (RT) and P300, respectively. The ERG group included 45 male:female (M:F) ratio = 38:7 and the MTG group included 39 (M:F = 21:18) subjects who played ≥5 h/week of each respective video game genre in past 6 months. The ERG group had better behavioral performance in comparison to the MTG group, as indexed by their significantly faster visual reaction time (VRT). The ERG subjects also had significantly lower P300 amplitudes as compared to MTG subjects. However, no difference in either auditory reaction time (ART) or P300 latency could be ascertained between the two groups. These results suggest that not only were ERG players able to make faster decisions and performed better in visuo-motor tasks but, also had better optimization of neural resources in them as compared to the MTG players. The current data supports the notion that not only exposure to video games but also the nature (i.e. genre) of mobile game play determines the extent to which neural processes concerned with attentional orientation, information processing and cognitive control are influenced.

Action Real-Time Strategy Gaming Experience Related to Increased Attentional Resources: An Attentional Blink Study

Action real-time strategy gaming (ARSG) is a cognitively demanding task which requires attention, sensorimotor skills, team cooperation, and strategy-making abilities. A recent study found that ARSG experts had superior visual selective attention (VSA) for detecting the location of a moving object that could appear in one of 24 different peripheral locations (Qiu et al., 2018), suggesting that ARSG experience is related to improvements in the spatial component of VSA. However, the influence of ARSG experience on the temporal component of VSA-the detection of an item among a sequence of items presented consecutively and quickly at a single location-still remains understudied. Using behavioral and electrophysiological measures, this study examined whether ARSG experts had superior temporal VSA performance compared to non-experts in an attentional blink (AB) task, which is typically used to examine temporal VSA. The results showed that the experts outperformed the non-experts in their detection rates of targets. Furthermore, compared to the non-experts, the experts had faster information processing as indicated by earlier P3 peak latencies in an AB period, more attentional resources distributed to targets as indicated by stronger P3 amplitudes, and a more flexible deployment of attentional resources. These findings suggest that experts were less prone to the AB effect. Thus, long-term ARSG experience is related to improvements in temporal VSA. The current findings support the benefit of video gaming experience on the development of VSA.

The influence of cognitive load on susceptibility to audio

In this study we evaluate how cognitive load affects susceptibility to auditory signals. Previous research has used the frontal P3 (fP3) event related potential response to auditory novel stimuli as an index for susceptibility to auditory signals. This work demonstrated that tasks that induce cognitive load such as visual and manual tasks, reduced susceptibility. It is however unknown whether cognitive load without visual or manual components also reduces susceptibility. To investigate this, we induced cognitive load by means of the verb generation task, in which participants need to think about a verb that matches a noun. The susceptibility to auditory signals was measured by recording the event related potential in response to a successively presented oddball probe stimulus at 3 different inter-stimulus intervals, 0 ms, 200 ms or 400 ms after the offset of the noun from the verb generation task. An additional control baseline condition, in which oddball response was probed without a verb generation task, was also included. Results show that the cognitive load associated with the verb task reduces fP3 response (and associated auditory signal susceptibility) compared to baseline, independent of presentation interval. This suggests that not only visual and motor processing, but also cognitive load without visual or manual components, can reduce susceptibility to auditory signals and alerts.

Recording mobile EEG in an outdoor environment reveals cognitive-motor interference dependent on movement complexity

Oftentimes we find ourselves in situations in which we need to perform concurrent motor and cognitive tasks like simple locomotion while being cognitively involved. In the present study, we investigated in how far cognitive and motor functioning interfere in an outdoor environment. Our participants performed an auditory oddball task while concurrently completing various motor tasks on the outside premises of our institute. Beside behavioural responses and subjective workload ratings, we also analysed electrophysiological data recorded with a 30-channel mobile EEG montage. We observed an increase of subjective workload and decrease of performance with increasing movement complexity. Accordingly, we also found a decrease in the parietal P3 amplitude as well as in frontal midline Theta power with higher motor load. These results indicate that an increased movement complexity imposes a higher workload to the cognitive system, which, in turn, effectively reduces the availability of cognitive resources for the cognitive task. Overall this experiment demonstrates the feasibility of transferring classical paradigms of cognitive research to real-world settings. The findings support the notion of shared resources for motor and cognitive functions by demonstrating distinct modulations of correlates of cognitive processes across different motor tasks.

A Systematic Review of Physiological Measures of Mental Workload

Mental workload (MWL) can affect human performance and is considered critical in the design and evaluation of complex human-machine systems. While numerous physiological measures are used to assess MWL, there appears no consensus on their validity as effective agents of MWL. This study was conducted to provide a comprehensive understanding of the use of physiological measures of MWL and to synthesize empirical evidence on the validity of the measures to discriminate changes in MWL. A systematical literature search was conducted with four electronic databases for empirical studies measuring MWL with physiological measures. Ninety-one studies were included for analysis. We identified 78 physiological measures, which were distributed in cardiovascular, eye movement, electroencephalogram (EEG), respiration, electromyogram (EMG) and skin categories. Cardiovascular, eye movement and EEG measures were the most widely used across varied research domains, with 76%, 66%, and 71% of times reported a significant association with MWL, respectively. While most physiological measures were found to be able to discriminate changes in MWL, they were not universally valid in all task scenarios. The use of physiological measures and their validity for MWL assessment also varied across different research domains. Our study offers insights into the understanding and selection of appropriate physiological measures for MWL assessment in varied human-machine systems.

Connecting levels of analysis in educational neuroscience: A review of multi-level structure of educational neuroscience with concrete examples

In its origins educational neuroscience has started as an endeavor to discuss implications of neuroscience studies for education. However, it is now on its way to become a transdisciplinary field, incorporating findings, theoretical frameworks and methodologies from education, and cognitive and brain sciences. Given the differences and diversity in the originating disciplines, it has been a challenge for educational neuroscience to integrate both theoretical and methodological perspectives in education and neuroscience in a coherent way. We present a multi-level framework for educational neuroscience, which argues for integration of multiple levels of analysis, some originating in brain and cognitive sciences, others in education, as a roadmap for the future of educational neuroscience, with concrete examples in mathematical learning and moral education.

Measurement of cognitive dynamics during video watching through event-related potentials (ERPs) and oscillations (EROs)

Event-related potentials (ERPs) and oscillations (EROs) are reliable measures of cognition, but they require time-locked electroencephalographic (EEG) data to repetitive triggers that are not available in continuous sensory input streams. However, such real-life-like stimulation by videos or virtual-reality environments may serve as powerful means of creating specific cognitive or affective states and help to investigate dysfunctions in psychiatric and neurological disorders more efficiently. This study aims to develop a method to generate ERPs and EROs during watching videos. Repeated luminance changes were introduced on short video segments, while EEGs of 10 subjects were recorded. The ERP/EROs time-locked to these distortions were analyzed in time and time-frequency domains and tested for their cognitive significance through a long term memory test that included frames from the watched videos. For each subject, ERPs and EROs corresponding to video segments of recalled images with 25% shortest and 25% longest reaction times were compared. ERPs produced by transient luminance changes displayed statistically significant fluctuations both in time and time-frequency domains. Statistical analyses showed that a positivity around 450 ms, a negativity around 500 ms and delta and theta EROs correlated with memory performance. Few studies mixed video streams with simultaneous ERP/ERO experiments with discrete task-relevant or passively presented auditory or somatosensory stimuli, while the present study, by obtaining ERPs and EROs to task-irrelevant events in the same sensory modality as that of the continuous sensory input, produces minimal interference with the main focus of attention on the video stream.

The pupil response as an indicator of user experience in a digital exercise game

To study whether psychophysiological indicators are suitable measures of user experience in a digital exercise game (exergame), a laboratory study employing both psychophysiological and self-report measures was conducted. Sixty-six participants cycled for 10 min on an ergometer while pupil diameter, skin conductance, and heart rate were measured; afterward, they completed a user experience questionnaire. The participants performed under three experimental conditions varying between subjects: active gaming (participants controlled the altitude of a digital bird by varying their pedal rate in order to catch letters flying across the screen), observing a game (they observed a replay of another participant's game), and no-game (blank screen). Only the gaming condition showed evidence for statistically significant pupil dilations-indicating emotional arousal-in response to game events (catching a letter) or corresponding points in time. The observational condition did not differ statistically from the no-game control condition. Self-reports also indicated that the gaming condition was rated most fun and least demanding. Other psychophysiological indicators (heart rate, skin conductance) showed no systematic effects in response to game events, rather they steadily increased during training. Thus, pupil responses were shown to be suitable indicators of positive emotional reactions to game events and user experience in a (training) game.