ERP CORE: An open resource for human event-related potential research

An auto-segmented multi-time window dual-scale neural network for brain-computer interfaces based on event-related potentials

Objective.Event-related potentials (ERPs) are cerebral responses to cognitive processes, also referred to as cognitive potentials. Accurately decoding ERPs can help to advance research on brain-computer interfaces (BCIs). The spatial pattern of ERP varies with time. In recent years, convolutional neural networks (CNNs) have shown promising results in electroencephalography (EEG) classification, specifically for ERP-based BCIs.Approach.This study proposes an auto-segmented multi-time window dual-scale neural network (AWDSNet). The combination of a multi-window design and a lightweight base network gives AWDSNet good performance at an acceptable cost of computing. For each individual, we create a time window set by calculating the correlation of signedR-squared values, which enables us to determine the length and number of windows automatically. The signal data are segmented based on the obtained window sets in sub-plus-global mode. Then, the multi-window data are fed into a dual-scale CNN model, where the sizes of the convolution kernels are determined by the window sizes. The use of dual-scale spatiotemporal convolution focuses on feature details while also having a large enough receptive length, and the grouping parallelism undermines the increase in the number of parameters that come with dual scaling.Main results.We evaluated the performance of AWDSNet on a public dataset and a self-collected dataset. A comparison was made with four popular methods including EEGNet, DeepConvNet, EEG-Inception, and PPNN. The experimental results show that AWDSNet has excellent classification performance with acceptable computational complexity.Significance.These results indicate that AWDSNet has great potential for applications in ERP decoding.

Influence of flavor information on visual search: Attentional capture by and suppression of flavor-associated colors

Numerous studies have demonstrated the impact of flavor cues on visual search, yet the underlying mechanisms remain elusive. In this experiment, we used event-related potentials (ERPs) to examine whether, and if so, how flavor information could lead to attentional capture by, and suppression of, flavor-associated colors. The participants were asked to taste certain flavored beverages and subsequently complete a shape-based visual search task, while their neural activities were simultaneously recorded. The behavioral results revealed that the participants made slower responses when a distractor in the flavor-associated color (DFAC) was present, suggesting an attentional bias toward the flavor-associated color. The ERP results revealed that the N2pc was detected if the target and the DFAC were shown in the same visual field (e.g. both target and DFCA on the right side of the screen), when the pairings between flavor cues and target colors were incongruent. However, the N2pc was not observed if the target and the DFAC were shown in the opposite visual fields (e.g. target on the right and DFCA on the left side of the screen) for the incongruent color-flavor pairings. Moreover, the distractor positivity (Pd) was observed if the target and the DFAC were shown in the opposite visual field for the congruent color-flavor pairings. These results suggest that both attentional capture and suppression are involved in the influence of flavor information on visual search. Collectively, these findings provide initial electrophysiological evidence on the mechanisms of the crossmodal influence of flavor cues on visual search.

Using multivariate pattern analysis to increase effect sizes for event-related potential analyses

Multivariate pattern analysis (MVPA) approaches can be applied to the topographic distribution of event-related potential (ERP) signals to "decode" subtly different stimulus classes, such as different faces or different orientations. These approaches are extremely sensitive, and it seems possible that they could also be used to increase effect sizes and statistical power in traditional paradigms that ask whether an ERP component differs in amplitude across conditions. To assess this possibility, we leveraged the open-source ERP CORE data set and compared the effect sizes resulting from conventional univariate analyses of mean amplitude with two MVPA approaches (support vector machine decoding and the cross-validated Mahalanobis distance, both of which are easy to compute using open-source software). We assessed these approaches across seven widely studied ERP components (N170, N400, N2pc, P3b, lateral readiness potential, error related negativity, and mismatch negativity). Across all components, we found that multivariate approaches yielded effect sizes that were as large or larger than the effect sizes produced by univariate approaches. These results indicate that researchers could obtain larger effect sizes, and therefore greater statistical power, by using multivariate analysis of topographic voltage patterns instead of traditional univariate analyses in many ERP studies.

Are the P600 and P3 ERP components linked to the task-evoked pupillary response as a correlate of norepinephrine activity?

During language comprehension, anomalies and ambiguities in the input typically elicit the P600 event-related potential component. Although traditionally interpreted as a specific signal of combinatorial operations in sentence processing, the component has alternatively been proposed to be a variant of the oddball-sensitive, domain-general P3 component. In particular, both components might reflect phasic norepinephrine release from the locus coeruleus (LC/NE) to motivationally significant stimuli. In this preregistered study, we tested this hypothesis by relating both components to the task-evoked pupillary response, a putative biomarker of LC/NE activity. 36 participants completed a sentence comprehension task (containing 25% morphosyntactic violations) and a non-linguistic oddball task (containing 20% oddballs), while the EEG and pupil size were co-registered. Our results showed that the task-evoked pupillary response and the ERP amplitudes of both components were similarly affected by both experimental tasks. In the oddball task, there was also a temporally specific relationship between the P3 and the pupillary response beyond the shared oddball effect, thereby further linking the P3 to NE. Because this link was less reliable in the linguistic context, we did not find conclusive evidence for or against a relationship between the P600 and the pupillary response. Still, our findings further stimulate the debate on whether language-related ERPs are indeed specific to linguistic processes or shared across cognitive domains. However, further research is required to verify a potential link between the two ERP positivities and the LC/NE system as the common neural generator.

EEG emotion recognition based on data-driven signal auto-segmentation and feature fusion

Pattern recognition based on network connections has recently been applied to the brain-computer interface (BCI) research, offering new ideas for emotion recognition using Electroencephalogram (EEG) signal. However unified standards are currently lacking for selecting emotional signals in emotion recognition research, and potential associations between activation differences in brain regions and network connectivity pattern are often being overlooked. To bridge this technical gap, a data-driven signal auto-segmentation and feature fusion algorithm (DASF) is proposed in this paper. First, the Phase Locking Value (PLV) method was used to construct the brain functional adjacency matrix of each subject, and the dynamic brain functional network across subjects was then constructed. Next, tucker decomposition was performed and the Grassmann distance of the connectivity submatrix was calculated. Subsequently, different brain network states were distinguished and signal segments under emotional states were automatically extract using data-driven methods. Then, tensor sparse representation was adopted on the intercepted EEG signals to effectively extract functional connections under different emotional states. Finally, power-distribution related features (differential entropy and energy feature) and brain functional connection features were effectively combined for classification using the support vector machines (SVM) classifier. The proposed method was validated on ERN and DEAP datasets. The single-feature emotion classification accuracy of 86.57 % and 87.74 % were achieved on valence and arousal dimensions, respectively. The accuracy of the proposed feature fusion method was achieved at 89.14 % and 89.65 %, accordingly, demonstrating an improvement in emotion recognition accuracy. The results demonstrated the superior classification performance of the proposed data-driven signal auto-segmentation and feature fusion algorithm in emotion recognition compared to state-of-the-art classification methods.

Assessing the effectiveness of spatial PCA on SVM-based decoding of EEG data

Principal component analysis (PCA) has been widely employed for dimensionality reduction prior to multivariate pattern classification (decoding) in EEG research. The goal of the present study was to provide an evaluation of the effectiveness of PCA on decoding accuracy (using support vector machines) across a broad range of experimental paradigms. We evaluated several different PCA variations, including group-based and subject-based component decomposition and the application of Varimax rotation or no rotation. We also varied the numbers of PCs that were retained for the decoding analysis. We evaluated the resulting decoding accuracy for seven common event-related potential components (N170, mismatch negativity, N2pc, P3b, N400, lateralized readiness potential, and error-related negativity). We also examined more challenging decoding tasks, including decoding of face identity, facial expression, stimulus location, and stimulus orientation. The datasets also varied in the number and density of electrode sites. Our findings indicated that none of the PCA approaches consistently improved decoding performance related to no PCA, and the application of PCA frequently reduced decoding performance. Researchers should therefore be cautious about using PCA prior to decoding EEG data from similar experimental paradigms, populations, and recording setups.

Optimal filters for ERP research I: A general approach for selecting filter settings

Filtering plays an essential role in event-related potential (ERP) research, but filter settings are usually chosen on the basis of historical precedent, lab lore, or informal analyses. This reflects, in part, the lack of a well-reasoned, easily implemented method for identifying the optimal filter settings for a given type of ERP data. To fill this gap, we developed an approach that involves finding the filter settings that maximize the signal-to-noise ratio for a specific amplitude score (or minimizes the noise for a latency score) while minimizing waveform distortion. The signal is estimated by obtaining the amplitude score from the grand average ERP waveform (usually a difference waveform). The noise is estimated using the standardized measurement error of the single-subject scores. Waveform distortion is estimated by passing noise-free simulated data through the filters. This approach allows researchers to determine the most appropriate filter settings for their specific scoring methods, experimental designs, subject populations, recording setups, and scientific questions. We have provided a set of tools in ERPLAB Toolbox to make it easy for researchers to implement this approach with their own data.

Optimal filters for ERP research II: Recommended settings for seven common ERP components

In research with event-related potentials (ERPs), aggressive filters can substantially improve the signal-to-noise ratio and maximize statistical power, but they can also produce significant waveform distortion. Although this tradeoff has been well documented, the field lacks recommendations for filter cutoffs that quantitatively address both of these competing considerations. To fill this gap, we quantified the effects of a broad range of low-pass filter and high-pass filter cutoffs for seven common ERP components (P3b, N400, N170, N2pc, mismatch negativity, error-related negativity, and lateralized readiness potential) recorded from a set of neurotypical young adults. We also examined four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency). For each combination of component and scoring methods, we quantified the effects of filtering on data quality (noise level and signal-to-noise ratio) and waveform distortion. This led to recommendations for optimal low-pass and high-pass filter cutoffs. We repeated the analyses after adding artificial noise to provide recommendations for data sets with moderately greater noise levels. For researchers who are analyzing data with similar ERP components, noise levels, and participant populations, using the recommended filter settings should lead to improved data quality and statistical power without creating problematic waveform distortion.

A registered report of a two-site study of variations of the flanker task: ERN experimental effects and data quality

Error-related negativity is a widely used measure of error monitoring, and many projects are independently moving ERN recorded during a flanker task toward standardization, optimization, and eventual clinical application. However, each project uses a different version of the flanker task and tacitly assumes ERN is functionally equivalent across each version. The routine neglect of a rigorous test of this assumption undermines efforts to integrate ERN findings across tasks, optimize and standardize ERN assessment, and widely apply ERN in clinical trials. The purpose of this registered report was to determine whether ERN shows similar experimental effects (correct vs. error trials) and data quality (intraindividual variability) during three commonly used versions of a flanker task. ERN was recorded from 172 participants during three versions of a flanker task across two study sites. ERN scores showed numerical differences between tasks, raising questions about the comparability of ERN findings across studies and tasks. Although ERN scores from all three versions of the flanker task yielded high data quality and internal consistency, one version did outperform the other two in terms of the size of experimental effects and the data quality. Exploratory analyses of the error positivity (Pe) provided tentative support for the other two versions of the task over the paradigm that appeared optimal for ERN. The present study provides a roadmap for how to statistically compare psychometric characteristics of ERP scores across paradigms and gives preliminary recommendations for flanker tasks to use for ERN- and Pe-focused studies.

Evaluating the effectiveness of artifact correction and rejection in event-related potential research

Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods in minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.

Blind source separation of event-related potentials using a recurrent neural network

Event-related potentials (ERPs) are a superposition of electric potential differences generated by neurophysiological activity associated with psychophysical events. Spatiotemporal dissociation of these signal sources can supplement conventional ERP analysis and improve source localization. However, results from established source separation methods applied to ERPs can be challenging to interpret. Hence, we have developed a recurrent neural network (RNN) method for blind source separation. The RNN transforms input step pulse signals representing events into corresponding ERP difference waveforms. Source waveforms are obtained from penultimate layer units and scalp maps are obtained from feed-forward output layer weights that project these source waveforms onto EEG electrode amplitudes. An interpretable, sparse source representation is achieved by incorporating L1 regularization of signals obtained from the penultimate layer of the network during training. This RNN method was applied to four ERP difference waveforms (MMN, N170, N400, P3) from the open-access ERP CORE database, and independent component analysis (ICA) was applied to the same data for comparison. The RNN decomposed these ERPs into eleven spatially and temporally separate sources that were less noisy, tended to be more ERP-specific, and were less similar to each other than ICA-derived sources. The RNN sources also had less ambiguity between source waveform amplitude, scalp potential polarity, and equivalent current dipole orientation than ICA sources. In conclusion, the proposed RNN blind source separation method can be effectively applied to grand-average ERP difference waves and holds promise for further development as a computational model of event-related neural signals.

Age-related similarities and differences in cognitive and neural processing revealed by task-related microstate analysis

We explored neural processing differences associated with aging across four cognitive functions. In addition to ERP analysis, we included task-related microstate analyses, which identified stable states of neural activity across the scalp over time, to explore whole-head neural activation differences. Younger and older adults (YA, OA) completed face perception (N170), word-pair judgment (N400), visual oddball (P3), and flanker (ERN) tasks. Age-related effects differed across tasks. Despite age-related delayed latencies, N170 ERP and microstate analyses indicated no age-related differences in amplitudes or microstates. However, age-related condition differences were found for P3 and N00 amplitudes and scalp topographies: smaller condition differences were found for in OAs as well as broader centroparietal scalp distributions. Age group comparisons for the ERN revealed similar focal frontocentral activation loci, but differential activation patterns. Our findings of differential age effects across tasks are most consistent with the STAC-r framework which proposes that age-related effects differ depending on the resources available and the kinds of processing and cognitive load required of various tasks.

Implicit weight bias: shared neural substrates for overweight and angry facial expressions revealed by cross-adaptation

The perception of facial expression plays a crucial role in social communication, and it is known to be influenced by various facial cues. Previous studies have reported both positive and negative biases toward overweight individuals. It is unclear whether facial cues, such as facial weight, bias facial expression perception. Combining psychophysics and event-related potential technology, the current study adopted a cross-adaptation paradigm to examine this issue. The psychophysical results of Experiments 1A and 1B revealed a bidirectional cross-adaptation effect between overweight and angry faces. Adapting to overweight faces decreased the likelihood of perceiving ambiguous emotional expressions as angry compared to adapting to normal-weight faces. Likewise, exposure to angry faces subsequently caused normal-weight faces to appear thinner. These findings were corroborated by bidirectional event-related potential results, showing that adaptation to overweight faces relative to normal-weight faces modulated the event-related potential responses of emotionally ambiguous facial expression (Experiment 2A); vice versa, adaptation to angry faces relative to neutral faces modulated the event-related potential responses of ambiguous faces in facial weight (Experiment 2B). Our study provides direct evidence associating overweight faces with facial expression, suggesting at least partly common neural substrates for the perception of overweight and angry faces.

Effects of the presentation order of stimulations in sequential ERP/SSVEP Hybrid Brain-Computer Interface

Hybrid Brain-Computer Interface (hBCI) combines multiple neurophysiology modalities or paradigms to speed up the output of a single command or produce multiple ones simultaneously. Concurrent hBCIs that employ endogenous and exogenous paradigms are limited by the reduced set of possible commands. Conversely, the fusion of different exogenous visual evoked potentials demonstrated impressive performances; however, they suffer from limited portability. Yet, sequential hBCIs did not receive much attention mainly due to slower transfer rate and user fatigue during prolonged BCI use (Lorenz et al 2014 J. Neural Eng. 11 035007). Moreover, the crucial factors for optimizing the hybridization remain under-explored. In this paper, we test the feasibility of sequential Event Related-Potentials (ERP) and Steady-State Visual Evoked Potentials (SSVEP) hBCI and study the effect of stimulus order presentation between ERP-SSVEP and SSVEP-ERP for the control of directions and speed of powered wheelchairs or mobile robots with 15 commands. Exploiting the fast single trial face stimulus ERP, SSVEP and modern efficient convolutional neural networks, the configuration with SSVEP presented at first achieved significantly (p < 0.05) higher average accuracy rate with 76.39% ( ± 7.30 standard deviation) hybrid command accuracy and an average Information Transfer Rate (ITR) of 25.05 ( ± 5.32 standard deviation) bits per minute (bpm). The results of the study demonstrate the suitability of a sequential SSVEP-ERP hBCI with challenging dry electroencephalography (EEG) electrodes and low-compute capacity. Although it presents lower ITR than concurrent hBCIs, our system presents an alternative in small screen settings when the conditions for concurrent hBCIs are difficult to satisfy.

Using Multivariate Pattern Analysis to Increase Effect Sizes for Event-Related Potential Analyses

Multivariate pattern analysis approaches can be applied to the topographic distribution of event-related potential (ERP) signals to 'decode' subtly different stimulus classes, such as different faces or different orientations. These approaches are extremely sensitive, and it seems possible that they could also be used to increase effect sizes and statistical power in traditional paradigms that ask whether an ERP component differs in amplitude across conditions. To assess this possibility, we leveraged the open-source ERP CORE dataset and compared the effect sizes resulting from conventional univariate analyses of mean amplitude with two multivariate pattern analysis approaches (support vector machine decoding and the cross-validated Mahalanobis distance, both of which are easy to compute using open-source software). We assessed these approaches across seven widely studied ERP components (N170, N400, N2pc, P3b, lateral readiness potential, error related negativity, and mismatch negativity). Across all components, we found that multivariate approaches yielded effect sizes that were as large or larger than the effect sizes produced by univariate approaches. These results indicate that researchers could obtain larger effect sizes, and therefore greater statistical power, by using multivariate analysis of topographic voltage patterns instead of traditional univariate analyses in many ERP studies.

Harmonic memory signals in the human cerebral cortex induced by semantic relatedness of words

When we memorize multiple words simultaneously, semantic relatedness among those words assists memory. For example, the information about "apple", "banana," and "orange" will be connected via a common concept of "fruits" and become easy to retain and recall. Neural mechanisms underlying this semantic integration in verbal working memory remain unclear. Here I used electroencephalography (EEG) and investigated neural signals when healthy human participants memorized five nouns semantically related (Sem trial) or not (NonSem trial). The regularity of oscillatory signals (8-30 Hz) during the retention period was found to be lower in NonSem than Sem trials, indicating that memorizing words unrelated to each other induced a non-harmonic (irregular) waveform in the temporal cortex. These results suggest that (i) semantic features of a word are retained as a set of neural oscillations at specific frequencies and (ii) memorizing words sharing a common semantic feature produces harmonic brain responses through a resonance or integration (sharing) of the oscillatory signals.

Maximizing signal-to-noise ratio and statistical power in ERP measurement: Single sites versus multi-site average clusters

One important decision in every event-related potential (ERP) experiment is which electrode site(s) to use in quantifying the ERP component of interest. A common approach is to measure the ERP from a single electrode site, typically the site where the ERP component is largest. Alternatively, two or more electrode sites in a given spatial region are averaged together, and the ERP is measured from the resulting multi-site cluster. The goal of the present study was to systematically compare these two measurement approaches across a range of outcome measures and ERP components to determine whether measuring from a single electrode site or an average of multiple sites yields consistently better results. We examined seven common ERP components from the open-source ERP CORE dataset that span a range of neurocognitive processes: N170, mismatch negativity (MMN), N2pc, N400, P3, lateralized readiness potential (LRP), and error-related negativity (ERN). For each component, we compared ERP amplitude, noise level, signal-to-noise ratio, and effect size at two single electrode sites and four multi-site clusters. We also used a Monte Carlo approach to simulate within-participant and between-groups experiments with known effect magnitudes to compare statistical power at single sites and multi-site clusters. Overall, measuring from a multi-site cluster produced results that were as good as or better than measuring from a single electrode site across analyses and components, indicating that the cluster-based measurement approach may be beneficial in quantifying ERPs from a range of neurocognitive domains.

The dynamics of statistical learning in visual search and its interaction with salience processing: An EEG study

Visual attention can be guided by statistical regularities in the environment, that people implicitly learn from past experiences (statistical learning, SL). Moreover, a perceptually salient element can automatically capture attention, gaining processing priority through a bottom-up attentional control mechanism. The aim of our study was to investigate the dynamics of SL and if it shapes attentional target selection additively with salience processing, or whether these mechanisms interact, e.g. one gates the other. In a visual search task, we therefore manipulated target frequency (high vs. low) across locations while, in some trials, the target was salient in terms of colour. Additionally, halfway through the experiment, the high-frequency location changed to the opposite hemifield. EEG activity was simultaneously recorded, with a specific interest in two markers related to target selection and post-selection processing, respectively: N2pc and SPCN. Our results revealed that both SL and saliency significantly enhanced behavioural performance, but also interacted with each other, with an attenuated saliency effect at the high-frequency target location, and a smaller SL effect for salient targets. Concerning processing dynamics, the benefit of salience processing was more evident during the early stage of target selection and processing, as indexed by a larger N2pc and early-SPCN, whereas SL modulated the underlying neural activity particularly later on, as revealed by larger late-SPCN. Furthermore, we showed that SL was rapidly acquired and adjusted when the spatial imbalance changed. Overall, our findings suggest that SL is flexible to changes and, combined with salience processing, jointly contributes to establishing attentional priority.

An ERP Study of Face Processing in Schizophrenia, Bipolar Disorder, and Socially Isolated Individuals from the Community

People with schizophrenia (SCZ) and bipolar disorder (BD) have impairments in processing social information, including faces. The neural correlates of face processing are widely studied with the N170 ERP component. However, it is unclear whether N170 deficits reflect neural abnormalities associated with these clinical conditions or differences in social environments. The goal of this study was to determine whether N170 deficits would still be present in SCZ and BD when compared with socially isolated community members. Participants included 66 people with SCZ, 37 with BD, and 125 community members (76 "Community-Isolated"; 49 "Community-Connected"). Electroencephalography was recorded during a face processing task in which participants identified the gender of a face, the emotion of a face (angry, happy, neutral), or the number of stories in a building. We examined group differences in the N170 face effect (greater amplitudes for faces vs buildings) and the N170 emotion effect (greater amplitudes for emotional vs neutral expressions). Groups significantly differed in levels of social isolation (Community-Isolated > SCZ > BD = Community-Connected). SCZ participants had significantly reduced N170 amplitudes to faces compared with both community groups, which did not differ from each other. The BD group was intermediate and did not differ from any group. There were no significant group differences in the processing of specific emotional facial expressions. The N170 is abnormal in SCZ even when compared to socially isolated community members. Hence, the N170 seems to reflect a social processing impairment in SCZ that is separate from level of social isolation.

Concurrent expectation and experience-based metacontrol: EEG insights and the role of working memory capacity

We investigated the simultaneous influence of expectation and experience on metacontrol, which we define as the instantiation of context-specific control states. These states could entail heightened control states in preparation for frequent task switching or lowered control states for task repetition. Specifically, we examined whether "expectations" regarding future control demands prompt proactive metacontrol, while "experiences" with items associated with specific control demands facilitate reactive metacontrol. In Experiment 1, we utilized EEG with a high temporal resolution to differentiate between brain activities associated with proactive and reactive metacontrol. We successfully observed cue-locked and image-locked ERP patterns associated with proactive and reactive metacontrol, respectively, supporting concurrent instantiation of two metacontrol modes. In Experiment 2, we focused on individual differences to investigate the modulatory role of working memory capacity (WMC) in the concurrent instantiation of two metacontrol modes. Our findings revealed that individuals with higher WMC exhibited enhanced proactive metacontrol, indicated by smaller response time variability (RTV). Additionally, individuals with higher WMC showed a lower tendency to rely on reactive metacontrol, indicated by a smaller item-specific switch probability (ISSP) effect. In conclusion, our results suggest that proactive and reactive metacontrol can coexist, but their interplay is influenced by individuals' WMC. Higher WMC promotes the use of proactive metacontrol while attenuating reliance on reactive metacontrol. This study provides insights into the interplay between proactive and reactive metacontrol and highlights the impact of WMC on their concurrent instantiation.

High-density ear-EEG for understanding ear-centered EEG

Background. Mobile ear-EEG provides the opportunity to record EEG unobtrusively in everyday life. However, in real-life, the EEG data quickly becomes difficult to interpret, as the neural signal is contaminated by other, non-neural signal contributions. Due to the small number of electrodes in ear-EEG devices, the interpretation of the EEG becomes even more difficult. For meaningful and reliable ear-EEG, it is crucial that the brain signals we wish to record in real life are well-understood and that we make optimal use of the available electrodes. Their placement should be guided by prior knowledge about the characteristics of the signal of interest.Objective.We want to understand the signal we record with ear-EEG and make recommendations on how to optimally place a limited number of electrodes.Approach.We built a high-density ear-EEG with 31 channels spaced densely around one ear. We used it to record four auditory event-related potentials (ERPs): the mismatch negativity, the P300, the N100 and the N400. With this data, we gain an understanding of how different stages of auditory processing are reflected in ear-EEG. We investigate the electrode configurations that carry the most information and use a mass univariate ERP analysis to identify the optimal channel configuration. We additionally use a multivariate approach to investigate the added value of multi-channel recordings.Main results.We find significant condition differences for all ERPs. The different ERPs vary considerably in their spatial extent and different electrode positions are necessary to optimally capture each component. In the multivariate analysis, we find that the investigation of the ERPs benefits strongly from multi-channel ear-EEG.Significance.Our work emphasizes the importance of a strong theoretical and practical background when building and using ear-EEG. We provide recommendations on finding the optimal electrode positions. These results will guide future research employing ear-EEG in real-life scenarios.

Neural mechanisms of attentional bias to emotional faces in patients with chronic insomnia disorder

OBJECTIVE

This study used event-related potential (ERP) and resting-state functional connectivity (rs-FC) approaches to investigate the neural mechanisms underlying the emotional attention bias in patients with chronic insomnia disorder (CID).

METHODS

Twenty-five patients with CID and thirty-three demographically matched healthy controls (HCs) completed clinical questionnaires and underwent electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) scans. EEG analysis examined the group differences in terms of reaction times, P3 amplitudes, event-related spectral perturbations, and inter-trial phase synchrony. Subsequently, seed-based rs-FC analysis of the amygdala nuclei (including the central-medial amygdala [CMA] and basolateral amygdala [BLA]) was performed. The relationship between P3 amplitude, rs-FC and clinical symptom severity in patients with CID was further investigated by correlation analysis.

RESULTS

CID patients exhibited shorter reaction times than HCs in both standard and deviant stimuli, with the abnormalities becoming more pronounced as attention allocation increased. Compared to HCs, ERP analysis revealed increased P3 amplitude, theta wave power, and inter-trial synchrony in CID patients. The rs-FC analysis showed increased connectivity of the BLA-occipital pole, CMA-precuneus, and CMA-angular gyrus and decreased connectivity of the CMA-thalamus in CID patients. Notably, correlation analysis of the EEG and fMRI measurements showed a significant positive correlation between the P3 amplitude and the rs-FC of the CMA-PCU.

CONCLUSION

This study confirms an emotional attention bias in CID, specifically in the neural mechanisms of attention processing that vary depending on the allocation of attentional resources. Abnormal connectivity in the emotion-cognition networks may constitute the neural basis of the abnormal scalp activation pattern.

The applied principles of EEG analysis methods in neuroscience and clinical neurology

Electroencephalography (EEG) is a non-invasive measurement method for brain activity. Due to its safety, high resolution, and hypersensitivity to dynamic changes in brain neural signals, EEG has aroused much interest in scientific research and medical fields. This article reviews the types of EEG signals, multiple EEG signal analysis methods, and the application of relevant methods in the neuroscience field and for diagnosing neurological diseases. First, three types of EEG signals, including time-invariant EEG, accurate event-related EEG, and random event-related EEG, are introduced. Second, five main directions for the methods of EEG analysis, including power spectrum analysis, time-frequency analysis, connectivity analysis, source localization methods, and machine learning methods, are described in the main section, along with different sub-methods and effect evaluations for solving the same problem. Finally, the application scenarios of different EEG analysis methods are emphasized, and the advantages and disadvantages of similar methods are distinguished. This article is expected to assist researchers in selecting suitable EEG analysis methods based on their research objectives, provide references for subsequent research, and summarize current issues and prospects for the future.

Optimal Filters for ERP Research I: A General Approach for Selecting Filter Settings

Filtering plays an essential role in event-related potential (ERP) research, but filter settings are usually chosen on the basis of historical precedent, lab lore, or informal analyses. This reflects, in part, the lack of a well-reasoned, easily implemented method for identifying the optimal filter settings for a given type of ERP data. To fill this gap, we developed an approach that involves finding the filter settings that maximize the signal-to-noise ratio for a specific amplitude score (or minimizes the noise for a latency score) while minimizing waveform distortion. The signal is estimated by obtaining the amplitude score from the grand average ERP waveform (usually a difference waveform). The noise is estimated using the standardized measurement error of the single-subject scores. Waveform distortion is estimated by passing noise-free simulated data through the filters. This approach allows researchers to determine the most appropriate filter settings for their specific scoring methods, experimental designs, subject populations, recording setups, and scientific questions. We have provided a set of tools in ERPLAB Toolbox to make it easy for researchers to implement this approach with their own data.

Evaluating the effectiveness of artifact correction and rejection in event-related potential research

Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods at minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.

Neural mechanisms of working memory dysfunction in patients with chronic insomnia disorder

OBJECTIVE

This study aimed to investigate the neural mechanisms underlying working memory impairment in patients with chronic insomnia disorder (CID) using event-related potentials (ERP) and resting-state functional connectivity (rsFC) approaches.

METHODS

Participants, including CID patients and healthy controls (HCs), completed clinical scales and underwent electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). EEG analysis compared reaction times, P3 amplitudes, event-related spectral perturbations (ERSP), and inter-trial phase synchronisation (ITPS) between CID patients and HCs. Subsequently, frontal regions (i.e., the Superior Frontal Gyrus [SFG] and Middle Frontal Gyrus [MFG]) corresponding to the EEG were selected as seeds for rsFC analysis. Correlation analyses were conducted to further investigate the relationship between functional connectivity abnormalities in brain regions and clinical symptom severity and P3 amplitude in CID patients.

RESULTS

Compared to HCs, CID patients exhibited slower reaction times across all working memory conditions, with the deficits becoming more pronounced as memory load increased. ERP analysis revealed increased P3 amplitude, theta wave power, and reduced inter-trial synchrony in CID patients. rsFC analysis showed decreased connectivity of SFG-posterior cingulated cortex (PCC), SFG-MFG, and MFG-frontal pole (FP), and increased connectivity of MFG- Middle Temporal Gyrus (MTG)in CID patients. Importantly, a significant correlation was found between the rsFC of SFG-MTG and P3 amplitude during 1-back.

CONCLUSION

This study confirms deficits in working memory capacity in patients with CID, specifically in the neural mechanisms of cognitive processing that vary depending on the level of cognitive load. Alterations in connectivity patterns within and between the frontal and temporal regions may be the neural basis of the cognitive impairment.

The impact of threat of shock-induced anxiety on alerting, orienting, and executive function in women: an ERP study

The present study used a combination of the Threat-of-Shock paradigm and the Attention Network Test (ANT) to investigate how induced anxiety affects alerting, orienting, and executive control and whether individual differences in threat sensitivity moderate these effects. Forty-two female subjects completed the ANT task in alternation under shock-threat and no-shock ("safe") conditions while event-related potentials (ERPs) were recorded. The results showed that anxiety induced by the threat of shock had a significant impact on alerting and executive control functions at the neural level. Specifically, alerting-related N1 and stimulus-preceding negativity (SPN) differences between double cue and no cue conditions were greater in the threat versus safe state, suggesting that the induced anxiety promoted the early perception of cues and preparation for the target. Moreover, executive control-related P3 and sustained potential (SP) differences between incongruent and congruent trials were greater in the threat versus safe state, indicating that the induced anxiety might improve the attentional allocation efficiency and stimulate subjects to recruit more cognitive resources to resolve conflicts. However, orienting-related ERPs were not affected by the threat of shock, but the threat of shock promoted the processing efficiency of spatial-cue at the behavioral level. Analysis of individual differences revealed that trait anxiety moderated the attentional allocation efficiency when performing executive control related tasks in the threat versus safe state. Our findings demonstrate the adaptive significance of the threat of shock-induced anxiety in that being in an anxious state can enhance individuals' alerting, orienting, and executive functions.

Adiposity and insulin resistance moderate the links between neuroelectrophysiology and working and episodic memory functions in young adult males but not females

INTRODUCTION

Obesity and insulin resistance negatively influence neural activity and cognitive function, but electrophysiological mechanisms underlying these interrelationships remain unclear. This study investigated whether adiposity and insulin resistance moderated neural activity and underlying cognitive functions in young adults.

METHODS

Real-time electroencephalography (EEG) was recorded in 38 lean (n = 12) and obese (n = 26) young adults with (n = 15) and without (n = 23) insulin resistance (18-38 years, 55.3% female) as participants completed three neurocognitive tasks in working memory (Operation Span), inhibitory control (Stroop), and episodic memory (Visual Association Test). Body fat percentage was quantified by a dual-energy X-ray absorptiometry scan (DEXA/DXA). Fasting serum insulin and glucose were quantified to calculate Homeostatic Model Assessment for Insulin Resistance (HOMA-IR) values, for which a higher value indicates more insulin resistance. Hierarchical moderated regression analysis tested these interrelationships.

RESULTS

In males, greater frontal negative slow wave (fNSW) and positive slow wave (PSW) amplitudes were linked to higher working memory accuracy in participants with low, but not high, body fat percentage and HOMA-IR levels. In contrast, body fat percentage and HOMA-IR did not moderate these associations in females. Furthermore, body fat percentage and HOMA-IR values moderated the relationship between greater fNSW amplitudes and better episodic memory accuracy in males, but not females. Finally, body fat percentage and insulin resistance did not moderate the link between neural activity and inhibitory control for either sex.

CONCLUSION

Young adult males, but not females, with higher body adiposity and insulin resistance showed reduced neural activity and worse underlying working and episodic memory functions.

Estimating statistical power for ERP studies using the auditory N1, Tb, and P2 components

The N1, Tb, and P2 components of the event-related potential (ERP) are thought to reflect the sequential processing of auditory stimuli in the human brain. Despite their extensive use in biological, cognitive, and clinical neuroscience, there are no guidelines for how to appropriately power ERP studies using these components. In the present study, we investigated how the number of trials, number of participants, effect magnitude, and study design influenced statistical power. Using Monte Carlo simulations of ERP data from a passive listening task, we determined the probability of finding a statistically significant effect in 58,900 experiments repeated 1,000 times each. We found that as the number of trials, number of participants, and effect magnitude increased, so did statistical power. We also found that increasing the number of trials had a bigger effect on statistical power for within-subject designs than for between-subject designs, and that within-subject designs required a smaller number of trials and participants to provide the same level of statistical power for a given effect magnitude than between-subject designs. These results show that it is important to carefully consider these factors when designing ERP studies, rather than relying on tradition or anecdotal evidence. To improve the robustness and reproducibility of ERP research, we have built an online statistical power calculator (https://bradleynjack.shinyapps.io/ErpPowerCalculator), which we hope will allow researchers to estimate the statistical power of previous studies, as well as help them design appropriately-powered studies in the future.

Managing EEG studies: How to prepare and what to do once data collection has begun

In this paper, we provide guidance for the organization and implementation of EEG studies. This work was inspired by our experience conducting a large-scale, multi-site study, but many elements could be applied to any EEG project. Section 1 focuses on study activities that take place before data collection begins. Topics covered include: establishing and training study teams, considerations for task design and piloting, setting up equipment and software, development of formal protocol documents, and planning communication strategy with all study team members. Section 2 focuses on what to do once data collection has already begun. Topics covered include: (1) how to effectively monitor and maintain EEG data quality, (2) how to ensure consistent implementation of experimental protocols, and (3) how to develop rigorous preprocessing procedures that are feasible for use in a large-scale study. Links to resources are also provided, including sample protocols, sample equipment and software tracking forms, sample code, and tutorial videos (to access resources, please visit: https://osf.io/wdrj3/).

Virtual Reality Sickness Reduces Attention During Immersive Experiences

In this paper, we show that Virtual Reality (VR) sickness is associated with a reduction in attention, which was detected with the P3b Event-Related Potential (ERP) component from electroencephalography (EEG) measurements collected in a dual-task paradigm. We hypothesized that sickness symptoms such as nausea, eyestrain, and fatigue would reduce the users' capacity to pay attention to tasks completed in a virtual environment, and that this reduction in attention would be dynamically reflected in a decrease of the P3b amplitude while VR sickness was experienced. In a user study, participants were taken on a tour through a museum in VR along paths with varying amounts of rotation, shown previously to cause different levels of VR sickness. While paying attention to the virtual museum (the primary task), participants were asked to silently count tones of a different frequency (the secondary task). Control measurements for comparison against the VR sickness conditions were taken when the users were not wearing the Head-Mounted Display (HMD) and while they were immersed in VR but not moving through the environment. This exploratory study shows, across multiple analyses, that the effect mean amplitude of the P3b collected during the task is associated with both sickness severity measured after the task with a questionnaire (SSQ) and with the number of counting errors on the secondary task. Thus, VR sickness may impair attention and task performance, and these changes in attention can be tracked with ERP measures as they happen, without asking participants to assess their sickness symptoms in the moment.

Binaural Beat Effects on Attention: A Study Based on the Oddball Paradigm

The impact of binaural beats (BBs) on human cognition and behavior remains and various methods have been used to measure their effect, including neurophysiological, psychometric, and human performance evaluations. The few approaches where the level of neural synchronicity and connectivity were measured by neuroimaging techniques have only been undertaken in spontaneous mode. The present research proposes an approach based on the oddball paradigm to study BB effect by estimating the level of attention induced by BBs. Evoked activity of 25 young adults between 19 and 24 years old with no hearing impairments nor clinical neurological history were analyzed. The experiment was conducted in two different sessions of 24.5 min. The first part consisted of 20-min BB stimulation in either theta (BBθ) or beta (BBβ). After the BB stimulation, an oddball paradigm was applied in each BB condition to assess the attentional effect induced by BBs. Attention enhancement is expected for BBβ with respect to BBθ. Target event related potentials (ERPs) were mainly analyzed in the time and time-frequency domains. The frequency analysis was based on continuous wavelet transform (CWT), event-related spectral perturbation (ERSP), and inter-trial phase coherence (ITPC). The study revealed that the P300 component was not significantly different between conditions (BBθ vs. BBβ). However, the target grand average ERP in BBθ condition was mainly composed of 8 Hz-frequency components, appearing before 400 ms post-stimulus, and mainly on the centro-parietal regions. In contrast, the target grand average ERP in BBβ condition was mainly composed of frequency components below 6 Hz, mainly appearing at 400 ms post-stimulus on the parieto-occipital regions. Furthermore, ERPs in the BBθ condition were more phase locked than the BBβ condition.

Permutation-based group sequential analyses for cognitive neuroscience

Cognitive neuroscientists have been grappling with two related experimental design problems. First, the complexity of neuroimaging data (e.g. often hundreds of thousands of correlated measurements) and analysis pipelines demands bespoke, non-parametric statistical tests for valid inference, and these tests often lack an agreed-upon method for performing a priori power analyses. Thus, sample size determination for neuroimaging studies is often arbitrary or inferred from other putatively but questionably similar studies, which can result in underpowered designs - undermining the efficacy of neuroimaging research. Second, when meta-analyses estimate the sample sizes required to obtain reasonable statistical power, estimated sample sizes can be prohibitively large given the resource constraints of many labs. We propose the use of sequential analyses to partially address both of these problems. Sequential study designs - in which the data is analyzed at interim points during data collection and data collection can be stopped if the planned test statistic satisfies a stopping rule specified a priori - are common in the clinical trial literature, due to the efficiency gains they afford over fixed-sample designs. However, the corrections used to control false positive rates in existing approaches to sequential testing rely on parametric assumptions that are often violated in neuroimaging settings. We introduce a general permutation scheme that allows sequential designs to be used with arbitrary test statistics. By simulation, we show that this scheme controls the false positive rate across multiple interim analyses. Then, performing power analyses for seven evoked response effects seen in the EEG literature, we show that this sequential analysis approach can substantially outperform fixed-sample approaches (i.e. require fewer subjects, on average, to detect a true effect) when study designs are sufficiently well-powered. To facilitate the adoption of this methodology, we provide a Python package "niseq" with sequential implementations of common tests used for neuroimaging: cluster-based permutation tests, threshold-free cluster enhancement, t-max, F-max, and the network-based statistic with tutorial examples using EEG and fMRI data.

Decoding semantic relatedness and prediction from EEG: A classification method comparison

Machine-learning (ML) decoding methods have become a valuable tool for analyzing information represented in electroencephalogram (EEG) data. However, a systematic quantitative comparison of the performance of major ML classifiers for the decoding of EEG data in neuroscience studies of cognition is lacking. Using EEG data from two visual word-priming experiments examining well-established N400 effects of prediction and semantic relatedness, we compared the performance of three major ML classifiers that each use different algorithms: support vector machine (SVM), linear discriminant analysis (LDA), and random forest (RF). We separately assessed the performance of each classifier in each experiment using EEG data averaged over cross-validation blocks and using single-trial EEG data by comparing them with analyses of raw decoding accuracy, effect size, and feature importance weights. The results of these analyses demonstrated that SVM outperformed the other ML methods on all measures and in both experiments.

Variations in ERP data quality across paradigms, participants, and scoring procedures

Although it is widely accepted that data quality for event-related potential (ERP) components varies considerably across studies and across participants within a study, ERP data quality has not received much systematic analysis. The present study used a recently developed metric of ERP data quality- the standardized measurement error (SME)-to examine how data quality varies across different ERP paradigms, across individual participants, and across different procedures for quantifying amplitude and latency values. The EEG recordings were taken from the ERP CORE, which includes data from 40 neurotypical college students for seven widely studied ERP components: P3b, N170, mismatch negativity, N400, error-related negativity, N2pc, and lateralized readiness potential. Large differences in data quality were observed across the different ERP components, and very large differences in data quality were observed across participants. Data quality also varied depending on the algorithm used to quantify the amplitude and especially the latency of a given ERP component. These results provide an initial set of benchmark values that can be used for comparison with previous and future ERP studies. They also provide useful information for predicting effect sizes and statistical power in future studies, even with different numbers of trials. More broadly, this study provides a general approach that could be used to determine which specific experimental designs, data collection procedures, and data processing algorithms lead to the best data quality.

Optimal Filters for ERP Research II: Recommended Settings for Seven Common ERP Components

In research with event-related potentials (ERPs), aggressive filters can substantially improve the signal-to-noise ratio and maximize statistical power, but they can also produce significant waveform distortion. Although this tradeoff has been well documented, the field lacks recommendations for filter cutoffs that quantitatively address both of these competing considerations. To fill this gap, we quantified the effects of a broad range of low-pass filter and high-pass filter cutoffs for seven common ERP components (P3b, N400, N170, N2pc, mismatch negativity, error-related negativity, and lateralized readiness potential) recorded from a set of neurotypical young adults. We also examined four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency). For each combination of component and scoring method, we quantified the effects of filtering on data quality (noise level and signal-to-noise ratio) and waveform distortion. This led to recommendations for optimal low-pass and high-pass filter cutoffs. We repeated the analyses after adding artificial noise to provide recommendations for datasets with moderately greater noise levels. For researchers who are analyzing data with similar ERP components, noise levels, and participant populations, using the recommended filter settings should lead to improved data quality and statistical power without creating problematic waveform distortion.

Interdisciplinary views of fNIRS: Current advancements, equity challenges, and an agenda for future needs of a diverse fNIRS research community

Functional Near-Infrared Spectroscopy (fNIRS) is an innovative and promising neuroimaging modality for studying brain activity in real-world environments. While fNIRS has seen rapid advancements in hardware, software, and research applications since its emergence nearly 30 years ago, limitations still exist regarding all three areas, where existing practices contribute to greater bias within the neuroscience research community. We spotlight fNIRS through the lens of different end-application users, including the unique perspective of a fNIRS manufacturer, and report the challenges of using this technology across several research disciplines and populations. Through the review of different research domains where fNIRS is utilized, we identify and address the presence of bias, specifically due to the restraints of current fNIRS technology, limited diversity among sample populations, and the societal prejudice that infiltrates today's research. Finally, we provide resources for minimizing bias in neuroscience research and an application agenda for the future use of fNIRS that is equitable, diverse, and inclusive.

An N400 identification method based on the combination of Soft-DTW and transformer

As a time-domain EEG feature reflecting the semantic processing of the human brain, the N400 event-related potentials still lack a mature classification and recognition scheme. To address the problems of low signal-to-noise ratio and difficult feature extraction of N400 data, we propose a Soft-DTW-based single-subject short-distance event-related potential averaging method by using the advantages of differentiable and efficient Soft-DTW loss function, and perform partial Soft-DTW averaging based on DTW distance within a single-subject range, and propose a Transformer-based ERP recognition classification model, which captures contextual information by introducing location coding and a self-attentive mechanism, combined with a Softmax classifier to classify N400 data. The experimental results show that the highest recognition accuracy of 0.8992 is achieved on the ERP-CORE N400 public dataset, verifying the effectiveness of the model and the averaging method.

Introducing RELAX: An automated pre-processing pipeline for cleaning EEG data - Part 1: Algorithm and application to oscillations

OBJECTIVE

Electroencephalographic (EEG) data are often contaminated with non-neural artifacts which can confound experimental results. Current artifact cleaning approaches often require costly manual input. Our aim was to provide a fully automated EEG cleaning pipeline that addresses all artifact types and improves measurement of EEG outcomes METHODS: We developed RELAX (the Reduction of Electroencephalographic Artifacts). RELAX cleans continuous data using Multi-channel Wiener filtering [MWF] and/or wavelet enhanced independent component analysis [wICA] applied to artifacts identified by ICLabel [wICA_ICLabel]). Several versions of RELAX were compared using three datasets (N = 213, 60 and 23 respectively) against six commonly used pipelines across a range of artifact cleaning metrics, including measures of remaining blink and muscle activity, and the variance explained by experimental manipulations after cleaning.

RESULTS

RELAX with MWF and wICA_ICLabel showed amongst the best performance at cleaning blink and muscle artifacts while preserving neural signal. RELAX with wICA_ICLabel only may perform better at differentiating alpha oscillations between working memory conditions.

CONCLUSIONS

RELAX provides automated, objective and high-performing EEG cleaning, is easy to use, and freely available on GitHub.

SIGNIFICANCE

We recommend RELAX for data cleaning across EEG studies to reduce artifact confounds, improve outcome measurement and improve inter-study consistency.

Single-trial-based temporal principal component analysis on extracting event-related potentials of interest for an individual subject

BACKGROUND

Temporal principal component analysis (tPCA) has been widely used to extract event-related potentials (ERPs) at group level of multiple subjects ERP data and it assumes that the underlying factor loading is fixed across participants. However, such assumption may fail to work if latency and phase for one ERP vary considerably across participants. Furthermore, effect of number of trials on tPCA decomposition has not been systematically examined as well, especially for within-subject PCA.

NEW METHOD

We reanalyzed a real ERP data of an emotional experiment using tPCA to extract N2 and P2 from single-trial EEG of an individual. We also explored influence of the number of trials (consecutively increased from 10 to 42 trials) on PCA decomposition by comparing temporal correlation, the statistical result, Cronbach's alpha, spatial correlation of both N2 and P2 for the proposed method with the conventional time-domain analysis, trial-averaged group PCA, and single-trial-based group PCA.

RESULTS

The results of the proposed method can enhance spatial and temporal consistency. We could obtain stable N2 with few trials (about 20) for the proposed method, but, for P2, approximately 30 trials were needed for all methods.

COMPARISON WITH EXISTING METHOD(S)

About 30 trials for N2 were required and the reconstructed P2 and N2 were poor correlated across participants for the other three methods.

CONCLUSION

The proposed approach may efficiently capture variability of one ERP from an individual that cannot be extracted by group PCA analysis.

Performance and Usability Evaluation of Brainwave Authentication Techniques with Consumer Devices

Brainwaves have demonstrated to be unique enough across individuals to be useful as biometrics. They also provide promising advantages over traditional means of authentication, such as resistance to external observability, revocability, and intrinsic liveness detection. However, most of the research so far has been conducted with expensive, bulky, medical-grade helmets, which offer limited applicability for everyday usage. With the aim to bring brainwave authentication and its benefits closer to real world deployment, we investigate brain biometrics with consumer devices. We conduct a comprehensive measurement experiment and user study that compare five authentication tasks on a user sample up to 10 times larger than those from previous studies, introducing three novel techniques based on cognitive semantic processing. Furthermore, we apply our analysis on high-quality open brainwave data obtained with a medical-grade headset, to assess the differences. We investigate both the performance, security, and usability of the different options and use this evidence to elicit design and research recommendations. Our results show that it is possible to achieve Equal Error Rates as low as 7.2% (a reduction between 68-72% with respect to existing approaches) based on brain responses to images with current inexpensive technology. We show that the common practice of testing authentication systems only with known attacker data is unrealistic and may lead to overly optimistic evaluations. With regard to adoption, users call for simpler devices, faster authentication, and better privacy.

Towards thoughtful planning of ERP studies: How participants, trials, and effect magnitude interact to influence statistical power across seven ERP components

In the field of EEG, researchers generally rely on rules of thumb, rather than a priori statistical calculations, when planning the number of trials to include in an ERP study. To aid in this practice, studies have tried to establish minimum numbers of trials required to reliably isolate ERPs. However, these guidelines do not necessarily apply across different study designs, as the reliability of an ERP waveform is not the same as the statistical power of a given experiment. Experiment parameters such as number of participants, trials, and effect magnitude interact to affect power in complex ways. Both under- and over-powered ERP studies represent a waste of time and resources that impedes the progress of the field. The current study fills this gap by subsampling real ERP data to estimate the relationship between experiment design parameters and statistical power. The simulations include seven commonly studied ERP components: the ERN, LRP, N170, MMN, P3, N2pc, and N400. In the first set of experiments, we determined the probability of obtaining a statistically significant ERP effect for each component. In the second and third set of experiments, we determined the probability of obtaining a statistically significant difference in ERP amplitude within and between groups for each component. Results indicate that the rules of thumb for ERP experiment design in the literature often lead to underpowered studies. Going forward, these results provide researchers with experiment design guidelines that are specific to the component under study, allowing for the design of sufficiently powered ERP studies.

M3CV: A multi-subject, multi-session, and multi-task database for EEG-based biometrics challenge

EEG signals exhibit commonality and variability across subjects, sessions, and tasks. But most existing EEG studies focus on mean group effects (commonality) by averaging signals over trials and subjects. The substantial intra- and inter-subject variability of EEG have often been overlooked. The recently significant technological advances in machine learning, especially deep learning, have brought technological innovations to EEG signal application in many aspects, but there are still great challenges in cross-session, cross-task, and cross-subject EEG decoding. In this work, an EEG-based biometric competition based on a large-scale M³CV (A Multi-subject, Multi-session, and Multi-task Database for investigation of EEG Commonality and Variability) database was launched to better characterize and harness the intra- and inter-subject variability and promote the development of machine learning algorithm in this field. In the M³CV database, EEG signals were recorded from 106 subjects, of which 95 subjects repeated two sessions of the experiments on different days. The whole experiment consisted of 6 paradigms, including resting-state, transient-state sensory, steady-state sensory, cognitive oddball, motor execution, and steady-state sensory with selective attention with 14 types of EEG signals, 120000 epochs. Two learning tasks (identification and verification), performance metrics, and baseline methods were introduced in the competition. In general, the proposed M³CV dataset and the EEG-based biometric competition aim to provide the opportunity to develop advanced machine learning algorithms for achieving an in-depth understanding of the commonality and variability of EEG signals across subjects, sessions, and tasks.

A Guided Tutorial on Modelling Human Event-Related Potentials with Recurrent Neural Networks

In cognitive neuroscience research, computational models of event-related potentials (ERP) can provide a means of developing explanatory hypotheses for the observed waveforms. However, researchers trained in cognitive neurosciences may face technical challenges in implementing these models. This paper provides a tutorial on developing recurrent neural network (RNN) models of ERP waveforms in order to facilitate broader use of computational models in ERP research. To exemplify the RNN model usage, the P3 component evoked by target and non-target visual events, measured at channel Pz, is examined. Input representations of experimental events and corresponding ERP labels are used to optimize the RNN in a supervised learning paradigm. Linking one input representation with multiple ERP waveform labels, then optimizing the RNN to minimize mean-squared-error loss, causes the RNN output to approximate the grand-average ERP waveform. Behavior of the RNN can then be evaluated as a model of the computational principles underlying ERP generation. Aside from fitting such a model, the current tutorial will also demonstrate how to classify hidden units of the RNN by their temporal responses and characterize them using principal component analysis. Statistical hypothesis testing can also be applied to these data. This paper focuses on presenting the modelling approach and subsequent analysis of model outputs in a how-to format, using publicly available data and shared code. While relatively less emphasis is placed on specific interpretations of P3 response generation, the results initiate some interesting discussion points.

Neuroaesthetic exploration on the cognitive processing behind repeating graphics

Repeating graphics are common research objects in modern design education. However, we do not exactly know the attentional processes underlying graphic artifacts consisting of repeating rhythms. In this experiment, the event-related potential, a neuroscientific measure, was used to study the neural correlates of repeating graphics within graded orderliness. We simulated the competitive identification process of people recognizing artifacts with graded repeating rhythms from a scattered natural environment with the oddball paradigm. In the earlier attentional processing related to the P2 component around the Fz electrode within the 150-250 ms range, a middle-grade repeating rhythm (Target 1) did not show a difference from a high-grade repeating rhythm (Target 2). However, in the later cognitive processes related to the P3b component around the Pz electrode within the 300-450 ms range, Target 1 had longer peak latency than Target 2, based on similar waveforms. Thus, we may suppose that the arrangement of the repeating graphics did not influence the earlier attentional processing but affected the later cognitive part, such as the categorization task in the oddball paradigm. Furthermore, as evidenced by the standard deviation wave across the trials, we suggest that the growing standard deviation value might represent the gradual loss of attentional focus to the task after the stimulus onset and that the zero-growth level may represent similar brain activity between trials.

A scoping review of electroencephalographic (EEG) markers for tracking neurophysiological changes and predicting outcomes in substance use disorder treatment

Substance use disorders (SUDs) constitute a growing global health crisis, yet many limitations and challenges exist in SUD treatment research, including the lack of objective brain-based markers for tracking treatment outcomes. Electroencephalography (EEG) is a neurophysiological technique for measuring brain activity, and although much is known about EEG activity in acute and chronic substance use, knowledge regarding EEG in relation to abstinence and treatment outcomes is sparse. We performed a scoping review of longitudinal and pre-post treatment EEG studies that explored putative changes in brain function associated with abstinence and/or treatment in individuals with SUD. Following PRISMA guidelines, we identified studies published between January 2000 and March 2022 from online databases. Search keywords included EEG, addictive substances (e.g., alcohol, cocaine, methamphetamine), and treatment related terms (e.g., abstinence, relapse). Selected studies used EEG at least at one time point as a predictor of abstinence or other treatment-related outcomes; or examined pre- vs. post-SUD intervention (brain stimulation, pharmacological, behavioral) EEG effects. Studies were also rated on the risk of bias and quality using validated instruments. Forty-four studies met the inclusion criteria. More consistent findings included lower oddball P3 and higher resting beta at baseline predicting negative outcomes, and abstinence-mediated longitudinal decrease in cue-elicited P3 amplitude and resting beta power. Other findings included abstinence or treatment-related changes in late positive potential (LPP) and N2 amplitudes, as well as in delta and theta power. Existing studies were heterogeneous and limited in terms of specific substances of interest, brief times for follow-ups, and inconsistent or sparse results. Encouragingly, in this limited but maturing literature, many studies demonstrated partial associations of EEG markers with abstinence, treatment outcomes, or pre-post treatment-effects. Studies were generally of good quality in terms of risk of bias. More EEG studies are warranted to better understand abstinence- or treatment-mediated neural changes or to predict SUD treatment outcomes. Future research can benefit from prospective large-sample cohorts and the use of standardized methods such as task batteries. EEG markers elucidating the temporal dynamics of changes in brain function related to abstinence and/or treatment may enable evidence-based planning for more effective and targeted treatments, potentially pre-empting relapse or minimizing negative lifespan effects of SUD.

Storage in Visual Working Memory Recruits a Content-Independent Pointer System

Past work has shown that storage in working memory elicits stimulus-specific neural activity that tracks the stored content. Here, we present evidence for a distinct class of load-sensitive neural activity that indexes items without representing their contents per se. We recorded electroencephalogram (EEG) activity while adult human subjects stored varying numbers of items in visual working memory. Multivariate analysis of the scalp topography of EEG voltage enabled precise tracking of the number of individuated items stored and robustly predicted individual differences in working memory capacity. Critically, this signature of working memory load generalized across variations in both the type and number of visual features stored about each item, suggesting that it tracked the number of individuated memory representations and not the content of those memories. We hypothesize that these findings reflect the operation of a capacity-limited pointer system that supports on-line storage and attentive tracking.

The alterations in event-related potential responses to pain empathy in breast cancer survivors treated with chemotherapy

Background

Previous findings indicated that breast cancer patients often have dysfunction in empathy and other cognitive functions during or after chemotherapy. However, the manifestations and possible neuro-electrophysiological mechanisms of pain empathy impairment in breast cancer patients after chemotherapy were still unknown.

Objective

The current study aimed to investigate the potential correlations between pain empathy impairment and event-related potentials (ERP) in breast cancer patients undergoing chemotherapy.

Methods

Twenty-two breast cancer patients were evaluated on a neuropsychological test and pain empathy paradigm before and after chemotherapy, containing the Chinese version of the Interpersonal Reactivity Index (IRI-C), while recording ERP data.

Results

The empathic concern scores were lower and personal distress scores were higher on IRI-C task compared with those before chemotherapy (t = 3.039, p < 0.01; t = −2.324, p < 0.05, respectively). Meanwhile, the accuracy rates were lower than those before chemotherapy for both pain and laterality tasks on the pain empathy paradigm (F = 5.099, P = 0.035). However, the response time was no significant differences before and after chemotherapy (F = 0.543, P = 0.469). Further, the amplitude of the N1 component was significantly increased (F = 38.091, P < 0.001), and the amplitude of the P2 component was significantly decreased (F = 15.046, P = 0.001) in the subsequent ERP study. A linear mixed effect model was used to analyze the correlation, the average amplitude of N1 and P2 were positively correlated with the accuracy rates in laterality tasks (r = 1.765, r = 1.125, respectively, P < 0.05).

Conclusion

The results indicated that pain empathy impairment was performed in chemotherapeutic breast cancer patients, which was possibly correlated to the changes of N1 and P2 components in ERP. These findings provide neuro-electrophysiological information about chemo-brain in breast cancer patients.

Wavelet Based Filters for Artifact Elimination in Electroencephalography Signal: A Review

Electroencephalography (EEG) is a diagnostic test that records and measures the electrical activity of the human brain. Research investigating human behaviors and conditions using EEG has increased from year to year. Therefore, an efficient approach is vital to process the EEG dataset to improve the output signal quality. The wavelet is one of the well-known approaches for processing the EEG signal in time-frequency domain analysis. The wavelet is better than the traditional Fourier Transform because it has good time-frequency localized properties and multi-resolution analysis where the transient information of an EEG signal can be extracted efficiently. Thus, this review article aims to comprehensively describe the application of the wavelet method in denoising the EEG signal based on recent research. This review begins with a brief overview of the basic theory and characteristics of EEG and the wavelet transform method. Then, several wavelet-based methods commonly applied in EEG dataset denoising are described and a considerable number of the latest published EEG research works with wavelet applications are reviewed. Besides, the challenges that exist in current EEG-based wavelet method research are discussed. Finally, alternative solutions to mitigate the issues are recommended.