Time courses of attentional modulation in neural amplification and synchronization measured with steady-state visual-evoked potentials

Advancements in brain-computer interfaces for the rehabilitation of unilateral spatial neglect: a concise review

This short review examines recent advancements in neurotechnologies within the context of managing unilateral spatial neglect (USN), a common condition following stroke. Despite the success of brain-computer interfaces (BCIs) in restoring motor function, there is a notable absence of effective BCI devices for treating cerebral visual impairments, a prevalent consequence of brain lesions that significantly hinders rehabilitation. This review analyzes current non-invasive BCIs and technological solutions dedicated to cognitive rehabilitation, with a focus on visuo-attentional disorders. We emphasize the need for further research into the use of BCIs for managing cognitive impairments and propose a new potential solution for USN rehabilitation, by combining the clinical subtleties of this syndrome with the technological advancements made in the field of neurotechnologies.

Steady-state Visual Evoked Potentials Reveal Dynamic (Re)allocation of Spatial Attention during Maintenance and Utilization of Visual Working Memory

Visual working memory (VWM) allows storing goal-relevant information to guide future behavior. Prior work suggests that VWM is spatially organized and relies on spatial attention directed toward locations at which memory items were encoded, even if location is task-irrelevant. Importantly, attention often needs to be dynamically redistributed between locations, for example, in preparation for an upcoming probe. Very little is known about how attentional resources are distributed between multiple locations during a VWM task and even less about the dynamic changes governing such attentional shifts over time. This is largely due to the inability to use behavioral outcomes to reveal fast dynamic changes within trials. We here demonstrated that EEG steady-state visual evoked potentials (SSVEPs) successfully track the dynamic allocation of spatial attention during a VWM task. Participants were presented with to-be-memorized gratings and distractors at two distinct locations, tagged with flickering discs. This allowed us to dynamically track attention allocated to memory and distractor items via their coupling with space by quantifying the amplitude and coherence of SSVEP responses in the EEG signal to flickering stimuli at the former memory and distractor locations. SSVEP responses did not differ between memory and distractor locations during early maintenance. However, shortly before probe comparison, we observed a decrease in SSVEP coherence over distractor locations indicative of a reallocation of spatial attentional resources. RTs were shorter when preceded by stronger decreases in SSVEP coherence at distractor locations, likely reflecting attentional shifts from the distractor to the probe or memory location. We demonstrate that SSVEPs can inform about dynamic processes in VWM, even if location does not have to be reported by participants. This finding not only supports the notion of a spatially organized VWM but also reveals that SSVEPs betray a dynamic prioritization process of working memory items and locations over time that is directly predictive of memory performance.

Attentional Modulation in Early Visual Cortex: A Focused Reanalysis of Steady-state Visual Evoked Potential Studies

Steady-state visual evoked potentials (SSVEPs) are a powerful tool for investigating selective attention. Here, we conducted a combined reanalysis of multiple studies employing this technique in a variety of attentional experiments to, first, establish benchmark effect sizes of attention on amplitude and phase of SSVEPs and, second, harness the power of a large data set to test more specific hypotheses. Data of eight published SSVEP studies were combined, in which human participants (n = 135 in total) attended to flickering random dot stimuli based on their defining features (e.g., location, color, luminance, or orientation) or feature conjunctions. The reanalysis established that, in all the studies, attention reliably enhanced amplitudes, with color-based attention providing the strongest effect. In addition, the latency of SSVEPs elicited by attended stimuli was reduced by ∼4 msec. Next, we investigated the modulation of SSVEP amplitudes in a subset of studies where two different features were attended concurrently. Although most models assume that attentional effects of multiple features are combined additively, our results suggest that neuronal enhancement provided by concurrent attention is better described by multiplicative integration. Finally, we used the combined data set to demonstrate that the increase in trial-averaged SSVEP amplitudes with attention cannot be explained by increased synchronization of single-trial phases. Contrary to the prediction of the phase-locking account, the variance across trials of complex Fourier coefficients increases with attention, which is more consistent with boosting of a largely phase-locked signal embedded in non-phase-locked noise.

Steady-state visual evoked potentials in children with neurofibromatosis type 1: associations with behavioral rating scales and impact of psychostimulant medication

Background

Neurofibromatosis type 1 (NF1) is a genetic disorder often associated with cognitive dysfunctions, including a high occurrence of deficits in visuoperceptual skills. The neural underpinnings of these visuoperceptual deficits are not fully understood. We used steady-state visual evoked potentials (SSVEPs) to investigate possible alterations in the synchronization of neural activity in the occipital cortex of children with NF1.

Methods

SSVEPs were measured using electroencephalography and compared between children with NF1 (n = 28) and neurotypical controls (n = 28) aged between 4 and 13 years old. SSVEPs were recorded during visual stimulation with coloured icons flickering at three different frequencies (6 Hz, 10 Hz, and 15 Hz) and analyzed in terms of signal-to-noise ratios. A mixed design ANCOVA was performed to compare SSVEP responses between groups at the three stimulation frequencies. Pearson’s correlations with levels of intellectual functioning as well as with symptoms of ADHD, ASD and emotional/behavioral problems were performed. The impact of psychostimulant medication on the SSVEP responses was analyzed in a subset of the NF1 group (n = 8) with paired t-tests.

Results

We observed reduced signal-to-noise ratios of the SSVEP responses in children with NF1. The SSVEP responses were negatively correlated with symptoms of inattention and with symptoms of emotional/behavioral problems in the NF1 group. The SSVEP response generated by the lowest stimulation frequency (i.e., 6 Hz) was rescued with the intake of psychostimulant medication.

Conclusions

Impaired processing of rhythmic visual stimulation was evidenced in children with NF1 through measures of SSVEP responses. Those responses seem to be more reduced in children with NF1 who exhibit more symptoms of inattention and emotional/behavioral problems in their daily life. SSVEPs are potentially sensitive electrophysiological markers that could be included in future studies investigating the impact of medication on brain activity and cognitive functioning in children with NF1.

Supplementary Information

The online version contains supplementary material available at 10.1186/s11689-022-09452-y.

Steady-state visual evoked potentials differentiate between internally and externally directed attention

While attention to external visual stimuli has been extensively studied, attention directed internally towards mental contents (e.g., thoughts, memories) or bodily signals (e.g., breathing, heartbeat) has only recently become a subject of increased interest, due to its relation to interoception, contemplative practices and mental health. The present study aimed at expanding the methodological toolbox for studying internal attention, by examining for the first time whether the steady-state visual evoked potential (ssVEP), a well-established measure of attention, can differentiate between internally and externally directed attention. To this end, we designed a task in which flickering dots were used to generate ssVEPs, and instructed participants to count visual targets (external attention condition) or their heartbeats (internal attention condition). We compared the ssVEP responses between conditions, along with alpha-band activity and the heartbeat evoked potential (HEP) - two electrophysiological measures associated with internally directed attention. Consistent with our hypotheses, we found that both the magnitude and the phase synchronization of the ssVEP decreased when attention was directed internally, suggesting that ssVEP measures are able to differentiate between internal and external attention. Additionally, and in line with previous findings, we found larger suppression of parieto-occipital alpha-band activity and an increase of the HEP amplitude in the internal attention condition. Furthermore, we found a trade-off between changes in ssVEP response and changes in HEP and alpha-band activity: when shifting from internal to external attention, increase in ssVEP response was related to a decrease in parieto-occipital alpha-band activity and HEP amplitudes. These findings suggest that shifting between external and internal directed attention prompts a re-allocation of limited processing resources that are shared between external sensory and interoceptive processing.

Visual attention around a hand location localized by proprioceptive information

Facilitation of visual processing has been reported in the space near the hand. To understand the underlying mechanism of hand proximity attention, we conducted experiments that isolated hand-related effects from top–down attention, proprioceptive information from visual information, the position effect from the influence of action, and the distance effect from the peripersonal effect. The flash-lag effect was used as an index of attentional modulation. Because the results showed that the flash-lag effect was smaller at locations near the hand, we concluded that there was a facilitation effect of the visual stimuli around the hand location identified through proprioceptive information. This was confirmed by conventional reaction time measures. We also measured steady-state visual evoked potential (SSVEP) in order to investigate the spatial properties of hand proximity attention and top–down attention. The results showed that SSVEP reflects the effect of top–down attention but not that of hand proximity attention. This suggests that the site of hand proximity attention is at a later stage of visual processing, assuming that SSVEP responds to neural activities at the early stages. The results of left-handers differed from those of right-handers, and this is discussed in relation to handedness variation.

Individual Optimal Attentional Strategy in Motor Learning Tasks Characterized by Steady-State Somatosensory and Visual Evoked Potentials

Focus of attention is one of the most influential factors facilitating motor performance. Previous evidence supports that the external focus (EF) strategy, which directs attention to movement outcomes, is associated with better motor performance than the internal focus (IF) strategy, which directs attention to body movements. However, recent studies have reported that the EF strategy is not effective for some individuals. Furthermore, neuroimaging studies have demonstrated that the frontal and parietal areas characterize individual optimal attentional strategies for motor tasks. However, whether the sensory cortices are also functionally related to individual optimal attentional strategy remains unclear. Therefore, the present study examined whether an individual’s sensory processing ability would reflect the optimal attentional strategy. To address this point, we explored the relationship between responses in the early sensory cortex and individuals’ optimal attentional strategy by recording steady-state somatosensory evoked potentials (SSSEP) and steady-state visual evoked potentials (SSVEP). Twenty-six healthy young participants first performed a motor learning task with reaching movements under IF and EF conditions. Of the total sample, 12 individuals showed higher after-effects under the IF condition than the EF condition (IF-dominant group), whereas the remaining individuals showed the opposite trend (EF-dominant group). Subsequently, we measured SSSEP from bilateral primary somatosensory cortices while presenting vibrotactile stimuli and measured SSVEP from bilateral primary visual cortices while presenting checkerboard visual stimuli. The degree of increasing SSSEP response when the individuals in the IF-dominant group directed attention to vibrotactile stimuli was significantly more potent than those in the EF-dominant individuals. By contrast, the individuals in the EF-dominant group showed a significantly larger SSVEP increase while they directed attention to visual stimuli compared with the IF-dominant individuals. Furthermore, a significant correlation was observed such that individuals with more robust IF dominance showed more pronounced SSSEP attention modulation. These results suggest that the early sensory areas have crucial brain dynamics to characterize an individual’s optimal attentional strategy during motor tasks. The response characteristics may reflect the individual sensory processing ability, such as control of priority to the sensory inputs. Considering individual cognitive traits based on the suitable attentional strategy could enhance adaptability in motor tasks.

The dynamics of reading complex words: evidence from steady-state visual evoked potentials

The present study used steady-state visual evoked potentials (SSVEPs) to examine the spatio-temporal dynamics of reading morphologically complex words and test the neurophysiological activation pattern elicited by stems and suffixes. Three different types of target words were presented to proficient readers in a delayed naming task: truly suffixed words (e.g., farmer), pseudo-suffixed words (e.g., corner), and non-suffixed words (e.g., cashew). Embedded stems and affixes were flickered at two different frequencies (18.75 Hz and 12.50 Hz, respectively). The stem data revealed an earlier SSVEP peak in the truly suffixed and pseudo-suffixed conditions compared to the non-suffixed condition, thus providing evidence for the form-based activation of embedded stems during reading. The suffix data also showed a dissociation in the SSVEP response between suffixes and non-suffixes with an additional activation boost for truly suffixed words. The observed differences are discussed in the context of current models of complex word recognition.

Inter-brain amplitude correlation differentiates cooperation from competition in a motion-sensing sports game

Cooperation and competition are two basic modes of human interaction. Their underlying neural mechanisms, especially from an interpersonal perspective, have not been fully explored. Using the electroencephalograph-based hyperscanning technique, the present study investigated the neural correlates of both cooperation and competition within the same ecological paradigm using a classic motion-sensing tennis game. Both the inter-brain coupling (the inter-brain amplitude correlation and inter-brain phase-locking) and the intra-brain spectral power were analyzed. Only the inter-brain amplitude correlation showed a significant difference between cooperation and competition, with different spatial patterns at theta, alpha and beta frequency bands. Further inspection revealed distinct inter-brain coupling patterns for cooperation and competition; cooperation elicited positive inter-brain amplitude correlation at the delta and theta bands in extensive brain regions, while competition was associated with negative occipital inter-brain amplitude correlation at the alpha and beta bands. These findings add to our knowledge of the neural mechanisms of cooperation and competition and suggest the significance of adopting an inter-brain perspective in exploring the neural underpinnings of social interaction in ecological contexts.

Dynamic Interplay between Reward and Voluntary Attention Determines Stimulus Processing in Visual Cortex

Reward enhances stimulus processing in the visual cortex, but the mechanisms through which this effect occurs remain unclear. Reward prospect can both increase the deployment of voluntary attention and increase the salience of previously neutral stimuli. In this study, we orthogonally manipulated reward and voluntary attention while human participants performed a global motion detection task. We recorded steady-state visual evoked potentials to simultaneously measure the processing of attended and unattended stimuli linked to different reward probabilities, as they compete for attentional resources. The processing of the high rewarded feature was enhanced independently of voluntary attention, but this gain diminished once rewards were no longer available. Neither the voluntary attention nor the salience account alone can fully explain these results. Instead, we propose how these two accounts can be integrated to allow for the flexible balance between reward-driven increase in salience and voluntary attention.

Neural Entrainment Meets Behavior: The Stability Index as a Neural Outcome Measure of Auditory-Motor Coupling

Understanding rhythmic behavior in the context of coupled auditory and motor systems has been of interest to neurological rehabilitation, in particular, to facilitate walking. Recent work based on behavioral measures revealed an entrainment effect of auditory rhythms on motor rhythms. In this study, we propose a method to compute the neural component of such a process from an electroencephalographic (EEG) signal. A simple auditory-motor synchronization paradigm was used, where 28 healthy participants were instructed to synchronize their finger-tapping with a metronome. The computation of the neural outcome measure was carried out in two blocks. In the first block, we used Generalized Eigendecomposition (GED) to reduce the data dimensionality to the component which maximally entrained to the metronome frequency. The scalp topography pointed at brain activity over contralateral sensorimotor regions. In the second block, we computed instantaneous frequency from the analytic signal of the extracted component. This returned a time-varying measure of frequency fluctuations, whose standard deviation provided our "stability index" as a neural outcome measure of auditory-motor coupling. Finally, the proposed neural measure was validated by conducting a correlation analysis with a set of behavioral outcomes from the synchronization task: resultant vector length, relative phase angle, mean asynchrony, and tempo matching. Significant moderate negative correlations were found with the first three measures, suggesting that the stability index provided a quantifiable neural outcome measure of entrainment, with selectivity towards phase-correction mechanisms. We address further adoption of the proposed approach, especially with populations where sensorimotor abilities are compromised by an underlying pathological condition. The impact of using stability index can potentially be used as an outcome measure to assess rehabilitation protocols, and possibly provide further insight into neuropathological models of auditory-motor coupling.

Steady-State Visually Evoked Potentials and Feature-based Attention: Preregistered Null Results and a Focused Review of Methodological Considerations

Feature-based attention is the ability to selectively attend to a particular feature (e.g., attend to red but not green items while looking for the ketchup bottle in your refrigerator), and steady-state visually evoked potentials (SSVEPs) measured from the human EEG signal have been used to track the neural deployment of feature-based attention. Although many published studies suggest that we can use trial-by-trial cues to enhance relevant feature information (i.e., greater SSVEP response to the cued color), there is ongoing debate about whether participants may likewise use trial-by-trial cues to voluntarily ignore a particular feature. Here, we report the results of a preregistered study in which participants either were cued to attend or to ignore a color. Counter to prior work, we found no attention-related modulation of the SSVEP response in either cue condition. However, positive control analyses revealed that participants paid some degree of attention to the cued color (i.e., we observed a greater P300 component to targets in the attended vs. the unattended color). In light of these unexpected null results, we conducted a focused review of methodological considerations for studies of feature-based attention using SSVEPs. In the review, we quantify potentially important stimulus parameters that have been used in the past (e.g., stimulation frequency, trial counts) and we discuss the potential importance of these and other task factors (e.g., feature-based priming) for SSVEP studies.

Exploring the temporal dynamics of inhibition of return using steady-state visual evoked potentials

Inhibition of return is characterized by delayed responses to previously attended locations when the interval between stimuli is long enough. The present study employed steady-state visual evoked potentials (SSVEPs) as a measure of attentional modulation to explore the nature and time course of input- and output-based inhibitory cueing mechanisms that each slow response times at previously stimulated locations under different experimental conditions. The neural effects of behavioral inhibition were examined by comparing post-cue SSVEPs between cued and uncued locations measured across two tasks that differed only in the response modality (saccadic or manual response to targets). Grand averages of SSVEP amplitudes for each condition showed a reduction in amplitude at cued locations in the window of 100-500 ms post-cue, revealing an early, short-term decrease in the responses of neurons that can be attributed to sensory adaptation, regardless of response modality. Because primary visual cortex has been found to be one of the major sources of SSVEP signals, the results suggest that the SSVEP modulations observed were caused by input-based inhibition that occurred in V1, or visual areas earlier than V1, as a consequence of reduced visual input activity at previously cued locations. No SSVEP modulations were observed in either response condition late in the cue-target interval, suggesting that neither late input- nor output-based IOR modulates SSVEPs. These findings provide further electrophysiological support for the theory of multiple mechanisms contributing to behavioral cueing effects.

The SSVEP tracks attention, not consciousness, during perceptual filling-in

Research on the neural basis of conscious perception has almost exclusively shown that becoming aware of a stimulus leads to increased neural responses. By designing a novel form of perceptual filling-in (PFI) overlaid with a dynamic texture display, we frequency-tagged multiple disappearing targets as well as their surroundings. We show that in a PFI paradigm, the disappearance of a stimulus and subjective invisibility is associated with increases in neural activity, as measured with steady-state visually evoked potentials (SSVEPs), in electroencephalography (EEG). We also find that this increase correlates with alpha-band activity, a well-established neural measure of attention. These findings cast doubt on the direct relationship previously reported between the strength of neural activity and conscious perception, at least when measured with current tools, such as the SSVEP. Instead, we conclude that SSVEP strength more closely measures changes in attention.

The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli

Steady-state visual evoked potential (SSVEP) is a periodic response to a repetitive visual stimulus at a specific frequency. Currently, SSVEP is widely treated as an attention tag in cognitive activities and is used as an input signal for brain-computer interfaces (BCIs). However, whether SSVEP can be used as a reliable indicator has been a controversial issue. We focused on the independence of SSVEP from frequency allocation and number of stimuli. First, a cue-target paradigm was adopted to examine the interaction between SSVEPs evoked by two stimuli with different frequency allocations under different attention conditions. Second, we explored whether signal strength and the performance of SSVEP-based BCIs were affected by the number of stimuli. The results revealed that no significant interaction of SSVEP responses appeared between attended and unattended stimuli under various frequency allocations, regardless of their appearance in the fundamental or second-order harmonic. The amplitude of SSVEP suffered no significant gain or loss under different numbers of stimuli, but the performance of SSVEP-based BCIs varied along with duration of stimuli; that is, the recognition rate was not affected by the number of stimuli when the duration of stimuli was long enough, while the information transfer rate (ITR) presented the opposite trend. It can be concluded that SSVEP is a reliable tool for marking and monitoring multiple stimuli simultaneously in cognitive studies, but much caution should be taken when choosing a suitable duration and the number of stimuli, in order to achieve optimal utility of BCIs in the future.

Recognition of the idle state based on a novel IFB-OCN method for an asynchronous brain-computer interface

BACKGROUND

A major difficulty for the asynchronous brain-computer interface (BCI) lies in the accurate recognition of the control and idle states. Although subject's attention level was found to be different in these states, the validity of recognizing them using attention features has not been studied.

NEW METHODS

This paper proposed a novel Individualized Frequency Band based Optimized Complex Network (IFB-OCN) method to enhance the performance of discriminating the control and idle states. The IFB-OCN method extracted the attention features from a single FPz channel, selected the first three individualized frequency bands with the highest accuracies, and integrated the features of these bands for classification.

RESULTS

The performance was evaluated using a steady-state visual evoked potential (SSVEP)-based BCI task. In the offline evaluation, the IFB-OCN method achieved the highest average accuracy of 93.5 % with the data length of 4 s, and achieved the highest information transfer rate (ITR) of 47.3 bits/min with the data length of 0.5 s. In the simulated online evaluation, the IFB-OCN method obtained a true positive rate (TPR) of 89.8 % and a true negative rate (TNR) of 86.2 %.

COMPARISON WITH EXISTING METHODS

The proposed IFB-OCN method recognized the control and idle states using a single FPz channel rather than the occipital channels, and outperformed the existing algorithms in the accuracy of detecting the attention level.

CONCLUSIONS

These results demonstrate that the proposed IFB-OCN method is efficient in recognizing the idle state and has a great potential for enhancing the asynchronous BCIs.

Too little, too late, and in the wrong place: Alpha band activity does not reflect an active mechanism of selective attention

Selective attention focuses visual processing on relevant stimuli in order to allow for adaptive behaviour despite an abundance of distracting information. It has been proposed that increases in alpha band (8-12 ​Hz) amplitude reflect an active mechanism for distractor suppression. If this were the case, increases in alpha band amplitude should be succeeded by a decrease in distractor processing. Surprisingly, this connection has not been tested directly; specifically, studies that have investigated changes in alpha band after attention-directing cues have not directly assessed the neuronal processing of distractors. We concurrently recorded alpha activity and steady-state visual evoked potentials (SSVEPs) to assess the processing of target and distractor stimuli. In two experiments, participants covertly shifted attention to one of two letter streams (left or right) to detect infrequent target letters 'X' while ignoring the other stream. In line with previous findings, alpha band amplitudes contralateral to the unattended location increased compared to a pre-cue baseline. However, there was no suppression of SSVEP amplitudes elicited by unattended stimuli, while there was a pronounced enhancement of SSVEPs elicited by attended stimuli. Furthermore, and crucially, changes in alpha band amplitude during attention shifts did not precede those in SSVEPs and hit rates in both experiments, indicating that changes in alpha band amplitudes are likely to be a consequence of attention shifts rather than the other way around. We conclude that these findings contradict the notion that alpha band activity reflects mechanisms that have a causal role in the allocation of selective attention.

Interaction between steady-state visually evoked potentials at nearby flicker frequencies

Steady-state visually evoked potential (SSVEP) studies routinely employ simultaneous presentation of two temporally modulated stimuli, with SSVEP amplitude modulations serving to index top-down cognitive processes. However, the nature of SSVEP amplitude modulations as a function of competing temporal frequency (TF) has not been systematically studied, especially in relation to the normalization framework which has been extensively used to explain visual responses to multiple stimuli. We recorded spikes and local field potential (LFP) from the primary visual cortex (V1) as well as EEG from two awake macaque monkeys while they passively fixated plaid stimuli with components counterphasing at different TFs. We observed asymmetric SSVEP response suppression by competing TFs (greater suppression for lower TFs), which further depended on the relative orientations of plaid components. A tuned normalization model, adapted to SSVEP responses, provided a good account of the suppression. Our results provide new insights into processing of temporally modulated visual stimuli.

Steady-state visual evoked potential temporal dynamics reveal correlates of cognitive decline

OBJECTIVE

A central concern in aging is the preservation of cognitive skills. Tools to detect cognitive decline are sparse. The aim of this study was to ascertain whether cognitive decline is accompanied by alterations in the temporal dynamics of steady-state visual evoked potentials (SSVEPs).

METHODS

We included 162 men from the Danish Metropolit birth cohort. Their cognitive trajectory was based on their intelligence test score at youth (age ~18), middle age (age ~56), and late middle age (age ~62). Subjects underwent cognitive tests and steady-state visual stimulation. Temporal dynamics of SSVEPs were assessed in terms of amplitude and phase coherence.

RESULTS

The latency and magnitude of the amplitude modulation of the 36-Hz response correlated negatively with subjects' cognition indices. Furthermore, negative cognition index was associated with loss of SSVEPs at 36 Hz, and both 8 Hz and 36 Hz in severe cases.

CONCLUSION

Latency and magnitude of gamma frequency SSVEPs increase with cognitive decline. This suggests that the facilitation of SSVEPs first becomes problematic at gamma frequencies, then at alpha frequencies.

SIGNIFICANCE

Our data suggests that the temporal dynamics of SSVEPs can be used as an indicator of cognitive impairment. Furthermore, evoked gamma oscillations are especially vulnerable in cognitive decline.

Spatial Attentional Selection Modulates Early Visual Stimulus Processing Independently of Visual Alpha Modulations

The capacity-limited human brain is constantly confronted with a huge amount of sensory information. Selective attention is needed for biasing neural processing towards relevant information and consequently allows meaningful interaction with the environment. Activity in the alpha-band has been proposed to be related to top-down modulation of neural inhibition and could thus represent a viable candidate to control the priority of stimulus processing. It is, however, unknown whether modulations in the alpha-band directly relate to changes in the sensory gain control of the early visual cortex. Here, we used a spatial cueing paradigm while simultaneously measuring ongoing alpha-band oscillations and steady-state visual evoked potentials (SSVEPs) as a marker of continuous early sensory processing in the human visual cortex. Thereby, the effects of spatial attention for both of these signals and their potential interactions were assessed. As expected, spatial attention modulated both alpha-band and SSVEP responses. However, their modulations were independent of each other and the corresponding activity profiles differed across task demands. Thus, our results challenge the view that modulations of alpha-band activity represent a mechanism that directly alters or controls sensory gain. The potential role of alpha-band oscillations beyond sensory processing will be discussed in light of the present results.

Spatial attention enhances cortical tracking of quasi-rhythmic visual stimuli

Successfully interpreting and navigating our natural visual environment requires us to track its dynamics constantly. Additionally, we focus our attention on behaviorally relevant stimuli to enhance their neural processing. Little is known, however, about how sustained attention affects the ongoing tracking of stimuli with rich natural temporal dynamics. Here, we used MRI-informed source reconstructions of magnetoencephalography (MEG) data to map to what extent various cortical areas track concurrent continuous quasi-rhythmic visual stimulation. Further, we tested how top-down visuo-spatial attention influences this tracking process. Our bilaterally presented quasi-rhythmic stimuli covered a dynamic range of 4-20 ​Hz, subdivided into three distinct bands. As an experimental control, we also included strictly rhythmic stimulation (10 vs 12 ​Hz). Using a spectral measure of brain-stimulus coupling, we were able to track the neural processing of left vs. right stimuli independently, even while fluctuating within the same frequency range. The fidelity of neural tracking depended on the stimulation frequencies, decreasing for higher frequency bands. Both attended and non-attended stimuli were tracked beyond early visual cortices, in ventral and dorsal streams depending on the stimulus frequency. In general, tracking improved with the deployment of visuo-spatial attention to the stimulus location. Our results provide new insights into how human visual cortices process concurrent dynamic stimuli and provide a potential mechanism - namely increasing the temporal precision of tracking - for boosting the neural representation of attended input.

Human visual steady-state responses to amplitude-modulated flicker: Latency measurement

The response latency of steady-state visually evoked potentials (SSVEPs) is a sensitive measurement for investigating visual functioning of the human brain, specifically in visual development and for clinical evaluation. This latency can be measured from the slope of phase versus frequency of responses by using multiple frequencies of stimuli. In an attempt to provide an alternative measurement of this latency, this study utilized an envelope response of SSVEPs elicited by amplitude-modulated visual stimulation and then compared with the envelope of the generating signal, which was recorded simultaneously with the electroencephalography recordings. The advantage of this measurement is that it successfully estimates the response latency based on the physiological envelope in the entire waveform. Results showed the response latency at the occipital lobe (Oz channel) was approximately 104.55 ms for binocular stimulation, 97.14 ms for the dominant eye, and 104.75 ms for the nondominant eye with no significant difference between these stimulations. Importantly, the response latency at frontal channels (125.84 ms) was significantly longer than that at occipital channels (104.11 ms) during binocular stimulation. Together with strong activation of the source envelope at occipital cortex, these findings support the idea of a feedforward process, with the visual stimuli propagating originally from occipital cortex to anterior cortex. In sum, these findings offer a novel method for future studies in measuring visual response latencies and also potentially shed a new light on understanding of how long collective neural activities take to travel in the human brain.

Sleepless and desynchronized: Impaired inter trial phase coherence of steady-state potentials following sleep deprivation

Sleep loss has detrimental effects on cognitive and emotional functioning. These impairments have been associated with alterations in EEG measures of power spectrum and event-related potentials, however the impact of sleep loss on inter trial phase coherence (ITPC), a measure of phase consistency over experimental trials, remains mostly unknown. ITPC is thought to reflect the ability of the neural response to temporally synchronize with relevant events, thus optimizing information processing. In the current study we investigated the effects of sleep deprivation on information processing by evaluating the phase consistency of steady-state visual evoked potentials (ssVEPs) as well as amplitude-based measures of ssVEPs, obtained from a group of 18 healthy individuals following 24 h of total sleep deprivation and after a night of habitual sleep. An ssVEP task was utilized, which included the presentation of dots flickering at 7.5 Hz, along with a cognitive-emotional task. Our results show that ITPC is significantly reduced under sleep deprivation relative to habitual sleep. Interestingly, decreased ITPC under sleep deprivation was associated with decreased behavioral performance in the psychomotor vigilance task (PVT), a validated measure of reduced vigilance following a lack of sleep. The results suggest that the capability of the brain to synchronize with rhythmic stimuli is disrupted without sleep. Thus, decreased ITPC may represent an objective and mechanistic measure of sleep loss, allowing future work to study the relation between brain-world synchrony and the specific functional impairments associated with sleep deprivation.

Type-1 diabetes shapes working memory processing strategies

BACKGROUND

Type 1 diabetes (T1D) is a metabolic disorder characterized by recurrent hypo- and hyperglycemic episodes, whose clinical development has been associated with cognitive and working memory (WM) deficits.

OBJECTIVE

To contrast quantitative electroencephalography (qEEG) measures between young patients with T1D and healthy controls while performing a visuospatial WM task with two memory load levels and facial emotional stimuli.

METHODS

Four or five neutral or happy faces were sequentially and pseudo-randomly presented in different spatial locations, followed by subsequent sequences displaying the reversed spatial order or any other. Participants were instructed to discriminate between these two alternatives during EEG recording.

RESULTS

A significant increase in the absolute power of the delta and theta bands, distributed mainly over the frontal region was found during task execution, with a slight decrease of alpha band power in both groups but mainly in control individuals. However, these changes were more pronounced in the T1D patients, and reached their maximum level during the WM encoding phase, even on trials with the lower memory load. In contrast, changes seemed to occur more gradually in controls and results differed significantly only on the trials with the higher WM load.

CONCLUSIONS

These results reflect adaptive WM-processing mechanisms in which cognitive strategies have evolved in T1D patients in order to meet task demands.

Attention differentially modulates the amplitude of resonance frequencies in the visual cortex

Rhythmic visual stimuli (flicker) elicit rhythmic brain responses at the frequency of the stimulus, and attention generally enhances these oscillatory brain responses (steady state visual evoked potentials, SSVEPs). Although SSVEP responses have been tested for flicker frequencies up to 100 Hz [Herrmann, 2001], effects of attention on SSVEP amplitude have only been reported for lower frequencies (up to ~30 Hz), with no systematic comparison across a wide, finely sampled frequency range. Does attention modulate SSVEP amplitude at higher flicker frequencies (gamma band, 30-80 Hz), and is attentional modulation constant across frequencies? By isolating SSVEP responses from the broadband EEG signal using a multivariate spatiotemporal source separation method, we demonstrate that flicker in the alpha and gamma bands elicit strongest and maximally phase stable brain responses (resonance), on which the effect of attention is opposite: positive for gamma and negative for alpha. Finding subject-specific gamma resonance frequency and a positive attentional modulation of gamma-band SSVEPs points to the untapped potential of flicker as a non-invasive tool for studying the causal effects of interactions between visual gamma-band rhythmic stimuli and endogenous gamma oscillations on perception and attention.

Frequency-tagged visual evoked responses track syllable effects in visual word recognition

The processing of syllables in visual word recognition was investigated using a novel paradigm based on steady-state visual evoked potentials (SSVEPs). French words were presented to proficient readers in a delayed naming task. Words were split into two segments, the first of which was flickered at 18.75 Hz and the second at 25 Hz. The first segment either matched (congruent condition) or did not match (incongruent condition) the first syllable. The SSVEP responses in the congruent condition showed increased power compared to the responses in the incongruent condition, providing new evidence that syllables are important sublexical units in visual word recognition and reading aloud. With respect to the neural correlates of the effect, syllables elicited an early activation of a right hemisphere network. This network is typically associated with the programming of complex motor sequences, cognitive control and timing. Subsequently, responses were obtained in left hemisphere areas related to phonological processing.

Steady state visual evoked potentials in reading aloud: Effects of lexicality, frequency and orthographic familiarity

The present study explored the possibility to use Steady-State Visual Evoked Potentials (SSVEPs) as a tool to investigate the core mechanisms in visual word recognition. In particular, we investigated three benchmark effects of reading aloud: lexicality (words vs. pseudowords), frequency (high-frequency vs. low-frequency words), and orthographic familiarity ('familiar' versus 'unfamiliar' pseudowords). We found that words and pseudowords elicited robust SSVEPs. Words showed larger SSVEPs than pseudowords and high-frequency words showed larger SSVEPs than low-frequency words. SSVEPs were not sensitive to orthographic familiarity. We further localized the neural generators of the SSVEP effects. The lexicality effect was located in areas associated with early level of visual processing, i.e. in the right occipital lobe and in the right precuneus. Pseudowords produced more activation than words in left sensorimotor areas, rolandic operculum, insula, supramarginal gyrus and in the right temporal gyrus. These areas are devoted to speech processing and/or spelling-to-sound conversion. The frequency effect involved the left temporal pole and orbitofrontal cortex, areas previously implicated in semantic processing and stimulus-response associations respectively, and the right postcentral and parietal inferior gyri, possibly indicating the involvement of the right attentional network.

Stimulus-Driven Brain Rhythms within the Alpha Band: The Attentional-Modulation Conundrum

Two largely independent research lines use rhythmic sensory stimulation to study visual processing. Despite the use of strikingly similar experimental paradigms, they differ crucially in their notion of the stimulus-driven periodic brain responses: one regards them mostly as synchronized (entrained) intrinsic brain rhythms; the other assumes they are predominantly evoked responses [classically termed steady-state responses (SSRs)] that add to the ongoing brain activity. This conceptual difference can produce contradictory predictions about, and interpretations of, experimental outcomes. The effect of spatial attention on brain rhythms in the alpha band (8-13 Hz) is one such instance: alpha-range SSRs have typically been found to increase in power when participants focus their spatial attention on laterally presented stimuli, in line with a gain control of the visual evoked response. In nearly identical experiments, retinotopic decreases in entrained alpha-band power have been reported, in line with the inhibitory function of intrinsic alpha. Here we reconcile these contradictory findings by showing that they result from a small but far-reaching difference between two common approaches to EEG spectral decomposition. In a new analysis of previously published human EEG data, recorded during bilateral rhythmic visual stimulation, we find the typical SSR gain effect when emphasizing stimulus-locked neural activity and the typical retinotopic alpha suppression when focusing on ongoing rhythms. These opposite but parallel effects suggest that spatial attention may bias the neural processing of dynamic visual stimulation via two complementary neural mechanisms.SIGNIFICANCE STATEMENT Attending to a visual stimulus strengthens its representation in visual cortex and leads to a retinotopic suppression of spontaneous alpha rhythms. To further investigate this process, researchers often attempt to phase lock, or entrain, alpha through rhythmic visual stimulation under the assumption that this entrained alpha retains the characteristics of spontaneous alpha. Instead, we show that the part of the brain response that is phase locked to the visual stimulation increased with attention (as do steady-state evoked potentials), while the typical suppression was only present in non-stimulus-locked alpha activity. The opposite signs of these effects suggest that attentional modulation of dynamic visual stimulation relies on two parallel cortical mechanisms-retinotopic alpha suppression and increased temporal tracking.

Top-Down Attention Is Limited Within but Not Between Feature Dimensions

In natural vision, processing of spatial and nonspatial features occurs simultaneously; however, the two types of attention in charge of facilitating this processing have distinct mechanisms. Here, we tested the independence of spatial and feature-based attention at different stages of visual processing by examining color-based attentional selection while spatial attention was focused or divided. Human observers attended to one or two of four fields of randomly moving dots presented in both left and right visual hemifields. In the focused attention condition, the target stimulus was defined both by color and location, whereas in the divided attention condition stimuli of the target color had to be attended in both hemifields. Sustained attentional selection was measured by means of steady-state visual evoked potentials elicited by each of the frequency-tagged flickering dot fields. Additionally, target and distractor selection was assessed with ERPs to these stimuli. We found that spatial and color-based attention independently modulated the amplitude of steady-state visual evoked potentials, confirming independent top-down influences on early visual areas. In contrast, P3 amplitudes elicited only by targets and distractors of the attended color were subject to space-based enhancement, suggesting increasing integration of spatial and feature-based selection over the course of perceptual processing.

A Brain-Computer Interface-Based Action Observation Game That Enhances Mu Suppression

Action observation training based on the theory of activation of the mirror-neuron system has been used for the rehabilitation of patients with stroke. In this paper, we sought to assess whether a brain-computer interface (BCI)-based action observation rehabilitation game, using a flickering action video, could preferentially activate the mirror-neuron system. Feedback of stimulus observation, evoked by the flickering action video, was provided using steady state visually evoked potential and event-related desynchronization. Fifteen healthy subjects have experienced the game with BCI interaction (game and interaction), without BCI interaction (game without interaction), observed non-flickering stimuli, and flickering stimuli without the game background (stimuli only) in a counter-balanced order. The game and interface condition was resulted in significantly stronger activation of the mirror-neuron system than did the other three conditions. In addition, the amount of mirror-neuron system activation is gradually decreased in the game without interface, non-flickering stimuli, and stimuli only conditions in a time-dependent manner; however, in the game and interface condition, the amount of mirror-neuron system activation was maintained until the end of the training. Taken together, these data suggest that the proposed game paradigm, which integrates the action observation paradigm with BCI technology, could provide interactive responses for whether watching video clips can engage patients and enhance rehabilitation.

Rapid adaptive adjustments of selective attention following errors revealed by the time course of steady-state visual evoked potentials

Directing attention to task-relevant stimuli is crucial for successful task performance, but too much attentional selectivity implies that new and unexpected information in the environment remains undetected. A possible mechanism for optimizing this fundamental trade-off could be an error monitoring system that immediately triggers attentional adjustments following the detection of behavioral errors. However, the existence of rapid adaptive post-error adjustments has been controversially debated. While preconscious error processing reflected by an error-related negativity (Ne/ERN) in the event-related potential has been shown to occur within milliseconds after errors, more recent studies concluded that error detection even impairs attentional selectivity and that adaptive adjustments are implemented, if at all, only after errors are consciously detected. Here, we employ steady-state visual evoked potentials elicited by continuously presented stimuli to precisely track the emergence of error-induced attentional adjustments. Our results indicate that errors lead to an immediate reallocation of attention towards task-relevant stimuli, which occurs simultaneously with the Ne/ERN. Single-trial variation of this adjustment was correlated with the Ne/ERN amplitude and predicted adaptive behavioral adjustments on the post-error trial. This suggests that early error monitoring in the medial frontal cortex is directly involved in eliciting adaptive attentional adjustments.

•

SSVEPs were used to track the time course of attentional post-error adjustments.

•

Errors lead to an immediate allocation of attention to relevant stimuli.

•

Adjustments occur simultaneously with Ne/ERN and correlate with its amplitude.

•

Adjustments predict adaptive behavioral adjustments on post-error trial.

Audio-visual synchrony and spatial attention enhance processing of dynamic visual stimulation independently and in parallel: A frequency-tagging study

The neural processing of a visual stimulus can be facilitated by attending to its position or by a co-occurring auditory tone. Using frequency-tagging, we investigated whether facilitation by spatial attention and audio-visual synchrony rely on similar neural processes. Participants attended to one of two flickering Gabor patches (14.17 and 17 Hz) located in opposite lower visual fields. Gabor patches further "pulsed" (i.e. showed smooth spatial frequency variations) at distinct rates (3.14 and 3.63 Hz). Frequency-modulating an auditory stimulus at the pulse-rate of one of the visual stimuli established audio-visual synchrony. Flicker and pulsed stimulation elicited stimulus-locked rhythmic electrophysiological brain responses that allowed tracking the neural processing of simultaneously presented Gabor patches. These steady-state responses (SSRs) were quantified in the spectral domain to examine visual stimulus processing under conditions of synchronous vs. asynchronous tone presentation and when respective stimulus positions were attended vs. unattended. Strikingly, unique patterns of effects on pulse- and flicker driven SSRs indicated that spatial attention and audiovisual synchrony facilitated early visual processing in parallel and via different cortical processes. We found attention effects to resemble the classical top-down gain effect facilitating both, flicker and pulse-driven SSRs. Audio-visual synchrony, in turn, only amplified synchrony-producing stimulus aspects (i.e. pulse-driven SSRs) possibly highlighting the role of temporally co-occurring sights and sounds in bottom-up multisensory integration.

Exploring the temporal dynamics of sustained and transient spatial attention using steady-state visual evoked potentials

While the behavioral dynamics as well as the functional network of sustained and transient attention have extensively been studied, their underlying neural mechanisms have most often been investigated in separate experiments. In the present study, participants were instructed to perform an audio-visual spatial attention task. They were asked to attend to either the left or the right hemifield and to respond to deviant transient either auditory or visual stimuli. Steady-state visual evoked potentials (SSVEPs) elicited by two task irrelevant pattern reversing checkerboards flickering at 10 and 15 Hz in the left and the right hemifields, respectively, were used to continuously monitor the locus of spatial attention. The amplitude and phase of the SSVEPs were extracted for single trials and were separately analyzed. Sustained attention to one hemifield (spatial attention) as well as to the auditory modality (intermodal attention) increased the inter-trial phase locking of the SSVEP responses, whereas briefly presented visual and auditory stimuli decreased the single-trial SSVEP amplitude between 200 and 500 ms post-stimulus. This transient change of the single-trial amplitude was restricted to the SSVEPs elicited by the reversing checkerboard in the spatially attended hemifield and thus might reflect a transient re-orienting of attention towards the brief stimuli. Thus, the present results demonstrate independent, but interacting neural mechanisms of sustained and transient attentional orienting.

Visual steady state in relation to age and cognitive function

Neocortical gamma activity is crucial for sensory perception and cognition. This study examines the value of using non-task stimulation-induced EEG oscillations to predict cognitive status in a birth cohort of healthy Danish males (Metropolit) with varying cognitive ability. In particular, we examine the steady-state VEP power response (SSVEP-PR) in the alpha (8Hz) and gamma (36Hz) bands in 54 males (avg. age: 62.0 years) and compare these with 10 young healthy participants (avg. age 27.6 years). Furthermore, we correlate the individual alpha-to-gamma difference in relative visual-area power (ΔR_V) with cognitive scores for the older adults. We find that ΔR_V decrease with age by just over one standard deviation when comparing young with old participants (p<0.01). Furthermore, intelligence is significantly negatively correlated with ΔR_V in the older adult cohort, even when processing speed, global cognition, executive function, memory, and education (p<0.05). In our preferred specification, an increase in ΔR_V of one standard deviation is associated with a reduction in intelligence of 48% of a standard deviation (p<0.01). Finally, we conclude that the difference in cerebral rhythmic activity between the alpha and gamma bands is associated with age and cognitive status, and that ΔR_V therefore provide a non-subjective clinical tool with which to examine cognitive status in old age.

Rhythmic entrainment source separation: Optimizing analyses of neural responses to rhythmic sensory stimulation

Steady-state evoked potentials (SSEPs) are rhythmic brain responses to rhythmic sensory stimulation, and are often used to study perceptual and attentional processes. We present a data analysis method for maximizing the signal-to-noise ratio of the narrow-band steady-state response in the frequency and time-frequency domains. The method, termed rhythmic entrainment source separation (RESS), is based on denoising source separation approaches that take advantage of the simultaneous but differential projection of neural activity to multiple electrodes or sensors. Our approach is a combination and extension of existing multivariate source separation methods. We demonstrate that RESS performs well on both simulated and empirical data, and outperforms conventional SSEP analysis methods based on selecting electrodes with the strongest SSEP response, as well as several other linear spatial filters. We also discuss the potential confound of overfitting, whereby the filter captures noise in absence of a signal. Matlab scripts are available to replicate and extend our simulations and methods. We conclude with some practical advice for optimizing SSEP data analyses and interpreting the results.

Visual cortex responses reflect temporal structure of continuous quasi-rhythmic sensory stimulation

Neural processing of dynamic continuous visual input, and cognitive influences thereon, are frequently studied in paradigms employing strictly rhythmic stimulation. However, the temporal structure of natural stimuli is hardly ever fully rhythmic but possesses certain spectral bandwidths (e.g. lip movements in speech, gestures). Examining periodic brain responses elicited by strictly rhythmic stimulation might thus represent ideal, yet isolated cases. Here, we tested how the visual system reflects quasi-rhythmic stimulation with frequencies continuously varying within ranges of classical theta (4–7 Hz), alpha (8–13 Hz) and beta bands (14–20 Hz) using EEG. Our findings substantiate a systematic and sustained neural phase-locking to stimulation in all three frequency ranges. Further, we found that allocation of spatial attention enhances EEG-stimulus locking to theta- and alpha-band stimulation. Our results bridge recent findings regarding phase locking (“entrainment”) to quasi-rhythmic visual input and “frequency-tagging” experiments employing strictly rhythmic stimulation. We propose that sustained EEG-stimulus locking can be considered as a continuous neural signature of processing dynamic sensory input in early visual cortices. Accordingly, EEG-stimulus locking serves to trace the temporal evolution of rhythmic as well as quasi-rhythmic visual input and is subject to attentional bias.

•

Dynamic visual stimuli constitute large parts of our perceptual experience.

•

Strictly rhythmic dynamics condense in EEG-recorded mass-neural activity.

•

We tested how stimuli with fluctuating rhythms reflect in the EEG.

•

We found that the EEG allows tracing two quasi-rhythmic stimuli in parallel.

•

Dynamics of attended stimuli may be tracked with greater temporal precision.

Visual attention spreads broadly but selects information locally

Visual attention spreads over a range around the focus as the spotlight metaphor describes. Spatial spread of attentional enhancement and local selection/inhibition are crucial factors determining the profile of the spatial attention. Enhancement and ignorance/suppression are opposite effects of attention, and appeared to be mutually exclusive. Yet, no unified view of the factors has been provided despite their necessity for understanding the functions of spatial attention. This report provides electroencephalographic and behavioral evidence for the attentional spread at an early stage and selection/inhibition at a later stage of visual processing. Steady state visual evoked potential showed broad spatial tuning whereas the P3 component of the event related potential showed local selection or inhibition of the adjacent areas. Based on these results, we propose a two-stage model of spatial attention with broad spread at an early stage and local selection at a later stage.

Flicker-Driven Responses in Visual Cortex Change during Matched-Frequency Transcranial Alternating Current Stimulation

We tested a novel combination of two neuro-stimulation techniques, transcranial alternating current stimulation (tACS) and frequency tagging, that promises powerful paradigms to study the causal role of rhythmic brain activity in perception and cognition. Participants viewed a stimulus flickering at 7 or 11 Hz that elicited periodic brain activity, termed steady-state responses (SSRs), at the same temporal frequency and its higher order harmonics. Further, they received simultaneous tACS at 7 or 11 Hz that either matched or differed from the flicker frequency. Sham tACS served as a control condition. Recent advances in reconstructing cortical sources of oscillatory activity allowed us to measure SSRs during concurrent tACS, which is known to impose strong artifacts in magnetoencephalographic (MEG) recordings. For the first time, we were thus able to demonstrate immediate effects of tACS on SSR-indexed early visual processing. Our data suggest that tACS effects are largely frequency-specific and reveal a characteristic pattern of differential influences on the harmonic constituents of SSRs.

Early Visual Cortex Dynamics during Top–Down Modulated Shifts of Feature-Selective Attention

Shifting attention from one color to another color or from color to another feature dimension such as shape or orientation is imperative when searching for a certain object in a cluttered scene. Most attention models that emphasize feature-based selection implicitly assume that all shifts in feature-selective attention underlie identical temporal dynamics. Here, we recorded time courses of behavioral data and steady-state visual evoked potentials (SSVEPs), an objective electrophysiological measure of neural dynamics in early visual cortex to investigate temporal dynamics when participants shifted attention from color or orientation toward color or orientation, respectively. SSVEPs were elicited by four random dot kinematograms that flickered at different frequencies. Each random dot kinematogram was composed of dashes that uniquely combined two features from the dimensions color (red or blue) and orientation (slash or backslash). Participants were cued to attend to one feature (such as color or orientation) and respond to coherent motion targets of the to-be-attended feature. We found that shifts toward color occurred earlier after the shifting cue compared with shifts toward orientation, regardless of the original feature (i.e., color or orientation). This was paralleled in SSVEP amplitude modulations as well as in the time course of behavioral data. Overall, our results suggest different neural dynamics during shifts of attention from color and orientation and the respective shifting destinations, namely, either toward color or toward orientation.

Independent Vector Analysis for SSVEP Signal Enhancement, Detection, and Topographical Mapping

Steady state visual evoked potentials (SSVEPs) have been identified as an effective solution for brain computer interface (BCI) systems as well as for neurocognitive investigations. SSVEPs can be observed in the scalp-based recordings of electroencephalogram signals, and are one component buried amongst the normal brain signals and complex noise. We present a novel method for enhancing and improving detection of SSVEPs by leveraging the rich joint blind source separation framework using independent vector analysis (IVA). IVA exploits the diversity within each dataset while preserving dependence across all the datasets. This approach is shown to enhance the detection of SSVEP signals across a range of frequencies and subjects for BCI systems. Furthermore, we show that IVA enables improved topographic mapping of the SSVEP propagation providing a promising new tool for neuroscience and neurocognitive research.

Driving steady-state visual evoked potentials at arbitrary frequencies using temporal interpolation of stimulus presentation

Background

Steady-state visual evoked potentials have been utilized widely in basic and applied research in recent years. These oscillatory responses of the visual cortex are elicited by flickering stimuli. They have the same fundamental frequency as the driving stimulus and are highly sensitive to manipulations of attention and stimulus properties. While standard computer monitors offer great flexibility in the choice of visual stimuli for driving SSVEPs, the frequencies that can be elicited are limited to integer divisors of the monitor’s refresh rate.

Results

To avoid this technical constraint, we devised an interpolation technique for stimulus presentation, with which SSVEPs can be elicited at arbitrary frequencies. We tested this technique with monitor refresh rates of 85 and 120 Hz. At a refresh rate of 85 Hz, interpolated presentation produced artifacts in the recorded spectrum in the form of additional peaks not located at the stimulated frequency or its harmonics. However, at a refresh rate of 120 Hz, these artifacts did not occur and the spectrum elicited by an interpolated flicker became indistinguishable from the spectrum obtained by non-interpolated presentation of the same frequency.

Conclusions

Our interpolation technique eliminates frequency limitations of the common non-interpolated presentation technique and has many possible applications for future research.

The steady-state visual evoked potential in vision research: A review

Periodic visual stimulation and analysis of the resulting steady-state visual evoked potentials were first introduced over 80 years ago as a means to study visual sensation and perception. From the first single-channel recording of responses to modulated light to the present use of sophisticated digital displays composed of complex visual stimuli and high-density recording arrays, steady-state methods have been applied in a broad range of scientific and applied settings.The purpose of this article is to describe the fundamental stimulation paradigms for steady-state visual evoked potentials and to illustrate these principles through research findings across a range of applications in vision science.

An objective index of individual face discrimination in the right occipito-temporal cortex by means of fast periodic oddball stimulation

We introduce an approach based on fast periodic oddball stimulation that provides objective, high signal-to-noise ratio (SNR), and behavior-free measures of the human brain's discriminative response to complex visual patterns. High-density electroencephalogram (EEG) was recorded for human observers presented with 60s sequences containing a base-face (A) sinusoidally contrast-modulated at a frequency of 5.88 Hz (F), with face size varying every cycle. Different oddball-faces (B, C, D...) were introduced at fixed intervals (every 4 stimuli = F/5 = 1.18 Hz: AAAABAAAACAAAAD...). Individual face discrimination was indexed by responses at this 1.18 Hz oddball frequency. Following only 4 min of recording, significant responses emerged at exactly 1.18 Hz and its harmonics (e.g., 2F/5 = 2.35 Hz, 3F/5 = 3.53 Hz...), with up to a 300% signal increase over the right occipito-temporal cortex. This response was present in all participants, for both color and greyscale faces, providing a robust implicit neural measure of individual face discrimination. Face inversion or contrast-reversal did not affect the basic 5.88 Hz periodic response over medial occipital channels. However, these manipulations substantially reduced the 1.18 Hz oddball discrimination response over the right occipito-temporal region, indicating that this response reflects high-level processes that are partly face-specific. These observations indicate that fast periodic oddball stimulation can be used to rapidly and objectively characterize the discrimination of visual patterns and may become invaluable in characterizing this process in typical adult, developmental, and neuropsychological patient populations.

Concurrent visual and tactile steady-state evoked potentials index allocation of inter-modal attention: a frequency-tagging study

We investigated effects of inter-modal attention on concurrent visual and tactile stimulus processing by means of stimulus-driven oscillatory brain responses, so-called steady-state evoked potentials (SSEPs). To this end, we frequency-tagged a visual (7.5Hz) and a tactile stimulus (20Hz) and participants were cued, on a trial-by-trial basis, to attend to either vision or touch to perform a detection task in the cued modality. SSEPs driven by the stimulation comprised stimulus frequency-following (i.e. fundamental frequency) as well as frequency-doubling (i.e. second harmonic) responses. We observed that inter-modal attention to vision increased amplitude and phase synchrony of the fundamental frequency component of the visual SSEP while the second harmonic component showed an increase in phase synchrony, only. In contrast, inter-modal attention to touch increased SSEP amplitude of the second harmonic but not of the fundamental frequency, while leaving phase synchrony unaffected in both responses. Our results show that inter-modal attention generally influences concurrent stimulus processing in vision and touch, thus, extending earlier audio-visual findings to a visuo-tactile stimulus situation. The pattern of results, however, suggests differences in the neural implementation of inter-modal attentional influences on visual vs. tactile stimulus processing.

Temporal dynamics of visual attention measured with event-related potentials

How attentional modulation on brain activities determines behavioral performance has been one of the most important issues in cognitive neuroscience. This issue has been addressed by comparing the temporal relationship between attentional modulations on neural activities and behavior. Our previous study measured the time course of attention with amplitude and phase coherence of steady-state visual evoked potential (SSVEP) and found that the modulation latency of phase coherence rather than that of amplitude was consistent with the latency of behavioral performance. In this study, as a complementary report, we compared the time course of visual attention shift measured by event-related potentials (ERPs) with that by target detection task. We developed a novel technique to compare ERPs with behavioral results and analyzed the EEG data in our previous study. Two sets of flickering stimulus at different frequencies were presented in the left and right visual hemifields, and a target or distracter pattern was presented randomly at various moments after an attention-cue presentation. The observers were asked to detect targets on the attended stimulus after the cue. We found that two ERP components, P300 and N2pc, were elicited by the target presented at the attended location. Time-course analyses revealed that attentional modulation of the P300 and N2pc amplitudes increased gradually until reaching a maximum and lasted at least 1.5 s after the cue onset, which is similar to the temporal dynamics of behavioral performance. However, attentional modulation of these ERP components started later than that of behavioral performance. Rather, the time course of attentional modulation of behavioral performance was more closely associated with that of the concurrently recorded SSVEPs analyzed. These results suggest that neural activities reflected not by either the P300 or N2pc, but by the SSVEPs, are the source of attentional modulation of behavioral performance.