Enhanced brain responses to color during smooth-pursuit eye movements

The execution of saccadic eye movements suppresses visual processing of both color and luminance in the early visual cortex of humans

Our eyes execute rapid, directional movements known as saccades, occurring several times per second, to focus on objects of interest in our environment. During these movements, visual sensitivity is temporarily reduced. Despite numerous studies on this topic, the underlying mechanism remains elusive, including a lingering debate on whether saccadic suppression affects the parvocellular visual pathway. To address this issue, we conducted a study employing steady-state visual evoked potentials (SSVEPs) elicited by chromatic and luminance stimuli while observers performed saccadic eye movements. We also employed an innovative analysis pipeline to enhance the signal-to-noise ratio, yielding superior results compared to the previous method. Our findings revealed a clear suppression effect on SSVEP signals during saccades compared to fixation periods. Notably, this suppression effect was comparable for both chromatic and luminance stimuli. We went further to measure the suppression effect across various contrast levels, which enabled us to model SSVEP responses with contrast response functions. The results suggest that saccades primarily reduce response gain without significantly affecting contrast gain and that this reduction applies uniformly to both chromatic and luminance pathways. In summary, our study provides robust evidence that saccades similarly suppress visual processing in both the parvocellular and magnocellular pathways within the human early visual cortex, as indicated by SSVEP responses. The observation that saccadic eye movements impact response gain rather than contrast gain implies that they influence visual processing through a multiplicative mechanism.NEW & NOTEWORTHY The present study demonstrates that saccadic eye movements reduce the processing of both luminance and chromatic stimuli in the early visual cortex of humans. By modeling the contrast response function, the study further shows that saccades affect visual processing by reducing the response gain rather than altering the contrast gain, suggesting that a multiplicative mechanism of visual attenuation affects both parvocellular and magnocellular pathways.

Laplacian reference is optimal for steady-state visual-evoked potentials

Steady-state visual-evoked potentials (SSVEPs) are widely used in human neuroscience studies and applications such as brain-computer interfaces (BCIs). Surprisingly, no previous study has systematically evaluated different reference methods for SSVEP analysis, despite that signal reference is crucial for the proper assessment of neural activities. In the present study, using four datasets from our previous SSVEP studies (Chen J, Valsecchi M, Gegenfurtner KR. J Neurophysiol 118: 749-754, 2017; Chen J, Valsecchi M, Gegenfurtner KR. Neuropsychologia 102: 206-216, 2017; Chen J, McManus M, Valsecchi M, Harris LR, Gegenfurtner KR. J Vis 19: 8, 2019) and three public datasets from other studies (Baker DH, Vilidaite G, Wade AR. PLoS Comput Biol 17: e1009507, 2021; Lygo FA, Richard B, Wade AR, Morland AB, Baker DH. NeuroImage 230: 117780, 2021; Vilidaite G, Norcia AM, West RJH, Elliott CJH, Pei F, Wade AR, Baker DH. Proc R Soc B 285: 20182255, 2018), we compared four reference methods: monopolar reference, common average reference, averaged-mastoids reference, and Laplacian reference. The quality of the resulting SSVEP signals was compared in terms of both signal-to-noise ratios (SNRs) and reliability. The results showed that Laplacian reference, which uses signals at the maximally activated electrode after subtracting the average of the nearby electrodes to reduce common noise, gave rise to the highest SNRs. Furthermore, the Laplacian reference resulted in SSVEP signals that were highly reliable across recording sessions or trials. These results suggest that Laplacian reference is optimal for SSVEP studies and applications. Laplacian reference is especially advantageous for SSVEP experiments where short preparation time is preferred as it requires only data from the maximally activated electrode and a few surrounding electrodes.NEW & NOTEWORTHY The present study provides a comprehensive evaluation of the use of different reference methods for steady-state visual-evoked potentials (SSVEPs) and has found that Laplacian reference increases signal-to-noise ratios (SNRs) and enhances reliabilities of SSVEP signals. Thus, the results suggest that Laplacian reference is optimal for SSVEP analysis.

A comparison of reading, in people with simulated and actual central vision loss, with static text, horizontally scrolling text, and rapid serial visual presentation

Reading with central vision loss (CVL), as caused by macular disease, may be enhanced by presenting text using dynamic formats such as horizontally scrolling text or rapid serial visual presentation (RSVP). The rationale for these dynamic text formats is that they can be read while holding gaze away from the text, potentially supporting reading while using the eccentric viewing strategy. This study was designed to evaluate the practice of reading with CVL, with passages of text presented as static sentences, with horizontal scrolling sentences, or as single-word RSVP. In separate studies, normally sighted participants with a simulated (artificial) central scotoma, controlled by an eye-tracker, or participants with CVL resulting from macular degeneration read passages of text using the eccentric viewing technique. Comprehension was better overall with scrolling text when reading with a simulated CVL, whereas RSVP produced lower overall comprehension and high error rates. Analysis of eye movement behavior showed that participants consistently adopted a strategy of making multiple horizontal saccades on the text itself. Adherence to using eccentric viewing was better with RSVP, but this did not translate into better reading performance. Participants with macular degeneration and an actual CVL also showed the highest comprehension and lowest error rates with scrolling text and the lowest comprehension and highest errors with RSVP. We conclude that scrolling text can support effective reading in people with CVL and has potential as a reading aid.

Machine-vision fused brain machine interface based on dynamic augmented reality visual stimulation

Objective.Brain-machine interfaces (BMIs) interpret human intent into machine reactions, and the visual stimulation (VS) paradigm is one of the most widely used of these approaches. Although VS-based BMIs have a relatively high information transfer rate (ITR), it is still difficult for BMIs to control machines in dynamic environments (for example, grabbing a dynamic object or targeting a walking person).Approach.In this study, we utilized a BMI based on augmented reality (AR) VS (AR-VS). The proposed VS was dynamically generated based on machine vision, and human intent was interpreted by a dynamic decision time interval approach. A robot based on the coordination of a task and self-motion system was controlled by the proposed paradigm in a fast and flexible state.Methods.Objects in scenes were first recognized by machine vision and tracked by optical flow. AR-VS was generated based on the objects' parameters. The number and distribution of VS was confirmed by the recognized objects. Electroencephalogram (EEG) features corresponding to VS and human intent were collected by a dry-electrode EEG cap and determined by the filter bank canonical correlation analysis method. Key parameters in the AR-VS, including the effect of VS size, frequency, dynamic object moving speed, ITR and the performance of the BMI-controlled robot, were analyzed.Conclusion and significance.The ITR of the proposed AR-VS paradigm for nine healthy subjects was 36.3 ± 20.1 bits min^-1. In the online robot control experiment, brain-controlled hybrid tasks including self-moving and grabbing objects were 64% faster than when using the traditional steady-state visual evoked potential paradigm. The proposed paradigm based on AR-VS could be optimized and adopted in other kinds of VS-based BMIs, such as P300, omitted stimulus potential, and miniature event-related potential paradigms, for better results in dynamic environments.

Electrophysiological evidence for higher-level chromatic mechanisms in humans

Color vision in humans starts with three types of cones (short [S], medium [M], and long [L] wavelengths) in the retina and three retinal and subcortical cardinal mechanisms, which linearly combine cone signals into the luminance channel (L + M), the red-green channel (L - M), and the yellow-blue channel (S-(L + M)). Chromatic mechanisms at the cortical level, however, are less well characterized. The present study investigated such higher-order chromatic mechanisms by recording electroencephalograms (EEGs) on human observers in a noise masking paradigm. Observers viewed colored stimuli that consisted of a target embedded in noise. Color directions of the target and noise varied independently and systematically in an isoluminant plane of color space. The target was flickering on-off at 3 Hz, eliciting steady-state visual evoked potential (SSVEP) responses. As a result, the masking strength could be estimated from the SSVEP amplitude in the presence of 6 Hz noise. Masking was strongest (i.e. target eliciting smallest SSVEPs) when the target and noise were along the same color direction, and was weakest (i.e. target eliciting highest SSVEPs) when the target and noise were along orthogonal directions. This pattern of results was observed both when the target color varied along the cardinal and intermediate directions, which is evidence for higher-order chromatic mechanisms tuned to intermediate axes. The SSVEP result can be well predicted by a model with multiple broadly tuned chromatic mechanisms. In contrast, a model with only cardinal mechanisms failed to account for the data. These results provide strong electrophysiological evidence for multiple chromatic mechanisms in the early visual cortex of humans.

Holistic Integration in the Processing of Chinese Characters as Revealed by Electroencephalography Frequency Tagging

It is debated whether perceptual expertise of nonface objects, such as visual words, is indicated by holistic processing, which is regarded as a marker of perceptual expertise of faces. We address this question by frequency-tagged electroencephalography. Different parts of real or pseudo Chinese characters are presented at distinctive frequencies (6 or 7.2 Hz), which induce frequency-tagged steady-state visual-evoked potentials at occipital brain areas. The intermodulation response (e.g., 6 + 7.2 = 13.2 Hz) would emerge when holistic integration takes place. Our results suggest that the intermodulation response to the real characters is left lateralized, which is contralateral to previous findings with faces. Furthermore, at the left occipital area, the intermodulation response to real characters is more prominent than pseudo characters, suggesting that holistic integration is enhanced for real characters than for pseudo ones. Taken together, our findings suggest that holistic integration is potentially a general expertise marker for both faces and non-face objects.

In pursuit of visual attention: SSVEP frequency-tagging moving targets

Previous research has shown that visual attention does not always exactly follow gaze direction, leading to the concepts of overt and covert attention. However, it is not yet clear how such covert shifts of visual attention to peripheral regions impact the processing of the targets we directly foveate as they move in our visual field. The current study utilised the co-registration of eye-position and EEG recordings while participants tracked moving targets that were embedded with a 30 Hz frequency tag in a Steady State Visually Evoked Potentials (SSVEP) paradigm. When the task required attention to be divided between the moving target (overt attention) and a peripheral region where a second target might appear (covert attention), the SSVEPs elicited by the tracked target at the 30 Hz frequency band were significantly, but transiently, lower than when participants did not have to covertly monitor for a second target. Our findings suggest that neural responses of overt attention are only briefly reduced when attention is divided between covert and overt areas. This neural evidence is in line with theoretical accounts describing attention as a pool of finite resources, such as the perceptual load theory. Altogether, these results have practical implications for many real-world situations where covert shifts of attention may discretely reduce visual processing of objects even when they are directly being tracked with the eyes.

Motion direction representation in multivariate electroencephalography activity for smooth pursuit eye movements

Visually-guided smooth pursuit eye movements are composed of initial open-loop and later steady-state periods. Feedforward sensory information dominates the motor behavior during the open-loop pursuit, and a more complex feedback loop regulates the steady-state pursuit. To understand the neural representations of motion direction during open-loop and steady-state smooth pursuits, we recorded electroencephalography (EEG) responses from human observers while they tracked random-dot kinematograms as pursuit targets. We estimated population direction tuning curves from multivariate EEG activity using an inverted encoding model. We found significant direction tuning curves as early as about 60 ms from stimulus onset. Direction tuning responses were generalized to later times during the open-loop smooth pursuit, but they became more dynamic during the later steady-state pursuit. The encoding quality of retinal motion direction information estimated from the early direction tuning curves was predictive of trial-by-trial variation in initial pursuit directions. These results suggest that the movement directions of open-loop smooth pursuit are guided by the representation of the retinal motion present in the multivariate EEG activity.

Saccadic suppression measured by steady-state visual evoked potentials

Visual sensitivity is severely impaired during the execution of saccadic eye movements. This phenomenon has been extensively characterized in human psychophysics and nonhuman primate single-neuron studies, but a physiological characterization in humans is less established. Here, we used a method based on steady-state visually evoked potential (SSVEP), an oscillatory brain response to periodic visual stimulation, to examine how saccades affect visual sensitivity. Observers made horizontal saccades back and forth, while horizontal black-and-white gratings flickered at 5-30 Hz in the background. We analyzed EEG epochs with a length of 0.3 s either centered at saccade onset (saccade epochs) or centered at fixations half a second before the saccade (fixation epochs). Compared with fixation epochs, saccade epochs showed a broadband power increase, which most likely resulted from saccade-related EEG activity. The execution of saccades, however, led to an average reduction of 57% in the SSVEP amplitude at the stimulation frequency. This result provides additional evidence for an active saccadic suppression in the early visual cortex in humans. Compared with previous functional MRI and EEG studies, an advantage of this approach lies in its capability to trace the temporal dynamics of neural activity throughout the time course of a saccade. In contrast to previous electrophysiological studies in nonhuman primates, we did not find any evidence for postsaccadic enhancement, even though simulation results show that our method would have been able to detect it. We conclude that SSVEP is a useful technique to investigate the neural correlates of visual perception during saccadic eye movements in humans. NEW & NOTEWORTHY We make fast ballistic saccadic eye movements a few times every second. At the time of saccades, visual sensitivity is severely impaired. The present study uses steady-state visually evoked potentials to reveal a neural correlate of the fine temporal dynamics of these modulations at the time of saccades in humans. We observed a strong reduction (57%) of visually driven neural activity associated with saccades but did not find any evidence for postsaccadic enhancement.