Temporal impulse response functions for luminance and colour during saccades

Theoretical and Technical Issues Concerning the Measurement of Alpha Frequency and the Application of Signal Detection Theory: Comment on Buergers and Noppeney (2022)

Classical and recent evidence has suggested that alpha oscillations play a critical role in temporally discriminating or binding successively presented items. Challenging this view, Buergers and Noppeney [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022] found that by combining EEG, psychophysics, and signal detection theory, neither prestimulus nor resting-state alpha frequency influences perceptual sensitivity and bias in the temporal binding task. We propose the following four points that should be considered when interpreting the role of alpha oscillations, and especially their frequency, on perceptual temporal binding: (1) Multiple alpha components can be contaminated in conventional EEG analysis; (2) the effect of alpha frequency on perception will interact with alpha power; (3) prestimulus and resting-state alpha frequency can be different from poststimulus alpha frequency, which is the frequency during temporal binding and should be more directly related to temporal binding; and (4) when applying signal detection theory under the assumption of equal variance, the assumption is often incomplete and can be problematic (e.g., the magnitude relationships between individuals in parametric sensitivity may change when converted into nonparametric sensitivity). Future directions, including solutions to each of the issues, are discussed.

Vision: Neuronal mechanisms enabling stable perception

Eye movements cause rapid motion of the retinal image, potentially confusable with external motion. A recent study shows that neurons in mouse primary visual cortex distinguish self-generated from external motion by combining sensory input with saccade-related signals from the thalamic pulvinar nucleus.

Abrupt darkening under high dynamic range (HDR) luminance invokes facilitation for high-contrast targets and grouping by luminance similarity

When scanning across a scene, luminance can vary by up to 100,000-to-1 (high dynamic range, HDR), requiring multiple normalizing mechanisms spanning from the retina to the cortex to support visual acuity and recognition. Vision models based on standard dynamic range (SDR) luminance contrast ratios below 100-to-1 have limited ability to generalize to real-world scenes with HDR luminance. To characterize how orientation and luminance are linked in brain mechanisms for luminance normalization, we measured orientation discrimination of Gabor targets under HDR luminance dynamics. We report a novel phenomenon, that abrupt 10- to 100-fold darkening engages contextual facilitation, distorting the apparent orientation of a high-contrast central target. Surprisingly, facilitation was influenced by grouping by luminance similarity, as well as by the degree of luminance variability in the surround. These results challenge vision models based solely on activity normalization and raise new questions that will lead to models that perform better in real-world scenes.

The role of action intentionality and effector in the subjective expansion of temporal duration after saccadic eye movements

Visual perception is based on periods of stable fixation separated by saccadic eye movements. Although naive perception seems stable (in space) and continuous (in time), laboratory studies have demonstrated that events presented around the time of saccades are misperceived spatially and temporally. Saccadic chronostasis, the "stopped clock illusion", represents one such temporal distortion in which the movement of the clock hand after the saccade is perceived as lasting longer than usual. Multiple explanations for chronostasis have been proposed including action-backdating, temporal binding of the action towards the moment of its effect ("intentional binding") and post-saccadic temporal dilation. The current study aimed to resolve this debate by using different types of action (keypress vs saccade) and varying the intentionality of the action. We measured both perceived onset of the motor action and perceived onset of an auditory tone presented at different delays after the keypress/saccade. The results showed intentional binding for the keypress action, with perceived motor onset shifted forwards in time and the time of the tone shifted backwards. Saccades resulted in the opposite pattern, showing temporal expansion rather than compression, especially with cued saccades. The temporal illusion was modulated by intentionality of the movement. Our findings suggest that saccadic chronostasis is not solely dependent on a backward shift in perceived saccade onset, but instead reflects a temporal dilation. This percept of an effectively "longer" period at the beginning of a new fixation may reflect the pattern of suppressed, and then enhanced, visual processing around the time of saccades.

Action-induced changes in the perceived temporal features of visual events

Perceived duration can be subject to deviations around the time of a voluntary action. Whether the mechanisms underlying action-induced visual duration effects are effector-specific or require a more generalized action-linked multimodal calibration with the transient visual system, however, is a question yet to be answered. Here, we investigate this using dynamic visual stimuli presented as contingent upon the execution of an arbitrarily associated voluntary manual response. Our results demonstrate that the duration of intervals with arbitrarily associated keypress-visual event pair is perceived as shorter than the duration in a pure visual condition, where the same stimuli are rather passively observed without the execution of a concurrent action. Whereas the control experiments show that motor memory and attention cannot explain the action-induced changes in perceived temporal features, action-induced changes in perceived speed are dissociated from those in perceived duration, and that the duration compression disappears using isoluminant or static stimuli, which together provide evidence that these two effects can be modulated in the motion-processing units, although via separate neural mechanisms.

Characterizing the spatiotemporal envelope of the human visual system through the visibility of temporal aliasing artifacts

Previous studies have demonstrated that the onset of temporal aliasing artifacts occurs when the spatial displacement between samples reaches a critical distance, and that subsequently a linear relationship exists between stimulus speed and critical sampling rates. In this paper, we carry out further experimentation using a novel experimental setup, in which a strobe light is used to emulate impulsive temporal sampling, in order to investigate the spatiotemporal envelope of the human visual system and the effect of a stimulus. For non-periodic stimuli, experimental results show that critical sampling rates increase with motion speed and decrease with stimulus width. These interactions can be described using simple log-linear models, and characterized using the temporal aliasing visibility function, where maximum critical frame rates up to 1500 Hz are predicted. For periodic stimuli, we demonstrate that both perceptible temporal aliasing artifacts and stimulus aliasing can cause stroboscopic effects.

The eye that binds: Feature integration is not disrupted by saccadic eye movements

Feature integration theory proposes that visual features, such as shape and color, can only be combined into a unified object when spatial attention is directed to their location in retinotopic maps. Eye movements cause dramatic changes on our retinae, and are associated with obligatory shifts in spatial attention. In two experiments, we measured the prevalence of conjunction errors (that is, reporting an object as having an attribute that belonged to another object), for brief stimulus presentation before, during, and after a saccade. Planning and executing a saccade did not itself disrupt feature integration. Motion did disrupt feature integration, leading to an increase in conjunction errors. However, retinal motion of an equal extent but caused by saccadic eye movements is spared this disruption, and showed similar rates of conjunction errors as a condition with static stimuli presented to a static eye. The results suggest that extra-retinal signals are able to compensate for the motion caused by saccadic eye movements, thereby preserving the integrity of objects across saccades and preventing their features from mixing or mis-binding.

Vision During Saccadic Eye Movements

The perceptual consequences of eye movements are manifold: Each large saccade is accompanied by a drop of sensitivity to luminance-contrast, low-frequency stimuli, impacting both conscious vision and involuntary responses, including pupillary constrictions. They also produce transient distortions of space, time, and number, which cannot be attributed to the mere motion on the retinae. All these are signs that the visual system evokes active processes to predict and counteract the consequences of saccades. We propose that a key mechanism is the reorganization of spatiotemporal visual fields, which transiently increases the temporal and spatial uncertainty of visual representations just before and during saccades. On one hand, this accounts for the spatiotemporal distortions of visual perception; on the other hand, it implements a mechanism for fusing pre- and postsaccadic stimuli. This, together with the active suppression of motion signals, ensures the stability and continuity of our visual experience.

Age-related changes in ON and OFF responses to luminance increments and decrements

Impulse response functions for an incremental luminous pulse (ON flash) or a decremental luminous pulse (OFF flash) were derived for twelve young (19-24 years old) and ten old (65-84 years old) observers. Thresholds were measured for two pulses separated by stimulus-onset-asynchronies from 13.3 to 186.7 ms. The pulses had a spatial Gaussian shape and were presented as increments or decrements on a 15  cd/m² equal-energy white background, having the same chromaticity as the pulse. A spatial four-alternative forced-choice method was combined with a staircase procedure. Retinal illuminance was equated individually by heterochromatic flicker photometry and using a 2.3-mm exit pupil in a Maxwellian-view optical system to reduce the effects of age-related changes and individual variations in lens density and pupil size. Luminance ON- and OFF-impulse response functions calculated from the threshold data revealed significant age-related changes in the response amplitude of both first excitatory and first inhibitory phases. However, there were no significant changes in the time to the first peak or the second peak. These age-related changes in luminance varying ON- and OFF-impulse response functions (IRFs), reflecting putative properties of the magnocellular pathway, are discussed in relation to motion detection and the balance of ON and OFF pathways across the life span.

Selective modulation of visual sensitivity during fixation

During periods of steady fixation, we make small-amplitude ocular movements, termed microsaccades, at a rate of 1–2 every second. Early studies provided evidence that visual sensitivity is reduced during microsaccades—akin to the well-established suppression associated with larger saccades. However, the results of more recent work suggest that microsaccades may alter retinal input in a manner that enhances visual sensitivity to some stimuli. Here we parametrically varied the spatial frequency of a stimulus during a detection task and tracked contrast sensitivity as a function of time relative to microsaccades. Our data reveal two distinct modulations of sensitivity: suppression during the eye movement itself and facilitation after the eye has stopped moving. The magnitude of suppression and facilitation of visual sensitivity is related to the spatial content of the stimulus: suppression is greatest for low spatial frequencies, while sensitivity is enhanced most for stimuli of 1–2 cycles/°, spatial frequencies at which we are already most sensitive in the absence of eye movements. We present a model in which the tuning of suppression and facilitation is explained by delayed lateral inhibition between spatial frequency channels. Our data show that eye movements actively modulate visual sensitivity even during fixation: the detectability of images at different spatial scales can be increased or decreased depending on when the image occurs relative to a microsaccade.

NEW & NOTEWORTHY Given the frequency with which we make microsaccades during periods of fixation, it is vital that we understand how they affect visual processing. We demonstrate two selective modulations of contrast sensitivity that are time-locked to the occurrence of a microsaccade: suppression of low spatial frequencies during each eye movement and enhancement of higher spatial frequencies after the eye has stopped moving. These complementary changes may arise naturally because of sluggish gain control between spatial channels.

Developing a Nonstationary Computational Framework With Application to Modeling Dynamic Modulations in Neural Spiking Responses

OBJECTIVE

This paper aims to develop a computational model that incorporates the functional effects of modulatory covariates (such as context, task, or behavior), which dynamically alter the relationship between the stimulus and the neural response.

METHODS

We develop a general computational approach along with an efficient estimation procedure in the widely used generalized linear model (GLM) framework to characterize such nonstationary dynamics in spiking response and spatiotemporal characteristics of a neuron at the level of individual trials. The model employs a set of modulatory components, which nonlinearly interact with other stimulus-related signals to reproduce such nonstationary effects.

RESULTS

The model is tested for its ability to predict the responses of neurons in the middle temporal cortex of macaque monkeys during an eye movement task. The fitted model proves successful in capturing the fast temporal modulations in the response, reproducing the spike response temporal statistics, and accurately accounting for the neurons' dynamic spatiotemporal sensitivities, during eye movements.

CONCLUSION

The nonstationary GLM framework developed in this study can be used in cases where a time-varying behavioral or cognitive component makes GLM-based models insufficient to describe the dependencies of neural responses on the stimulus-related covariates.

SIGNIFICANCE

In addition to being quite powerful in encoding time-varying response modulations, this general framework also enables a readout of the neural code while dissociating the influence of other nonstimulus covariates. This framework will advance our ability to understand sensory processing in higher brain areas when modulated by several behavioral or cognitive variables.

Mechanisms of Saccadic Suppression in Primate Cortical Area V4

Psychophysical studies have shown that subjects are often unaware of visual stimuli presented around the time of an eye movement. This saccadic suppression is thought to be a mechanism for maintaining perceptual stability. The brain might accomplish saccadic suppression by reducing the gain of visual responses to specific stimuli or by simply suppressing firing uniformly for all stimuli. Moreover, the suppression might be identical across the visual field or concentrated at specific points. To evaluate these possibilities, we recorded from individual neurons in cortical area V4 of nonhuman primates trained to execute saccadic eye movements. We found that both modes of suppression were evident in the visual responses of these neurons and that the two modes showed different spatial and temporal profiles: while gain changes started earlier and were more widely distributed across visual space, nonspecific suppression was found more often in the peripheral visual field, after the completion of the saccade. Peripheral suppression was also associated with increased noise correlations and stronger local field potential oscillations in the α frequency band. This pattern of results suggests that saccadic suppression shares some of the circuitry responsible for allocating voluntary attention.

SIGNIFICANCE STATEMENT

We explore our surroundings by looking at things, but each eye movement that we make causes an abrupt shift of the visual input. Why doesn't the world look like a film recorded on a shaky camera? The answer in part is a brain mechanism called saccadic suppression, which reduces the responses of visual neurons around the time of each eye movement. Here we reveal several new properties of the underlying mechanisms. First, the suppression operates differently in the central and peripheral visual fields. Second, it appears to be controlled by oscillations in the local field potentials at frequencies traditionally associated with attention. These results suggest that saccadic suppression shares the brain circuits responsible for actively ignoring irrelevant stimuli.

Saccadic suppression as a perceptual consequence of efficient sensorimotor estimation

Humans perform saccadic eye movements two to three times per second. When doing so, the nervous system strongly suppresses sensory feedback for extended periods of time in comparison to movement time. Why does the brain discard so much visual information? Here we suggest that perceptual suppression may arise from efficient sensorimotor computations, assuming that perception and control are fundamentally linked. More precisely, we show theoretically that a Bayesian estimator should reduce the weight of sensory information around the time of saccades, as a result of signal dependent noise and of sensorimotor delays. Such reduction parallels the behavioral suppression occurring prior to and during saccades, and the reduction in neural responses to visual stimuli observed across the visual hierarchy. We suggest that saccadic suppression originates from efficient sensorimotor processing, indicating that the brain shares neural resources for perception and control.

Physical-Perceptual Correspondence for Dynamic Thermal Stimulation

Thermal displays have been applied in various haptic applications, from material simulation to interpersonal communication; however, there is insufficient knowledge about the temporal processing in human thermal sense to provide a　knowledge basis for thermal display design. In this study, we investigated the physical-perceptual correspondence for dynamic thermal stimulation to shed a light on the temporal processing of human thermal sense. In the experiments, participants reported subjective timings of the temperature onset and temperature peak of continuous temperature changes applied to the thenar eminence. We found that the physical-perceptual correspondence was not consistent for warm and cold stimulations. For warm stimulation, the subjective experience always came after the corresponding physical event. On the other hand, for cold stimulation, while the subjective onset always lagged the physical onset, the subjective temperature peak preceded the physical temperature peak. We analyzed these results in the framework of linear systems theory. The results suggest that the senses of warmth and cold have distinct temporal filtering properties, with the sense of cold being more transient than the sense of warmth. These findings advance our knowledge regarding temporal processing in human thermal sense and serve as a basis for thermal display design.

Practice improves peri-saccadic shape judgment but does not diminish target mislocalization

Visual sensitivity is markedly reduced during an eye movement. Peri-saccadic vision is also characterized by a mislocalization of the briefly presented stimulus closer to the saccadic target. These features are commonly viewed as obligatory elements of peri-saccadic vision. However, practice improves performance in many perceptual tasks performed at threshold conditions. We wondered if this could also be the case with peri-saccadic perception. To test this, we used a paradigm in which subjects reported the orientation (or location) of an ellipse briefly presented during a saccade. Practice on peri-saccadic orientation discrimination led to long-lasting gains in that task but did not alter the classical mislocalization of the visual stimulus. Shape discrimination gains were largely generalized to other untrained conditions when the same stimuli were used (discrimination during a saccade in the opposite direction or at a different stimulus location than previously trained). However, performance dropped to baseline level when participants shifted to a novel Vernier discrimination task under identical saccade conditions. Furthermore, practice on the location task did not induce better stimulus localization or discrimination. These results suggest that the limited visual information available during a saccade may be better used with practice, possibly by focusing attention on the specific target features or a better readout of the available information. Saccadic mislocalization, by contrast, is robust and resistant to top-down modulations, suggesting that it involves an automatic process triggered by the upcoming execution of a saccade (e.g., an efference copy signal).

Changes in apparent duration follow shifts in perceptual timing

It is well established that the apparent duration of moving visual objects is greater at higher as compared to slower speeds. Here we report the effects of acceleration and deceleration on the perceived duration of a drifting grating with average speed kept constant (10°/s).For acceleration, increasing the speed range progressively reduced perceived duration. The magnitude of apparent duration compression was determined by speed rather than temporal frequency and was proportional to speed range (independent of standard duration) rather than acceleration. The perceived duration reduction was also proportional to the standard length. The effects of increases and decreases in speed were highly asymmetric. Reducing speed through the interval induced a moderate increase in perceived duration. These results could not be explained by changes in apparent onset or offset or differences in perceived average speed between intervals containing increasing speed and intervals containing decreasing speed. Paradoxically, for intervals combining increasing speed and decreasing speed, compression only occurred when increasing speed occurred in the second half of the interval. We show that this pattern of results in the duration domain was concomitant with changes in the reported direction of apparent motion of Gaussian blobs, embedded in intervals of increasing or decreasing speed, that could be predicted from adaptive changes in the temporal impulse response function. We detected similar changes after flicker adaptation, suggesting that the two effects might be linked through changes in the temporal tuning of visual filters.

The role of contrast adaptation in saccadic suppression in humans

The idea of retinal and ex-retinal sources of saccadic suppression has long been established in previous studies. However, how they are implemented in local circuit remains unknown. Researchers have suggested that saccadic suppression was probably achieved by contrast gain control, but this possibility has never been directly tested. In this study, we manipulated contrast gain control by contrast-adapting observers with sinusoidal gratings of different contrasts. Presaccadic and fixational contrast thresholds were measured and compared to give estimates of saccadic suppression at different adaptation states. Our results reconfirmed the selective saccadic suppression in achromatic condition, and further showed that, achromatic saccadic suppression diminished as contrast adaptation was accentuated, whereas no significant chromatic saccadic suppression was induced by greater contrast adaptation. Our data provided evidence for the involvement of contrast gain control in saccadic suppression in achromatic channel. We also discussed how the negative correlation between contrast adaptation and saccadic suppression could be interpreted with contrast gain control.

Amplitude difference and similar time course of impulse responses in positive- and negative-contrast detection

Temporal impulse response functions (IRFs) were measured to investigate the temporal characteristics of positive- and negative-contrast detection in human vision. The IRFs were estimated using models from sequential double-pulse thresholds measured by the psi method. The results indicated that thresholds for positive contrast detection were significantly higher than those for negative contrast detection. However, positive- and negative-contrast IRFs were similar except for the first peak amplitude, reflecting the difference in sensitivity that originates from the summation operation rather than the linear filtering of the visual system.

Intrasaccadic suppression is dominated by reduced detector gain

Human vision requires fast eye movements (saccades). Each saccade causes a self-induced motion signal, but we are not aware of this potentially jarring visual input. Among the theorized causes of this phenomenon is a decrease in visual sensitivity before (presaccadic suppression) and during (intrasaccadic suppression) saccades. We investigated intrasaccadic suppression using a perceptual template model (PTM) relating visual detection to different signal-processing stages. One stage changes the gain on the detector's input; another increases uncertainty about the stimulus, allowing more noise into the detector; and other stages inject noise into the detector in a stimulus-dependent or -independent manner. By quantifying intrasaccadic suppression of flashed horizontal gratings at varying external noise levels, we obtained threshold-versus-noise (TVN) data, allowing us to fit the PTM. We tested if any of the PTM parameters changed significantly between the fixation and saccade models and could therefore account for intrasaccadic suppression. We found that the dominant contribution to intrasaccadic suppression was a reduction in the gain of the visual detector. We discuss how our study differs from previous ones that have pointed to uncertainty as an underlying cause of intrasaccadic suppression and how the equivalent noise approach provides a framework for comparing the disparate neural correlates of saccadic suppression.

Spatiotemporal structure of visual receptive fields in macaque superior colliculus

Saccades are useful for directing the high-acuity fovea to visual targets that are of behavioral relevance. The selection of visual targets for eye movements involves the superior colliculus (SC), where many neurons respond to visual stimuli. Many of these neurons are also activated before and during saccades of specific directions and amplitudes. Although the role of the SC in controlling eye movements has been thoroughly examined, far less is known about the nature of the visual responses in this area. We have, therefore, recorded from neurons in the intermediate layers of the macaque SC, while using a sparse-noise mapping procedure to obtain a detailed characterization of the spatiotemporal structure of visual receptive fields. We find that SC responses to flashed visual stimuli start roughly 50 ms after the onset of the stimulus and last for on average ∼70 ms. About 50% of these neurons are strongly suppressed by visual stimuli flashed at certain locations flanking the excitatory center, and the spatiotemporal pattern of suppression exerts a predictable influence on the timing of saccades. This suppression may, therefore, contribute to the filtering of distractor stimuli during target selection. We also find that saccades affect the processing of visual stimuli by SC neurons in a manner that is quite similar to the saccadic suppression and postsaccadic enhancement that has been observed in the cortex and in perception. However, in contrast to what has been observed in the cortex, decreased visual sensitivity was generally associated with increased firing rates, while increased sensitivity was associated with decreased firing rates. Overall, these results suggest that the processing of visual stimuli by SC receptive fields can influence oculomotor behavior and that oculomotor signals originating in the SC can shape perisaccadic visual perception.

Perception of duration in the parvocellular system

Both theoretical and experimental evidence suggests that duration perception is mediated preferentially by the color-blind but high temporally sensitive luminance pathway. In this experiment we tested whether color modulated stimuli and high spatial frequency luminance modulated stimuli, which are known to be relayed mostly by the slow parvocellular system, are able to elicit reliable sense of duration. We show that ramped color modulated stimuli seem to last less than luminance modulated stimuli matched for visibility. The effect is large, about 200 ms and is constant at all durations tested (range 500-1100 ms). However, high spatial frequency luminance stimuli obtain duration matches similar to those of low spatial frequency luminance modulated stimuli. The results at various levels of contrast and temporal smoothing indicate that equiluminant stimuli have higher contrast thresholds to activate the mechanisms which time visual stimuli. Overall the results imply that both the magnocellular and the parvocellular systems access reliably the timing mechanisms with a difference only in the way these are engaged.

Spatio-temporal templates of transient attention revealed by classification images

Visual attention is captured by transient signals in the periphery of the visual field, allowing enhanced perceptual representations in spatial tasks. However, it has been reported that the same cues impair performance in temporal tasks (e.g., Yeshurun, 2004; Yeshurun & Levy, 2003). This findings suggest that transient attention enhances the activity of slow, high-resolution channels, like parvocellular neurons, and/or shuts off faster channels better sensitive to low spatial frequencies, such as the ones of the magnocellular system. To test this idea, we have measured the spatio-temporal perceptive fields for transiently cued signals at various eccentricities using the classification images (CI) technique. At near eccentricities transient attention caused the perceptual templates to be sharper in space and characterized by much stronger high spatial frequency components. At the same time, they show a consistently larger temporal integration window. These effects of attention on perceptual filters are strongly reduced at far eccentricities and disappear when using longer target-cue lags. These data provide evidence in support of the parvocellular model of transient, exogenous attention, showing that in the presence of a well timed spatial cue observers rely on noisy evidence lasting longer and with finer spatial configurations.

Visual perception and saccadic eye movements

We use saccades several times per second to move the fovea between points of interest and build an understanding of our visual environment. Recent behavioral experiments show evidence for the integration of pre- and postsaccadic information (even subliminally), the modulation of visual sensitivity, and the rapid reallocation of attention. The recent physiological literature has identified a characteristic modulation of neural responsiveness-perisaccadic reduction followed by a postsaccadic increase-that is found in many visual areas, but whose source is as yet unknown. This modulation seems optimal for reducing sensitivity during and boosting sensitivity between saccades, but no study has yet established a direct causal link between neural and behavioral changes.

Effects of microsaccades on contrast detection and V1 responses in macaques

Microsaccades can elevate contrast detection thresholds of human observers and modulate the activity of neurons in monkey visual cortex. Whether microsaccades elevate contrast detection thresholds in monkey observers is not known and bears on the interpretation of neurophysiological experiments. To answer this question, we trained two monkeys to perform a 2AFC contrast detection task. Performance was worse on trials in which a microsaccade occurred during the stimulus presentation. The magnitude of the effect was modest (threshold changes of <0.2 log unit) and color specific: achromatic sensitivity was impaired, but red-green sensitivity was not. To explore the neural basis of this effect, we recorded the responses of individual V1 neurons to a white noise stimulus. Microsaccades produced a suppression of spiking activity followed by an excitatory rebound that was similar for L - M cone-opponent and L + M nonopponent V1 neurons. We conclude that microsaccades in the monkey increase luminance contrast detection thresholds and modulate the spiking activity of V1 neurons, but the luminance specificity of the behavioral suppression is likely implemented downstream of V1.

The perception of motion smear during eye and head movements

Because the visual system integrates information across time, an image that moves on the retina would be expected to be perceived as smeared. In this article, we summarize the previous evidence that human observers perceive a smaller extent of smear when retinal image motion results from an eye or head movement, compared to when a physically moving target generates comparable image motion while the eyes and head are still. This evidence indicates that the reduction of perceived motion smear is asymmetrical, occurring only for targets that move against the direction of an eye or head movement. In addition, we present new data to show that no reduction of perceived motion smear occurs for targets that move in either direction during a visually-induced perception of self motion. We propose that low-level extra-retinal eye- and head-movement signals are responsible for the reduction of perceived motion smear, by decreasing the duration of the temporal impulse response. Although retinal as well as extra-retinal mechanisms can reduce the extent of perceived motion smear, available evidence suggests that improved visual functioning may occur only when an extra-retinal mechanism reduces the perception of smear.

Denoising forced-choice detection data

Observers in a two-alternative forced-choice (2AFC) detection task face the need to produce a response at random (a guess) on trials in which neither presentation appeared to display a stimulus. Observers could alternatively be instructed to use a 'guess' key on those trials, a key that would produce a random guess and would also record the resultant correct or wrong response as emanating from a computer-generated guess. A simulation study shows that 'denoising' 2AFC data with information regarding which responses are a result of guesses yields estimates of detection threshold and spread of the psychometric function that are far more precise than those obtained in the absence of this information, and parallel the precision of estimates obtained with yes-no tasks running for the same number of trials. Simulations also show that partial compliance with the instructions to use the 'guess' key reduces the quality of the estimates, which nevertheless continue to be more precise than those obtained from conventional 2AFC data if the observers are still moderately compliant. An empirical study testing the validity of simulation results showed that denoised 2AFC estimates of spread were clearly superior to conventional 2AFC estimates and similar to yes-no estimates, but variations in threshold across observers and across sessions hid the benefits of denoising for threshold estimation. The empirical study also proved the feasibility of using a 'guess' key in addition to the conventional response keys defined in 2AFC tasks.

Contrast gain shapes visual time

Traditionally time perception has been considered the product of a central, generic, cognitive mechanism. However, evidence is emerging for a distributive system with modality-specific sensory components (Morrone et al., 2005; Johnston et al., 2006). Here we show that fast contrast adaptation, which can be observed in the retina, induces a change in apparent duration. The perceived duration of a subsecond interval containing a 50% luminance contrast drifting pattern is compressed when it follows a high (90%) as compared to a low (10%) contrast interval. The duration effect cannot be attributed to changes in latency at onset relative to offset, can be dissociated from the effect of contrast context on apparent speed or apparent contrast per se and it occurs in a retinocentric frame of reference. The temporal compression is limited to high drift temporal frequencies (≥10 Hz) and is not observed for equiluminant chromatic stimuli. This pattern of results indicates a major role for the magnocellular pathway in the neural encoding and representation of visual time.

The temporal impulse response function during smooth pursuit

Recent studies indicate that the extent of perceived motion smear is attenuated asymmetrically during smooth pursuit eye movements, based on the relative directions of the target and eye motion. We conducted two experiments to determine if the reduction of perceived smear during pursuit might be associated with an acceleration of the temporal impulse response function (TIRF). In Experiment 1, two-pulse increment sensitivity was determined during fixation and rightward pursuit for sequential flashes of a long horizontal line, presented with stimulus-onset asynchronies between 5.9 and 234 ms. In Experiment 2, temporal contrast sensitivity was measured during fixation and rightward pursuit for a vertical 1 cpd grating with retinal image velocities between 4 and 30 Hz. During pursuit, grating motion was either in the same or the opposite direction as the eye movement. TIRFs were modeled as the impulse responses of a second-order, low-pass linear system, fit to the two-pulse increment sensitivity data by an optimization procedure and to the temporal contrast sensitivity results by iterative Fourier synthesis. The results indicate that the natural temporal frequency of the fitted TIRFs was approximately 10% higher during pursuit than fixation. In Experiment 2, the increased natural frequency of the TIRF was restricted to the condition in which the grating moved spatially in the opposite direction of the pursuit eye movement. The results are consistent with the hypothesis that extra-retinal signals reduce the extent of perceived motion smear during pursuit, in part by increasing the speed of visual processing preferentially for one direction of image motion.

Functional distinction between visuomovement and movement neurons in macaque frontal eye field during saccade countermanding

In the previous studies on the neural control of saccade initiation using the countermanding paradigm, movement and visuomovement neurons in the frontal eye field were grouped as movement-related neurons. The activity of both types of neurons was modulated when a saccade was inhibited in response to a stop signal, and this modulation occurred early enough to contribute to the control of the saccade initiation. We now report a functional difference between these two classes of neurons when saccades are produced. Movement neurons exhibited a progressive accumulation of discharge rate following target presentation that triggered a saccade when it reached a threshold. When saccades were inhibited with lower probability in response to a stop signal appearing at longer delays, this accumulating activity was interrupted at levels progressively closer to the threshold. In contrast, visuomovement neurons exhibited a maintained elevated discharge rate following target presentation that was followed by a further enhancement immediately before the saccade initiation. When saccades were inhibited in response to a stop signal, the late enhancement was absent and the maintained activity decayed regardless of stop-signal delay. These results demonstrate that the activity of movement neurons realizes the progressive commitment to the saccade initiation modeled by the activation of the go unit in computational models of countermanding performance. The lack of correspondence of the activity of visuomovement neurons with any elements of these models indicates that visuomovement neurons perform a function other than the saccade preparation such as a corollary discharge to update visual processing.

Improved visual sensitivity during smooth pursuit eye movements: Temporal and spatial characteristics

Recently, we showed that contrast sensitivity for color and high–spatial frequency luminance stimuli is enhanced during smooth pursuit eye movements (Schütz et al., 2008). In this study, we investigated the enhancement over a wide range of temporal and spatial frequencies. In Experiment 1, we measured the temporal impulse response function (TIRF) for colored stimuli. The TIRF for pursuit and fixation differed mostly with respect to the gain but not with respect to the natural temporal frequency. Hence, the sensitivity enhancement seems to be rather independent of the temporal frequency of the stimuli. In Experiment 2, we measured the spatial contrast sensitivity function for luminance-defined Gabor patches with spatial frequencies ranging from 0.2 to 7 cpd. We found a sensitivity improvement during pursuit for spatial frequencies above 2–3 cpd. Between 0.5 and 3 cpd, sensitivity was impaired by smooth pursuit eye movements, but no consistent difference was observed below 0.5 cpd. The results of both experiments are consistent with an increased contrast gain of the parvocellular retinogeniculate pathway.

Direction and contrast tuning of macaque MSTd neurons during saccades

Saccades are rapid eye movements that change the direction of gaze, although the full-field image motion associated with these movements is rarely perceived. The attenuation of visual perception during saccades is referred to as saccadic suppression. The mechanisms that produce saccadic suppression are not well understood. We recorded from neurons in the dorsal medial superior temporal area (MSTd) of alert macaque monkeys and compared the neural responses produced by the retinal slip associated with saccades (active motion) to responses evoked by identical motion presented during fixation (passive motion). We provide evidence for a neural correlate of saccadic suppression and expand on two contentious results from previous studies. First, we confirm the finding that some neurons in MSTd reverse their preferred direction during saccades. We quantify this effect by calculating changes in direction tuning index for a large cell population. Second, it has been noted that neural activity associated with saccades can arrive in the parietal cortex <or=30 ms earlier than activity produced by similar visual stimulation during fixation. This led to the question of whether the saccade-related responses were visual in origin or were motor signals arising from saccade-planning areas of the brain. By comparing the responses to saccades made over textured backgrounds of different contrasts, we provide strong evidence that saccade-related responses were visual in origin. Refinements of the possible models of saccadic suppression are discussed.

Saccadic modulation of neural responses: possible roles in saccadic suppression, enhancement, and time compression

Humans use saccadic eye movements to make frequent gaze changes, yet the associated full-field image motion is not perceived. The theory of saccadic suppression has been proposed to account for this phenomenon, but it is not clear whether suppression originates from a retinal signal at saccade onset or from the brain before saccade onset. Perceptually, visual sensitivity is reduced before saccades and enhanced afterward. Over the same time period, the perception of time is compressed and even inverted. We explore the origins and neural basis of these effects by recording from neurons in the dorsal medial superior temporal area (MSTd) of alert macaque monkeys. Neuronal responses to flashed presentations of a textured pattern presented at random times relative to saccades exhibit a stereotypical pattern of modulation. Response amplitudes are strongly suppressed for flashes presented up to 90 ms before saccades. Immediately after the suppression, there is a period of 200-450 ms in which flashes generate enhanced response amplitudes. Our results show that (1) MSTd is not directly suppressed, rather suppression is inherited from earlier visual areas; (2) early suppression of the visual system must be of extra-retinal origin; (3) postsaccadic enhancement of neural activity occurs in MSTd; and (4) the enhanced responses have reduced latencies. As a whole, these observations reveal response properties that could account for perceptual observations relating to presaccadic suppression, postsaccadic enhancement and time compression.

Asymmetrical perception of motion smear in infantile nystagmus

Normal observers perceive less motion smear if a target moves in the opposite direction of a smooth eye movement than if the target moves to produce the same retinal image speed in the same direction as the eye movement. This study investigated whether a similar asymmetrical attenuation of perceived motion smear occurs in observers with infantile nystagmus (IN). Observers (N=3) viewed a laser spot that moved for 100 or 125ms to the right or left at a speed between 5 and 60 degrees /s during the slow phase of jerk IN. After each trial, the observer adjusted the length of a bright line to match the extent of the perceived smear. Across observers, the average duration of perceived smear was 39 and 106ms, respectively, for relative motion of the laser spot in the opposite vs. the same direction as the IN slow phase. In one observer with periodic alternating nystagmus, the direction of spot motion that produced less perceived smear reversed with an alternation in the direction of the IN slow phase. The reduction of perceived motion smear for relative target motion in the opposite direction of IN slow phases is attributed to extra-retinal signals that accompany IN. As during normal eye movements, the reduction of perceived smear for this direction of relative motion should foster the perception of clarity in the stationary visual world.

The temporal impulse response function in infantile nystagmus

Despite rapid to-and-fro motion of the retinal image that results from their incessant involuntary eye movements, persons with infantile nystagmus (IN) rarely report the perception of motion smear. We performed two experiments to determine if the reduction of perceived motion smear in persons with IN is associated with an increase in the speed of the temporal impulse response. In Experiment 1, increment thresholds were determined for pairs of successively presented flashes of a long horizontal line, presented on a 65-cd/m2 background field. The stimulus-onset asynchrony (SOA) between the first and second flash varied from 5.9 to 234 ms. In experiment 2, temporal contrast sensitivity functions were determined for a 3-cpd horizontal square-wave grating that underwent counterphase flicker at temporal frequencies between 1 and 40 Hz. Data were obtained for 2 subjects with predominantly pendular IN and 8 normal observers in Experiment 1 and for 3 subjects with IN and 4 normal observers in Experiment 2. Temporal impulse response functions (TIRFs) were estimated as the impulse response of a linear second-order system that provided the best fit to the increment threshold data in Experiment 1 and to the temporal contrast sensitivity functions in Experiment 2. Estimated TIRFs of the subjects with pendular IN have natural temporal frequencies that are significantly faster than those of normal observers (ca. 13 vs. 9 Hz), indicating an accelerated temporal response to visual stimuli. This increase in response speed is too small to account by itself for the virtual absence of perceived motion smear in subjects with IN, and additional neural mechanisms are considered.

Transient cortical excitation at the onset of visual fixation

Primates actively examine the visual world by rapidly shifting gaze (fixation) over the elements in a scene. Despite this fact, we typically study vision by presenting stimuli with gaze held constant. To better understand the dynamics of natural vision, we examined how the onset of visual fixation affects ongoing neuronal activity in the absence of visual stimulation. We used multiunit activity and current source density measurements to index neuronal firing patterns and underlying synaptic processes in macaque V1. Initial averaging of neural activity synchronized to the onset of fixation suggested that a brief period of cortical excitation follows each fixation. Subsequent single-trial analyses revealed that 1) neuronal oscillation phase transits from random to a highly organized state just after the fixation onset, 2) this phase concentration is accompanied by increased spectral power in several frequency bands, and 3) visual response amplitude is enhanced at the specific oscillatory phase associated with fixation. We hypothesize that nonvisual inputs are used by the brain to increase cortical excitability at fixation onset, thus "priming" the system for new visual inputs generated at fixation. Despite remaining mechanistic questions, it appears that analysis of fixation-related responses may be useful in studying natural vision.

The initial ocular following responses elicited by apparent-motion stimuli: reversal by inter-stimulus intervals

Transient apparent-motion stimuli, consisting of single 1/4-wavelength steps applied to square-wave gratings lacking the fundamental ("missing fundamental stimulus") and to sinusoidal gratings, were used to elicit ocular following responses (OFRs) in humans. As previously reported [Sheliga, B. M., Chen, K. J., FitzGibbon, E. J., & Miles, F. A. (2005). Initial ocular following in humans: a response to first-order motion energy. Vision Research, in press], the earliest OFRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. Introducing inter-stimulus intervals (ISIs) of 10-200 ms, during which the screen was gray with the same mean luminance, reversed the initial direction of the OFR, the peak reversed responses (with ISIs of 20-40 ms) being substantially greater than the non-reversed responses (with an ISI of 0 ms). When the mean luminance was reduced to scotopic levels, reversals now occurred only with ISIs > or=60 ms and the peak reversed responses (with ISIs of 60-100 ms) were substantially smaller than the non-reversed responses (with an ISI of 0 ms). These findings are consistent with the idea that initial OFRs are mediated by first-order motion-energy-sensing mechanisms that receive a visual input whose temporal impulse response function is strongly biphasic in photopic conditions and almost monophasic in scotopic conditions.

Development of saccadic suppression in children

We measured saccadic suppression in adolescent children and young adults using spatially curtailed low spatial frequency stimuli. For both groups, sensitivity for color-modulated stimuli was unchanged during saccades. Sensitivity for luminance-modulated stimuli was greatly reduced during saccades in both groups but far more for adolescents than for young adults. Adults' suppression was on average a factor of about 3, whereas that for the adolescent group was closer to a factor of 10. The specificity of the suppression to luminance-modulated stimuli excludes generic explanations such as task difficulty and attention. We suggest that the enhanced suppression in adolescents results from the immaturity of the ocular-motor system at that age.

Lateral masking, levels of processing and stimulus category: A comparative study between normal and dyslexic readers

The lateral masking effect results in lower performance on letter recognition when items are flanked by other stimuli. Using a new paradigm based on discrimination (feature analysis) and categorization (memory access) tasks, we investigated the influence of level of processing (as addressed, respectively, by these two tasks) and stimulus type (Latin letters, Korean letters and geometrical figures) on lateral masking. In addition, performance of dyslexic and non-dyslexic adult readers was compared. The non-dyslexic participants demonstrated a classical lateral masking effect with lower performance for flanked items than isolated ones. In addition, lateral masking was stronger in the categorization than in the discrimination task and was restricted to familiar items, i.e., Latin letters and geometrical figures. Dyslexic participants showed poorer performance than non-dyslexics on processing isolated items, and the pattern of decrease in performance for lateral masking was similar to non-dyslexics. However, they also showed a stronger decrease in performance in categorization and a stronger decrease related to the lateral masking for this categorization task. Our results in normal readers suggest that lateral masking relies on the interference between the target and the flankers during feature integration that may result in marked impairment of memory access (categorization task). Poorer performance in dyslexic readers may reflect impaired parafoveal/peripheral low-level processing during feature integration that may have worsened during the flanked condition due to a target selection/spatial-attentional disorder. Moreover, dyslexic subjects presented an additional categorization deficit that may relate to a specific left-hemispheric disorder.

Vision: in the blink of an eye

Although we blink every 4 to 6 seconds, we notice neither the act of blinking nor the mini-blackouts they cause. A new study using imaging techniques identifies the neural structures in humans involved in suppressing vision processing and visual awareness during blinking.

Saccadic eye movements cause compression of time as well as space

There is now considerable evidence that space is compressed when stimuli are flashed shortly before or after the onset of a saccadic eye movement. Here we report that short intervals of time between two successive perisaccadic visual (but not auditory) stimuli are also underestimated, indicating a compression of perceived time. We were even more surprised that in a critical interval before saccades, perceived temporal order is consistently reversed. The very similar time courses of spatial and temporal compression suggest that both are mediated by a common neural mechanism, probably related to the predictive shifts that occur in receptive fields of many visual areas at the time of saccades.

Correlates of motor planning and postsaccadic fixation in the macaque monkey lateral geniculate nucleus

There is significant controversy regarding the ability of the primate visual system to construct stable percepts from a never-ending stream of brief fixations and rapid saccadic eye movements. In this study, we examined the timing and occurrence of perisaccadic modulation of LGN single-unit activity in awake-behaving macaque monkeys while they made spontaneous saccades in the dark and made visually guided saccades to discrete stimuli located outside the receptive field. Our hypothesis was that the activity of LGN cells is modulated by efference copies of motor plans to produce saccadic eye movements and that this modulation depends neither on the presence of feedforward visual information nor on a corollary discharge of signals directing saccadic eye movements. On average, 25% of LGN cells demonstrated significant perisaccadic modulation. This modulation consisted of a moderate suppression of activity that began more than 100 ms prior to the initiation of a saccadic eye movement and continued beyond the termination of the saccadic eye movement. This suppression was followed by a large enhancement of activity after the eyes arrived at the next fixation. Although members of all three LGN relay cell classes (magnocellular, parvocellular, and koniocellular) demonstrated significant saccade-related suppression and enhancement of activity, more cells demonstrated postsaccadic enhancement (25%) than perisaccadic suppression (17%). In no case did the timing of the modulation coincide directly with saccade duration. The degree of modulation observed did not vary with LGN cell class, LGN receptive field center location, center sign (ON-center or OFF-center), or saccade latency or velocity. The time course of modulation did, however, vary with saccade size such that suppression was longer for longer saccades. The fact that activity from a percentage of LGN cells from all cell classes was modulated in relationship to saccadic eye movements in the absence of direct visual stimulation suggests that this modulation is a general phenomenon not tied to specific types of visual stimuli. Similarly, because the onset of the modulation preceded eye movements by more than 100 ms, it is likely that this modulation reflects higher order motor-planning rather than a corollary of mechanisms in direct control of eye movements themselves. Finally, the fact that the largest modulation is a postsaccadic enhancement of activity may suggest that perisaccadic modulations are designed more for the facilitation of visual information processing once the eyes land at a new location than for filtering unwanted visual stimuli.

Perisaccadic perception of continuous flickers

To realize perceptual space constancy, the visual system compensates for the retinal displacement caused by eye movements. It has been reported that the compensation process does not function perfectly around the time of a saccade--a perisaccadic flash is systematically mislocalized. However, observations made with transient flash stimuli do not necessarily indicate a general perisaccadic failure of space constancy. To investigate how the visual system realizes perisaccadic space constancy for continuous stimuli, we examined the time course of localization for a perisaccadic 500 Hz flicker with systematic variation of the onset timing, the offset timing and the duration. If each flash in the flicker is localized individually in the same way as a single flash, the apparent position and length of the flicker should be predicted from the time course of mislocalization of a perisaccadic flash. However, the results did not support this prediction in many respects. A dot array (of half the length of the retinal image) was perceived when the flicker was presented during a saccade, while only a single dot was perceived when the flicker was presented only before or after the saccade. A flash in a flicker was localized at a different position, depending on the onset timing, the offset timing and the duration of the flicker, even if the flash was presented at the same timing to the saccade. In general, our results support a two-stage localization in which the local geometrical configuration is first generated primarily based on the retinal information, and then localized as a whole in the egocentric or exocentric space. The localization is based on the eye position signal sampled at a time temporally distant from the saccade, which enables precise localization and space constancy for continuous stimuli.

Isoluminant stimuli and red background attenuate the effects of transient spatial attention on temporal resolution

The effects of transient spatial attention on temporal resolution were recently studied and compared with attentional effects on spatial resolution. It was found that in contrast to the attentional enhancement of spatial resolution, transient attention impairs temporal resolution. To account for these findings a novel attentional mechanism was suggested. This attentional mechanism facilitates parvocellular neurons at the attended location, which in turn inhibit the activity of magnocellular neurons at the same location [Yeshurun & Levy, Psychol. Sci. 14 (3) (2003a) 225]. The goal of the present study was to replicate the attentional decrement in temporal resolution (Experiment 1), and perform direct tests of this 'parvo facilitation-magno inhibition' hypothesis. The employment of isoluminant stimuli (Experiments 2a and 2b) or a red background (Experiment 3) ensured that the parvo system was the main system mediating performance. Consequently, any parvo-magno inhibitory processes elicited by the attentional mechanism should only have a minor effect on performance. As predicted, these manipulations either significantly attenuated or completely eliminated the attentional decrement in temporal resolution. These findings provide direct support to the hypothesis that attention favors parvocellular over magnocellular neurons.

Neural correlates of saccadic suppression in humans

When you look into a mirror and move your eyes left to right, you will see that you cannot observe your own eye movements. This demonstrates the phenomenon of saccadic suppression: during saccadic eye movements, visual sensitivity is much reduced. Given that humans make more than 100,000 eye movements each day, it is clear why suppression is needed: without it, the motion on the retina would prevent us from seeing anything at all. Psychophysical data show that suppression is stimulus selective: it is strongest for the kind of stimuli that preferentially activate magnocellular thalamic neurons. This has led to the hypothesis that saccadic suppression selectively targets the magnocellular stream. We used fMRI to find brain areas with a stimulus-selective suppression of the BOLD signal that matches the psychophysical data. We found such a neural correlate of saccadic suppression in the dorsal stream (hMT+, V7) and in ventral area V4. These areas receive magnocellular input; hence our findings are consistent with the magnocellular hypothesis. The range of effects in our data and in single cell data, however, argues against a single thalamic mechanism that suppresses all cortical input. Instead, we speculate that saccadic suppression relies on multiple mechanisms operating in different cortical areas.

Eye movements: keeping vision stable

A long-standing problem for vision researchers is how our perception of the world remains stable despite the continual motion of our eyes. Three recent studies begin to shed light on how the visual system suppresses the motion generated by these eye movements.

Attenuation of perceived motion smear during vergence and pursuit tracking

When the eyes move, the images of stationary objects sweep across the retina. Despite this motion of the retinal image and the substantial integration of visual signals across time, physically stationary objects typically do not appear to be smeared during eye movements. Previous studies indicated that the extent of perceived motion smear is smaller when a stationary target is presented during pursuit or saccadic eye movements than when comparable motion of the retinal image occurs during steady fixation. In this study, we compared the extent of perceived motion smear for a stationary target during smooth pursuit and vergence eye movements with that for a physically moving target during fixation. For a target duration of 100 ms or longer, perceived motion smear is substantially less when the motion of the retinal image results from vergence or pursuit eye movements than when it results from the motion of a target during fixation. The reduced extent of perceived motion smear during eye movements compared to fixation cannot be accounted for by different spatio-temporal interactions between visual targets or by unequal attention to the moving test spot under these two types of conditions. We attribute the highly similar attenuation of perceived smear during vergence and pursuit to a comparable action of the extra-retinal signals for disjunctive and conjugate eye movements.

Senescence of the temporal impulse response to a luminous pulse

An impulse response function (IRF) to a luminous pulse was derived for 70 normal observers ranging in age from 16 to 86 years. Thresholds were measured for two pulses separated by interstimulus intervals from 6.7 to 180 ms. The pulses had a spatial Gaussian shape (+/-1SD=2.3 degrees diam) and were presented as increments on a 10 cd/m(2) background, having the same chromaticity as the pulse. A spatial 4-alternative forced-choice method was combined with a staircase procedure. Retinal illuminance was equated individually by heterochromatic flicker photometry and control of pupil area. Each IRF was measured four times, in separate sessions, for each observer. IRFs calculated from the threshold data revealed significant age-related changes in the response amplitude of both excitatory and inhibitory phases. In general, there were no significant changes in the time to the first peak or in the first zero crossing. For 12 of 20 observers over 60 years of age, however, the amplitude of the second (inhibitory) phase was reduced relative to the excitatory phase so their IRFs were quite slow and long. Control conditions with three pseudophakic observers and two normal observers with induced blur demonstrated that age-related changes in the IRF under these conditions cannot be ascribed to optical factors. The data suggest that the human visual system generally maintains a stable speed of response to a flash until at least about 80 years of age, even while there are senescent reductions in response signal amplitude.