Eye Movements in Response to Dichoptic Motion: Evidence for a Parallel-Hierarchical Structure of Visual Motion Processing in Primates

Manipulating the Fourier spectra of stimuli comprising a two-frame kinematogram to study early visual motion-detecting mechanisms: Perception versus short latency ocular-following responses

Two-frame kinematograms have been extensively used to study motion perception in human vision. Measurements of the direction-discrimination performance limits (Dmax) have been the primary subject of such studies, whereas surprisingly little research has asked how the variability in the spatial frequency content of individual frames affects motion processing. Here, we used two-frame one-dimensional vertical pink noise kinematograms, in which images in both frames were bandpass filtered, with the central spatial frequency of the filter manipulated independently for each image. To avoid spatial aliasing, there was no actual leftward-rightward shift of the image: instead, the phases of all Fourier components of the second image were shifted by ±¼ wavelength with respect to those of the first. We recorded ocular-following responses (OFRs) and perceptual direction discrimination in human subjects. OFRs were in the direction of the Fourier components' shift and showed a smooth decline in amplitude, well fit by Gaussian functions, as the difference between the central spatial frequencies of the first and second images increased. In sharp contrast, 100% correct perceptual direction-discrimination performance was observed when the difference between the central spatial frequencies of the first and second images was small, deteriorating rapidly to chance when increased further. Perceptual dependencies moved closer to the OFR ones when subjects were allowed to grade the strength of perceived motion. Response asymmetries common for perceptual judgments and the OFRs suggest that they rely on the same early visual processing mechanisms. The OFR data were quantitatively well described by a model which combined two factors: (1) an excitatory drive determined by a power law sum of stimulus Fourier components' contributions, scaled by (2) a contrast normalization mechanism. Thus, in addition to traditional studies relying on perceptual reports, the OFRs represent a valuable behavioral tool for studying early motion processing on a fine scale.

Binocular global motion perception is improved by dichoptic segregation when stimuli have high contrast and high speed

The brain combines information from the two eyes during vision. This combination is obligatory to a remarkable extent: In random-dot kinematograms (RDKs), randomly moving noise dots were similarly effective at preventing observers from seeing the motion of coherently moving signals dots, independent of whether the signal and noise were presented to the same eye or segregated to different eyes. However, motion detectors have varied binocularity: Neurons in visual brain area V1 that encode high contrast, high speed stimuli may be less completely binocular than neurons that encode low contrast, low speed stimuli. Also, neurons in MT often have unbalanced inputs from the two eyes. We predicted that for high contrast, high speed stimuli only, there would be a benefit to segregating the signal and noise of the RDK into different eyes. We found this benefit, both when performance was measured by percent coherence thresholds and when it was measured by luminance contrast ratio (signal-dot-contrast to noise-dot-contrast) thresholds. Thus, for high contrast, high speed stimuli, binocular fusion of local motion is not complete before the extraction of global motion. We also replicated a cross-over interaction: At high speed, global motion extraction was generally more efficient when dot contrast was high, but at low speed it was more efficient when dot contrast was low. We provide a schematic model of binocular global motion perception, to show how the contrast-speed interaction can be predicted from neurophysiology and why it should be exaggerated for segregated viewing. Our data bore out these predictions. We conclude that different neural populations limit performance during binocular global motion perception, depending on stimulus contrast and speed.

Contribution of color signals to ocular following responses

Ocular following responses (OFRs) are elicited at ultra-short latencies (< 60 ms) by sudden movements of the visual scene. In this study, we investigated the roles of color signals in OFRs in monkeys. To make physiologically isoluminant sinusoidal color gratings, we estimated the physiologically isoluminant points using OFRs and found that the physiologically isoluminant points were nearly independent of the spatiotemporal frequency of the gratings. We recorded OFRs induced by the motion of physiologically isoluminant color gratings and found that OFRs elicited by the motion of color gratings had different spatiotemporal frequency tuning from those elicited by the motion of luminance gratings. Additionally, OFRs to isoluminant color gratings had smaller peak responses, suggesting that color signals weakly contribute to OFRs compared with luminance signals. OFRs to the motion of stimuli composed of luminance and color signals were also examined. We found that color signals largely contributed to OFRs under low luminance signals regardless of whether color signals moved in the same or opposite direction to luminance signals. These results provide evidence of the multichannel visual computations underlying motor responses. We conclude that, in everyday situations, color information contributes cooperatively with luminance information to the generation of ocular tracking behaviors.

Difference in perceptual and oculomotor responses revealed by apparent motion stimuli presented with an interstimulus interval

To understand the mechanisms underlying visual motion analyses for perceptual and oculomotor responses and their similarities/differences, we analyzed eye movement responses to two-frame animations of dual-grating 3f5f stimuli while subjects performed direction discrimination tasks. The 3f5f stimulus was composed of two sinusoids with a spatial frequency ratio of 3:5 (3f and 5f), creating a pattern with fundamental frequency f. When this stimulus was shifted by 1/4 of the wavelength, the two components shifted 1/4 of their wavelengths and had opposite directions: the 5f forward and the 3f backward. By presenting the 3f5f stimulus with various interstimulus intervals (ISIs), two visual-motion-analysis mechanisms, low-level energy-based and high-level feature-based, could be effectively distinguished. This is because response direction depends on the relative contrast between the components when the energy-based mechanism operates, but not when the feature-based mechanism works. We found that when the 3f5f stimuli were presented with shorter ISIs (<100 ms), and 3f component had higher contrast, both perceptual and ocular responses were in the direction of the pattern shift, whereas the responses were reversed when the 5f had higher contrast, suggesting operation of the energy-based mechanism. On the other hand, the ocular responses were almost negligible with longer ISIs (>100 ms), whereas perceived directions were biased toward the direction of pattern shift. These results suggest that the energy-based mechanism is dominant in oculomotor responses throughout ISIs; however, there is a transition from energy-based to feature-tracking mechanisms when we perceive visual motion.

Ocular tracking responses to background motion gated by feature-based attention

Involuntary ocular tracking responses to background motion offer a window on the dynamics of motion computations. In contrast to spatial attention, we know little about the role of feature-based attention in determining this ocular response. To probe feature-based effects of background motion on involuntary eye movements, we presented human observers with a balanced background perturbation. Two clouds of dots moved in opposite vertical directions while observers tracked a target moving in horizontal direction. Additionally, they had to discriminate a change in the direction of motion (±10° from vertical) of one of the clouds. A vertical ocular following response occurred in response to the motion of the attended cloud. When motion selection was based on motion direction and color of the dots, the peak velocity of the tracking response was 30% of the tracking response elicited in a single task with only one direction of background motion. In two other experiments, we tested the effect of the perturbation when motion selection was based on color, by having motion direction vary unpredictably, or on motion direction alone. Although the gain of pursuit in the horizontal direction was significantly reduced in all experiments, indicating a trade-off between perceptual and oculomotor tasks, ocular responses to perturbations were only observed when selection was based on both motion direction and color. It appears that selection by motion direction can only be effective for driving ocular tracking when the relevant elements can be segregated before motion onset.

Selective defects of visual tracking in progressive supranuclear palsy (PSP): implications for mechanisms of motion vision

Smooth ocular tracking of a moving visual stimulus comprises a range of responses that encompass the ocular following response (OFR), a pre-attentive, short-latency mechanism, and smooth pursuit, which directs the retinal fovea at the moving stimulus. In order to determine how interdependent these two forms of ocular tracking are, we studied vertical OFR in progressive supranuclear palsy (PSP), a parkinsonian disorder in which vertical smooth pursuit is known to be impaired. We measured eye movements of 9 patients with PSP and 12 healthy control subjects. Subjects viewed vertically moving sine-wave gratings that had a temporal frequency of 16.7 Hz, contrast of 32%, and spatial frequencies of 0.17, 0.27 or 0.44 cycles/degree. We measured OFR amplitude as change in eye position in the 70-150 ms, open-loop interval following stimulus onset. Vertical smooth pursuit was studied as subjects attempted to track a 0.27 cycles/degree grating moving sinusoidally through several cycles at frequencies between 0.1 and 2.5 Hz. We found that OFR amplitude, and its dependence on spatial frequency, was similar in PSP patients (group mean 0.10 degree) and control subjects (0.11 degree), but the latency to onset of OFR was greater for PSP patients (group mean 99 ms) than control subjects (90 ms). When OFR amplitude was re-measured, taking into account the increased latency in PSP patients, there was still no difference from control subjects. We confirmed that smooth pursuit was consistently impaired in PSP; group mean tracking gain at 0.7 Hz was 0.29 for PSP patients and 0.63 for controls. Neither PSP patients nor control subjects showed any correlation between OFR amplitude and smooth-pursuit gain. We propose that OFR is spared because it is generated by low-level motion processing that is dependent on posterior cerebral cortex, which is less affected in PSP. Conversely, smooth pursuit depends more on projections from frontal cortex to the pontine nuclei, both of which are involved in PSP. The accessory optic pathway, which is heavily involved in PSP, seems unlikely to contribute to the OFR in humans.

How Motion Signals Are Integrated Across Frequencies: Study on Motion Perception and Ocular Following Responses Using Multiple-Slit Stimuli

Visual motion signals, which are initially extracted in parallel at multiple spatial frequencies, are subsequently integrated into a unified motion percept. Cross-frequency integration plays a crucial role when directional information conflicts across frequencies due to such factors as occlusion. We investigated the human observers' open-loop oculomotor tracking responses (ocular following responses, or OFRs) and the perceived motion direction in an idealized situation of occlusion—multiple-slits viewing (MSV)—in which a moving pattern is visible only through an array of slits. We also tested a more challenging viewing condition, contrast-alternating MSV (CA-MSV), in which the contrast polarity of the moving pattern alternates when it passes the slits. We found that changes in the distribution of the spectral content of the slit stimuli, introduced by variations of both the interval between the slits and the frame rate of the image stream, modulated the OFR and the reported motion direction in a rather complex manner. We show that those complex modulations could be explained by the weighted sum of the motion signal (motion contrast) of each spatiotemporal frequency. The estimated distribution of frequency weights (tuning maps) indicate that the cross-frequency integration of supra-threshold motion signals gives strong weight to low spatial frequency components (<0.25 cpd) for both OFR and motion perception. However, the tuning map estimated with the MSV stimuli were significantly different from those estimated with the CA-MSV (and from those measured in a more direct manner using grating stimuli), suggesting that inter-frequency interactions (e.g., interaction producing speed-dependent tuning) was involved.

The initial disparity vergence elicited with single and dual grating stimuli in monkeys: evidence for disparity energy sensing and nonlinear interactions

We recorded the initial vertical vergence eye movements elicited in monkeys at short latency ( approximately 70 ms) when the two eyes see one-dimensional (1D) horizontal grating patterns that are identical except for a phase difference (disparity) of one-quarter wavelength. With gratings composed of single sine waves, responses were always compensatory, showing Gaussian dependence on log spatial frequency (on average: peak = 0.75 cycles/deg; SD = 0.74; r(2) = 0.980) and monotonic dependence on log contrast with a gradual saturation well described by the Naka-Rushton equation (on average: n = 0.89; C(50) = 4.1%; r(2) = 0.978). With gratings composed of two sine waves whose spatial frequencies were in the ratio 3:5 and whose disparities were of opposite sign (the 3f5f stimulus), responses were determined by the disparities and contrasts of the two sine-wave components rather than the disparity of the features, consistent with early spatial filtering of the monocular inputs before their binocular combination and mediation by detectors sensitive to disparity energy. In addition, responses to the 3f5f stimulus showed a nonlinear dependence on the relative contrasts of the two sine waves. Thus on average, when the contrast of one sine wave was 2.3 times greater than that of the other, the one with the lower contrast was largely ineffective as though suppressed, and responses were determined almost entirely by the sine wave of higher contrast: Winner-Take-All. These findings are very similar to those published previously on the vertical vergence responses of humans, indicating that the monkey provides a good animal model for studying these disparity vergence responses.