Human ocular following initiated by competing image motions: evidence for a winner-take-all mechanism

Weighted power summation and contrast normalization mechanisms account for short-latency eye movements to motion and disparity of sine-wave gratings and broadband visual stimuli in humans

In this paper, we show that the model we proposed earlier to account for the disparity vergence eye movements (disparity vergence responses, or DVRs) in response to horizontal and vertical disparity steps of white noise visual stimuli also provides an excellent description of the short-latency ocular following responses (OFRs) to broadband stimuli in the visual motion domain. In addition, we reanalyzed the data and applied the model to several earlier studies that used sine-wave gratings (single or a combination of two or three gratings) and white noise stimuli. The model provides a very good account of all of these data. The model postulates that the short-latency eye movements-OFRs and DVRs-can be accounted for by the operation of two factors: an excitatory drive, determined by a weighted sum of contributions of stimulus Fourier components, scaled by a global contrast normalization mechanism. The output of the operation of these two factors is then nonlinearly scaled by the total contrast of the stimulus. Despite different roles of disparity (horizontal and vertical) and motion signals in visual scene analyses, the earliest processing stages of these different signals appear to be very similar.

Shared Mechanisms Drive Ocular Following and Motion Perception

How features of complex visual patterns are combined to drive perception and eye movements is not well understood. Here we simultaneously assessed human observers' perceptual direction estimates and ocular following responses (OFR) evoked by moving plaids made from two summed gratings with varying contrast ratios. When the gratings were of equal contrast, observers' eye movements and perceptual reports followed the motion of the plaid pattern. However, when the contrasts were unequal, eye movements and reports during early phases of the OFR were biased toward the direction of the high-contrast grating component; during later phases, both responses followed the plaid pattern direction. The shift from component- to pattern-driven behavior resembles the shift in tuning seen under similar conditions in neuronal responses recorded from monkey MT. Moreover, for some conditions, pattern tracking and perceptual reports were correlated on a trial-by-trial basis. The OFR may therefore provide a precise behavioral readout of the dynamics of neural motion integration for complex visual patterns.

Manipulating the Fourier spectra of stimuli comprising a two-frame kinematogram to study early visual motion-detecting mechanisms: Perception versus short latency ocular-following responses

Two-frame kinematograms have been extensively used to study motion perception in human vision. Measurements of the direction-discrimination performance limits (Dmax) have been the primary subject of such studies, whereas surprisingly little research has asked how the variability in the spatial frequency content of individual frames affects motion processing. Here, we used two-frame one-dimensional vertical pink noise kinematograms, in which images in both frames were bandpass filtered, with the central spatial frequency of the filter manipulated independently for each image. To avoid spatial aliasing, there was no actual leftward-rightward shift of the image: instead, the phases of all Fourier components of the second image were shifted by ±¼ wavelength with respect to those of the first. We recorded ocular-following responses (OFRs) and perceptual direction discrimination in human subjects. OFRs were in the direction of the Fourier components' shift and showed a smooth decline in amplitude, well fit by Gaussian functions, as the difference between the central spatial frequencies of the first and second images increased. In sharp contrast, 100% correct perceptual direction-discrimination performance was observed when the difference between the central spatial frequencies of the first and second images was small, deteriorating rapidly to chance when increased further. Perceptual dependencies moved closer to the OFR ones when subjects were allowed to grade the strength of perceived motion. Response asymmetries common for perceptual judgments and the OFRs suggest that they rely on the same early visual processing mechanisms. The OFR data were quantitatively well described by a model which combined two factors: (1) an excitatory drive determined by a power law sum of stimulus Fourier components' contributions, scaled by (2) a contrast normalization mechanism. Thus, in addition to traditional studies relying on perceptual reports, the OFRs represent a valuable behavioral tool for studying early motion processing on a fine scale.

Form Properties of Moving Targets Bias Smooth Pursuit Target Selection in Monkeys

During natural viewing, we often recognize multiple objects, detect their motion, and select one object as the target to track. It remains to be determined how such behavior is guided by the integration of visual form and motion perception. To address this, we studied how monkeys made a choice to track moving targets with different forms by smooth pursuit eye movements in a two-target task. We found that pursuit responses were biased toward the motion direction of a target with a hole. By computing the relative weighting, we found that the target with a hole exhibited a larger weight for vector computation. The global hole feature dominated other form properties. This dominance failed to account for changes in pursuit responses to a target with different forms moving singly. These findings suggest that the integration of visual form and motion perception can reshape the competition in sensorimotor networks to guide behavioral selection.

Short-latency ocular following responses to motion stimuli are strongly affected by temporal modulations of the visual content during the initial fixation period

Neuronal and psychophysical responses to a visual stimulus are known to depend on the preceding history of visual stimulation, but the effect of stimulation history on reflexive eye movements has received less attention. Here, we quantify these effects using short-latency ocular following responses (OFRs), a valuable tool for studying early motion processing. We recorded, in human subjects, the horizontal OFRs induced by drifting vertical 1D pink noise. The stimulus was preceded by 600 to 1000 ms of maintained fixation (on a visible cross), and we explored the effect of different stimuli (“fixation patterns”) presented during the fixation period. We found that any temporal modulation present during the fixation period reduced the magnitude of the subsequent OFRs. Even changes in the overall luminance during the fixation period induced significant suppression. The magnitude of the effect was a function of both spatial and temporal structure of the fixation pattern. Suppression that was selective for both relative orientation and relative spatial frequency accounted for a considerable fraction of total suppression. Finally, changes in stimulus temporal structure alone (i.e. “flicker” versus “transparent motion”) led to changes in the spatial frequency tuning of suppression. In the time domain, the suppression developed quickly: 100 ms of temporal modulation in the fixation pattern produced up to 80% of maximal suppression. Recovery from suppression was instead more gradual, taking up to several seconds. By presenting transparent motion during the fixation period, with opposite motion signals having different spatial frequency content, we also discovered a direction-selective component of suppression, which depended on both the frequency and the direction of the moving stimulus.

Macaque monkeys show reversed ocular following responses to two-frame-motion stimulus presented with inter-stimulus intervals

When two-frame apparent motion stimuli are presented with an appropriate inter-stimulus interval (ISI), motion is perceived in the direction opposite to the actual image shift. Herein, we measured a simple eye movement, ocular following responses (OFRs), in macaque monkeys to examine the ISI reversal effect on oculomotor. Two-frame movies with an ISI induced reversed OFRs. Without ISI, the OFRs to the two-frame movie were induced in the direction of the stimulus shift. However, with ISIs ≥10 ms, OFRs in the direction opposite to the phase shift were observed. This directional reversal persisted for ISIs up to 160 ms; for longer ISIs virtually no ocular response was observed. Furthermore, longer exposure to the initial image (Motion onset delay: MOD) reduced OFRs. We show that these dependences on ISIs/MODs can be explained by the motion energy model. Furthermore, we examined the dependence on ISI reversal using various spatial frequencies. To account for our findings, the optimal frequency of the temporal filters of the energy model must decrease between 0.5 and 1 cycles/°, suggesting that there are at least two channels with different temporal characteristics. These results are consistent with those from humans, suggesting that the temporal filters embedded in human and macaque visual systems are similar. Thus, the macaque monkey is a good animal model for the early visual processing of humans to understand the neural substrates underlying the visual motion detectors that elicit OFRs.

Short-latency ocular-following responses: Weighted nonlinear summation predicts the outcome of a competition between two sine wave gratings moving in opposite directions

We recorded horizontal ocular-following responses to pairs of superimposed vertical sine wave gratings moving in opposite directions in human subjects. This configuration elicits a nonlinear interaction: when the relative contrast of the gratings is changed, the response transitions abruptly between the responses elicited by either grating alone. We explore this interaction in pairs of gratings that differ in spatial and temporal frequency and show that all cases can be described as a weighted sum of the responses to each grating presented alone, where the weights are a nonlinear function of stimulus contrast: a nonlinear weighed summation model. The weights depended on the spatial and temporal frequency of the component grating. In many cases the dominant component was not the one that produced the strongest response when presented alone, implying that the neuronal circuits assigning weights precede the stages at which motor responses to visual motion are generated. When the stimulus area was reduced, the relationship between spatial frequency and weight shifted to higher frequencies. This finding may reflect a contribution from surround suppression. The nonlinear interaction is strongest when the two components have similar spatial frequencies, suggesting that the nonlinearity may reflect interactions within single spatial frequency channels. This framework can be extended to stimuli composed of more than two components: our model was able to predict the responses to stimuli composed of three gratings. That this relatively simple model successfully captures the ocular-following responses over a wide range of spatial/temporal frequency and contrast parameters suggests that these interactions reflect a simple mechanism.

Spatiotemporal Filter for Visual Motion Integration from Pursuit Eye Movements in Humans and Monkeys

Despite the enduring interest in motion integration, a direct measure of the space-time filter that the brain imposes on a visual scene has been elusive. This is perhaps because of the challenge of estimating a 3D function from perceptual reports in psychophysical tasks. We take a different approach. We exploit the close connection between visual motion estimates and smooth pursuit eye movements to measure stimulus-response correlations across space and time, computing the linear space-time filter for global motion direction in humans and monkeys. Although derived from eye movements, we find that the filter predicts perceptual motion estimates quite well. To distinguish visual from motor contributions to the temporal duration of the pursuit motion filter, we recorded single-unit responses in the monkey middle temporal cortical area (MT). We find that pursuit response delays are consistent with the distribution of cortical neuron latencies and that temporal motion integration for pursuit is consistent with a short integration MT subpopulation. Remarkably, the visual system appears to preferentially weight motion signals across a narrow range of foveal eccentricities rather than uniformly over the whole visual field, with a transiently enhanced contribution from locations along the direction of motion. We find that the visual system is most sensitive to motion falling at approximately one-third the radius of the stimulus aperture. Hypothesizing that the visual drive for pursuit is related to the filtered motion energy in a motion stimulus, we compare measured and predicted eye acceleration across several other target forms.SIGNIFICANCE STATEMENT A compact model of the spatial and temporal processing underlying global motion perception has been elusive. We used visually driven smooth eye movements to find the 3D space-time function that best predicts both eye movements and perception of translating dot patterns. We found that the visual system does not appear to use all available motion signals uniformly, but rather weights motion preferentially in a narrow band at approximately one-third the radius of the stimulus. Although not universal, the filter predicts responses to other types of stimuli, demonstrating a remarkable degree of generalization that may lead to a deeper understanding of visual motion processing.

A Readout Mechanism for Latency Codes

Response latency has been suggested as a possible source of information in the central nervous system when fast decisions are required. The accuracy of latency codes was studied in the past using a simplified readout algorithm termed the temporal-winner-take-all (tWTA). The tWTA is a competitive readout algorithm in which populations of neurons with a similar decision preference compete, and the algorithm selects according to the preference of the population that reaches the decision threshold first. It has been shown that this algorithm can account for accurate decisions among a small number of alternatives during short biologically relevant time periods. However, one of the major points of criticism of latency codes has been that it is unclear how can such a readout be implemented by the central nervous system. Here we show that the solution to this long standing puzzle may be rather simple. We suggest a mechanism that is based on reciprocal inhibition architecture, similar to that of the conventional winner-take-all, and show that under a wide range of parameters this mechanism is sufficient to implement the tWTA algorithm. This is done by first analyzing a rate toy model, and demonstrating its ability to discriminate short latency differences between its inputs. We then study the sensitivity of this mechanism to fine-tuning of its initial conditions, and show that it is robust to wide range of noise levels in the initial conditions. These results are then generalized to a Hodgkin-Huxley type of neuron model, using numerical simulations. Latency codes have been criticized for requiring a reliable stimulus-onset detection mechanism as a reference for measuring latency. Here we show that this frequent assumption does not hold, and that, an additional onset estimator is not needed to trigger this simple tWTA mechanism.

Contribution of color signals to ocular following responses

Ocular following responses (OFRs) are elicited at ultra-short latencies (< 60 ms) by sudden movements of the visual scene. In this study, we investigated the roles of color signals in OFRs in monkeys. To make physiologically isoluminant sinusoidal color gratings, we estimated the physiologically isoluminant points using OFRs and found that the physiologically isoluminant points were nearly independent of the spatiotemporal frequency of the gratings. We recorded OFRs induced by the motion of physiologically isoluminant color gratings and found that OFRs elicited by the motion of color gratings had different spatiotemporal frequency tuning from those elicited by the motion of luminance gratings. Additionally, OFRs to isoluminant color gratings had smaller peak responses, suggesting that color signals weakly contribute to OFRs compared with luminance signals. OFRs to the motion of stimuli composed of luminance and color signals were also examined. We found that color signals largely contributed to OFRs under low luminance signals regardless of whether color signals moved in the same or opposite direction to luminance signals. These results provide evidence of the multichannel visual computations underlying motor responses. We conclude that, in everyday situations, color information contributes cooperatively with luminance information to the generation of ocular tracking behaviors.

Ocular-following responses to white noise stimuli in humans reveal a novel nonlinearity that results from temporal sampling

White noise stimuli are frequently used to study the visual processing of broadband images in the laboratory. A common goal is to describe how responses are derived from Fourier components in the image. We investigated this issue by recording the ocular-following responses (OFRs) to white noise stimuli in human subjects. For a given speed we compared OFRs to unfiltered white noise with those to noise filtered with band-pass filters and notch filters. Removing components with low spatial frequency (SF) reduced OFR magnitudes, and the SF associated with the greatest reduction matched the SF that produced the maximal response when presented alone. This reduction declined rapidly with SF, compatible with a winner-take-all operation. Removing higher SF components increased OFR magnitudes. For higher speeds this effect became larger and propagated toward lower SFs. All of these effects were quantitatively well described by a model that combined two factors: (a) an excitatory drive that reflected the OFRs to individual Fourier components and (b) a suppression by higher SF channels where the temporal sampling of the display led to flicker. This nonlinear interaction has an important practical implication: Even with high refresh rates (150 Hz), the temporal sampling introduced by visual displays has a significant impact on visual processing. For instance, we show that this distorts speed tuning curves, shifting the peak to lower speeds. Careful attention to spectral content, in the light of this nonlinearity, is necessary to minimize the resulting artifact when using white noise patterns undergoing apparent motion.

Difference in perceptual and oculomotor responses revealed by apparent motion stimuli presented with an interstimulus interval

To understand the mechanisms underlying visual motion analyses for perceptual and oculomotor responses and their similarities/differences, we analyzed eye movement responses to two-frame animations of dual-grating 3f5f stimuli while subjects performed direction discrimination tasks. The 3f5f stimulus was composed of two sinusoids with a spatial frequency ratio of 3:5 (3f and 5f), creating a pattern with fundamental frequency f. When this stimulus was shifted by 1/4 of the wavelength, the two components shifted 1/4 of their wavelengths and had opposite directions: the 5f forward and the 3f backward. By presenting the 3f5f stimulus with various interstimulus intervals (ISIs), two visual-motion-analysis mechanisms, low-level energy-based and high-level feature-based, could be effectively distinguished. This is because response direction depends on the relative contrast between the components when the energy-based mechanism operates, but not when the feature-based mechanism works. We found that when the 3f5f stimuli were presented with shorter ISIs (<100 ms), and 3f component had higher contrast, both perceptual and ocular responses were in the direction of the pattern shift, whereas the responses were reversed when the 5f had higher contrast, suggesting operation of the energy-based mechanism. On the other hand, the ocular responses were almost negligible with longer ISIs (>100 ms), whereas perceived directions were biased toward the direction of pattern shift. These results suggest that the energy-based mechanism is dominant in oculomotor responses throughout ISIs; however, there is a transition from energy-based to feature-tracking mechanisms when we perceive visual motion.

More is not always better: adaptive gain control explains dissociation between perception and action

Moving objects generate motion information at different scales, which are processed in the visual system with a bank of spatiotemporal frequency channels. It is not known how the brain pools this information to reconstruct object speed and whether this pooling is generic or adaptive; that is, dependent on the behavioral task. We used rich textured motion stimuli of varying bandwidths to decipher how the human visual motion system computes object speed in different behavioral contexts. We found that, although a simple visuomotor behavior such as short-latency ocular following responses takes advantage of the full distribution of motion signals, perceptual speed discrimination is impaired for stimuli with large bandwidths. Such opposite dependencies can be explained by an adaptive gain control mechanism in which the divisive normalization pool is adjusted to meet the different constraints of perception and action.

Spatial summation properties of the human ocular following response (OFR): dependence upon the spatial frequency of the stimulus

Ocular following responses (OFRs) are the initial tracking eye movements that can be elicited at ultra-short latency by sudden motion of a textured pattern. The OFR magnitude depends upon stimulus size, and also upon the spatial frequency (SF) of sine-wave gratings. Here we investigate the interaction of size and SF. We recorded initial OFRs in human subjects when 1D vertical sine-wave gratings were subject to horizontal motion. Gratings were restricted to elongated horizontal apertures-"strips"-aligned with the axis of motion. In Experiment 1 the SF and the height of a single strip was manipulated. The magnitude of the OFR increased with strip height up to some optimum value, while strip heights greater than this optimum produced smaller responses. This effect was strongly dependent on SF: the optimum strip height was smaller for higher SFs. In order to explore the underlying mechanism, Experiment 2 measured OFRs to stimuli composed of two thin horizontal strips-one in the upper visual field, the other in the lower visual field-whose vertical separation varied 32-fold. Stimuli of different sizes can be reconstructed from the sum of such horizontal strips. We found that the OFRs in Experiment 1 were smaller than the sum of the responses to the component stimuli, but greater than the average of those responses. We defined an averaging coefficient that described whether a given response was closer to the sum or to the average. For any one SF, the averaging coefficients were similar over a wide range of stimulus sizes, while they varied considerably (7-fold) for stimuli of different SFs.

Ocular following in humans: spatial properties

Ocular following responses (OFRs) are tracking eye movements elicited at ultrashort latency by the sudden movement of a textured pattern. Here we report the results of our study of their dependency on the spatial arrangement of the motion stimulus. Unlike previous studies that looked at the effect of stimulus size, we investigated the impact of stimulus location and how two distinct stimuli, presented together, collectively determine the OFR. We used as stimuli vertical gratings that moved in the horizontal direction and that were confined to either one or two 0.58° high strips, spanning the width of the screen. We found that the response to individual strips varied as a function of the location and spatial frequency (SF) of the stimulus. The response decreased as the stimulus eccentricity increased, but this relationship was more accentuated at high than at low spatial frequencies. We also found that when pairs of stimuli were presented, nearby stimuli interacted strongly, so that the response to the pair was barely larger than the response to a single strip in the pair. This suppressive effect faded away as the separation between the strips increased. The variation of the suppressive interaction with strip separation, paired with the dependency on eccentricity of the responses to single strips, caused the peak response for strip pairs to be achieved at a specific separation, which varied as a function of SF.

Principal Fourier component of motion stimulus dominates the initial optokinetic response in mice

Optokinetic responses (OKRs) are reflexive eye movements elicited by a moving visual pattern, and have been recognized in a variety of species. Several brainstem and cortical structures are known to be implicated in the generation of OKRs in primates, while the OKRs of afoveate mammals have been posited to be dominated by subcortical structures. To understand the subcortical mechanism underlying OKRs, the initial OKRs to horizontal quarter-wavelength steps applied to vertical grating patterns were studied in adult C57BL/6J mice under the monocular viewing conditions. The initial OKRs to sinusoidal gratings showed directional asymmetry with temporal-to-nasal predominance, a common characteristic of afoveate mammals that uses the subcortical structures to elicit OKRs. We then examined whether the OKRs of afoveate mammals are driven by the same visual features of the moving images as those in primates. The OKRs in mice were elicited by using the missing fundamental (mf) stimuli and its variants that had been used to understand the mechanism(s) underlying the cortical control of eye movements in primates. We obtained the results indicating that the OKRs of mice are driven by the principal Fourier component of moving visual image as in primates despite the differences in neural circuitries.

Dissociating the role of prefrontal and premotor cortices in controlling inhibitory mechanisms during motor preparation

Top-down control processes are critical to select goal-directed actions in flexible environments. In humans, these processes include two inhibitory mechanisms that operate during response selection: one is involved in solving a competition between different response options, the other ensures that a selected response is initiated in a timely manner. Here, we evaluated the role of dorsal premotor cortex (PMd) and lateral prefrontal cortex (LPF) of healthy subjects in these two forms of inhibition by using an innovative transcranial magnetic stimulation (TMS) protocol combining repetitive TMS (rTMS) over PMd or LPF and a single pulse TMS (sTMS) over primary motor cortex (M1). sTMS over M1 allowed us to assess inhibitory changes in corticospinal excitability, while rTMS was used to produce transient disruption of PMd or LPF. We found that rTMS over LPF reduces inhibition associated with competition resolution, whereas rTMS over PMd decreases inhibition associated with response impulse control. These results emphasize the dissociable contributions of these two frontal regions to inhibitory control during motor preparation. The association of LPF with competition resolution is consistent with the role of this area in relatively abstract aspects of control related to goal maintenance, ensuring that the appropriate response is selected in a variable context. In contrast, the association of PMd with impulse control is consistent with the role of this area in more specific processes related to motor preparation and initiation.

Sensory versus motor loci for integration of multiple motion signals in smooth pursuit eye movements and human motion perception

We have investigated how visual motion signals are integrated for smooth pursuit eye movements by measuring the initiation of pursuit in monkeys for pairs of moving stimuli of the same or differing luminance. The initiation of pursuit for pairs of stimuli of the same luminance could be accounted for as a vector average of the responses to the two stimuli singly. When stimuli comprised two superimposed patches of moving dot textures, the brighter stimulus suppressed the inputs from the dimmer stimulus, so that the initiation of pursuit became winner-take-all when the luminance ratio of the two stimuli was 8 or greater. The dominance of the brighter stimulus could be not attributed to either the latency difference or the ratio of the eye accelerations for the bright and dim stimuli presented singly. When stimuli comprised either spot targets or two patches of dots moving across separate locations in the visual field, the brighter stimulus had a much weaker suppressive influence; the initiation of pursuit could be accounted for by nearly equal vector averaging of the responses to the two stimuli singly. The suppressive effects of the brighter stimulus also appeared in human perceptual judgments, but again only for superimposed stimuli. We conclude that one locus of the interaction of two moving visual stimuli is shared by perception and action and resides in local inhibitory connections in the visual cortex. A second locus resides deeper in sensory-motor processing and may be more closely related to action selection than to stimulus selection.

Representation of concurrent stimuli by population activity in visual cortex

How do neuronal populations represent concurrent stimuli? We measured population responses in cat primary visual cortex (V1) using electrode arrays. Population responses to two superimposed gratings were weighted sums of the individual grating responses. The weights depended strongly on the relative contrasts of the gratings. When the contrasts were similar, the population performed an approximately equal summation. When the contrasts differed markedly, however, the population performed approximately a winner-take-all competition. Stimuli that were intermediate to these extremes elicited intermediate responses. This entire range of behaviors was explained by a single model of contrast normalization. Normalization captured both the spike responses and the local field potential responses; it even predicted visually evoked currents source-localized to V1 in human subjects. Normalization has profound effects on V1 population responses and is likely to shape the interpretation of these responses by higher cortical areas.

How Motion Signals Are Integrated Across Frequencies: Study on Motion Perception and Ocular Following Responses Using Multiple-Slit Stimuli

Visual motion signals, which are initially extracted in parallel at multiple spatial frequencies, are subsequently integrated into a unified motion percept. Cross-frequency integration plays a crucial role when directional information conflicts across frequencies due to such factors as occlusion. We investigated the human observers' open-loop oculomotor tracking responses (ocular following responses, or OFRs) and the perceived motion direction in an idealized situation of occlusion—multiple-slits viewing (MSV)—in which a moving pattern is visible only through an array of slits. We also tested a more challenging viewing condition, contrast-alternating MSV (CA-MSV), in which the contrast polarity of the moving pattern alternates when it passes the slits. We found that changes in the distribution of the spectral content of the slit stimuli, introduced by variations of both the interval between the slits and the frame rate of the image stream, modulated the OFR and the reported motion direction in a rather complex manner. We show that those complex modulations could be explained by the weighted sum of the motion signal (motion contrast) of each spatiotemporal frequency. The estimated distribution of frequency weights (tuning maps) indicate that the cross-frequency integration of supra-threshold motion signals gives strong weight to low spatial frequency components (<0.25 cpd) for both OFR and motion perception. However, the tuning map estimated with the MSV stimuli were significantly different from those estimated with the CA-MSV (and from those measured in a more direct manner using grating stimuli), suggesting that inter-frequency interactions (e.g., interaction producing speed-dependent tuning) was involved.

The initial torsional Ocular Following Response (tOFR) in humans: a response to the total motion energy in the stimulus?

We recorded the initial torsional Ocular Following Responses (tOFRs) elicited at short latency by visual images that occupied the frontal plane and rotated about the lines of sight. Using 1-D radial gratings, the local spatio-temporal characteristics of these tOFRs closely resembled those we previously reported for the hOFRs to horizontal motion with 1-D vertical gratings. When the 1-D radial grating was subdivided into a number of concentric annuli, each with the same radial thickness, tOFRs were less than predicted from the sum of the responses to the individual annuli: spatial normalization. However, the normalization was much weaker than that which we previously reported for the hOFRs. Further, when the number, thickness and contrast of these concentric annuli were varied systematically, the latency and magnitude of the tOFRs were well described by single monotonic functions when plotted against the product of the total area of the annuli and the square of their Michelson contrast ("A*C(2)"), consistent with the hypothesis that the onset and magnitude of the initial tOFR are determined by the total motion energy in the stimulus. When our previously published hOFR data were plotted against A*C(2), a single monotonic function sufficed to describe the latency but not the magnitude.

The effects of prolonged viewing of motion on short-latency ocular following responses

The adaptive effects of prolonged viewing of conditioning motion on ocular following responses (OFRs) elicited by brief test motion of a random-dot pattern were studied in humans. We found that the OFRs were significantly reduced when the directions of the conditioning and test motions were the same. The effect of conditioning motion was still observed when the speeds of the conditioning and test motions did not match. The effect was larger when the conditioning duration was longer, and decayed over time with increased temporal separation between the conditioning and test periods. These results are consistent with the characteristics of motion adaptation on the initial smooth pursuit responses. We also obtained data suggesting that the persistence of the effect depends on visual stimulation in the time between the conditioning and test periods, and that the presence of a stationary visual stimulus facilitates recovery from the motion adaptation.

The initial disparity vergence elicited with single and dual grating stimuli in monkeys: evidence for disparity energy sensing and nonlinear interactions

We recorded the initial vertical vergence eye movements elicited in monkeys at short latency ( approximately 70 ms) when the two eyes see one-dimensional (1D) horizontal grating patterns that are identical except for a phase difference (disparity) of one-quarter wavelength. With gratings composed of single sine waves, responses were always compensatory, showing Gaussian dependence on log spatial frequency (on average: peak = 0.75 cycles/deg; SD = 0.74; r(2) = 0.980) and monotonic dependence on log contrast with a gradual saturation well described by the Naka-Rushton equation (on average: n = 0.89; C(50) = 4.1%; r(2) = 0.978). With gratings composed of two sine waves whose spatial frequencies were in the ratio 3:5 and whose disparities were of opposite sign (the 3f5f stimulus), responses were determined by the disparities and contrasts of the two sine-wave components rather than the disparity of the features, consistent with early spatial filtering of the monocular inputs before their binocular combination and mediation by detectors sensitive to disparity energy. In addition, responses to the 3f5f stimulus showed a nonlinear dependence on the relative contrasts of the two sine waves. Thus on average, when the contrast of one sine wave was 2.3 times greater than that of the other, the one with the lower contrast was largely ineffective as though suppressed, and responses were determined almost entirely by the sine wave of higher contrast: Winner-Take-All. These findings are very similar to those published previously on the vertical vergence responses of humans, indicating that the monkey provides a good animal model for studying these disparity vergence responses.

Spatial summation properties of the human ocular following response (OFR): evidence for nonlinearities due to local and global inhibitory interactions

Ocular following responses (OFRs) are the initial tracking eye movements that can be elicited at ultra-short latency by sudden motion of a textured pattern. A recent study used motion stimuli consisting of two large coextensive sine-wave gratings with the same orientation but different spatial frequency and moving in (1/4)-wavelength steps in the same or opposite directions: when the two gratings differed in contrast by more than about an octave then the one with the higher contrast completely dominated the OFR and the one with lower contrast lost its influence as though suppressed [Sheliga, B. M., Kodaka, Y., FitzGibbon, E. J., & Miles, F. A. (2006). Human ocular following initiated by competing image motions: Evidence for a winner-take-all mechanism. Vision Research, 46, 2041-2060]. This winner-take-all (WTA) outcome was attributed to nonlinear interactions in the form of mutual inhibition between the mechanisms sensing the competing motions. In the present study, we recorded the initial horizontal OFRs to the horizontal motion of two vertical sine-wave gratings that differed in spatial frequency and were each confined to horizontal strips that extended the full width of our display (45 degrees ) but were only 1-2 degrees high. The two gratings could be coextensive or separated by a vertical gap of up to 8 degrees , and each underwent motion consisting of successive (1/4)-wavelength steps. Initial OFRs showed strong dependence on the relative contrasts of the competing gratings and when these were coextensive this dependence was always highly nonlinear (WTA), regardless of whether the two gratings moved in the same or opposite direction. When the two gratings moved in opposite directions the nonlinear interactions were purely local: with a vertical gap of 1 degrees or more between the gratings OFRs approximated the linear sum of the responses to each grating alone. On the other hand, when the two gratings moved in the same direction the nonlinear interactions were more global: even with a gap of 8 degrees -the largest separation tried-OFRs were still substantially less than predicted by the linear sum. When the motions were in the same direction, we postulate two nonlinear interactions: local mutual inhibition (resulting in WTA) and global divisive inhibition (resulting in normalization). Motion stimuli whose responses were totally suppressed by coextensive opponent motion of higher contrast were rendered invisible to normalization, suggesting that the local interactions responsible for the WTA behavior here occur at an earlier stage of neural processing than the global interactions responsible for normalization.

Eye Movements in Response to Dichoptic Motion: Evidence for a Parallel-Hierarchical Structure of Visual Motion Processing in Primates

Brief movements of a large-field visual stimulus elicit short-latency tracking eye movements termed “ocular following responses” (OFRs). To address the question of whether OFRs can be elicited by purely binocular motion signals in the absence of monocular motion cues, we measured OFRs from monkeys using dichoptic motion stimuli, the monocular inputs of which were flickering gratings in spatiotemporal quadrature, and compared them with OFRs to standard motion stimuli including monocular motion cues. Dichoptic motion did elicit OFRs, although with longer latencies and smaller amplitudes. In contrast to these findings, we observed that other types of motion stimuli categorized as non-first-order motion, which is undetectable by detectors for standard luminance-defined (first-order) motion, did not elicit OFRs, although they did evoke the sensation of motion. These results indicate that OFRs can be driven solely by cortical visual motion processing after binocular integration, which is distinct from the process incorporating non-first-order motion for elaborated motion perception. To explore the nature of dichoptic motion processing in terms of interaction with monocular motion processing, we further recorded OFRs from both humans and monkeys using our novel motion stimuli, the monocular and dichoptic motion signals of which move in opposite directions with a variable motion intensity ratio. We found that monocular and dichoptic motion signals are processed in parallel to elicit OFRs, rather than suppressing each other in a winner-take-all fashion, and the results were consistent across the species.

Ocular following responses of monkeys to the competing motions of two sinusoidal gratings

Ocular following responses (OFRs) were elicited in monkeys at short latencies ( approximately 50ms) by applying motion in the form of successive 1/4-wavelength steps to each of two overlapping vertical sine-wave gratings that had different spatial frequencies. In the first experiment, the two sine waves had spatial frequencies in the ratio 3:5 and moved in opposite directions. The initial OFRs showed a highly nonlinear dependence on the relative contrasts of the competing sine waves. On average, when the contrast of one was less than a third of that of the other then the one with the lower contrast became ineffective - as though suppressed - and the OFR was entirely determined by the sine wave of higher contrast: winner-take-all. In a second experiment, the two sine waves had spatial frequencies in the ratio 3:7 and moved in the same direction (though at different speeds). The initial OFRs again showed a highly nonlinear dependence on the relative contrasts of the competing sine waves, with a winner-take-all outcome when the contrasts of the two sine waves were sufficiently different. In both experiments, the nonlinear dependence on the relative contrasts of the competing sine waves was well described by a contrast-weighted-average model with just two free parameters. These findings were very similar to those of [Sheliga, B.M., Kodaka, Y., FitzGibbon, E.J., Miles, F.A., 2006c. Human ocular following initiated by competing image motions: evidence for a winner-take-all mechanism. Vision Res. 46, 2041-2060] on the human OFR, indicating that the monkey is a good animal model for studying the nonlinear interactions that emerge when competing motions are used.

The vergence eye movements induced by radial optic flow: some fundamental properties of the underlying local-motion detectors

Radial optic flow applied to large random dot patterns is known to elicit horizontal vergence eye movements at short latency, expansion causing convergence and contraction causing divergence: the Radial Flow Vergence Response (RFVR). We elicited RFVRs in human subjects by applying radial motion to concentric circular patterns whose radial luminance modulation was that of a square wave lacking the fundamental: the missing fundamental (mf) stimulus. The radial motion consisted of successive 1/4-wavelength steps, so that the overall pattern and the 4n+1 harmonics (where n=integer) underwent radial expansion (or contraction), whereas the 4n-1 harmonics--including the strongest Fourier component (the 3rd harmonic)--underwent the opposite radial motion. Radial motion commenced only after the subject had fixated the center of the pattern. The initial RFVRs were always in the direction of the 3rd harmonic, e.g., expansion of the mf pattern causing divergence. Thus, the earliest RFVRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. If the radial mf stimulus was reduced to just two competing harmonics--the 3rd and 5th--the initial RFVRs showed a nonlinear dependence on their relative contrasts: when the two harmonics differed in contrast by more than about an octave then the one with the higher contrast completely dominated the RFVRs and the one with lower contrast lost its influence: winner-take-all. We suggest that these nonlinear interactions result from mutual inhibition between the mechanisms sensing the motion of the different competing harmonics. If single radial-flow steps were used, a brief inter-stimulus interval resulted in reversed RFVRs, consistent with the idea that the motion detectors mediating these responses receive a visual input whose temporal impulse response function is strongly biphasic. Lastly, all of these characteristics of the RFVR, which we attribute to the early cortical processing of visual motion, are known to be shared by the Ocular Following Response (OFR)--a conjugate tracking (version) response elicited at short-latency by linear motion-and even the quantitative details are generally very similar. Thus, although the RFVR and OFR respond to very different patterns of global motion-radial vs. linear-they have very similar local spatiotemporal properties as though mediated by the same low-level, local-motion detectors, which we suggest are in the striate cortex.

Human vergence eye movements initiated by competing disparities: evidence for a winner-take-all mechanism

Vergence eye movements were elicited in human subjects at short latencies (approximately 70 ms) by applying binocular disparities briefly (200 ms) to large grating patterns (46 degrees wide, 35 degrees high). The positions of both eyes were recorded with the electromagnetic search coil technique. Using a dichoptic viewing arrangement (Wheatstone stereoscope), each eye viewed two overlapping 1-D sine waves that had the same orientation but different spatial frequencies. These two sine waves each had a binocular disparity that was 1/4 of its wavelength and the effect of varying their relative contrasts was examined (15 contrast ratios ranging from 0.125 to 8). The first experiment used horizontal gratings and recorded the vertical vergence responses when the two sine waves had spatial frequencies in the ratio 3:5 and vertical disparities of opposite sign. Initial vergence responses showed a highly nonlinear dependence on the contrast ratio. On average, when the contrast of one sine wave exceeded that of the other by a factor of >2.2, the sine wave with the higher contrast dominated responses and the sine wave with the lower contrast had almost no influence: winner-take-all. A second experiment, which used vertical gratings and recorded the horizontal vergence responses when the two sine waves had spatial frequencies in the ratio 3:5 and horizontal disparities of opposite sign, also uncovered nonlinear interactions but these were much more variable from one subject to another and, on average, one sine wave did not achieve complete dominance until its contrast exceeded that of the other by a factor of >4.5. When these two experiments were repeated with grating patterns in which the two sine waves had spatial frequencies in the ratio 3:7 and disparities of the same sign, similar nonlinear interactions were apparent. We attribute the nonlinear dependence on relative contrast to mutual inhibition between the neural elements processing the disparities of the two sine waves. We further suggest that this interaction will help to maintain binocular alignment on the objects in the plane of regard because the retinal images of those objects will tend to be better focused-and hence tend to have higher contrasts-than the images of objects in other depth planes.

Short-latency disparity vergence eye movements: a response to disparity energy

Vergence eye movements were elicited in human subjects by applying disparities to square-wave gratings lacking the fundamental ("missing fundamental", mf). Using a dichoptic arrangement, subjects viewed gratings that were identical at the two eyes except for a phase difference of 1/4 wavelength so that, based on the nearest-neighbor matches, the features and the 4n+1 harmonics (5th, 9th, etc.) all had binocular disparities of one sign, whereas the 4n-1 harmonics (3rd, 7th, etc.) all had disparities of the opposite sign. Further, the amplitude of the ith harmonic was proportional to 1/i. Using the electromagnetic search coil technique to record the positions of both eyes indicated that the earliest vergence eye movements elicited by these disparity stimuli had ultra-short latencies (minimum, <65 ms) and were always in the direction of the most prominent harmonic, the 3rd, but their magnitudes fell short of those elicited when the same disparities were applied to pure sinusoids whose spatial frequency and contrast matched those of the 3rd harmonic. This shortfall was evident in both the horizontal vergence responses recorded with vertical grating stimuli and the vertical vergence responses recorded with horizontal grating stimuli. When the next most prominent harmonic, the 5th, was removed from the mf stimulus (creating the "mf-5" stimulus) the vertical vergence responses showed almost no shortfall-indicating that it had been almost entirely due to that 5th harmonic-but the horizontal vergence responses still showed a small shortfall, at least with higher contrast stimuli. This small shortfall might represent a very minor contribution from higher harmonics and/or distortion products and/or a feature-based mechanism. We conclude that the earliest disparity vergence responses-especially vertical-were strongly dependent on the major Fourier components of the binocular images, consistent with early spatial filtering of the monocular visual inputs prior to their binocular combination as in the disparity-energy model of complex cells in striate cortex [Ohzawa, I., DeAngelis, G. C., & Freeman, R. D. (1990). Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. Science, 249, 1037-1041].

Spatiotemporal tuning of rapid interactions between visual-motion analysis and reaching movement

In addition to the goal-directed preplanned control, which strongly governs reaching movements, another type of control mechanism is suggested by recent findings that arm movements are rapidly entrained by surrounding visual motion. It remains, however, controversial whether this rapid manual response is generated in a goal-oriented manner similarly to preplanned control or is reflexively and directly induced by visual motion. To investigate the sensorimotor process underlying rapid manual responses induced by large-field visual motion, we examined the effects of contrast and spatiotemporal frequency of the visual-motion stimulus. The manual response amplitude increased steeply with image contrast up to 10% and leveled off thereafter. Regardless of the spatial frequency, the response amplitude increased almost proportionally to the logarithm of stimulus speed until the temporal frequency reached 15-20 Hz and then fell off. The maximum response was obtained at the lowest spatial frequency we examined (0.05 cycles/degrees). These stimulus specificities are surprisingly similar to those of the reflexive ocular-following response induced by visual motion, although there is no direct motor entrainment from the ocular to manual responses. In addition, the spatiotemporal tuning is clearly different from that of perceptual effects caused by visual motion. These comparisons suggest that the rapid manual response is generated by a reflexive sensorimotor mechanism. This mechanism shares a distinctive visual-motion processing stage with the reflexive control for other motor systems yet is distinct from visual-motion perception.