The vergence eye movements induced by radial optic flow: some fundamental properties of the underlying local-motion detectors

Convergence and divergence to radial optic flow in infancy

Research finds a relationship between the development of depth perception and ocular motion functions including smooth pursuit and ocular following response. Infants' reactions to looming stimuli also suggest sensitivity to optic flow information that specifies relative distance. With radial optic flow, an expanding flow field elicits involuntary convergent eye movements while a contracting one elicits involuntary divergent eye movements. This response suggests the visual system is interpreting the radial flow as a change in relative depth. We measured the oculomotor response to radial optic flow in infants aged two to five months. The stimulus comprised a radial optic flow pattern that expanded or contracted across eight 400 ms trials while eye position was monitored with a Tobii X120 eye tracker. A subset of infants also viewed trials of a static version of the stimulus. On average, most infants in each age group demonstrated convergence to the expanding pattern and divergence to the contracting one. Moreover, the difference in gain between the convergence and divergence eye movements was significant. The presence of correct-direction vergence eye movements in response to expansion and contraction provides further evidence that infants are sensitive to information that specifies relative motion in depth.

A Rhesus Monkey With a Naturally Occurring Impairment of Disparity Vergence. II. Abnormal Near Response Cell Activity in the Supraoculomotor Area

Purpose

Convergence insufficiency is a very common disorder that can have significant adverse effects on school performance. When reading, children with this disorder often experience diplopia and headaches. We have recently obtained a rhesus monkey with a naturally occurring impairment of vergence eye movements. In the companion paper, we report behavioral testing that shows a pattern of impairments similar to what clinicians observe in human children with convergence insufficiency, including a receded near point, an exophoria that increases as target distance decreases, and difficulty maintaining an appropriate vergence angle when presented with a large field stimulus at near. For the present case report, we wondered whether these behavioral deficits would be associated with abnormal discharge patterns in brainstem neurons related to vergence eye movements.

Methods

Single unit activity was recorded from near and far response cells in the supraoculomotor area in the vergence-impaired monkey, while he performed a smooth vergence tracking task or fixated visual targets at different distances.

Results

We found an abnormally weak sensitivity to both vergence angle and vergence velocity. Nonetheless, these neurons modulated in association with contextually inappropriate slow vergence movements that occurred in the absence of saccades but not for slow divergence drifts that immediately followed converging saccades. Modulation of activity was more robust when additional depth cues were available.

Conclusions

These data suggest that disorders affecting vergence eye movements may be associated with impoverished sensory input to the near and far response cells and, perhaps, aberrant tuning in vergence-related neurons.

Retinal visual processing constrains human ocular following response

Ocular following responses (OFRs) are the initial tracking eye movements elicited at ultra-short latency by sudden motion of a textured pattern. We wished to evaluate quantitatively the impact that subcortical stages of visual processing might have on the OFRs. In three experiments we recorded the OFRs of human subjects to brief horizontal motion of 1D vertical sine-wave gratings restricted to an elongated horizontal aperture. Gratings were composed of a variable number of abutting horizontal strips where alternate strips were in counterphase. In one of the experiments we also utilized gratings occupying a variable number of horizontal strips separated vertically by mean-luminance gaps. We modeled retinal center/surround receptive fields as a difference of two 2-D Gaussian functions. When the characteristics of such local filters were selected in accord with the known properties of primate retinal ganglion cells, a single-layer model was capable to quantitatively account for the observed changes in the OFR amplitude for stimuli composed of counterphase strips of different heights (Experiment 1), for a wide range of stimulus contrasts (Experiment 2) and spatial frequencies (Experiment 3). A similar model using oriented filters that resemble cortical simple cells was also able to account for these data. Since similar filters can be constructed from the linear summation of retinal filters, and these filters alone can explain the data, we conclude that retinal processing determines the response to these stimuli. Thus, with appropriately chosen stimuli, OFRs can be used to study visual spatial integration processes as early as in the retina.

Spatial summation properties of the human ocular following response (OFR): dependence upon the spatial frequency of the stimulus

Ocular following responses (OFRs) are the initial tracking eye movements that can be elicited at ultra-short latency by sudden motion of a textured pattern. The OFR magnitude depends upon stimulus size, and also upon the spatial frequency (SF) of sine-wave gratings. Here we investigate the interaction of size and SF. We recorded initial OFRs in human subjects when 1D vertical sine-wave gratings were subject to horizontal motion. Gratings were restricted to elongated horizontal apertures-"strips"-aligned with the axis of motion. In Experiment 1 the SF and the height of a single strip was manipulated. The magnitude of the OFR increased with strip height up to some optimum value, while strip heights greater than this optimum produced smaller responses. This effect was strongly dependent on SF: the optimum strip height was smaller for higher SFs. In order to explore the underlying mechanism, Experiment 2 measured OFRs to stimuli composed of two thin horizontal strips-one in the upper visual field, the other in the lower visual field-whose vertical separation varied 32-fold. Stimuli of different sizes can be reconstructed from the sum of such horizontal strips. We found that the OFRs in Experiment 1 were smaller than the sum of the responses to the component stimuli, but greater than the average of those responses. We defined an averaging coefficient that described whether a given response was closer to the sum or to the average. For any one SF, the averaging coefficients were similar over a wide range of stimulus sizes, while they varied considerably (7-fold) for stimuli of different SFs.

Selective defects of visual tracking in progressive supranuclear palsy (PSP): implications for mechanisms of motion vision

Smooth ocular tracking of a moving visual stimulus comprises a range of responses that encompass the ocular following response (OFR), a pre-attentive, short-latency mechanism, and smooth pursuit, which directs the retinal fovea at the moving stimulus. In order to determine how interdependent these two forms of ocular tracking are, we studied vertical OFR in progressive supranuclear palsy (PSP), a parkinsonian disorder in which vertical smooth pursuit is known to be impaired. We measured eye movements of 9 patients with PSP and 12 healthy control subjects. Subjects viewed vertically moving sine-wave gratings that had a temporal frequency of 16.7 Hz, contrast of 32%, and spatial frequencies of 0.17, 0.27 or 0.44 cycles/degree. We measured OFR amplitude as change in eye position in the 70-150 ms, open-loop interval following stimulus onset. Vertical smooth pursuit was studied as subjects attempted to track a 0.27 cycles/degree grating moving sinusoidally through several cycles at frequencies between 0.1 and 2.5 Hz. We found that OFR amplitude, and its dependence on spatial frequency, was similar in PSP patients (group mean 0.10 degree) and control subjects (0.11 degree), but the latency to onset of OFR was greater for PSP patients (group mean 99 ms) than control subjects (90 ms). When OFR amplitude was re-measured, taking into account the increased latency in PSP patients, there was still no difference from control subjects. We confirmed that smooth pursuit was consistently impaired in PSP; group mean tracking gain at 0.7 Hz was 0.29 for PSP patients and 0.63 for controls. Neither PSP patients nor control subjects showed any correlation between OFR amplitude and smooth-pursuit gain. We propose that OFR is spared because it is generated by low-level motion processing that is dependent on posterior cerebral cortex, which is less affected in PSP. Conversely, smooth pursuit depends more on projections from frontal cortex to the pontine nuclei, both of which are involved in PSP. The accessory optic pathway, which is heavily involved in PSP, seems unlikely to contribute to the OFR in humans.

The initial torsional Ocular Following Response (tOFR) in humans: a response to the total motion energy in the stimulus?

We recorded the initial torsional Ocular Following Responses (tOFRs) elicited at short latency by visual images that occupied the frontal plane and rotated about the lines of sight. Using 1-D radial gratings, the local spatio-temporal characteristics of these tOFRs closely resembled those we previously reported for the hOFRs to horizontal motion with 1-D vertical gratings. When the 1-D radial grating was subdivided into a number of concentric annuli, each with the same radial thickness, tOFRs were less than predicted from the sum of the responses to the individual annuli: spatial normalization. However, the normalization was much weaker than that which we previously reported for the hOFRs. Further, when the number, thickness and contrast of these concentric annuli were varied systematically, the latency and magnitude of the tOFRs were well described by single monotonic functions when plotted against the product of the total area of the annuli and the square of their Michelson contrast ("A*C(2)"), consistent with the hypothesis that the onset and magnitude of the initial tOFR are determined by the total motion energy in the stimulus. When our previously published hOFR data were plotted against A*C(2), a single monotonic function sufficed to describe the latency but not the magnitude.

Monocular vision and increased distance reducing the effects of visual manipulation on body sway

The goal of this study was to examine the coupling between visual information and body sway with binocular and monocular vision at two distances from the front wall of a moving room. Ten participants stood as still as possible inside of a moving room facing the front wall in conditions that combined room movement with monocular/binocular vision and distance from the front wall (75 and 150cm). Visual information effect on body sway decreased with monocular vision and with increased distance from the front wall. In addition, the combination of monocular vision with the farther distance resulted in the smallest body sway response to the driving stimulus provided by the moving room. These results suggest that binocular vision near the front wall provides visual information of a better quality than the monocular vision far from the front wall. We discuss the results with respect to two modes of visual detection of body sway: ocular and extraocular.

Effect of vergence on human ocular following response (OFR)

The human ocular following response (OFR) is a preattentive, short-latency visual-field-holding mechanism, which is enhanced if the moving stimulus is applied in the wake of a saccade. Since most natural gaze shifts incorporate both saccadic and vergence components, we asked whether the OFR was also enhanced during vergence. Ten subjects viewed vertically moving sine-wave gratings on a video monitor at 45 cm that had a temporal frequency of 16.7 Hz, contrast of 32%, and spatial frequency of 0.17, 0.27, or 0.44 cycle/deg. In Fixation/OFR experiments, subjects fixed on a white central dot on the video monitor, which disappeared at the beginning of each trial, just as the sinusoidal grating started moving up or down. We measured the change in eye position in the 70- to 150-ms open-loop interval following stimulus onset. Group mean downward responses were larger (0.14 degrees) and made at shorter latency (85 ms) than upward responses (0.10 degrees and 96 ms). The direction of eye drifts during control trials, when gratings remained stationary, was unrelated to the prior response. During vergence/OFR experiments, subjects switched their fixation point between the white dot at 45 cm and a red spot at 15 cm, cued by the disappearance of one target and appearance of the other. When horizontal vergence velocity exceeded 15 degrees/s, motion of sinusoidal gratings commenced and elicited the vertical OFR. Subjects showed significantly (P<0.001) larger OFR when the moving stimulus was presented during convergence (group mean increase of 46%) or divergence (group mean increase of 36%) compared with following fixation. Since gaze shifts between near and far are common during natural activities, we postulate that the increase of OFR during vergence movements reflects enhancement of early cortical motion processing, which serves to stabilize the visual field as the eyes approach their new fixation point.

Human vergence eye movements to oblique disparity stimuli: evidence for an anisotropy favoring horizontal disparities

Binocular disparities applied to large-field patterns elicit vergence eye movements at ultra-short latencies. We used the electromagnetic search coil technique to record the horizontal and vertical positions of both eyes while subjects briefly viewed (150 ms) large patterns that were identical at the two eyes except for a difference in position (binocular disparity) that was varied in direction from trial to trial. For accurate alignment with the stimuli, the horizontal and vertical disparity vergence responses (HDVRs, VDVRs) should vary as the sine and cosine, respectively, of the direction of the disparity stimulus vector. In a first experiment, using random-dots patterns (RDs) with a binocular disparity of 0.2 degrees , this was indeed the case. In a second experiment, using 1-D sine-wave gratings with a binocular phase difference (disparity) of 1/4-wavelength, it was not the case: HDVRs were maximal when the grating was vertical and showed little decrement until the grating was oriented more than approximately 65 degrees away from vertical, whereas VDVRs were maximal when the grating was horizontal and began to decrement roughly linearly when the grating was oriented away from the horizontal. We attribute these complex directional dependencies with gratings to the aperture problem, and the HDVR data strongly resemble the stereothresholds for 1-D gratings, which are minimal when the gratings are vertical and remain constant for orientations up to approximately 80 degrees away from the vertical when expressed as spatial phase disparities [Morgan, M. J., & Castet, E. (1997). The aperture problem in stereopsis. Vision Research, 37, 2737-2744.]. To explain this constancy of stereothresholds, Morgan and Castet (1997) postulated detectors sensitive to the phase disparity of the gratings seen by the two eyes (rather than their linear separation along some fixed axis, such as the horizontal). However, because (1) our VDVR data with gratings did not show this constancy and (2) the available evidence strongly suggests that there are no major differences in the disparity detectors mediating the initial HDVR and VDVR, we sought an alternative explanation for our data. We show that the dependence of the initial HDVR and VDVR on grating orientation can be successfully modeled by a bias in the number and/or efficacy of the detectors that favors horizontal disparities.

The initial disparity vergence elicited with single and dual grating stimuli in monkeys: evidence for disparity energy sensing and nonlinear interactions

We recorded the initial vertical vergence eye movements elicited in monkeys at short latency ( approximately 70 ms) when the two eyes see one-dimensional (1D) horizontal grating patterns that are identical except for a phase difference (disparity) of one-quarter wavelength. With gratings composed of single sine waves, responses were always compensatory, showing Gaussian dependence on log spatial frequency (on average: peak = 0.75 cycles/deg; SD = 0.74; r(2) = 0.980) and monotonic dependence on log contrast with a gradual saturation well described by the Naka-Rushton equation (on average: n = 0.89; C(50) = 4.1%; r(2) = 0.978). With gratings composed of two sine waves whose spatial frequencies were in the ratio 3:5 and whose disparities were of opposite sign (the 3f5f stimulus), responses were determined by the disparities and contrasts of the two sine-wave components rather than the disparity of the features, consistent with early spatial filtering of the monocular inputs before their binocular combination and mediation by detectors sensitive to disparity energy. In addition, responses to the 3f5f stimulus showed a nonlinear dependence on the relative contrasts of the two sine waves. Thus on average, when the contrast of one sine wave was 2.3 times greater than that of the other, the one with the lower contrast was largely ineffective as though suppressed, and responses were determined almost entirely by the sine wave of higher contrast: Winner-Take-All. These findings are very similar to those published previously on the vertical vergence responses of humans, indicating that the monkey provides a good animal model for studying these disparity vergence responses.

Spatial summation properties of the human ocular following response (OFR): evidence for nonlinearities due to local and global inhibitory interactions

Ocular following responses (OFRs) are the initial tracking eye movements that can be elicited at ultra-short latency by sudden motion of a textured pattern. A recent study used motion stimuli consisting of two large coextensive sine-wave gratings with the same orientation but different spatial frequency and moving in (1/4)-wavelength steps in the same or opposite directions: when the two gratings differed in contrast by more than about an octave then the one with the higher contrast completely dominated the OFR and the one with lower contrast lost its influence as though suppressed [Sheliga, B. M., Kodaka, Y., FitzGibbon, E. J., & Miles, F. A. (2006). Human ocular following initiated by competing image motions: Evidence for a winner-take-all mechanism. Vision Research, 46, 2041-2060]. This winner-take-all (WTA) outcome was attributed to nonlinear interactions in the form of mutual inhibition between the mechanisms sensing the competing motions. In the present study, we recorded the initial horizontal OFRs to the horizontal motion of two vertical sine-wave gratings that differed in spatial frequency and were each confined to horizontal strips that extended the full width of our display (45 degrees ) but were only 1-2 degrees high. The two gratings could be coextensive or separated by a vertical gap of up to 8 degrees , and each underwent motion consisting of successive (1/4)-wavelength steps. Initial OFRs showed strong dependence on the relative contrasts of the competing gratings and when these were coextensive this dependence was always highly nonlinear (WTA), regardless of whether the two gratings moved in the same or opposite direction. When the two gratings moved in opposite directions the nonlinear interactions were purely local: with a vertical gap of 1 degrees or more between the gratings OFRs approximated the linear sum of the responses to each grating alone. On the other hand, when the two gratings moved in the same direction the nonlinear interactions were more global: even with a gap of 8 degrees -the largest separation tried-OFRs were still substantially less than predicted by the linear sum. When the motions were in the same direction, we postulate two nonlinear interactions: local mutual inhibition (resulting in WTA) and global divisive inhibition (resulting in normalization). Motion stimuli whose responses were totally suppressed by coextensive opponent motion of higher contrast were rendered invisible to normalization, suggesting that the local interactions responsible for the WTA behavior here occur at an earlier stage of neural processing than the global interactions responsible for normalization.

Differential projections from the vestibular nuclei to the flocculus and uvula-nodulus in pigeons (Columba livia)

The pigeon vestibulocerebellum is divided into two regions based on the responses of Purkinje cells to optic flow stimuli: the uvula-nodulus responds best to self-translation, and the flocculus responds best to self-rotation. We used retrograde tracing to determine whether the flocculus and uvula-nodulus receive differential mossy fiber input from the vestibular and cerebellar nuclei. From retrograde injections into the both the flocculus and uvula-nodulus, numerous cells were found in the superior vestibular nucleus (VeS), the cerebellovestibular process (pcv), the descending vestibular nucleus (VeD), and the medial vestibular nucleus (VeM). Less labeling was found in the prepositus hypoglossi, the cerebellar nuclei, the dorsolateral vestibular nucleus, and the lateral vestibular nucleus, pars ventralis. In the VeS, the differential input to the flocculus and uvula-nodulus was distinct: cells were localized to the medial and lateral regions, respectively. The same pattern was observed in the VeD, although there was considerable overlap. In the VeM, the majority of cells labeled from the flocculus were in rostral margins on the ipsilateral side, whereas labeling from uvula-nodulus injections was distributed bilaterally throughout the VeM. Finally, from injections in the flocculus but not the uvula-nodulus, moderate labeling was observed in a paramedian area, adjacent to the medial longitudinal fasciculus. In summary, there were clear differences with respect to the projections from the vestibular nuclei to functionally distinct parts of the vestibulocerebellum. Generally speaking, the mossy fibers to the flocculus and uvula-nodulus arise from regions of the vestibular nuclei that receive input from the semicircular canals and otolith organs, respectively.

Human ocular following: evidence that responses to large-field stimuli are limited by local and global inhibitory influences

Large-field visual motion elicits tracking eye movements at ultra-short latency, often termed ocular following responses (OFRs). We recorded the initial OFRs of three human subjects when vertical sine-wave gratings were subject to horizontal motion in the form of successive 1/4-wavelength steps. The gratings could occupy the full screen (45 degrees wide, 30 degrees high) or a number of horizontal strips, each 1 degrees high and extending the full width of the display. These strips were always equally spaced vertically. In a first experiment, the gratings always had a contrast of 32%. Increasing the number of strips could reduce the response latency by up to 20 ms, so the magnitude of the initial OFRs was estimated from the change in eye position over the initial open-loop period measured with respect to response onset. A single (centred) strip (covering 3.3% of the screen) always elicited robust OFRs, and three strips (10% coverage) were sufficient to elicit the maximum OFR. Increasing the number of strips to 15 (50% coverage) had little impact, i.e., responses had asymptoted, and further increasing the coverage to 100% (full screen image) actually decreased the OFR so that it was now less than that elicited with only one strip. In a second experiment, the contrast of the gratings could be fixed at one of the four levels ranging from 8% to 64%, and the OFR showed essentially the same pattern of dependence on screen coverage except that the lower the contrast, the lower the level at which the response asymptoted. This indicated that the asymptote was not due simply to some upper limit on the magnitude of the eye movement or the underlying motion signals. We postulate that this asymptote is the result of normalization due to global divisive inhibition, which has often been described in visual-motion-selective neurons in the cortex. We further suggest that the decrease in the OFR when the image filled the screen was due to the increased continuity of the gratings which we postulate would favour the local inhibitory surround mechanisms over the central excitatory ones. This study indicates that robust OFRs can be elicited by much smaller motion stimuli than is commonly supposed and that introducing spatial discontinuities can increase the efficacy of the motion stimuli even while decreasing the area stimulated.