Motion-reversal reveals two motion mechanisms functioning in scotopic vision

Motion processing impaired by transient spatial attention: Potential implications for the magnocellular pathway

Spatial cues presented prior to the presentation of a static stimulus usually improve its perception. However, previous research has also shown that transient exogenous cues to direct spatial attention to the location of a forthcoming stimulus can lead to reduced performance. In the present study, we investigated the effects of transient exogenous cues on the perception of briefly presented drifting Gabor patches. The spatial and temporal frequencies of the drifting Gabors were chosen to mainly engage the magnocellular pathway. We found better performance in the motion direction discrimination task when neutral cues were presented before the drifting target compared to a valid spatial cue. The behavioral results support the hypothesis that transient attention prolongs the internal response to the attended stimulus, thus reducing the temporal segregation of visual events. These results were complemented by applying a recently developed model for perceptual decisions to rule out a speed-accuracy trade-off and to further assess cueing effects on visual performance. In a model-based assessment, we found that valid cues initially enhanced processing but overall resulted in less efficient processing compared to neutral cues, possibly caused by reduced temporal segregation of visual events.

Common and independent processing of visual motion perception and oculomotor response

Visual motion signals are used not only to drive motion perception but also to elicit oculomotor responses. A fundamental question is whether perceptual and oculomotor processing of motion signals shares a common mechanism. This study aimed to address this question using visual motion priming, in which the perceived direction of a directionally ambiguous stimulus is biased in the same (positive priming) or opposite (negative priming) direction as that of a priming stimulus. The priming effect depends on the duration of the priming stimulus. It is assumed that positive and negative priming are mediated by high- and low-level motion systems, respectively. Participants were asked to judge the perceived direction of a π-phase-shifted test grating after a smoothly drifting priming grating during varied durations. Their eye movements were measured while the test grating was presented. The perception and eye movements were discrepant under positive priming and correlated under negative priming on a trial-by-trial basis when an interstimulus interval was inserted between the priming and test stimuli, indicating that the eye movements were evoked by the test stimulus per se. These findings suggest that perceptual and oculomotor responses are induced by a common mechanism at a low level of motion processing but by independent mechanisms at a high level of motion processing.

Macaque monkeys show reversed ocular following responses to two-frame-motion stimulus presented with inter-stimulus intervals

When two-frame apparent motion stimuli are presented with an appropriate inter-stimulus interval (ISI), motion is perceived in the direction opposite to the actual image shift. Herein, we measured a simple eye movement, ocular following responses (OFRs), in macaque monkeys to examine the ISI reversal effect on oculomotor. Two-frame movies with an ISI induced reversed OFRs. Without ISI, the OFRs to the two-frame movie were induced in the direction of the stimulus shift. However, with ISIs ≥10 ms, OFRs in the direction opposite to the phase shift were observed. This directional reversal persisted for ISIs up to 160 ms; for longer ISIs virtually no ocular response was observed. Furthermore, longer exposure to the initial image (Motion onset delay: MOD) reduced OFRs. We show that these dependences on ISIs/MODs can be explained by the motion energy model. Furthermore, we examined the dependence on ISI reversal using various spatial frequencies. To account for our findings, the optimal frequency of the temporal filters of the energy model must decrease between 0.5 and 1 cycles/°, suggesting that there are at least two channels with different temporal characteristics. These results are consistent with those from humans, suggesting that the temporal filters embedded in human and macaque visual systems are similar. Thus, the macaque monkey is a good animal model for the early visual processing of humans to understand the neural substrates underlying the visual motion detectors that elicit OFRs.

Visual discomfort from flicker: Effects of mean light level and contrast

Uncomfortable images generally have a particular spatial structure, which deviates from a reciprocal relationship between amplitude and spatial frequency (f) in the Fourier domain (1/f). Although flickering patterns with similar temporal structure also appear uncomfortable, the discomfort is affected by not only the amplitude spectrum but also the phase spectrum. Here we examined how discomfort from flicker with differing temporal profiles also varies as a function of the mean light level and luminance contrast of the stimulus. Participants were asked to rate discomfort for a 17° flickering uniform field at different light levels from scotopic to photopic. The flicker waveform was varied with a square wave or random phase spectrum and filtered by modulating the slope of the amplitude spectrum relative to 1/f. At photopic levels, the 1/f square wave flicker appeared most comfortable, whereas the discomfort from the random flicker increased monotonically as the slope of the amplitude spectrum decreased. This special status for the 1/f square wave condition was limited to photopic light levels. At the lower mesopic or scotopic levels, the effect of phase spectrum on the discomfort was diminished, with both phase spectra showing a monotonic change with the slope of the amplitude spectrum. We show that these changes cannot be accounted for by changes in the effective luminance contrast of the stimuli or by the responses from a linear model based on the temporal impulse responses under different light levels. However, discomfort from flicker is robustly correlated with judgments of the perceived naturalness of flicker across different contrasts and mean luminance levels.

Retinal ON and OFF pathways contribute to initial optokinetic responses with different temporal characteristics

Visual information in the retina is processed via two pathways: ON and OFF pathways that originate from ON and OFF bipolar cells. The differences in the receptors that mediate signal transmission from photoreceptors imply that the response speed to light signals differs between ON and OFF pathways. We studied the initial optokinetic responses (OKRs) of mice using two-frame motion stimuli presented with interstimulus intervals (ISIs) to understand functional difference of these pathways. When two successive image frames were presented with an ISI, observers often perceived motion in the opposite direction of the actual shift. This directional reversal results from the biphasic nature of the temporal filters in visual systems whose characteristics can be estimated from the dependence on ISIs. We examined the dependence on ISIs in the OKRs of TRPM1^-/- mice, whose ON bipolar cells are dysfunctional, as well as in those of wild-type control mice. Wild type and TRPM1^-/- mice showed comparable OKRs in the veridical direction when no ISI was present. Both types of mice showed OKRs that decreased and eventually reversed as the ISI increased, but with a directional reversal at a shorter ISI in TRPM1^-/- than wild-type mice. In addition, the temporal filters of TRPM1^-/- mice estimated from dependence on ISIs were tuned for higher frequencies, suggesting that compared with wild-type mice, the visual system of TRPM1^-/- mice responds to light signals with faster dynamics. We conclude that the ON and OFF pathways contribute to initial OKRs by providing visual signals processed with different temporal resolutions.

Two-frame apparent motion presented with an inter-stimulus interval reverses optokinetic responses in mice

Two successive image frames presented with a blank inter-stimulus interval (ISI) induce reversals of perceived motion in humans. This illusory effect is a manifestation of the temporal properties of image filters embedded in the visual processing pathway. In the present study, ISI experiments were performed to identify the temporal characteristics of vision underlying optokinetic responses (OKRs) in mice. These responses are thought to be mediated by subcortical visual processing. OKRs of C57BL/6 J mice, induced by a 1/4-wavelength shift of a square-wave grating presented with and without an ISI were recorded. When a 1/4-wavelength shift was presented without, or with shorter ISIs (≤106.7 ms), OKRs were induced in the direction of the shift, with progressively decreasing amplitude as the ISI increased. However, when ISIs were 213.3 ms or longer, OKR direction reversed. Similar dependence on ISIs was also obtained using a sinusoidal grating. We subsequently quantitatively estimated temporal filters based on the ISI effects. We found that filters with biphasic impulse response functions could reproduce the ISI and temporal frequency dependence of the mouse OKR. Comparison with human psychophysics and behaviors suggests that mouse vision has more sluggish response dynamics to light signals than that of humans.

Spatial scaling of illusory motion perceived in a static figure

In a phenomenon known as the Rotating Snakes illusion (Kitaoka & Ashida, 2003), illusory motion is perceived in a static figure with a specially designed luminance profile. It is known that the strength of this illusion increases with eccentricity, suggesting that the underlying mechanism of the illusion has a spatial property that changes with eccentricity. If a change in receptive-field size of responsible neurons causes the eccentricity dependence of the illusion, its strength should be spatially scalable using a scaling factor that increases with eccentricity, because the receptive field size of neurons in visual areas with retinotopy generally obeys quantitative dependence on eccentricity. For the luminance micropatterns comprising the figure for the Rotating Snakes illusion, we varied eccentricity from 9 to 15 deg and spatial frequency from 0.25 to 1.6 cycles/deg, and measured illusion strength. Illusion strength was found to increase with decreasing spatial frequency and with increasing eccentricity. Furthermore, the profiles of illusion strength at different eccentricities were spatially scalable into a single parabola as a function of the spatially scaled visual angle. The estimated scaling factors linearly increased with eccentricity with a slope similar to the eccentricity dependence of the receptive field size of V1 neurons, suggesting the involvement of early visual areas in the generation of the illusion.

Masking of random-walk motion by flicker, and its role in the allocation of motion in the on-line jitter illusion

Typically, perceptual stabilization mechanisms make us unaware of the retinal image motion produced by the small, involuntary eye movements our eyes constantly make during fixation. The breakdown of perceptual stability is demonstrated by the on-line jitter illusion, in which a circular static pattern appears to jitter coherently when surrounded by a flickering annular pattern. Although both regions of the stimulus are subject to retinal motion from eye movements, the visual system attributes this motion to the central static region in the form of visual jitter, while the surrounding flickering region remains perceptually stable. We investigated factors influencing this allocation of motion and reference frame in the on-line jitter illusion. The flickering of the surround was found to impair the detection of simultaneous random-walk motion in this area, giving a detection reliability of around 80% for motion approximating that from fixational eye movements. Changes to spatial texture and location of flicker (centre vs. surrounding annulus) had little effect on the final percept. However, use of a nonconcentric stimulus resulted in a marked reduction in apparent jitter in all subjects. Our results suggest for the on-line jitter illusion, allocation of motion and reference frame is influenced by the general principle that, if one region surrounds another, the surrounding region tends to be allocated as the frame of reference. When this factor is controlled for, spatial textures, location of flicker, and the masking of motion by flicker have a smaller but measurable influence on the final percept.

Changes in apparent duration follow shifts in perceptual timing

It is well established that the apparent duration of moving visual objects is greater at higher as compared to slower speeds. Here we report the effects of acceleration and deceleration on the perceived duration of a drifting grating with average speed kept constant (10°/s).For acceleration, increasing the speed range progressively reduced perceived duration. The magnitude of apparent duration compression was determined by speed rather than temporal frequency and was proportional to speed range (independent of standard duration) rather than acceleration. The perceived duration reduction was also proportional to the standard length. The effects of increases and decreases in speed were highly asymmetric. Reducing speed through the interval induced a moderate increase in perceived duration. These results could not be explained by changes in apparent onset or offset or differences in perceived average speed between intervals containing increasing speed and intervals containing decreasing speed. Paradoxically, for intervals combining increasing speed and decreasing speed, compression only occurred when increasing speed occurred in the second half of the interval. We show that this pattern of results in the duration domain was concomitant with changes in the reported direction of apparent motion of Gaussian blobs, embedded in intervals of increasing or decreasing speed, that could be predicted from adaptive changes in the temporal impulse response function. We detected similar changes after flicker adaptation, suggesting that the two effects might be linked through changes in the temporal tuning of visual filters.

Difference in perceptual and oculomotor responses revealed by apparent motion stimuli presented with an interstimulus interval

To understand the mechanisms underlying visual motion analyses for perceptual and oculomotor responses and their similarities/differences, we analyzed eye movement responses to two-frame animations of dual-grating 3f5f stimuli while subjects performed direction discrimination tasks. The 3f5f stimulus was composed of two sinusoids with a spatial frequency ratio of 3:5 (3f and 5f), creating a pattern with fundamental frequency f. When this stimulus was shifted by 1/4 of the wavelength, the two components shifted 1/4 of their wavelengths and had opposite directions: the 5f forward and the 3f backward. By presenting the 3f5f stimulus with various interstimulus intervals (ISIs), two visual-motion-analysis mechanisms, low-level energy-based and high-level feature-based, could be effectively distinguished. This is because response direction depends on the relative contrast between the components when the energy-based mechanism operates, but not when the feature-based mechanism works. We found that when the 3f5f stimuli were presented with shorter ISIs (<100 ms), and 3f component had higher contrast, both perceptual and ocular responses were in the direction of the pattern shift, whereas the responses were reversed when the 5f had higher contrast, suggesting operation of the energy-based mechanism. On the other hand, the ocular responses were almost negligible with longer ISIs (>100 ms), whereas perceived directions were biased toward the direction of pattern shift. These results suggest that the energy-based mechanism is dominant in oculomotor responses throughout ISIs; however, there is a transition from energy-based to feature-tracking mechanisms when we perceive visual motion.

The influence of spatiotemporal structure of noisy stimuli in decision making

Decision making is a process of utmost importance in our daily lives, the study of which has been receiving notable attention for decades. Nevertheless, the neural mechanisms underlying decision making are still not fully understood. Computational modeling has revealed itself as a valuable asset to address some of the fundamental questions. Biophysically plausible models, in particular, are useful in bridging the different levels of description that experimental studies provide, from the neural spiking activity recorded at the cellular level to the performance reported at the behavioral level. In this article, we have reviewed some of the recent progress made in the understanding of the neural mechanisms that underlie decision making. We have performed a critical evaluation of the available results and address, from a computational perspective, aspects of both experimentation and modeling that so far have eluded comprehension. To guide the discussion, we have selected a central theme which revolves around the following question: how does the spatiotemporal structure of sensory stimuli affect the perceptual decision-making process? This question is a timely one as several issues that still remain unresolved stem from this central theme. These include: (i) the role of spatiotemporal input fluctuations in perceptual decision making, (ii) how to extend the current results and models derived from two-alternative choice studies to scenarios with multiple competing evidences, and (iii) to establish whether different types of spatiotemporal input fluctuations affect decision-making outcomes in distinctive ways. And although we have restricted our discussion mostly to visual decisions, our main conclusions are arguably generalizable; hence, their possible extension to other sensory modalities is one of the points in our discussion.

Modelling adaptation to directional motion using the Adelson-Bergen energy sensor

The motion energy sensor has been shown to account for a wide range of physiological and psychophysical results in motion detection and discrimination studies. It has become established as the standard computational model for retinal movement sensing in the human visual system. Adaptation effects have been extensively studied in the psychophysical literature on motion perception, and play a crucial role in theoretical debates, but the current implementation of the energy sensor does not provide directly for modelling adaptation-induced changes in output. We describe an extension of the model to incorporate changes in output due to adaptation. The extended model first computes a space-time representation of the output to a given stimulus, and then a RC gain-control circuit ("leaky integrator") is applied to the time-dependent output. The output of the extended model shows effects which mirror those observed in psychophysical studies of motion adaptation: a decline in sensor output during stimulation, and changes in the relative of outputs of different sensors following this adaptation.

The effect of retinal illuminance on visual motion priming

The perceived direction of a directionally ambiguous stimulus is influenced by the moving direction of a preceding priming stimulus. Previous studies have shown that a brief priming stimulus induces positive motion priming, in which a subsequent directionally ambiguous stimulus is perceived to move in the same direction as the primer, while a longer priming stimulus induces negative priming, in which the following ambiguous stimulus is perceived to move in the opposite direction of the primer. The purpose of this study was to elucidate the underlying mechanism of motion priming by examining how retinal illuminance and velocity of the primer influences the perception of priming. Subjects judged the perceived direction of 180-deg phase-shifted (thus directionally ambiguous) sine-wave gratings displayed immediately after the offset of a primer stimulus. We found that perception of motion priming was greatly modulated by the retinal illuminance and velocity of the primer. Under low retinal illuminance, positive priming nearly disappeared even when the effective luminance contrast was equated between different conditions. Positive priming was prominent when the velocity of the primer was low, while only negative priming was observed when the velocity was high. These results suggest that the positive motion priming is induced by a higher-order mechanism that tracks prominent features of the visual stimulus, while a directionally selective motion mechanism induces negative motion priming.

Transient Attention Degrades Perceived Apparent Motion

Transient spatial attention refers to the automatic selection of a location that is driven by the stimulus rather than a voluntary decision. Apparent motion is an illusory motion created by stationary stimuli that are presented successively at different locations. In this study we explored the effects of transient attention on apparent motion. The motion target presentation was preceded by either valid attentional cues that attract attention to the target location in advance (experiments 1–4), neutral cues that do not indicate a location (experiments 1, 3, and 4), or invalid cues that direct attention to a non-target location (experiment 2). Valid attentional cues usually improve performance in various tasks. Here, however, an attentional impairment was found. Observers' ability to discriminate the direction of motion diminished at the cued location. Analogous results were obtained regardless of cue type: singleton cue (experiment 1), central non-informative cue (experiment 2), or abrupt onset cue (experiment 3). Experiment 4 further demonstrated that reversed apparent motion is less likely with attention. This seemingly counterintuitive attentional degradation of perceived apparent motion is consistent with several recent findings, and together they suggest that transient attention facilitates spatial segregation and temporal integration but impairs spatial integration and temporal segregation.

A motion-energy model predicts the direction discrimination and MAE duration of two-stroke apparent motion at high and low retinal illuminance

Two-stroke apparent motion offers a challenge to current theoretical models of motion processing and is thus a useful tool for investigating motion sensor input. The stimulus involves repeated presentation of two pattern frames containing a spatial displacement, with a blank inter-stimulus interval (ISI) at one of the two-frame transitions. The resulting impression of continuous motion was measured here using both direction discrimination and motion after-effect duration in order to assess the extent to which data using the two measures can be explained by a computational model without reference to attentive tracking mechanisms. The motion-energy model was found to offer a very good account of the psychophysical data using similar parameters for both tasks. The experiment was run under both photopic and scotopic retinal illumination. Data revealed that the optimum ISI for perceiving two-stroke apparent motion shifts to longer ISIs under scotopic conditions, providing evidence for a biphasic impulse response at low luminance. Best-fitting model parameters indicate that motion sensors receive inputs from temporal filters whose central temporal frequency shifts from 2.5 to 3.0 Hz at high retinal illuminance to 1.0–1.5 Hz at low retinal illuminance.

Visual motion mechanisms under low retinal illuminance revealed by motion reversal

The aim of this study is to determine what kinds of motion mechanisms operate at low luminance levels. We used a motion reversal phenomenon in which the perceived direction of motion is reversed when a blank inter-stimulus interval (ISI) frame is inserted between two image frames of similar mean luminance. At low luminance levels, we found that motion reversal was perceived when the moving pattern was presented in the retinal periphery, but no motion reversal was observed when the stimulus was presented in the central retina. When a large stimulus that covers both central and peripheral visual fields was presented, motion reversal did not occur. We conclude that as retinal illuminance decreases, the relative contribution of a feature-tracking mechanism in the central retina becomes larger, while motion perception in the peripheral retina continues to depend on a biphasic, first-order motion mechanism. When both central and peripheral visual fields are stimulated simultaneously, the motion mechanism that dominates in the central retina determines the perceived direction of motion at low luminance levels.

Psychophysical properties of two-stroke apparent motion

In two-stroke apparent movement, repeated presentation of a two-frame pattern displacement followed by a brief inter-stimulus interval (ISI) can create an impression of continuous forward motion (G. Mather, 2006). Does the ISI in two-stroke motion just break the connection between adjacent frames, switching off the motion signal they normally generate, or does it actually generate a reversed motion signal? Reversed apparent motion in two-frame stimuli separated by a brief ISI has been reported in several previous papers (ISI reversal), which found that the effect is optimal at short, mean-luminance ISIs, and is abolished at scotopic luminances. A series of five experiments compared two-stroke apparent motion with ISI reversal using the same stimulus display. The two effects show the same dependence on ISI duration and luminance and are both abolished at low mean luminance. Results therefore support the conclusion that the ISI in two-stroke apparent motion does contribute a reversed motion signal and constrain theoretical explanations of two-stroke apparent motion.

The vergence eye movements induced by radial optic flow: some fundamental properties of the underlying local-motion detectors

Radial optic flow applied to large random dot patterns is known to elicit horizontal vergence eye movements at short latency, expansion causing convergence and contraction causing divergence: the Radial Flow Vergence Response (RFVR). We elicited RFVRs in human subjects by applying radial motion to concentric circular patterns whose radial luminance modulation was that of a square wave lacking the fundamental: the missing fundamental (mf) stimulus. The radial motion consisted of successive 1/4-wavelength steps, so that the overall pattern and the 4n+1 harmonics (where n=integer) underwent radial expansion (or contraction), whereas the 4n-1 harmonics--including the strongest Fourier component (the 3rd harmonic)--underwent the opposite radial motion. Radial motion commenced only after the subject had fixated the center of the pattern. The initial RFVRs were always in the direction of the 3rd harmonic, e.g., expansion of the mf pattern causing divergence. Thus, the earliest RFVRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. If the radial mf stimulus was reduced to just two competing harmonics--the 3rd and 5th--the initial RFVRs showed a nonlinear dependence on their relative contrasts: when the two harmonics differed in contrast by more than about an octave then the one with the higher contrast completely dominated the RFVRs and the one with lower contrast lost its influence: winner-take-all. We suggest that these nonlinear interactions result from mutual inhibition between the mechanisms sensing the motion of the different competing harmonics. If single radial-flow steps were used, a brief inter-stimulus interval resulted in reversed RFVRs, consistent with the idea that the motion detectors mediating these responses receive a visual input whose temporal impulse response function is strongly biphasic. Lastly, all of these characteristics of the RFVR, which we attribute to the early cortical processing of visual motion, are known to be shared by the Ocular Following Response (OFR)--a conjugate tracking (version) response elicited at short-latency by linear motion-and even the quantitative details are generally very similar. Thus, although the RFVR and OFR respond to very different patterns of global motion-radial vs. linear-they have very similar local spatiotemporal properties as though mediated by the same low-level, local-motion detectors, which we suggest are in the striate cortex.

Initial ocular following in humans depends critically on the fourier components of the motion stimulus

Visual motion is sensed by low-level (energy-based) and high-level (feature-based) mechanisms. Our interest is in the motion detectors underlying the initial ocular following responses (OFR) that are elicited at ultrashort latencies by sudden motions of large images. OFR were elicited in humans by applying horizontal motion to vertical square-wave gratings lacking the fundamental. In the frequency domain, a pure square wave is composed of the odd harmonics--first, third, fifth, seventh, etc.--such that the third, fifth, seventh, etc., have amplitudes that are one-third, one-fifth, one-seventh, etc., that of the first, and the missing fundamental stimulus lacks the first harmonic. Motion consisted of successive quarter-wavelength steps, so the features and 4n+1 harmonics (where n = integer) shifted forward, whereas the 4n-1 harmonics--including the strongest Fourier component (the third harmonic)--shifted backward (spatial aliasing). Thus, the net Fourier energy and the non-Fourier features moved in opposite directions. Initial OFR, recorded with the search coil technique, had minimum latencies of 60 to 70 ms and were always in the direction of the third harmonic, for example, leftward steps resulted in rightward OFR. Thus, the earliest OFR were strongly dependent on the motion of the major Fourier component, consistent with mediation by oriented spatiotemporal visual filters as in the well-known energy model of motion detection. Introducing interstimulus intervals of 10 to 100 ms (during which the screen was uniform gray) reversed the initial direction of tracking, consistent with extensive neurophysiological and psychophysical data suggesting that the visual input to the motion detectors has a biphasic temporal impulse response.

The initial ocular following responses elicited by apparent-motion stimuli: reversal by inter-stimulus intervals

Transient apparent-motion stimuli, consisting of single 1/4-wavelength steps applied to square-wave gratings lacking the fundamental ("missing fundamental stimulus") and to sinusoidal gratings, were used to elicit ocular following responses (OFRs) in humans. As previously reported [Sheliga, B. M., Chen, K. J., FitzGibbon, E. J., & Miles, F. A. (2005). Initial ocular following in humans: a response to first-order motion energy. Vision Research, in press], the earliest OFRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. Introducing inter-stimulus intervals (ISIs) of 10-200 ms, during which the screen was gray with the same mean luminance, reversed the initial direction of the OFR, the peak reversed responses (with ISIs of 20-40 ms) being substantially greater than the non-reversed responses (with an ISI of 0 ms). When the mean luminance was reduced to scotopic levels, reversals now occurred only with ISIs > or=60 ms and the peak reversed responses (with ISIs of 60-100 ms) were substantially smaller than the non-reversed responses (with an ISI of 0 ms). These findings are consistent with the idea that initial OFRs are mediated by first-order motion-energy-sensing mechanisms that receive a visual input whose temporal impulse response function is strongly biphasic in photopic conditions and almost monophasic in scotopic conditions.

Two-stroke: a new illusion of visual motion based on the time course of neural responses in the human visual system

A sequence of static images presented in rapid succession can create a powerful impression of visual movement, a fact exploited by the visual media (television and cinema) and by animators. A new illusion of movement called "two-stroke" is described, in which repeated presentation of a two-frame pattern displacement can create an impression of continuous forward motion, without the inclusion of any additional pattern displacements. The illusion can be explained by a biphasic temporal impulse response that modifies the stimulus delivered to motion energy sensors. It offers a basis for further research on temporal and motion responses in the visual system as well as a tool for animators and graphic artists to create consistent apparent movement from minimal external stimulation.

Fixational eye movements and motion perception

Small eye movements are necessary for maintained visibility of the static scene, but at the same time they randomly oscillate the retinal image, so the visual system must compensate for such motions to yield the stable visual world. According to the theory of visual stabilization based on retinal motion signals, objects are perceived to move only if their retinal images make spatially differential motions with respect to some baseline movement probably due to eye movements. Motion illusions favoring this theory are demonstrated, and psychophysical as well as brain-imaging studies on the illusions are reviewed. It is argued that perceptual stability is established through interactions between motion-energy detection at an early stage and spatial differentiation of motion at a later stage. As such, image oscillations originating in fixational eye movements go unnoticed perceptually, and it is also shown that image oscillations are, though unnoticed, working as a limiting factor of motion detection. Finally, the functional importance of non-differential, global motion signals are discussed in relation to visual stability during large-scale eye movements as well as heading estimation.

The visual motion detectors underlying ocular following responses in monkeys

Psychophysical evidence indicates that visual motion can be sensed by low-level (energy-based) and high-level (feature-based) mechanisms. The present experiments were undertaken to determine which of these mechanisms mediates the initial ocular following response (OFR) that can be elicited at ultra-short latencies by sudden motion of large-field images. We used the methodology of Sheliga, Chen, Fitzgibbon, and Miles (Initial ocular following in humans: A response to first-order motion energy. Vision Research, 2005a), who studied the initial OFRs of humans, to study the initial OFRs of monkeys. Accordingly, we applied horizontal motion to: (1) vertical square-wave gratings lacking the fundamental ("missing fundamental stimulus") and (2) vertical grating patterns consisting of the sum of two sinusoids of frequency 3f and 4f, which created a repeating pattern with beat frequency, f. Both visual stimuli share a critical property: when subject to 1/4-wavelength steps, their overall pattern (feature) shifts in the direction of the steps, whereas their major Fourier component shifts in the reverse direction (because of spatial aliasing). We found that the initial OFRs of monkeys to these stimuli, like those of humans, were always in the opposite direction to the 1/4-wavelength shifts, i.e., in the direction of the major Fourier component, consistent with detection by (low-level) oriented spatio-temporal filters as in the well-known energy model of motion analysis. Our data indicate that the motion detectors mediating the initial OFR have quantitatively similar properties in monkeys and humans, suggesting that monkeys provide a good animal model for the human OFR.

Correlations between fixation stability and visual motion sensitivity

To assess influences of fixational drift eye movements on motion detection, lower thresholds for motion and drift amplitudes were measured in normal subjects. The threshold was higher without visible surrounds than with a surround, and had a positive correlation with drift amplitude. The same effect, but more pronounced, was found when the surround was visible but flickered synchronously. In contrast, the correlation disappeared in the threshold with a static surround. These results suggest that, while spurious image motions by eye drift can have a detrimental effect, a mechanism tuned for differential motions normally counteracts it.

Texture segregation by motion under low luminance levels

We examined the effect of average luminance level on texture segregation by motion. We determined the minimum presentation duration required for subjects to detect a target defined by motion direction against a moving background. The average luminance level and retinal position of the target were systematically varied. We found that the minimum presentation duration needed for texture segregation depends significantly on the average luminance level and on retinal position. The minimum presentation duration increased as the mean luminance decreased. At a very low (presumably scotopic) luminance level, the motion-defined target was never detected rapidly. Under scotopic conditions, the minimum presentation duration was shorter in the periphery than in a near foveal region when the task was simple detection of the target. When the task included identifying the shape of the target patch, however, the target presented near the fovea was identified faster at all luminance levels. These results suggest that the performance of texture segregation is constrained by the spatiotemporal characteristics of the early visual system.

Illusory jitter in a static stimulus surrounded by a synchronously flickering pattern

The eyes are always moving even during fixation, making the retinal image move concomitantly. While these motions activate early visual stages, they are excluded from one's perception. A striking illusion reported here renders them visible: a static pattern surrounded by a synchronously flickering pattern appears to move coherently in random directions. There was a positive correlation between the illusion and fixational eye movements. A simulation revealed that motion computation artificially creates a motion difference between center and surround, which is usually a cue to object motion but now a wrong cue to seeing eye movements of oneself on-line. Therefore, this novel illusion indicates that the visual system normally counteracts shaky visual inputs due to small eye movements by using retinal, as opposed to extraretinal, motion signals. As long as they comprise common image motions over space, they are interpreted as coming from a static outer world viewed through moving eyes. Such visual stability fails in the condition of artificial flicker, because common image motions due to eye movements are registered differently between flickering and non-flickering regions.

Dual-directional optokinetic nystagmus elicited by the intermittent display of gratings in primary open-angle glaucoma and normal eyes

PURPOSE

To compare optokinetic nystagmus (OKN) responses to the intermittent display of stimuli between normal subjects and patients with primary open-angle glaucoma (POAG).

METHODS

Optokinetic nystagmus (OKN) was recorded in 9 glaucomatous patients and 7 normal subjects. The computer-generated stimuli displayed sinusoidal luminance gratings (16 cd/m(2) mean luminance, 0.5 cyc/deg) with a pi/2 phase shift between successive stimulus gratings. These stimulus gratings were separated by an interstimulus interval (ISI), during which a homogeneous luminance field of 16 cd/m(2) was presented. The ISI duration and the luminance contrast were set at different values.

RESULTS

For normal subjects, dual-directional alternating OKN could be evoked in the ISI range from 33 to 100 ms. The dual-directional alternating OKN was defined as that OKN slow phase alternatively tracked in the direction of pi/2 shift (forward OKN) and against the pi/2 shift (reverse OKN). By contrast, for most glaucomatous eyes, nearly no reverse OKN could be evoked at any ISI value.

CONCLUSIONS

The lack of reverse OKN in POAG patients in the present experiments is a meaningful finding. The occurrence of reverse OKN during a certain range of ISI duration could be related to the biphasic characteristics of the temporal impulse response in normal subjects, whereas, the lack of reverse OKN might suggest the plausible damage of magnocellular cells in POAG.

Light adaptation in motion direction judgments

We examined the time course of light adaptation in the visual motion system. Subjects judged the direction of a two-frame apparent-motion display, with the two frames separated by a 50-ms interstimulus interval of the same mean luminance. The phase of the first frame was randomly determined on each trial. The grating presented in the second frame was phase shifted either leftward or rightward by pi/2 with respect to the grating in the first frame. At some variable point during the first frame, the mean luminance of the pattern increased or decreased by 1-3 log units. Mean luminance levels varied from scotopic or low mesopic to photopic levels. We found that the perceived direction of motion depended jointly on the luminance level of the first frame grating and the time at which the shift in average luminance occurs. When the average luminance increases from scotopic or mesopic to photopic levels at least 0.5 s before the offset of the first frame, motion in the 3pi/2 direction is perceived. When average luminance decreases to low mesopic or scotopic levels, motion in the pi/2 direction is perceived if the change occurs 1.0 s or more before first frame offset, depending on the size of the luminance step. Thus light adaptation in the visual motion system is essentially complete within 1 s. This suggests a rapid change in the shape (biphasic or monophasic) of the temporal impulse response functions that feed into a first-order motion mechanism.

Motion coherence detection as a function of luminance level in human central vision

We studied the changes and invariances of foveal motion detection upon dark adaptation. It is well-documented that dark adaptation affects both spatial and temporal aspects of visual processing. The question we were interested in is how this alters motion coherence detection for moving random texture. To compare motion sensitivity at different adaptation levels, we adjusted the viewing distance for equal detectability of a stationary pattern. At these viewing distances we then measured velocity tuning curves for moving random pixel arrays (RPAs). Mean luminance levels ranged from 50 down to 0.005 cd m-2. Our main conclusion is that foveal velocity tuning is amazingly close to luminance-invariant, down to a level of 0.05 cd m-2. Because different viewing distances, and hence, retinal image sizes were used, we performed two control experiments to assess variations of these two parameters separately. We examined the effects of retinal inhomogeneities using discs of different size and annuli filled with RPAs. Our conclusion is that the central visual field, including the near periphery is still rather homogeneous for motion detection at 0.05 cd m-2, but the fovea becomes unresponsive at the lowest luminance level. Variations in viewing distance had marked effects on velocity tuning, both at the light adapted level and the 0.05 cd m-2 level. The size and type of these changes indicated the effectiveness of distance scaling, and show that deviations from perfect invariance of motion coherence detection were not due to inaccurate distance scaling.

Velocity discrimination in scotopic vision

To characterize scotopic motion mechanisms, we examined how variation in average luminance affects the ability to discriminate velocity. Stimuli were drifting horizontal sine-wave gratings (0.25, 1.0 and 2.0 c/deg) viewed through a 2 mm artificial pupil and neutral density filters to produce mean adapting levels from 2.5 to -1.5 log photopic trolands. Drift temporal frequency varied from 0.5 to 36.0 Hz. Grating contrasts were either three or five times direction discrimination threshold contrasts at each adaptation level. Following 30 min adaptation, two drifting gratings were presented sequentially at the fovea. Subjects were asked to indicate which interval contained the faster moving stimulus. The Weber fraction for each base temporal frequency was determined using a staircase method. As previously reported, velocity discrimination performance was most acute at temporal frequencies of about 8.0 Hz and greater than 20.0 Hz (though there are individual differences), and fell off at both higher and lower temporal frequencies under photopic conditions. As adaptation level decreased, discrimination of high temporal frequencies in the central retina became increasingly worse, while discrimination of low temporal frequencies remained largely unaltered. The overall scotopic discrimination performance was best at about 3.0 Hz. These results can be explained by a motion mechanism comprising both low-pass and band-pass temporal filters whose peak and temporal cut-off shifts to lower temporal frequencies under scotopic conditions.

Motion perception at scotopic light levels

Although the spatial and temporal properties of rod-mediated vision have been extensively characterized, little is known about scotopic motion perception. To provide such information, we determined thresholds for the detection and identification of the direction of motion of sinusoidal grating patches moving at speeds from 1 to 32 deg/s, under scotopic light levels, in four different types of observers: three normals, a rod monochromat (who lacks all cone vision), an S-cone monochromat (who lacks M- and L-cone vision), and four deuteranopes (who lack M-cone vision). The deuteranopes, whose motion perception does not differ from that of normals, allowed us to measure rod and L-cone thresholds under silent substitution conditions and to compare directly the perceived velocity for moving stimuli detected by either rod or cone vision at the same light level. We find, for rod as for cone vision, that the direction of motion can be reliably identified very near to detection threshold. In contrast, the perceived velocity of rod-mediated stimuli is reduced by approximately 20% relative to cone-mediated stimuli at temporal frequencies below 4 Hz and at all intensity levels investigated (0.92 to -1.12 log cd m(-2)). Most likely, the difference in velocity perception is distal in origin because rod and cone signals converge in the retina and further processing of their combined signals in the visual cortex is presumably identical. To account for the difference, we propose a model of velocity, in which the greater temporal averaging of rod signals in the retina leads to an attenuation of the motion signal in the detectors tuned to high velocities.

Motion detection from photopic to low scotopic luminance levels

In this study we quantify the influence of adaptation luminance on the threshold for direction-detection in coherently moving random-pixel arrays (RPAs). Square RPAs of a constant rms-contrast (35%) were used and we determined their 'critical' or threshold-width Wc. Mean retinal illuminances were varied in 13 steps of 0.5 log unit from the low photopic range (screen luminance 0.3 cd/m2) down to 6 log units attenuation, which appeared to be about the absolute threshold of vision under the conditions of our experiment. Moving RPAs were presented at six retinal locations (0, 3, 6, 12, 24 and 48 degrees) from the fovea to the far periphery in the temporal visual field of the right eye of three experienced observers (the authors). In order to ensure an honest comparison between these very disparate conditions, the spatial dimensions (including speed) were scaled according to the acuity, as measured separately for each of the viewing-conditions and observers. Acuity scaling proves to equate the performance for all eccentricities and luminance levels rather well. The fovea is special, but only in the sense that the absolute threshold for light detection is reahed earlier than in peripheral regions. In all other respects foveal results follow the pattern found for peripheral locations. Two different regimes can be discerned in the data, one for high and one for low speeds. In the low speed range Wc is almost constant, regardless of luminance level or eccentricity. The critical 'crossing-time' Tc for any pixel starting at one end of the stimulus and leaving at the opposite end is therefore inversely proportional to velocity in the low-speed range (time-velocity reciprocity). At medium-to-high speeds Wc increases linearly with velocity, so Tc is constant. This constant (minimum) value of Tc differs between subjects, but in all subjects it increases somewhat with decreasing luminance level, even for our acuity-scaled stimuli. The different behaviour for low and high speeds [reported before for photopic viewing conditions by van de Grind, W. A., van Doorn, A. J., & Koenderink, J. J. (1983. Journal of the Optical Society of America, 73, 1674-1683) and van de Grind, W. A., Koenderink, J. J., & van Doorn A. J. (1986. Vision Research, 26, 797-810)] proves to hold from photopic to low scotopic luminance ranges, provided the stimuli are scaled according to acuity. We draw the general conclusion that movement detection is a very robust process that tolerates extremely low retinal illuminance levels. Moreover, the visual system appears to use the same processing principles in combination with an acuity-scaled architecture under all adaptation states and at all eccentricities.

Perception of coherent motion, biological motion and form-from-motion under dim-light conditions

Three experiments investigated several aspects of motion perception at high and low luminance levels. Detection of weak coherent motion in random dot cinematograms was unaffected by light level over a range of dot speeds. The ability to judge form from motion was, however, impaired at low light levels, as was the ability to discriminate normal from phase-scrambled biological motion sequences. The difficulty distinguishing differential motions may be explained by increased spatial pooling at low light levels.

Effect of contrast on the perception of moving multiple Gabor patterns

The present study examined the way in which the perception of motion coherency depends on luminance contrast. Pseudo-plaid patterns were presented to subjects who judged whether coherent motion or component motion of the Gabor patterns was perceived. Michelson contrast, eccentricity, spatial separation, and angular separation between two groups of Gabor patches were varied systematically. When the contrast was high, coherent motion perception was dominant in peripheral viewing but not in foveal viewing. When the contrast was low, coherent motion was perceived at all eccentricities. Under low-contrast conditions and with peripheral viewing, coherent motion was perceived over broader spatial areas and at wider angular separations. The contrast dependency of motion coherency can be qualitatively explained in terms of the relative activity of hypothetical local-motion units in area V1 and global-motion units in area MT of the visual cortex.

The motion analogue of the Café Wall illusion

Detecting visual motion is computationally equivalent to detecting spatiotemporally oriented contours. The question addressed in this study is whether the illusory oriented contour in the space-space domain induces corresponding illusory motion perception. Two experiments were conducted. In experiment 1, the Café Wall pattern, which elicits a strong illusion of orientation (Café Wall illusion), was found to induce an illusion of motion when this pattern was converted to the space-time domain. The strength of the motion illusion depends on the mortar luminance and width, as for the Café Wall illusion. In experiment 2, the adaptation to this illusion of motion was found to induce a motion aftereffect in a static test, which indicates that a first-order-motion system contributes to the induction of the motion illusion. In fact, the motion-energy model was able to predict the strength of this motion aftereffect.