Dependence on stimulus onset asynchrony in apparent motion: evidence for two mechanisms

Common and independent processing of visual motion perception and oculomotor response

Visual motion signals are used not only to drive motion perception but also to elicit oculomotor responses. A fundamental question is whether perceptual and oculomotor processing of motion signals shares a common mechanism. This study aimed to address this question using visual motion priming, in which the perceived direction of a directionally ambiguous stimulus is biased in the same (positive priming) or opposite (negative priming) direction as that of a priming stimulus. The priming effect depends on the duration of the priming stimulus. It is assumed that positive and negative priming are mediated by high- and low-level motion systems, respectively. Participants were asked to judge the perceived direction of a π-phase-shifted test grating after a smoothly drifting priming grating during varied durations. Their eye movements were measured while the test grating was presented. The perception and eye movements were discrepant under positive priming and correlated under negative priming on a trial-by-trial basis when an interstimulus interval was inserted between the priming and test stimuli, indicating that the eye movements were evoked by the test stimulus per se. These findings suggest that perceptual and oculomotor responses are induced by a common mechanism at a low level of motion processing but by independent mechanisms at a high level of motion processing.

First- and second-order transformational apparent motion rely on common shape representations

When one figure is replaced with another that overlaps its spatial location, observers perceive an illusory, continuous shape change of the original object, a phenomenon known as transformational apparent motion (TAM). The current study investigated the extent to which TAM depends on a common, high-level shape representation that is independent of the shape-defining attribute. Specifically, we tested whether TAM is perceived similarly for both first- and second-order objects, defined by luminance and texture contrast, respectively. A compelling motion percept was observed in second-order TAM displays that was comparable to that seen in first-order TAM displays. Importantly, TAM for both stimulus classes showed the same pattern over a range of stimulus onset asynchronies. These results support the high-level shape account, indicating that TAM is driven by segmentation mechanisms that rely on high-level shape information rather than low-level visual characteristics.

Macaque monkeys show reversed ocular following responses to two-frame-motion stimulus presented with inter-stimulus intervals

When two-frame apparent motion stimuli are presented with an appropriate inter-stimulus interval (ISI), motion is perceived in the direction opposite to the actual image shift. Herein, we measured a simple eye movement, ocular following responses (OFRs), in macaque monkeys to examine the ISI reversal effect on oculomotor. Two-frame movies with an ISI induced reversed OFRs. Without ISI, the OFRs to the two-frame movie were induced in the direction of the stimulus shift. However, with ISIs ≥10 ms, OFRs in the direction opposite to the phase shift were observed. This directional reversal persisted for ISIs up to 160 ms; for longer ISIs virtually no ocular response was observed. Furthermore, longer exposure to the initial image (Motion onset delay: MOD) reduced OFRs. We show that these dependences on ISIs/MODs can be explained by the motion energy model. Furthermore, we examined the dependence on ISI reversal using various spatial frequencies. To account for our findings, the optimal frequency of the temporal filters of the energy model must decrease between 0.5 and 1 cycles/°, suggesting that there are at least two channels with different temporal characteristics. These results are consistent with those from humans, suggesting that the temporal filters embedded in human and macaque visual systems are similar. Thus, the macaque monkey is a good animal model for the early visual processing of humans to understand the neural substrates underlying the visual motion detectors that elicit OFRs.

Retinal ON and OFF pathways contribute to initial optokinetic responses with different temporal characteristics

Visual information in the retina is processed via two pathways: ON and OFF pathways that originate from ON and OFF bipolar cells. The differences in the receptors that mediate signal transmission from photoreceptors imply that the response speed to light signals differs between ON and OFF pathways. We studied the initial optokinetic responses (OKRs) of mice using two-frame motion stimuli presented with interstimulus intervals (ISIs) to understand functional difference of these pathways. When two successive image frames were presented with an ISI, observers often perceived motion in the opposite direction of the actual shift. This directional reversal results from the biphasic nature of the temporal filters in visual systems whose characteristics can be estimated from the dependence on ISIs. We examined the dependence on ISIs in the OKRs of TRPM1^-/- mice, whose ON bipolar cells are dysfunctional, as well as in those of wild-type control mice. Wild type and TRPM1^-/- mice showed comparable OKRs in the veridical direction when no ISI was present. Both types of mice showed OKRs that decreased and eventually reversed as the ISI increased, but with a directional reversal at a shorter ISI in TRPM1^-/- than wild-type mice. In addition, the temporal filters of TRPM1^-/- mice estimated from dependence on ISIs were tuned for higher frequencies, suggesting that compared with wild-type mice, the visual system of TRPM1^-/- mice responds to light signals with faster dynamics. We conclude that the ON and OFF pathways contribute to initial OKRs by providing visual signals processed with different temporal resolutions.

Two-frame apparent motion presented with an inter-stimulus interval reverses optokinetic responses in mice

Two successive image frames presented with a blank inter-stimulus interval (ISI) induce reversals of perceived motion in humans. This illusory effect is a manifestation of the temporal properties of image filters embedded in the visual processing pathway. In the present study, ISI experiments were performed to identify the temporal characteristics of vision underlying optokinetic responses (OKRs) in mice. These responses are thought to be mediated by subcortical visual processing. OKRs of C57BL/6 J mice, induced by a 1/4-wavelength shift of a square-wave grating presented with and without an ISI were recorded. When a 1/4-wavelength shift was presented without, or with shorter ISIs (≤106.7 ms), OKRs were induced in the direction of the shift, with progressively decreasing amplitude as the ISI increased. However, when ISIs were 213.3 ms or longer, OKR direction reversed. Similar dependence on ISIs was also obtained using a sinusoidal grating. We subsequently quantitatively estimated temporal filters based on the ISI effects. We found that filters with biphasic impulse response functions could reproduce the ISI and temporal frequency dependence of the mouse OKR. Comparison with human psychophysics and behaviors suggests that mouse vision has more sluggish response dynamics to light signals than that of humans.

Difference in perceptual and oculomotor responses revealed by apparent motion stimuli presented with an interstimulus interval

To understand the mechanisms underlying visual motion analyses for perceptual and oculomotor responses and their similarities/differences, we analyzed eye movement responses to two-frame animations of dual-grating 3f5f stimuli while subjects performed direction discrimination tasks. The 3f5f stimulus was composed of two sinusoids with a spatial frequency ratio of 3:5 (3f and 5f), creating a pattern with fundamental frequency f. When this stimulus was shifted by 1/4 of the wavelength, the two components shifted 1/4 of their wavelengths and had opposite directions: the 5f forward and the 3f backward. By presenting the 3f5f stimulus with various interstimulus intervals (ISIs), two visual-motion-analysis mechanisms, low-level energy-based and high-level feature-based, could be effectively distinguished. This is because response direction depends on the relative contrast between the components when the energy-based mechanism operates, but not when the feature-based mechanism works. We found that when the 3f5f stimuli were presented with shorter ISIs (<100 ms), and 3f component had higher contrast, both perceptual and ocular responses were in the direction of the pattern shift, whereas the responses were reversed when the 5f had higher contrast, suggesting operation of the energy-based mechanism. On the other hand, the ocular responses were almost negligible with longer ISIs (>100 ms), whereas perceived directions were biased toward the direction of pattern shift. These results suggest that the energy-based mechanism is dominant in oculomotor responses throughout ISIs; however, there is a transition from energy-based to feature-tracking mechanisms when we perceive visual motion.

The detection of the motion of contrast modulation: a parametric study

Despite a long and productive history as a focus of research interest, the details of how humans detect motion in an image remain controversial. This debate has not been helped by the lack of a clear parametric description of motion discrimination for some of the more simple visual stimuli employed in the literature to date. With this in mind, in the present work, we examined a peculiarity observed in the perception of the motion of second-order (contrast-modulated) stimuli: Under certain stimulus conditions, there is a reversal in the perceived direction of motion of the pattern. The aim was to quantify this phenomenon, relate the reversal to forward (veridical) and ambiguous motion, and place the behavioral data in the context of the window of visibility model of spatiotemporal contrast sensitivity. The direction of motion of contrast-modulated patterns was measured as a function of temporal frequency and carrier contrast, under different critical stimulus conditions. The stimulus properties manipulated were spatial frequency, spatial-phase relationship of carrier and sidebands, color, duration, and, most critically, the retinal location of the stimulus. On a purely empirical basis, the data reconciled several conflicts in the recent literature. From a theoretical standpoint, the data were well explained by the window of visibility approach in the majority of conditions and were partially explained in the remaining conditions. The results raise some interesting questions about underlying motion detection mechanisms and the assumptions embodied in our approach to motion modeling and the visual system in general. Supplemental materials for this article may be downloaded from app.psychonomic-journals.org/content/supplemental.

Visual motion mechanisms under low retinal illuminance revealed by motion reversal

The aim of this study is to determine what kinds of motion mechanisms operate at low luminance levels. We used a motion reversal phenomenon in which the perceived direction of motion is reversed when a blank inter-stimulus interval (ISI) frame is inserted between two image frames of similar mean luminance. At low luminance levels, we found that motion reversal was perceived when the moving pattern was presented in the retinal periphery, but no motion reversal was observed when the stimulus was presented in the central retina. When a large stimulus that covers both central and peripheral visual fields was presented, motion reversal did not occur. We conclude that as retinal illuminance decreases, the relative contribution of a feature-tracking mechanism in the central retina becomes larger, while motion perception in the peripheral retina continues to depend on a biphasic, first-order motion mechanism. When both central and peripheral visual fields are stimulated simultaneously, the motion mechanism that dominates in the central retina determines the perceived direction of motion at low luminance levels.

The vergence eye movements induced by radial optic flow: some fundamental properties of the underlying local-motion detectors

Radial optic flow applied to large random dot patterns is known to elicit horizontal vergence eye movements at short latency, expansion causing convergence and contraction causing divergence: the Radial Flow Vergence Response (RFVR). We elicited RFVRs in human subjects by applying radial motion to concentric circular patterns whose radial luminance modulation was that of a square wave lacking the fundamental: the missing fundamental (mf) stimulus. The radial motion consisted of successive 1/4-wavelength steps, so that the overall pattern and the 4n+1 harmonics (where n=integer) underwent radial expansion (or contraction), whereas the 4n-1 harmonics--including the strongest Fourier component (the 3rd harmonic)--underwent the opposite radial motion. Radial motion commenced only after the subject had fixated the center of the pattern. The initial RFVRs were always in the direction of the 3rd harmonic, e.g., expansion of the mf pattern causing divergence. Thus, the earliest RFVRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. If the radial mf stimulus was reduced to just two competing harmonics--the 3rd and 5th--the initial RFVRs showed a nonlinear dependence on their relative contrasts: when the two harmonics differed in contrast by more than about an octave then the one with the higher contrast completely dominated the RFVRs and the one with lower contrast lost its influence: winner-take-all. We suggest that these nonlinear interactions result from mutual inhibition between the mechanisms sensing the motion of the different competing harmonics. If single radial-flow steps were used, a brief inter-stimulus interval resulted in reversed RFVRs, consistent with the idea that the motion detectors mediating these responses receive a visual input whose temporal impulse response function is strongly biphasic. Lastly, all of these characteristics of the RFVR, which we attribute to the early cortical processing of visual motion, are known to be shared by the Ocular Following Response (OFR)--a conjugate tracking (version) response elicited at short-latency by linear motion-and even the quantitative details are generally very similar. Thus, although the RFVR and OFR respond to very different patterns of global motion-radial vs. linear-they have very similar local spatiotemporal properties as though mediated by the same low-level, local-motion detectors, which we suggest are in the striate cortex.

Temporal limits of long-range phase discrimination across the visual field

When two flickering sources are far enough apart to avoid low-level motion signals, phase judgment relies on the temporal individuation of the light and dark phases of each source. The highest rate at which the individuation can be maintained has been referred to as Gestalt flicker fusion [Van de Grind, W. A., Grüsser, O. -J., & Lunkenheimer, H. U. (1973). Temporal transfer properties of the afferent visual system. Psychophysical, neurophysiological and theoretical investigations. In R. Jung (Ed.), Handbook of sensory physiology (Vol. VII/3, pp. 431-573). Berlin: Springer, Chapter 7] and this has been taken as a measure of the temporal resolution of attention [Verstraten, F. A., Cavanagh, P., & Labianca, A. T. (2000). Limits of attentive tracking reveal temporal properties of attention. Vision Research, 40, 3651-3664; Battelli, L., Cavanagh, P., Intriligator, J., Tramo, M. J., Henaff, M. A., Michel, F., et al. (2001). Unilateral right parietal damage leads to bilateral deficit for high-level motion. Neuron, 32, 985-995]. Here we examine the variation of the temporal resolution of attention across the visual field using phase judgments of widely spaced pairs of flickering dots presented either in the upper or lower visual field and at either 4 degrees or 14 degrees eccentricity. We varied inter-dot separation to determine the spacing at which phase discriminations are no longer facilitated by low-level motion signals. Our data for these long-range phase judgments showed that temporal resolution decreases only slightly with increased distance from center of gaze (decrease from 11.4 to 8.9 Hz between 4 degrees to 14 degrees ), and does not differ between upper and lower visual fields. We conclude that the variation of the temporal limits of visual attention across the visual field differs markedly from that of the spatial resolution of attention.

S-cone contributions to linear and non-linear motion processing

We investigated the characteristics of mechanisms mediating motion discrimination of S-cone isolating stimuli and found a double dissociation between the effects of luminance noise, which masks linear but not non-linear motion, and chromatic noise, which masks non-linear but not linear motion. We conclude that S-cones contribute to motion via two different pathways: a non-linear motion mechanism via a chromatic pathway and a linear motion mechanism via a luminance pathway. Additionally, motion discrimination and detection thresholds for drifting, S-cone isolating Gabors are unaffected by luminance noise, indicating that grating motion is mediated via chromatic mechanisms and based on higher-order motion processing.

The perception of motion in chromatic stimuli

The issue of whether there is a motion mechanism sensitive to purely chromatic stimuli has been pertinent for the past 30 or more years. The aim of this review is to examine why such different conclusions have been drawn in the literature and to reach some reconciliation. The review critically examines the behavioral evidence and concludes that there is a purely chromatic motion mechanism but that it is limited to the fovea. Examination of motion performance for chromatic and luminance stimuli provides convincing evidence that there are at least two different mechanisms for the two kinds of stimuli. The authors further argue that the chromatic mechanism may be at a particular disadvantage when the integration of multiple local motion signals is required. Finally, the authors present a descriptive model that may go some way toward explaining the reasons for the differences in collected data outlined in this article.

The initial ocular following responses elicited by apparent-motion stimuli: reversal by inter-stimulus intervals

Transient apparent-motion stimuli, consisting of single 1/4-wavelength steps applied to square-wave gratings lacking the fundamental ("missing fundamental stimulus") and to sinusoidal gratings, were used to elicit ocular following responses (OFRs) in humans. As previously reported [Sheliga, B. M., Chen, K. J., FitzGibbon, E. J., & Miles, F. A. (2005). Initial ocular following in humans: a response to first-order motion energy. Vision Research, in press], the earliest OFRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. Introducing inter-stimulus intervals (ISIs) of 10-200 ms, during which the screen was gray with the same mean luminance, reversed the initial direction of the OFR, the peak reversed responses (with ISIs of 20-40 ms) being substantially greater than the non-reversed responses (with an ISI of 0 ms). When the mean luminance was reduced to scotopic levels, reversals now occurred only with ISIs > or=60 ms and the peak reversed responses (with ISIs of 60-100 ms) were substantially smaller than the non-reversed responses (with an ISI of 0 ms). These findings are consistent with the idea that initial OFRs are mediated by first-order motion-energy-sensing mechanisms that receive a visual input whose temporal impulse response function is strongly biphasic in photopic conditions and almost monophasic in scotopic conditions.

Bistable Glass-pattern motion reveals two different processes

Examining the two motion processes is an elusive task due to the difficulty of finding a proper stimulus paradigm. A rotational Glass pattern created with a random-dot array by superimposing its rotated version on the top of it can provide such a paradigm. If we displace only its rotated part in the vertical or horizontal direction, a bistable motion occurs; local dot motion in the same direction and Glass-pattern motion in the orthogonal direction. From two experiments, we found local dot motion is predominant in short spatiotemporal range and global pattern motion in long spatiotemporal range. Since the stimulus allows us to maintain all of its properties identical except for the changes in spatiotemporal parameters, this result shows more robustly that the energy-based first-order motion favors short spatiotemporal ranges while the pattern-based second-order motion favors long spatiotemporal ranges.

The detection of motion in chromatic stimuli: pedestals and masks

This study seeks to clarify the reasons for some of the differences in the published data on chromatic motion perception, and to provide further support for the existence of a low-level motion mechanism sensitive to purely chromatic change. Observers discriminated the direction of motion of displaced sinusoidal gratings in the presence of a static grating mask (or pedestal). Each component of the stimulus was independently described in cardinal colour space and calibrated for subjective equiluminance using multiple methods. The motion structure, stimulus size, temporal frequency, contrast, relative phase and chromatic properties were all varied parametrically and the data cast in terms of predictions made by two different theoretical approaches to the test-mask combination. The vast majority of the data were well explained by a low-level motion mechanism sensitive to the motion of foveally-placed chromatic stimuli. Data consistent with either higher-level motion perception or a luminance-like signal were found outside the fovea and when the stimulus properties did not otherwise favour chromatic motion perception. There was some explanation of inconsistencies in previously published data and a strong suggestion that previous results showing pedestal-like behaviour for these stimulus combinations were a special case rather than a general result.

The detection of motion in chromatic stimuli: first-order and second-order spatial structure

This study provides evidence for the existence of a low-level chromatic motion mechanism and further elucidates the conditions under which its operation becomes measurable in an experimental stimulus. Observers discriminated the direction of motion of amplitude modulated (AM) gratings that were defined by luminance or chromatic variation and masked with spatiotemporally broadband luminance or chromatic noise. The size and retinal location of the stimuli were varied and the effects of broadband noise and grating masks were both compared with the cohort of stimuli. Some significant disparities in the published literature were well explained by the results. In conclusion, evidence for a chromatically sensitive motion mechanism that evades the, detrimental effects of a luminance mask was found only at the fovea and only when the stimulus was small and centrally placed.

First-order and second-order motion: neurological evidence for neuroanatomically distinct systems

An unresolved issue in visual motion perception is how distinct are the processes underlying 'first-order' and 'second-order' motion. The former is defined by spatio-temporal variations of luminance and the latter by spatio-temporal variations in other image attributes such as contrast or depth, for example. Using neuroimaging and psychophysics we present data from four neurological patients with unilateral and mostly cortical infarcts, which strongly suggest that first- and second-order motion have a different neural substrate. We found that from the early stages of processing, these two types of motions are mediated by two distinct pathways: first-order motion is carried out by mechanisms along the dorsal pathway in the occipital lobe, while the second-order motion by mechanisms mostly along the ventral pathway. The data reported here also suggest that different cortical regions may be in charge of processing direction-discrimination in second-order motion defined by different second-order attributes.

Apparent motion cues distort object localisation in egocentric space

The visual localisation of objects in space is thought to rely on retinal information defining the environmental context and non-retinal cues from proprioception and motor commands. Here, the influence of dynamic contextual cues on the perception of egocentric space in a reaching task was investigated. Compared to performances with realistic motion or static cues, target localisation was less accurate when apparent motion was used to provide contextual information about space between the hand and the target. This effect could not be explained by the 'presence' of motion, or a bias in depth perception. Since the distortion was connected with the reaching area it was concluded that cognitive factors can unconsciously influence the perception of egocentric space, in particular distance estimation. We propose a mechanism for this whereby signals from areas MT/MST (middle temporal/medial superior temporal) create a perceptual bias through cortico-cortical connections with posterior parietal cortex.

Failure of signed chromatic apparent motion with luminance masking

It has been suggested that there are two types of chromatic motion mechanisms: signed chromatic motion, in which correspondence across successive frames is based on chromatic content of image regions, and unsigned chromatic motion based on movement of chromatically-defined borders. We investigate whether signed and unsigned red-green chromatic motion are mediated by a genuinely chromatic mechanism. Direction discrimination of signed and unsigned red-green chromatic motion were measured in the presence of a dynamic luminance masking noise. Increasing the luminance noise contrast systematically impaired signed motion, regardless of contrast and speed. This result suggests that signed red-green chromatic motion is derived from a luminance-based signal, rather than a genuinely chromatic motion mechanism. In the case of unsigned chromatic motion, there is no effect of luminance masking noise, indicating there exists a genuine chromatic mechanism for second-order motion perception.

Comparison of the spatial-frequency selectivity of local and global motion detectors

Convergent physiological and behavioral evidence indicates that the initial receptive fields responsible for motion detection are spatially localized. Consequently, the perception of global patterns of movement (such as expansion) requires that the output of these local mechanisms be integrated across visual space. We have differentiated local and global motion processes, with mixtures of coherent and incoherent moving patterns composed of bandpass filtered dots, and have measured their spatial-frequency selectivity. We report that local motion detectors show narrow-band spatial-frequency tuning (i.e., they respond only to a narrow range of spatial frequencies) but that global motion detectors show broadband spatial-frequency tuning (i.e., they integrate across a broad range of spatial frequencies), with a preference for low spatial frequencies.

Processing of second-order stimuli in the visual cortex

Naturally occurring visual stimuli are rich in examples of objects delineated from their backgrounds simply by differences in luminance, so-called first-order stimuli, as well as those defined by differences of contrast or texture, referred to as second-order stimuli. Here we provide a brief overview of visual cortical processing of second-order stimuli, as well as some comparative background on first-order processing, concentrating on single-unit neurophysiology, but also discussing relationships to human psychophysics and to neuroimaging. The selectivity of visual cortical neurons to orientation, spatial frequency, and direction of movement of first-order, luminance-defined stimuli is conventionally understood in terms of simple linear filter models, albeit with some minor nonlinearities such as thresholding and gain control. However, these kinds of models fail entirely to account for responses of neurons to second-order stimuli such as contrast envelopes, illusory contours, or texture borders. Second-order stimuli constructed from sinusoidal components have been used to analyze the neurophysiological mechanisms of such responses; these experiments demonstrate that the same neuron can exhibit three distinct kinds of tuning to spatial frequency, and also to orientation. These results can be understood in terms of a type of nonlinear 'filter-->rectify-->filter' model, which has been widely used in human psychophysics. Finally, several general issues will be discussed, including potential artifacts in experiments with second-order stimuli, and strategies for avoiding or controlling for them; caveats about definitions of first- vs. second-order mechanisms and stimuli; the concept of form-cue invariance; and the functional significance of second-order processing.

Unilateral right parietal damage leads to bilateral deficit for high-level motion

Patients with right parietal damage demonstrate a variety of attentional deficits in their left visual field contralateral to their lesion. We now report that patients with right lesions also show a severe loss in the perception of apparent motion in their "good" right visual field ipsilateral to their lesion. Three tests of attention were conducted, and losses were found only in the contralesional fields for a selective attention and a multiple object tracking task. Losses in apparent motion, however, were bilateral in all cases. The deficit in apparent motion in the parietal patients supports previous claims that this relatively effortless percept is mediated by attention. However, the bilateral deficit suggests that the disruption is due to a bilateral loss in the temporal resolution of attention to transient events that drive the apparent motion percept.

Interaction of first- and second-order direction in motion-defined motion

Motion-defined motion can play a special role in the discussion of whether one or two separate systems are required to process first- and second-order information because, in contrast to other second-order stimuli, such as contrast-modulated contours, motion detection cannot be explained by a simple input nonlinearity but requires preprocessing by motion detectors. Furthermore, the perceptual quality that defines an object (motion on the object surface) is identical to that which is attributed to the object as an emergent feature (motion of the object), raising the question of how these two object properties are linked. The interaction of first- and second-order information in such stimuli has been analyzed previously in a direction-discrimination task, revealing some cooperativity. Because any comprehensive integration of these two types of motion information should be reflected in the most fundamental property of a moving object, i.e., the direction in which it moves, we now investigate how motion direction is estimated in motion-defined objects. Observers had to report the direction of moving objects that were defined by luminance contrast or in random-dot kinematograms by differences in the spatiotemporal properties between the object region and the random-noise background. When the dots were moving coherently with the object (Fourier motion), direction sensitivity resembled that for luminance-defined objects, but performance deteriorated when the dots in the object region were static (drift-balanced motion). When the dots on the object surface were moving diagonally relative to the object direction (theta motion), the general level of accuracy declined further, and the perceived direction was intermediate between the veridical object motion direction and the direction of dot motion, indicating that the first- and second-order velocity vectors are somehow pooled. The inability to separate first- and second-order directional information suggests that the two corresponding subsystems of motion processing are not producing independent percepts and provides clues for possible implementations of the two-layer motion-processing network.

Centrifugal bias for second-order but not first-order motion

Limited-lifetime Gabor stimuli were used to assess both first- and second-order motion in peripheral vision. Both first- and second-order motion mechanisms were present at a 20-deg eccentricity. Second-order motion, unlike first-order, exhibits a bias for centrifugal motion, suggesting a role for the second-order mechanism in optic flow processing.

The properties of the motion-detecting mechanisms mediating perceived direction in stochastic displays

Previous studies [e.g. Baker & Hess, 1998. Vision Research, 38, 1211-1222] have shown that perceived direction in displays composed of multiple, limited-lifetime, Gabor micropatterns (G) is influenced by movement both at the fine spatial scale of the internal luminance modulation (first-order motion) and the coarse spatial scale of the Gaussian, contrast window (second-order motion). However it is presently indeterminate as to whether this pattern of results is indicative of the processes by which first-order and second-order motion signals interact within the visual system per se or those by which motion information, irrespective of how it is defined, is utilised across different spatial scales. To address this issue, and more generally the properties of the mechanisms that analyse motion in such displays, we employed stochastic motion sequences composed of either G, G added to a static carrier (G + C) or G multiplied with a carrier (G*C). Crucially G*C, unlike both G and G + C, micropatterns contain no net first-order motion and second-order motion only at the scale of the internal contrast modulation. For small displacements perceived direction in all cases showed a dependence on the internal sinusoidal spatial structure of the micropatterns and characteristic oscillations were typically observed, consistent with models in which first-order motion and second-order motion are encoded on the basis of similar low-level mechanisms. Importantly for larger displacements, and also when the internal spatial structure was randomised on successive exposures (so that motion at this spatial scale was unreliable), performance tended to be veridical for all types of micropattern, even though under these conditions displacements of the G*C micropatterns should have been invisible to current, low-level, motion-detecting schemes. This suggests that both low-level motion sensors and mechanisms utilising a different motion-detecting strategy such as high-level, attentive, feature-tracking may mediate perceptual judgements in stochastic displays.

Absence of a chromatic linear motion mechanism in human vision

We have investigated motion mechanisms in central and perifoveal vision using two-frame random Gabor kinematograms with isoluminant red-green or luminance stimuli. In keeping with previous results, we find that performance dominated by a linear motion mechanism is obtained using high densities of micropatterns and small temporal intervals between frames, while nonlinear performance is found with low densities and longer temporal intervals [Boulton, J. C., & Baker, C. L. (1994) Proceedings of SPIE, computational vision based on neurobiology, 2054, 124-133]. We compare direction discrimination and detection thresholds in the presence of variable luminance and chromatic noise. Our results show that the linear motion response obtained from chromatic stimuli is selectively masked by luminance noise; the effect is selective for motion since luminance noise masks direction discrimination thresholds but not stimulus detection. Furthermore, we find that chromatic noise has the reverse effect to luminance noise: detection thresholds for the linear chromatic stimulus are masked by chromatic noise but direction discrimination is relatively unaffected. We thus reveal a linear 'chromatic' mechanism that is susceptible to luminance noise but relatively unaffected by color noise. The nonlinear chromatic mechanism behaves differently since both detection and direction discrimination are unaffected by luminance noise but masked by chromatic noise. The double dissociation between the effects of chromatic and luminance noise on linear and nonlinear motion mechanisms is not based on stimulus speed or differences in the temporal presentations of the stimuli. We conclude that: (1) 'chromatic' linear motion is solely based on a luminance signal, probably arising from cone-based temporal phase shifts; (2) the nonlinear chromatic motion mechanism is purely chromatic; and (3) we find the same results for both perifoveal and foveal presentations.

Feature matching and segmentation in motion perception

We examined the role of feature matching in motion perception. The stimulus sequence was constructed from a vertical, 1 cycle deg-1 sinusoidal grating divided into horizontal strips of equal height, where alternate strips moved leftward and rightward. The initial relative phase of adjacent strips was either 0 degree (aligned) or 90 degrees (non-aligned) and the motion was sampled at 90 degrees phase steps. A blank interstimulus interval (ISI) of 0-117 ms was introduced between each 33 ms presentation of the stimulus frames. The observers had to identify the direction of motion of the central strip. Motion was perceived correctly at short ISIs, but at longer ISIs performance was much better for the non-aligned sequence than the aligned sequence. This difference in performance may reflect a role for feature correspondence and grouping of features in motion perception at longer ISIs. In the aligned sequence half the frames consisted of a single coherent vertical grating, while the interleaved frames contained short strips. We argue that to achieve feature matching over time, the long edge and bar features must be broken up perceptually (segmented) into shorter elements before these short segments can appear to move in opposite directions. This idea correctly predicted that overlaying narrow, stationary, black horizontal lines at the junctions of the grating strips would improve performance in the aligned condition. The results support the view that, in addition to motion energy, feature analysis and feature tracking play an important role in motion perception.

Two processes in stereoscopic apparent motion

This study investigated the human ability to discriminate the motion direction of sequentially presented depth patterns produced by random-dot stereograms. The stereoscopic (cyclopean) patterns used here consisted of 256 rectangle patches, each of which had an alternative depth position (near or far). Two successive frames of correlated depth patterns made impressions of lateral motion when the pattern position in the second frame shifted laterally. The density of the patches that were near was varied. The Dmax that was measured using the 2AFC method was short when the density was high. The effect of depth reversing in the second frame was also tested. Under low density conditions, the performance was still good against reversing 3-D polarity. However, when the density was high, with depth reversal, motion in the reversed direction was perceived. Reversed motion was observed more often when SOA was small and when the density of near patches was near 1/2. Two strategies seem to exist in stereoscopic motion detecting: a polarity-independent process which matches figures, ignoring their depth polarity, and a polarity-dependent process which operates locally, ignoring 2-D shapes. The latter suggests the existence of a passive process in stereoscopic motion.

Motion perception over long interstimulus intervals

Recent studies using moving arrays of textured micropatterns have suggested that motion perception can be supported by two mechanisms, one quasilinear and sensitive to the motion of luminance-defined local texture, the other nonlinear and coding motion of contrast-defined envelopes of texture (Baker & Hess, 1998; Boulton & Baker, 1993b). Here we used similar patterns to study motion perception under conditions previously shown to isolate the nonlinear mechanism (low micropattern densities and positive interstimulus intervals [ISIs]. We measured direction discrimination for two-flash apparent motion over a much larger range of ISIs, and susceptibility to masking by incoherently moving "distractor" micropatterns. The results suggest that two nonlinear mechanisms can support motion perception under these conditions. One operates only for relatively short ISIs (less than c. 100 msec), is sensitive to small spatial displacements, and is relatively insensitive to distractor masking. The other operates over much longer ISIs, is insensitive to small spatial displacements, and is highly disrupted by distractor masking. These results are in line with previous studies suggesting that three mechanisms support motion perception.

Comparison of motion and stereopsis: linear and nonlinear performance

To address the issue of whether the luminance-dependent (linear) and contrast-dependent (nonlinear) processes in stereo and motion have a common computational basis, we compare both carrier-dependent and envelope-dependent performance for these two modalities by using the same stimulus and task: two-flash apparent motion/depth for a wide range of displacements. We do this for different densities, bandwidths, contrasts, spatial frequencies, and exposure durations. The results suggest that there is concordance not only between the luminance-dependent (linear) processes of motion and stereo but also between the envelope-dependent (nonlinear) processes of both modalities. Only one exception was found, but we show this to be amenable to an explanation based on a different contrast dependence for the nonlinear mechanisms of stereo and motion. This suggests that the computational basis of linear and nonlinear processes may be similar for stereopsis and motion.

Effect of noise contrast polarity and temporal asynchrony on visual sensitivity

We evaluated the effect of substitutive noise on contrast sensitivity within the context of linear (Fourier) and nonlinear (non-Fourier) visual processes. Orientation judgments for D6 (sixth spatial derivative of Gaussian) patterns were obtained from three visually normal subjects when random regions of the target and background were occluded by small (1.7 arc min) pixel arrays that were either all of the same contrast polarity or a mixture of equal percentages of negative and positive contrast. The target was presented either synchronously or asynchronously with the occluding elements. Our results indicate that the manipulation of noise characteristics in this way can bias performance either toward a nonlinear process that is insensitive to noise contrast polarity but sensitive to temporal asynchrony or toward a quasi-linear process that is sensitive to noise contrast polarity but insensitive to temporal asynchrony. These findings have relevance to models of the effect of spatial sampling on the visual performance of persons with retinal disease.

Second-order motions contribute to vection

First- and second-order motions differ in their ability to induce motion aftereffects (MAEs) and the kinetic depth effect (KDE). To test whether second-order stimuli support computations relating to motion-in-depth we examined the vection illusion (illusory self motion induced by image flow) using a vection stimulus (V, expanding concentric rings) that depicted a linear path through a circular tunnel. The set of vection stimuli contained differing amounts of first- and second-order motion energy (ME). Subjects reported the duration of the perceived MAEs and the duration of their vection percept. In Experiment 1 both MAEs and vection durations were longest when the first-order (Fourier) components of V were present in the stimulus. In Experiment 2, V was multiplicatively combined with static noise carriers having different check sizes. The amount of first-order ME associated with V increases with check size. MAEs were found to increase with check size but vection durations were unaffected. In general MAEs depend on the amount of first-order ME present in the signal. Vection, on the other hand, appears to depend on a representation of image flow that combines first- and second-order ME.

Detection of chromatic and luminance contrast modulation by the visual system

The data presented in this paper examine the ability of observers to detect a modulation in the contrast of chromatic and luminance gratings as a function of the carrier contrast, duration, and spatial frequency. The nature of the signal underlying this ability is investigated by examining both the paradigm used to make the measurement and the effect of grating masks on performance in the tasks. The results show that observers' ability to discriminate amplitude modulation from an unmodulated carrier is dependent on carrier contrast but only up to approximately 5-8 times carrier-detection threshold. Discrimination is, however, independent of spatial frequency [10-1 cycles per degree (cpd) component-frequency range], carrier color, and, most surprisingly, stimulus duration (1000-30 ms). This set of experiments compliments data from previous papers and assimilates many of the conclusions drawn from this previous data. There is absolutely no evidence for the existence of a distortion product mediating performance under any of the current conditions, and the data seriously question whether the visual system might use such a signal even if it does exist under more extreme conditions than those used here. The evidence suggests that the visual system detects variations in both chromatic and luminance contrast by means of a mechanism operating locally upon the spatial structure of the carrier.

Two mechanisms underlie processing of stochastic motion stimuli

We have constructed "limited lifetime" stochastic motion stimuli using Gabor functions instead of dots, thereby controlling the local attributes of spatial frequency and orientation. Human psychophysical data for direction discrimination using these stimuli reveal two qualitatively distinct kinds of processing. For small displacements, direction discrimination performance as a function of displacement is scaled with spatial frequency in a manner consistent with a linear filtering motion mechanism. Motion perception for relatively large displacements is not directly related to the spatial frequency, and is consistent with a nonlinear process which signals motion of contrast envelopes.

A nonlinear chromatic motion mechanism

Previous research has demonstrated two categorically distinct mechanisms mediating apparent motion of kinematograms composed of eccentricity-confined, randomly placed Gabor micropatterns: a quasi-linear mechanism operating for high micropattern densities and short time separations, and a nonlinear mechanism operating at low micropattern densities or longer time separations. Here we compare the performance of these two mechanisms using color (isoluminant) and luminance-defined stimuli. When these stimuli are defined only by their color contrast, the response of the quasi-linear mechanism is severely impaired, while the nonlinear mechanism remains fully operative. This result further strengthens the dichotomy between the two kinds of motion perception, and suggests that when color vision supports motion perception it does so primarily, or perhaps entirely, via a nonlinear mechanism.

The effects of distractor elements on direction discrimination in random Gabor kinematograms

For both Fourier and non-Fourier moving patterns, models have been proposed which detect motion based on either the net orientation of energy in the stimulus (after nonlinear stage for non-Fourier motion stimuli) or on the changes in the relative locations of spatial primitives in the image. Both approaches have been successful in accounting for detection of simple translational displacements, but we examined how such models coped with more demanding stimuli. We examined direction discrimination using two-flash random Gabor kinematograms which selectively reveal Fourier and non-Fourier motion mechanisms. In addition to target elements, multiple distractor elements were added, either static or randomly moving. It was found that detection of Fourier motion was relatively unaffected by the distractors unless they were of orthogonal orientation. Detection of non-Fourier motion was possible, but with a slightly higher error rate, even with many distractors and was not at all affected by orthogonal distractors. The results for distractors of the same orientation as targets are in better agreement with predictions of energy than with edge-matching models. The differing effects of orthogonal distractors further strengthen the proposed dichotomy of quasi-linear and nonlinear motion mechanisms, but indicate that the latter operates on a more complex representation than a simple contrast envelope.

Nonlinear preprocessing in short-range motion

The phenomenon of non-Fourier motion (visually perceived motion that cannot be explained simply on the basis of the autocorrelation structure of the visual stimulus) is well recognized, and is generally considered to be due to nonlinear preprocessing of the visual stimulus prior to a stage of standard motion analysis. We devised a sequence of novel visual stimuli in which the availability of a motion stimulus depends on the nature of the nonlinear preprocessing: an nth order stimulus Pn will generate a perception of motion if it is preprocessed by a nonlinearity of polynomial order n or greater, but not if preprocessed by a nonlinearity of polynomial order less than n. We found that unambiguous motion direction was perceived for P2, P3, and P4, but not for higher-order stimuli, and we measured the contrast thresholds for direction discrimination with superimposed noise. We found that an asymmetric compressive nonlinearity can, in a unified fashion, account for these results, while a purely quadratic nonlinearity or a rectification of the form T(p) = magnitude of p cannot. We compared velocity discrimination judgements for second-order non-Fourier stimuli (P2) with standard drifting gratings. Although velocity comparisons were veridical, uncertainties were greater for the non-Fourier stimuli. This could be reproduced by substituting a Fourier grating with superimposed noise for the non-Fourier grating. These findings are consistent with a single pathway which processes both Fourier and non-Fourier short-range motion, and are discussed in the context of other investigations which have been interpreted as demonstrating separate pathways.

Motion-reversal reveals two motion mechanisms functioning in scotopic vision

We studied scotopic motion mechanisms, using a two-frame sinusoidal grating separated by various ISIs equated for mean luminance level. Perceived direction of displacement varied with both ISI and luminance. As luminance decreased, apparent motion reversal disappeared. This is predicted by a first-order motion model if the underlying temporal impulse response function varies from biphasic under photopic conditions to monophasic under scotopic conditions. Performance at long (but not short) ISIs depends upon stimulus contrast, suggesting there is also a scotopic feature-tracking mechanism. With isoluminant and high spatial frequency gratings, where the temporal impulse response function is monophasic, no motion reversal was observed.

Optical blur and the perception of global coherent motion in random dot cinematograms

We evaluated the effect of +3.25 dioptres of optical blur on the discrimination of motion direction in random dot cinematograms. Dot displacement between frames varied from 2.1 to 63' of visual angle while the temporal interval was held constant. Optical blur worsened discrimination in three normal subjects at displacements below 16', but improved discrimination at displacements of 21' or more. In a second experiment, two subjects viewed equivalent velocity stimuli constructed with different combinations of temporal interval and spatial displacement. Results showed that the effect of blur was specific to displacement and not velocity. Furthermore, varying the dot density of the display showed that the effect of blur correlated with dot displacement and not the probability of dot mismatches. Since optical blur attenuates high spatial frequencies, this suggests that high spatial frequencies are important for motion perception when dot displacements are less than 16' to 21', but reduce motion perception at larger dot displacements. The use of random dot cinematograms in populations must take into account stimulus displacement and optical causes of reduced spatial acuity.

Impairment of the perception of second order motion but not first order motion in a patient with unilateral focal brain damage

Unlike first order motion, which is based on spatiotemporal variations in luminance, second-order motion relies on spatiotemporal variation of attributes derived from luminance, such as contrast. Here we show that a patient with a small unilateral cortical lesion adjacent to human cortical area MT (V5) has an apparently permanent disorder in perceiving several forms of second-order but not first-order motion in his contralateral visual field. This result indicates that separate pathways for motion perception exist, either as divergent pathways from area MT or even from primary visual cortex, or as separate pathways from subcortical areas to extrastriate visual areas.

Motion detection is limited by element density not spatial frequency

Two-frame random-element kinematograms were used to study the matching algorithm employed by the visual system to keep track of moving elements. Previous data have shown that the maximum spatial displacement detectable (dmax) for random-dot kinematogram stimuli increases both with increasing dot size and with decreasing centre frequency for spatially band-pass kinematograms. Both of these findings could be explained by either (i) a matching algorithm sensitive to the number of false targets in the display (informational limit) or (ii) spatial-frequency tuned sensors hardwired for detecting displacements of a constant proportion of their preferred frequency (phase-based limit). The present experiment was designed to differentiate between these alternative explanations. The stimuli were band-pass filtered (difference-of-Gaussian) random-dot patterns. The combination of six dot densities and three filter sizes produced 18 experimental conditions and allowed independent control of the spectral content and filtered-element density of the stimuli. When the dot density was high, dmax was larger for the coarse-filtered stimuli, as predicted by both theories. There was also a critical dot density for each filter size, above which dmax was constant but below which dmax rose sharply. This critical density was higher for fine-filtered stimuli such that at the lowest dot density of 0.025%, dmax was constant for all filter sizes. In support of the informational limit model, dmax was found to be directly proportional to the two-dimensional spacing of filtered elements. In contrast, dmax varied from 0.6 to 8.5 cycles of the stimulus peak frequency, suggesting that a phase-based model of motion detection cannot account for the results.

Spatial phase differences can drive apparent motion

Can shape differences drive apparent motion? Results from previous research are equivocal. Much of the confusion may be due to the use of relatively complex stimuli: letters or geometric shapes, comprising many spatial frequencies, phases, orientations, and contrasts. We focus on relatively simple stimuli: Gaussian damped f+nf compound sinewave gratings. We examine whether relative phase differences, which are critical for shape perception, can drive apparent motion. We find that some, but not all, phase differences can drive apparent motion. Specifically, stimuli that are easily discriminable and perceptually dissimilar can affect the solution of the correspondence problem. In this case, observers consistently perceive stimuli in one frame moving to the position of perceptually similar stimuli in the next frame. This general result holds over a wide range of spatial frequencies, orientations, and contrasts. Implications for theories of motion processing are discussed.

Attentional tracking in the perception of apparent motion: evidence from sequential blanking displays

Perception of sequential blanking displays was studied in a series of three experiments investigating factors that influence whether "shadow motion" or "item motion" is seen in a display. In addition to the duration of the blanking interval (BI) itself, three other such factors were identified: the eccentricity at which the display is viewed, the spacing of items in the display, and the type of motion that subjects are instructed to try to see. It is argued that these and other previously reported results are explicable without the need to invoke any kind of visual integration period. Instead, they are interpreted in terms of a first-order system of automatic luminance detectors and a second-order tracking system involving both voluntary and involuntary attention. The relationship of these findings to other recent work in apparent motion and visual attention and to other bistable motion displays is discussed.

Motion aftereffect with flickering test patterns reveals higher stages of motion processing

A series of experiments was conducted to clarify the distinction between motion aftereffects (MAEs) with static and counterphasing test patterns (static and flicker MAEs). It was found that while the motion of higher-order structure, such as areas defined by texture, flicker, or stereoscopic depth, induces little static MAE, such motion reliably generates flicker MAE. It was also found that static and flicker MAEs were induced in opposite directions for stimuli in which first- and second-order structures moved in opposite directions (compound graftings of 2f + 3f or 2f + 3f + 4f, shifting a half cycle of 2f). When the test was static, MAE was induced in the direction opposite to the first-order motion; but when the test was counterphasing, MAE was induced in the direction opposite to the second-order motion. This means that static MAE is predominantly induced by first-order motion, but that flicker MAE is affected strongly by second-order motion, along with first-order motion. The present results suggest that static MAE primarily reflects adaptation of a low-level motion mechanism, where first-order motion is processed, while flicker MAE reveals a high-level motion processing, where both first- and second-order motion signals are available.

An energy model of interframe interval effects in single-step apparent motion

A computational model was developed to explain the effects of an interframe interval (IFI) in single-step apparent motion experiments. In these experiments a stimulus appears in one position, disappears, and then reappears in a shifted position after a short or long IFI. If the luminance during the IFI matches the mean luminance of the stimulus frames, long IFIs result in perceived motion opposite the short-IFI conditions. Brighter or darker IFIs, however, do not support the reversed motion effect. The model possess the following defining characteristics: (1) a biphasic ("transient") channel whose signalled direction of motion reverses with changes of IFI duration; (2) a combined direction-opponent output which is the sum of directional responses developed in two channels--biphasic ("transient") and monophasic ("sustained"); (3) a signal/noise weighting of the contributions of the two channels to the final directional output of the system. Predictions of the model about the effects of IFI intensity and viewing eccentricity were tested and confirmed in two new psychophysical experiments. The interpretations of past studies which included a role for second-order motion mechanisms in explaining IFI duration effects were reexamined. Further empirical tests of the model were outlined.