Directional motion sensitivity under transparent motion conditions

Visual motion integration of bidirectional transparent motion in mouse opto-locomotor reflexes

Visual motion perception depends on readout of direction selective sensors. We investigated in mice whether the response to bidirectional transparent motion, activating oppositely tuned sensors, reflects integration (averaging) or winner-take-all (mutual inhibition) mechanisms. We measured whole body opto-locomotor reflexes (OLRs) to bidirectional oppositely moving random dot patterns (leftward and rightward) and compared the response to predictions based on responses to unidirectional motion (leftward or rightward). In addition, responses were compared to stimulation with stationary patterns. When comparing OLRs to bidirectional and unidirectional conditions, we found that the OLR to bidirectional motion best fits an averaging model. These results reflect integration mechanisms in neural responses to contradicting sensory evidence as has been documented for other sensory and motor domains.

Criterion-free measurement of motion transparency perception at different speeds

Transparency perception often occurs when objects within the visual scene partially occlude each other or move at the same time, at different velocities across the same spatial region. Although transparent motion perception has been extensively studied, we still do not understand how the distribution of velocities within a visual scene contribute to transparent perception. Here we use a novel psychophysical procedure to characterize the distribution of velocities in a scene that give rise to transparent motion perception. To prevent participants from adopting a subjective decision criterion when discriminating transparent motion, we used an “odd-one-out,” three-alternative forced-choice procedure. Two intervals contained the standard—a random-dot-kinematogram with dot speeds or directions sampled from a uniform distribution. The other interval contained the comparison—speeds or directions sampled from a distribution with the same range as the standard, but with a notch of different widths removed. Our results suggest that transparent motion perception is driven primarily by relatively slow speeds, and does not emerge when only very fast speeds are present within a visual scene. Transparent perception of moving surfaces is modulated by stimulus-based characteristics, such as the separation between the means of the overlapping distributions or the range of speeds presented within an image. Our work illustrates the utility of using objective, forced-choice methods to reveal the mechanisms underlying motion transparency perception.

Perception of Motion Transparency in 5-Month-Old Infants

We investigated the perceptual development of motion transparency in 3- to 5-month-old infants. In two experiments we tested a total of 55 infants and examined their preferential looking behaviour. In experiment 1, we presented transparent motion as a target, and uniform motion as a non-target consisting of random-dot motions. We measured the time during which infants looked at the target and non-target stimuli. In experiment 2, we used paired-dot motions (Qian et al, 1994 Journal of Neuroscience14 7357 – 7366) as non-targets and also measured target looking time. We calculated the ratio of the target looking time to the total target and no-target looking time. In both experiments we controlled the dot size, speed, the horizontal travel distance of the dots, and the motion pattern of the dots. The results demonstrated that 5-month-old infants showed a statistically significant preference for motion transparency in almost all stimulus conditions, whereas the preference in 3- and 4-month-old infants depended on stimulus conditions. These results suggest that the sensitivity to motion transparency was robust in 5-month-olds, but not in 3- and 4-month-olds.

Neural mechanisms of speed perception: transparent motion

Visual motion on the macaque retina is processed by direction- and speed-selective neurons in extrastriate middle temporal cortex (MT). There is strong evidence for a link between the activity of these neurons and direction perception. However, there is conflicting evidence for a link between speed selectivity of MT neurons and speed perception. Here we study this relationship by using a strong perceptual illusion in speed perception: when two transparently superimposed dot patterns move in opposite directions, their apparent speed is much larger than the perceived speed of a single pattern moving at that physical speed. Moreover, the sensitivity for speed discrimination is reduced for such bidirectional patterns. We first confirmed these behavioral findings in human subjects and extended them to a monkey subject. Second, we determined speed tuning curves of MT neurons to bidirectional motion and compared these to speed tuning curves for unidirectional motion. Consistent with previous reports, the response to bidirectional motion was often reduced compared with unidirectional motion at the preferred speed. In addition, we found that tuning curves for bidirectional motion were shifted to lower preferred speeds. As a consequence, bidirectional motion of some speeds typically evoked larger responses than unidirectional motion. Third, we showed that these changes in neural responses could explain changes in speed perception with a simple labeled line decoder. These data provide new insight into the encoding of transparent motion patterns and provide support for the hypothesis that MT activity can be decoded for speed perception with a labeled line model.

The motion aftereffect reloaded

The motion aftereffect is a robust illusion of visual motion resulting from exposure to a moving pattern. There is a widely accepted explanation of it in terms of changes in the response of cortical direction-selective neurons. Research has distinguished several variants of the effect. Converging recent evidence from different experimental techniques (psychophysics, single-unit recording, brain imaging, transcranial magnetic stimulation, visual evoked potentials and magnetoencephalography) reveals that adaptation is not confined to one or even two cortical areas, but occurs at multiple levels of processing involved in visual motion analysis. A tentative motion-processing framework is described, based on motion aftereffect research. Recent ideas on the function of adaptation see it as a form of gain control that maximises the efficiency of information transmission at multiple levels of the visual pathway.

Perception of opposite-moving dots in 3- to 5-month-old infants

We conducted four experiments on the development of motion perception in a total of 109 3- to 5-month-old infants using motion stimuli consisting of opposite-moving dots. A psychophysical study showed that adult subjects perceived two global planes with opposite-moving dots, but this global perception collapsed when paired opposite-moving dots were located within 0.4 deg of one another (Qian, Andersen, & Adelson, 1994). We used this paired-dot stimulus as a non-target and the opponent motion stimulus as a target and examined target preference using methods based on forced-choice-preferential looking (Teller, 1979). In Experiment 1, we used 90 moving dots as stimuli. The results showed that 5-month-old infants had a significant preference for the targets but 4- and 3-month-olds did not. In Experiment 2, we used a small number of dots, and the results showed that 5-month-old infants did not prefer the target significantly. These results suggest that the preference for a target decreases according to the number of dots. In Experiment 3, we used opponent motion with long traveling length of the dots, and the results showed that all age groups, including 3-month-olds, had a preference for the moving targets. We showed that the preference observed in Experiment 3 was dependent not on local traveling length but on the global opponency. These results suggest that the perception of motion opponency based on a global motion cue emerges at 5 months of age (Experiments 1 and 2) and that the traveling length of the dots promote this perception (Experiments 3 and 4).

Exogenously cued attention triggers competitive selection of surfaces

It has been reported that when an endogenous cue directs attention to a brief translation of one of two superimposed surfaces, observers reliably report the direction of that translation as well as the direction of a second translation of the cued surface. In contrast, if the uncued surface translates second, direction judgments are severely impaired for several hundred milliseconds. We replicated this result, but found that the impairment survived the removal of the endogenous cue. The impairment is therefore not due to endogenously cued attention. Instead, a brief translation of one surface acts as an exogenous cue that triggers an automatic selection mechanism, which suppresses processing of the other surface. This study provides a clear case of exogenous cueing of surface-based attention. We relate these results to identified competitive selection mechanisms in visual cortex.

Global speed processing: evidence for local averaging within, but not across two speed ranges

A primary task of the visual system is to extract the direction and speed of animate objects from the retinal image. We examined global speed processing by determining how local speeds are integrated and whether integration occurs across all speeds or within fixed speed ranges. The first experiment addressed how local motion signals are combined to determine the speed of an object in motion. Observers judged the speed of a moving cloud of dots that took a random walk in direction while the dots inside the cloud moved somewhat independently of the cloud itself. The apparent speed of the cloud of dots is found to change in proportion with the dot speed and is well predicted by calculating the average speed resulting from nearest neighbour matches across stimulus frames. The second experiment addressed whether local speeds are combined across all speeds or within fixed speed ranges for the detection of global motion. Global dot motion (GDM) stimuli that moved in a radial or rotational directions moving at a low speed of 1.2 degrees /s or a high speed of 9.6 degrees /s were used to measure the thresholds for detecting structured motion as a function of the speed of noise dots (0 degrees /s-10.8 degrees /s) added to the stimulus. With low-speed targets, only additional noise dots moving at low speeds interfered with signal detection. High-speed targets were only interfered with by dots moving at high speeds. This finding established the existence of at least two independent speed tuned systems in the range of speeds tested. Experiment 3 investigated how speed signals are combined within a system to determine the global speed. Using sectored radial GDM stimuli the perceived speed of the fastest dots was measured as a function of whether the speed of the dots in alternate sectors either activated the high or low-speed systems. Averaging only occurred when dots were all within the sensitivity range of the high-speed system, however, if alternate sectors activated separate speed systems, averaging did not occur. Thus local speeds are averaged, independent of direction, to derive a global speed estimate, but averaging only occurs within, and not across, speed tuned mechanisms.

Multiple uses of visual motion. The case for stability in sensory cortex

The problem of 'readout' from sensory maps has received considerable attention recently. Specifically, many experiments in different systems have suggested that the routing of sensory signals from cortical maps can be impressively flexible. In this review, we discuss many of the experiments addressing readout of motion signals from the middle temporal area (also known as V5) in the macaque monkey. We focus on two different types of output: perceptual reports (categorical decisions, usually) and motion-guided eye movements. We specifically consider situations in which multiple-motion vectors present in the stimulus are combined, as well as those in which one or more of the vectors in the stimulus is selected for output. The results of these studies suggest that in some situations multiple motions are vector averaged, while in others multiple vectors can be maintained. Interestingly, in most of the experiments producing a single (often average) vector, the output is a movement. However, many perceptual experiments involve the simultaneous processing of multiple-stimulus motions. One prosaic explanation for this pattern of apparently discrepant results is that different downstream structures impose different rules, in parallel, on the output from sensory maps such as the one in the middle temporal area. We also specifically discuss the case of motion opponency, a specific readout rule that has been posited to explain perceptual phenomena such as the waterfall illusion (motion aftereffect). We present evidence from a recent experiment showing that an opponent step must occur downstream from the middle temporal area itself. This observation is consistent with our proposal that significant processing need occur downstream from sensory structures. If a single output is to be used for multiple purposes, often at once, this necessitates a degree of task invariance on the sensory information present even at a relatively high level of cortical processing.

Direction repulsion in unfiltered and ring-filtered Julesz textures

Perceived directions of motion were measured for each of two superposed two-dimensional dynamic random patterns consisting of unfiltered or ring-filtered dense random-check (Julesz) textures. One pattern always moved in a cardinal direction (up, down, left, or right), and the other texture always moved in an oblique direction separated from the cardinal component by 20 degrees-80 degrees. Several cardinal/oblique speed ratios were tested. In Experiment 1, the textures were unfiltered. In Experiment 2, the textures were ring filtered and had the same center frequency (1, 2, or 4 cpd). In Experiment 3, a 1-cpd ring-filtered texture was paired with a 2-, 4-, or 8-cpd texture. Subjects consistently misperceived the directions of component motion in these experiments; the angular separation of movement of the two textures was perceptually exaggerated, a phenomenon referred to as direction repulsion (Marshak & Sekuler, 1979). The results show that (1) direction repulsion occurs across at least a fourfold range of spatial frequencies and a sixfold range of speed ratios, (2) direction repulsion varies systematically with speed ratio, and (3) across most conditions, direction repulsion is anisotropic--direction repulsion is more evident in the oblique directions than in the cardinal directions. These findings suggest that the spatiotemporal range of inhibitory interactions involved in motion transparency is much greater than previously appreciated.

Stereoscopic depth cues can segment motion information

Can the motion system selectively process elements at a particular depth? We attempted to answer this question using global coherence tasks in which signal and noise elements could be given different disparities. In experiment 1 we found that, if all the signal elements had a disparity different from that of the noise elements, performance was far better than when they had the same disparity (at least for stereo-normal observers). In a second experiment we found that adding additional noise elements to the motion task had no effect if they had a different disparity (however, they had a marked effect for stereo-blind observers). We conclude that stereo disparity can be used as a segmentation cue by the motion system.

Speed tuning of motion segmentation and discrimination

Motion transparency requires that the visual system distinguish different motion vectors and selectively integrate similar motion vectors over space into the perception of multiple surfaces moving through or over each other. Using large-field (7 degrees x 7 degrees) displays containing two populations of random-dots moving in the same (horizontal) direction but at different speeds, we examined speed-based segmentation by measuring the speed difference above which observers can perceive two moving surfaces. We systematically investigated this 'speed-segmentation' threshold as a function of speed and stimulus duration, and found that it increases sharply for speeds above approximately 8 degrees/s. In addition, speed-segmentation thresholds decrease with stimulus duration out to approximately 200 ms. In contrast, under matched conditions, speed-discrimination thresholds stay low at least out to 16 degrees/s and decrease with increasing stimulus duration at a faster rate than for speed segmentation. Thus, motion segmentation and motion discrimination exhibit different speed selectivity and different temporal integration characteristics. Results are discussed in terms of the speed preferences of different neuronal populations within the primate visual cortex.

Aftereffect of high-speed motion

A visual illusion known as the motion aftereffect is considered to be the perceptual manifestation of motion sensors that are recovering from adaptation. This aftereffect can be obtained for a specific range of adaptation speeds with its magnitude generally peaking for speeds around 3 deg s-1. The classic motion aftereffect is usually measured with a static test pattern. Here, we measured the magnitude of the motion aftereffect for a large range of velocities covering also higher speeds, using both static and dynamic test patterns. The results suggest that at least two (sub)populations of motion-sensitive neurons underlie these motion aftereffects. One population shows itself under static test conditions and is dominant for low adaptation speeds, and the other is prevalent under dynamic test conditions after adaptation to high speeds. The dynamic motion aftereffect can be perceived for adaptation speeds up to three times as fast as the static motion aftereffect. We tested predictions that follow from the hypothesised division in neuronal substrates. We found that for exactly the same adaptation conditions (oppositely directed transparent motion with different speeds), the aftereffect direction differs by 180 degrees depending on the test pattern. The motion aftereffect is opposite to the pattern moving at low speed when the test pattern is static, and opposite to the high-speed pattern for a dynamic test pattern. The determining factor is the combination of adaptation speed and type of test pattern.

Independent speed-tuned global-motion systems

Several experiments were conducted to investigate the role of speed in global-motion processing; the extraction of the direction of motion of a small subset of coherently-moving (signal) dots in a stimulus in which the other (noise) dots move in random directions. The specific aim of the experiments was to determine whether multiple speed-tuned global-motion systems exist. The results of these experiments are: (1) when the signal dots were chosen from a group of dots moving at 1.2 degrees s-1, the speed of additional-noise dots had to be below 4.8 degrees s-1 for them to affect global-motion extraction; (2) the addition of static dots did not impair the extraction of a global-motion signal carried by dots moving at 1.2 degrees s-1; (3) noise dots moving at 1.2 degrees s-1 impaired the extraction of a global-motion signal from dots moving at 10.8 degrees s-1, though not to the same extent as dots moving at a higher speed; and (4) these results were dependent upon speed, not spatial-step size or luminance contrast. These results are interpreted as indicating that global-motion extraction occurs within at least two independent speed tuned systems. One of these systems is sensitive to high speeds and the other to low speeds.

Forced-choice staircases with fixed step sizes: asymptotic and small-sample properties

Visual detection and discrimination thresholds are often measured using adaptive staircases, and most studies use transformed (or weighted) up/down methods with fixed step sizes--in the spirit of Wetherill and Levitt (Br J Mathemat Statist Psychol 1965;18:1-10) or Kaernbach (Percept Psychophys 1991;49:227-229)--instead of changing step size at each trial in accordance with best-placement rules--in the spirit of Watson and Pelli (Percept Psychophys 1983;47:87-91). It is generally assumed that a fixed-step-size (FSS) staircase converges on the stimulus level at which a correct response occurs with the probabilities derived by Wetherill and Levitt or Kaernbach, but this has never been proved rigorously. This work used simulation techniques to determine the asymptotic and small-sample convergence of FSS staircases as a function of such parameters as the up/down rule, the size of the steps up or down, the starting stimulus level, or the spread of the psychometric function. The results showed that the asymptotic convergence of FSS staircases depends much more on the sizes of the steps than it does on the up/down rule. Yet, if the size delta+ of a step up differs from the size delta- of a step down in a way that the ratio delta-/delta+ is constant at a specific value that changes with up/down rule, then convergence percent-correct is unaffected by the absolute sizes of the steps. For use with the popular one-, two-, three- and four-down/one-up rules, these ratios must respectively be set at 0.2845, 0.5488, 0.7393 and 0.8415, rendering staircases that converge on the 77.85%-, 80.35%-, 83.15%- and 85.84%-correct points. Wetherill and Levitt's transformed up/down rules--which require delta-/delta+ = 1--and the general version of Kaernbach's weighted up/down rule--which allows any delta-/delta+ ratio--fail to reach their presumed targets. The small-sample study showed that, even with the optimal settings, short FSS staircases (up to 20 reversals in length) are subject to some bias, and their precision is less than reasonable, but their characteristics improve when the size delta+ of a step up is larger than half the spread of the psychometric function. Practical recommendations are given for the design of efficient and trustworthy FSS staircases.

Opponent motion interactions in the perception of transparent motion

Interactions in the perception of motion transparency were investigated using a signal-detection paradigm. The stimuli were the linear sum of two independent, moving, random-check "signal" textures and a third texture consisting of dynamic random "noise." Performance was measured as the ratio of squared signal and noise contrasts was varied (S2/N2). Motion detectability was poorest when the two signal textures moved in opposite directions (180 degrees), intermediate when they moved in the same direction (0 degrees), and best when the textures moved in directions separated by 90 degrees in the stimulus plane. This pattern of results held across substantial variations in velocity, field size, duration, and texture-element size. Motion identification was also impaired, relative to 0 degrees, in the 180 degrees but not in the 90 degrees condition. These results are consistent with the idea that performance in the opponent-motion condition is limited by inhibitory (or suppressive) interactions. These interactions, however, appear to be direction specific: little, if any, inhibition was observed for perpendicular motion.