Motion capture changes to induced motion at higher luminance contrasts, smaller eccentricities, and larger inducer sizes

Motion direction tuning in centre-surround suppression of contrast

The perceived contrast of a central stimulus is reduced in the presence of a high contrast surround. A number of stimulus features influence the amount of suppression. A two-mechanism model has been proposed for stationary patterns involving a narrowly-tuned process, requiring very similar stimuli in the centre and surround, and a weaker, untuned or very broadly tuned process unselective for stimulus features. This study examines whether a similar model applies to the motion pathway in human participants by varying the orientation and direction of motion of the surround relative to the centre. Four experienced observers completed a two-interval forced-choice contrast matching task. The stimuli were drifting sinusoidal grating patterns with high contrast surrounds (95%) differing in direction of motion and orientation relative to the centre grating. All surround conditions produced suppression but a common orientation and direction of motion produced significantly more suppression than either opposite direction of motion conditions or orthogonal direction conditions. The tuning for motion direction differences was assessed for same and opposite directions of motion. These findings support the extension of the two-mechanism model of contrast suppression to motion direction.

Helix rotation: luminance contrast controls the shift from two-dimensional to three-dimensional perception

We present the helix rotation phenomenon, an array of moving dots that creates a conflict between two potential perceptions: a 3D Pulfrich-like horizontal rotation and a low-spatial-frequency up-down motion. We show that observers perceive up-down motion when the dots are equiluminant with the background and when the display is blurred; that the addition of sparse luminance information to equiluminant and blurred displays produces 3D perception; and that the balance between the perception of 3D rotation and up-down motion depends on the magnitude of the luminance contrast. The results are discussed in terms of the luminance capture of equiluminant information.

Near- and Far-Surround Suppression in Human Motion Discrimination

The spatial context has strong effects on visual processing. Psychophysics and modeling studies have provided evidence that the surround context can systematically modulate the perception of center stimuli. For motion direction, these center-surround interactions are considered to come from spatio-directional interactions between direction of motion tuned neurons, which are attributed to the middle temporal (MT) area. Here, we investigated through psychophysics experiments on human subjects changes with spatial separation in center-surround inhibition and motion direction interactions. Center-surround motion repulsion effects were measured under near-and far-surround conditions. Using a simple physiological model of the repulsion effect we extracted theoretical population parameters of surround inhibition strength and tuning widths with spatial distance. All 11 subjects showed clear motion repulsion effects under the near-surround condition, while only 10 subjects showed clear motion repulsion effects under the far-surround condition. The model predicted human performance well. Surround inhibition under the near-surround condition was significantly stronger than that under the far-surround condition, and the tuning widths were smaller under the near-surround condition. These results demonstrate that spatial separation can both modulate the surround inhibition strength and surround to center tuning width.

The field-size effect: Short motions look faster than long ones

Reducing the amount of motion information can surprisingly make motion look faster (e.g., motion behind Venetian blinds). We found that a textured pattern moving to the right at speeds ranging from 0.34 to 5.5°/s appeared to move 50% faster when viewed through a short (0.5°) compared with a long (4.5°) horizontal slot. Perceived speed varied inversely with the log of the slot length. We varied the length of rectangular apertures over a tenfold range and manipulated their size, shape, and orientation. We attribute the field-size effect mostly to landmarks provided by the ends of the slots, but we also examined temporal and spatial frequency and lateral inhibition of motion.

Robust size illusion produced by expanding and contracting flow fields

A new illusion is described. Randomly positioned dots moved radially within an imaginary annular window. The dots' motion periodically changed the direction, leading to an alternating percept of expanding and contracting motion. Strikingly, the apparent size of the enclosed circular region shrank during the dots' expanding phases and dilated during the contracting phases. We quantitatively measured the illusion, and found that the presence of energy at the local kinetic edge could not account for the illusion. Besides, we reproduced the illusion on a natural scene background seen from a first-person point of view that moved forward and backward periodically. Blurring the boundaries of motion areas could not reverse the illusion in all subjects. Taken together, our observed illusion is likely induced by optic flow processing with some components of motion contrast. Expanding or contracting dots may induce the self-motion perception of either approaching or leaving way from the circle. These will make the circle appear smaller or larger since its retinal size remains constant.

Integration of motion energy from overlapping random background noise increases perceived speed of coherently moving stimuli

The perception of visual motion can be profoundly influenced by visual context. To gain insight into how the visual system represents motion speed, we investigated how a background stimulus that did not move in a net direction influenced the perceived speed of a center stimulus. Visual stimuli were two overlapping random-dot patterns. The center stimulus moved coherently in a fixed direction, whereas the background stimulus moved randomly. We found that human subjects perceived the speed of the center stimulus to be significantly faster than its veridical speed when the background contained motion noise. Interestingly, the perceived speed was tuned to the noise level of the background. When the speed of the center stimulus was low, the highest perceived speed was reached when the background had a low level of motion noise. As the center speed increased, the peak perceived speed was reached at a progressively higher background noise level. The effect of speed overestimation required the center stimulus to overlap with the background. Increasing the background size within a certain range enhanced the effect, suggesting spatial integration. The speed overestimation was significantly reduced or abolished when the center stimulus and the background stimulus had different colors, or when they were placed at different depths. When the center- and background-stimuli were perceptually separable, speed overestimation was correlated with perceptual similarity between the center- and background-stimuli. These results suggest that integration of motion energy from random motion noise has a significant impact on speed perception. Our findings put new constraints on models regarding the neural basis of speed perception.

Distributed and Dynamic Neural Encoding of Multiple Motion Directions of Transparently Moving Stimuli in Cortical Area MT

Segmenting visual scenes into distinct objects and surfaces is a fundamental visual function. To better understand the underlying neural mechanism, we investigated how neurons in the middle temporal cortex (MT) of macaque monkeys represent overlapping random-dot stimuli moving transparently in slightly different directions. It has been shown that the neuronal response elicited by two stimuli approximately follows the average of the responses elicited by the constituent stimulus components presented alone. In this scheme of response pooling, the ability to segment two simultaneously presented motion directions is limited by the width of the tuning curve to motion in a single direction. We found that, although the population-averaged neuronal tuning showed response averaging, subgroups of neurons showed distinct patterns of response tuning and were capable of representing component directions that were separated by a small angle--less than the tuning width to unidirectional stimuli. One group of neurons preferentially represented the component direction at a specific side of the bidirectional stimuli, weighting one stimulus component more strongly than the other. Another group of neurons pooled the component responses nonlinearly and showed two separate peaks in their tuning curves even when the average of the component responses was unimodal. We also show for the first time that the direction tuning of MT neurons evolved from initially representing the vector-averaged direction of slightly different stimuli to gradually representing the component directions. Our results reveal important neural processes underlying image segmentation and suggest that information about slightly different stimulus components is computed dynamically and distributed across neurons.

SIGNIFICANCE STATEMENT

Natural scenes often contain multiple entities. The ability to segment visual scenes into distinct objects and surfaces is fundamental to sensory processing and is crucial for generating the perception of our environment. Because cortical neurons are broadly tuned to a given visual feature, segmenting two stimuli that differ only slightly is a challenge for the visual system. In this study, we discovered that many neurons in the visual cortex are capable of representing individual components of slightly different stimuli by selectively and nonlinearly pooling the responses elicited by the stimulus components. We also show for the first time that the neural representation of individual stimulus components developed over a period of ∼70-100 ms, revealing a dynamic process of image segmentation.

Suppressive mechanisms in visual motion processing: From perception to intelligence

Perception operates on an immense amount of incoming information that greatly exceeds the brain's processing capacity. Because of this fundamental limitation, the ability to suppress irrelevant information is a key determinant of perceptual efficiency. Here, I will review a series of studies investigating suppressive mechanisms in visual motion processing, namely perceptual suppression of large, background-like motions. These spatial suppression mechanisms are adaptive, operating only when sensory inputs are sufficiently robust to guarantee visibility. Converging correlational and causal evidence links these behavioral results with inhibitory center-surround mechanisms, namely those in cortical area MT. Spatial suppression is abnormally weak in several special populations, including the elderly and individuals with schizophrenia-a deficit that is evidenced by better-than-normal direction discriminations of large moving stimuli. Theoretical work shows that this abnormal weakening of spatial suppression should result in motion segregation deficits, but direct behavioral support of this hypothesis is lacking. Finally, I will argue that the ability to suppress information is a fundamental neural process that applies not only to perception but also to cognition in general. Supporting this argument, I will discuss recent research that shows individual differences in spatial suppression of motion signals strongly predict individual variations in IQ scores.

A common framework for the analysis of complex motion? Standstill and capture illusions

A series of illusions was created by presenting stimuli, which consisted of two overlapping surfaces each defined by textures of independent visual features (i.e., modulation of luminance, color, depth, etc.). When presented concurrently with a stationary 2-D luminance texture, observers often fail to perceive the motion of an overlapping stereoscopically defined depth-texture. This illusory motion standstill arises due to a failure to represent two independent surfaces (one for luminance and one for depth textures) and motion transparency (the ability to perceive motion of both surfaces simultaneously). Instead the stimulus is represented as a single non-transparent surface taking on the stationary nature of the luminance-defined texture. By contrast, if it is the 2D-luminance defined texture that is in motion, observers often perceive the stationary depth texture as also moving. In this latter case, the failure to represent the motion transparency of the two textures gives rise to illusionary motion capture. Our past work demonstrated that the illusions of motion standstill and motion capture can occur for depth-textures that are rotating, or expanding / contracting, or else spiraling. Here I extend these findings to include stereo-shearing. More importantly, it is the motion (or lack thereof) of the luminance texture that determines how the motion of the depth will be perceived. This observation is strongly in favor of a single pathway for complex motion that operates on luminance-defines texture motion signals only. In addition, these complex motion illusions arise with chromatically-defined textures with smooth transitions between their colors. This suggests that in respect to color motion perception the complex motions' pathway is only able to accurately process signals from isoluminant colored textures with sharp transitions between colors, and/or moving at high speeds, which is conceivable if it relies on inputs from a hypothetical dual opponent color pathway.

Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain

How the visual field is represented by neurons in the cerebral cortex is one of the most basic questions in visual neuroscience. However, research to date has focused heavily on the small part of the visual field within, and immediately surrounding the fovea. Studies on the cortical representation of the full visual field in the primate brain are still scarce. We have been investigating this issue with electrophysiological and anatomical methods, taking advantage of the small and lissencephalic marmoset brain, which allows easy access to the representation of the full visual field in many cortical areas. This review summarizes our main findings to date, and relates the results to a broader question: is the peripheral visual field processed in a similar manner to the central visual field, but with lower spatial acuity? Given the organization of the visual cortex, the issue can be addressed by asking: (1) Is visual information processed in the same way within a single cortical area? and (2) Are different cortical areas specialized for different parts of the visual field? The electrophysiological data from the primary visual cortex indicate that many aspects of spatiotemporal computation are remarkably similar across the visual field, although subtle variations are detectable. Our anatomical and electrophysiological studies of the extrastriate cortex, on the other hand, suggest that visual processing in the far peripheral visual field is likely to involve a distinct network of specialized cortical areas, located in the depths of the calcarine sulcus and interhemispheric fissure.

Neural correlates of induced motion perception in the human brain

A physically stationary stimulus surrounded by a moving stimulus appears to move in the opposite direction. There are similarities between the characteristics of this phenomenon of induced motion and surround suppression of directionally selective neurons in the brain. Here, functional magnetic resonance imaging was used to investigate the link between the subjective perception of induced motion and cortical activity. The visual stimuli consisted of a central drifting sinusoid surrounded by a moving random-dot pattern. The change in cortical activity in response to changes in speed and direction of the central stimulus was measured. The human cortical area hMT+ showed the greatest activation when the central stimulus moved at a fast speed in the direction opposite to that of the surround. More importantly, the activity in this area was the lowest when the central stimulus moved in the same direction as the surround and at a speed such that the central stimulus appeared to be stationary. The results indicate that the activity in hMT+ is related to perceived speed modulated by induced motion rather than to physical speed or a kinetic boundary. Early visual areas (V1, V2, V3, and V3A) showed a similar pattern; however, the relationship to perceived speed was not as clear as that in hMT+. These results suggest that hMT+ may be a neural correlate of induced motion perception and play an important role in contrasting motion signals in relation to their surrounding context and adaptively modulating our motion perception depending on the spatial context.

Motion noise changes directional interaction between transparently moving stimuli from repulsion to attraction

To interpret visual scenes, visual systems need to segment or integrate multiple moving features into distinct objects or surfaces. Previous studies have found that the perceived direction separation between two transparently moving random-dot stimuli is wider than the actual direction separation. This perceptual “direction repulsion” is useful for segmenting overlapping motion vectors. Here we investigate the effects of motion noise on the directional interaction between overlapping moving stimuli. Human subjects viewed two overlapping random-dot patches moving in different directions and judged the direction separation between the two motion vectors. We found that the perceived direction separation progressively changed from wide to narrow as the level of motion noise in the stimuli was increased, showing a switch from direction repulsion to attraction (i.e. smaller than the veridical direction separation). We also found that direction attraction occurred at a wider range of direction separations than direction repulsion. The normalized effects of both direction repulsion and attraction were the strongest near the direction separation of ∼25° and declined as the direction separation further increased. These results support the idea that motion noise prompts motion integration to overcome stimulus ambiguity. Our findings provide new constraints on neural models of motion transparency and segmentation.

A single theoretical framework for circular features processing in humans: orientation and direction of motion compared

Common computational principles underlie processing of various visual features in the cortex. They are considered to create similar patterns of contextual modulations in behavioral studies for different features as orientation and direction of motion. Here, I studied the possibility that a single theoretical framework, implemented in different visual areas, of circular feature coding and processing could explain these similarities in observations. Stimuli were created that allowed direct comparison of the contextual effects on orientation and motion direction with two different psychophysical probes: changes in weak and strong signal perception. One unique simplified theoretical model of circular feature coding including only inhibitory interactions, and decoding through standard vector average, successfully predicted the similarities in the two domains, while different feature population characteristics explained well the differences in modulation on both experimental probes. These results demonstrate how a single computational principle underlies processing of various features across the cortices.

Neuronal population decoding explains the change in signal detection sensitivity caused by task-irrelevant perceptual bias

Spatiotemporal context in sensory stimulus has profound effects on neural responses and perception, and it sometimes affects task difficulty. Recently reported experimental data suggest that human detection sensitivity to motion in a target stimulus can be enhanced by adding a slow surrounding motion in an orthogonal direction, even though the illusory motion component caused by the surround is not relevant to the task. It is not computationally clear how the task-irrelevant component of motion modulates the subject's sensitivity to motion detection. In this study, we investigated the effects of encoding biases on detection performance by modeling the stochastic neural population activities. We modeled two types of modulation on the population activity profiles caused by a contextual stimulus: one type is identical to the activity evoked by a physical change in the stimulus, and the other is expressed more simply in terms of response gain modulation. For both encoding schemes, the motion detection performance of the ideal observer is enhanced by a task-irrelevant, additive motion component, replicating the properties observed for real subjects. The success of these models suggests that human detection sensitivity can be characterized by a noisy neural encoding that limits the resolution of information transmission in the cortical visual processing pathway. On the other hand, analyses of the neuronal contributions to the task predict that the effective cell populations differ between the two encoding schemes, posing a question concerning the decoding schemes that the nervous system used during illusory states.

Reaction time to motion onset and magnitude estimation of velocity in the presence of background motion

Reaction times (RT) to motion onset of a target grating moving at 0.4, 0.6, 0.8, 1.0 or 1.6 °/s and magnitude estimation of the same velocities were studied in the presence of the surrounding background motion which was either in the same or opposite direction. Surprisingly, we found no relative motion effect: if the background motion, irrespective of its direction, affected the target, then it delayed the RTs and decreased velocity ratings. The background motion was effective on RTs to motion onset only when the target was relatively small and immediately surrounded by a moving background. Increases in RTs were mostly explained by an apparent slowdown of the target stimulus velocity which was caused by the interference from the moving background. The background motion also affected velocity ratings by decreasing them without systematic effect of the background motion direction.

Stimulus-dependent modulation of suppressive influences in MT

Surround suppression contributes to important functions in visual processing, such as figure-ground segregation; however, this benefit comes at the cost of decreased neuronal sensitivity. Studies of receptive fields at several levels of the visual hierarchy have demonstrated that surround suppression is reduced for low contrast stimuli, thereby improving neuronal sensitivity. We investigated whether this reduction of surround suppression reflects a general processing strategy to boost sensitivity for weak signals by summing them over a larger region of the visual field (spatial integration) or if the reduction is limited to specialized stimulus conditions. To do this, we used stochastic motion stimuli to measure surround suppression in area MT of alert macaque monkeys. While varying stimulus size we also varied the strength of two other critical stimulus features: contrast and coherence (i.e., the proportion of dots moving in the preferred direction of the neuron). We found that reducing stimulus contrast weakened surround suppression, but reducing stimulus coherence had the opposite effect, indicating that diminished surround suppression is not a universal response to stimuli of low signal-to-noise. This can be partially explained by our other finding, which is that surrounds in MT are very broadly direction tuned. Instead of producing a reduction of surround suppression that would improve the ability of the neuron to integrate preferred direction motion, low coherence stimuli activated the broadly tuned surrounds relatively better than the centers, which are generally more direction selective. Our results are consistent with a normalization mechanism of surround suppression that pools broadly across multiple stimulus dimensions.

Differential effect of luminance contrast reduction and noise on motion induction

Motion perception in a region is affected by motion in the surround regions. When a physically static or flickering stimulus surrounded by moving stimuli appears to move in the direction opposite to that of the surround motion, it is referred to as motion contrast. When the centre appears to move in the same direction, it is referred to as motion assimilation. We investigated how noise and luminance contrast affect motion induction by employing static and dynamic counterphase flickering targets. The tendency of motion assimilation was found to be stronger at a high noise level than at a low noise level for both static and dynamic targets. On the other hand, a decrease of luminance contrast tended to strengthen the tendency of motion contrast. However, the addition of noise and the decrease of luminance contrast decreased the visibility of motion comparably. These results suggest that the visual system changes the mode of motion induction according to the noise level, but not the visibility.

Spatial coincidence of intentional actions modulates an implicit visuomotor control

We investigated a visuomotor mechanism contributing to reach correction: the manual following response (MFR), which is a quick response to background visual motion that frequently occurs as a reafference when the body moves. Although several visual specificities of the MFR have been elucidated, the functional and computational mechanisms of its motor coordination remain unclear mainly because it involves complex relationships among gaze, reaching target, and visual stimuli. To directly explore how these factors interact in the MFR, we assessed the impact of spatial coincidences among gaze, arm reaching, and visual motion on the MFR. When gaze location was displaced from the reaching target with an identical visual motion kept on the retina, the amplitude of the MFR significantly decreased as displacement increased. A factorial manipulation of gaze, reaching-target, and visual motion locations showed that the response decrease is due to the spatial separation between gaze and reaching target but is not due to the spatial separation between visual motion and reaching target. Additionally, elimination of visual motion around the fovea attenuated the MFR. The effects of these spatial coincidences on the MFR are completely different from their effects on the perceptual mislocalization of targets caused by visual motion. Furthermore, we found clear differences between the modulation sensitivities of the MFR and the ocular following response to spatial mismatch between gaze and reaching locations. These results suggest that the MFR modulation observed in our experiment is not due to changes in visual interaction between target and visual motion or to modulation of motion sensitivity in early visual processing. Instead the motor command of the MFR appears to be modulated by the spatial relationship between gaze and reaching.

Invisible motion contributes to simultaneous motion contrast

The purpose of the present study was two-fold. First we examined whether visible motion appearance was altered by the spatial interaction between invisible and visible motion. We addressed this issue by means of simultaneous motion contrast, in which a horizontal test grating with a counterphase luminance modulation was seen to have the opposite motion direction to a peripheral inducer grating with unidirectional upward or downward motion. Using a mirror stereoscope, observers viewed the inducer and test gratings with one eye, and continuous flashes of colorful squares forming an annulus shape with the other eye. The continuous flashes rendered the inducer subjectively invisible. The observers' task was to report whether the test grating moved upward or downward. Consequently, simultaneous motion contrast was observed even when the inducer was invisible (Experiment 1). Second, we examined whether the observers could correctly respond to the direction of invisible motion: It was impossible (Experiment 2).

Filling-in and suppression of visual perception from context: a Bayesian account of perceptual biases by contextual influences

Visual object recognition and sensitivity to image features are largely influenced by contextual inputs. We study influences by contextual bars on the bias to perceive or infer the presence of a target bar, rather than on the sensitivity to image features. Human observers judged from a briefly presented stimulus whether a target bar of a known orientation and shape is present at the center of a display, given a weak or missing input contrast at the target location with or without a context of other bars. Observers are more likely to perceive a target when the context has a weaker rather than stronger contrast. When the context can perceptually group well with the would-be target, weak contrast contextual bars bias the observers to perceive a target relative to the condition without contexts, as if to fill in the target. Meanwhile, high-contrast contextual bars, regardless of whether they group well with the target, bias the observers to perceive no target. A Bayesian model of visual inference is shown to account for the data well, illustrating that the context influences the perception in two ways: (1) biasing observers' prior belief that a target should be present according to visual grouping principles, and (2) biasing observers' internal model of the likely input contrasts caused by a target bar. According to this model, our data suggest that the context does not influence the perceived target contrast despite its influence on the bias to perceive the target's presence, thereby suggesting that cortical areas beyond the primary visual cortex are responsible for the visual inferences.

Evidence for flow-parsing in radial flow displays

Retinal motion of objects is not in itself enough to signal whether or how objects are moving in the world; the same pattern of retinal motion can result from movement of the object, the observer or both. Estimation of scene-relative movement of an object is vital for successful completion of many simple everyday tasks. Recent research has provided evidence for a neural flow-parsing mechanism which uses the brain's sensitivity to optic flow to separate retinal motion signals into those components due to observer movement and those due to the movement of objects in the scene. In this study we provide further evidence that flow-parsing is implicated in the assessment of object trajectory during observer movement. Furthermore, it is shown that flow-parsing involves a global analysis of retinal motion, as might be expected if optic flow processing underpinned this mechanism.

The effects of interocular correlation and contrast on stereoscopic depth magnitude estimation

PURPOSE

Decreasing the interocular correlation in random dot stereograms elevates disparity detection thresholds. Whether decorrelation also affects perceived depth from suprathreshold disparity magnitudes is unknown. The present study investigated the effects of interocular correlation and contrast on the magnitude of perceived depth in suprathreshold random dot stereograms.

METHODS

Stereoscopic depth magnitude estimation as a function of percent interocular correlation of dynamic random dot stimuli was measured for five human subjects with clinically normal binocular vision. Each trial's stimulus was randomly assigned one of two magnitudes of either crossed or uncrossed relative disparity. Subjects verbally reported the direction and magnitude of perceived relative depth for each trial using a modulus-free scale. Normalized depth magnitude estimations as a function of the percent interocular correlation demonstrated the relationship between perceived depth, interocular correlation and contrast within subjects. Inter-subject variability was examined with comparisons of data across subjects.

RESULTS

The depth magnitude perceived for a given magnitude of disparity declined as the percent of correlation of elements between the eyes decreased for both crossed and uncrossed directions. The effect generally was greater for uncrossed disparities and lower contrast. Some subjects demonstrated asymmetries in perceived depth for crossed vs. uncrossed disparities of the same magnitude.

CONCLUSIONS

Magnitude estimation of suprathreshold stimuli provided a method of studying performance characteristics of stereoscopic depth perception across the range of functional disparities. Differences found in depth magnitude estimation as a function of the sign of disparity suggest that the neural mechanisms underlying depth perception from uncrossed disparity are more sensitive to image decorrelation, particularly at low contrast, than the mechanisms underlying depth estimation from crossed disparity. These results could occur from differences in near and far disparity-sensitive neurons, from the geometrical relationship between disparity and physical distance in normal viewing, or from the response measure independent of perception.

Shared attentional resources for global and local motion processing

One of the most important aspects of visual attention is its flexibility; our attentional "window" can be tuned to different spatial scales, allowing us to perceive large-scale global patterns and local features effortlessly. We investigated whether the perception of global and local motion competes for a common attentional resource. Subjects viewed arrays of individual moving Gabors that group to produce a global motion percept when subjects attended globally. When subjects attended locally, on the other hand, they could identify the direction of individual uncrowded Gabors. Subjects were required to devote their attention toward either scale of motion or divide it between global and local scales. We measured direction discrimination as a function of the validity of a precue, which was varied in opposite directions for global and local motion such that when the precue was valid for global motion, it was invalid for local motion and vice versa. There was a trade-off between global and local motion thresholds, such that increasing the validity of precues at one spatial scale simultaneously reduced thresholds at that spatial scale but increased thresholds at the other spatial scale. In a second experiment, we found a similar pattern of results for static-oriented Gabors: Attending to local orientation information impaired the subjects' ability to perceive globally defined orientation and vice versa. Thresholds were higher for orientation compared to motion, however, suggesting that motion discrimination in the first experiment was not driven by orientation information alone but by motion-specific processing. The results of these experiments demonstrate that a shared attentional resource flexibly moves between different spatial scales and allows for the perception of both local and global image features, whether these features are defined by motion or orientation.

Adaptive surround modulation in cortical area MT

Visual motion perception relies on two opposing operations: integration and segmentation. Integration overcomes motion ambiguity in the visual image by spatial pooling of motion signals, whereas segmentation identifies differences between adjacent moving objects. For visual motion area MT, previous investigations have reported that stimuli in the receptive field surround, which do not elicit a response when presented alone, can nevertheless modulate responses to stimuli in the receptive field center. The directional tuning of this "surround modulation" has been found to be mainly antagonistic and hence consistent with segmentation. Here, we report that surround modulation in area MT can be either antagonistic or integrative depending upon the visual stimulus. Both types of modulation were delayed relative to response onset. Our results suggest that the dominance of antagonistic modulation in previous MT studies was due to stimulus choice and that segmentation and integration are achieved, in part, via adaptive surround modulation.

Explaining the footsteps, belly dancer, Wenceslas, and kickback illusions

The footsteps illusion (FI) demonstrates that an object's background can have a profound effect on the object's perceived speed. This illusion consists of a yellow bar and a blue bar that move over a black-and-white, striped background. Although the bars move at a constant rate, they appear to repeatedly accelerate and decelerate in antiphase with each other. Previously, this illusion has been explained in terms of the variations in contrast at the leading and trailing edges of the bars that occur as the bars traverse the striped background. Here, we show that this explanation is inadequate and instead propose that for each bar, the bar's leading edge, trailing edge, lateral edges, and the surrounding background edges all contribute to the bar's perceived speed and that the degree to which each edge contributes to the motion percept is determined by that edge's contrast. We show that this theory can explain all the data on the FI as well as the belly dancer and Wenceslas illusions. We conclude by presenting a new illusion, the kickback illusion, which, although geometrically similar to the FI, is mediated by a different mechanism, namely, reverse phi motion.

Spatiotemporal tuning of rapid interactions between visual-motion analysis and reaching movement

In addition to the goal-directed preplanned control, which strongly governs reaching movements, another type of control mechanism is suggested by recent findings that arm movements are rapidly entrained by surrounding visual motion. It remains, however, controversial whether this rapid manual response is generated in a goal-oriented manner similarly to preplanned control or is reflexively and directly induced by visual motion. To investigate the sensorimotor process underlying rapid manual responses induced by large-field visual motion, we examined the effects of contrast and spatiotemporal frequency of the visual-motion stimulus. The manual response amplitude increased steeply with image contrast up to 10% and leveled off thereafter. Regardless of the spatial frequency, the response amplitude increased almost proportionally to the logarithm of stimulus speed until the temporal frequency reached 15-20 Hz and then fell off. The maximum response was obtained at the lowest spatial frequency we examined (0.05 cycles/degrees). These stimulus specificities are surprisingly similar to those of the reflexive ocular-following response induced by visual motion, although there is no direct motor entrainment from the ocular to manual responses. In addition, the spatiotemporal tuning is clearly different from that of perceptual effects caused by visual motion. These comparisons suggest that the rapid manual response is generated by a reflexive sensorimotor mechanism. This mechanism shares a distinctive visual-motion processing stage with the reflexive control for other motor systems yet is distinct from visual-motion perception.

Large-field visual motion directly induces an involuntary rapid manual following response

Recent neuroscience studies have been concerned with how aimed movements are generated on the basis of target localization. However, visual information from the surroundings as well as from the target can influence arm motor control, in a manner similar to known effects in postural and ocular motor control. Here, we show an ultra-fast manual motor response directly induced by a large-field visual motion. This rapid response aided reaction when the subject moved his hand in the direction of visual motion, suggesting assistive visually evoked manual control during postural movement. The latency of muscle activity generating this response was as short as that of the ocular following responses to the visual motion. Abrupt visual motion entrained arm movement without affecting perceptual target localization, and the degrees of motion coherence and speed of the visual stimulus modulated this arm response. This visuomotor behavior was still observed when the visual motion was confined to the "follow-through" phase of a hitting movement, in which no target existed. An analysis of the arm movements suggests that the hitting follow through made by the subject is not a part of a reaching movement. Moreover, the arm response was systematically modulated by hand bias forces, suggesting that it results from a reflexive control mechanism. We therefore propose that its mechanism is radically distinct from motor control for aimed movements to a target. Rather, in an analogy with reflexive eye movement stabilizing a retinal image, we consider that this mechanism regulates arm movements in parallel with voluntary motor control.

Fixational eye movements and motion perception

Small eye movements are necessary for maintained visibility of the static scene, but at the same time they randomly oscillate the retinal image, so the visual system must compensate for such motions to yield the stable visual world. According to the theory of visual stabilization based on retinal motion signals, objects are perceived to move only if their retinal images make spatially differential motions with respect to some baseline movement probably due to eye movements. Motion illusions favoring this theory are demonstrated, and psychophysical as well as brain-imaging studies on the illusions are reviewed. It is argued that perceptual stability is established through interactions between motion-energy detection at an early stage and spatial differentiation of motion at a later stage. As such, image oscillations originating in fixational eye movements go unnoticed perceptually, and it is also shown that image oscillations are, though unnoticed, working as a limiting factor of motion detection. Finally, the functional importance of non-differential, global motion signals are discussed in relation to visual stability during large-scale eye movements as well as heading estimation.

Dynamics of directional selectivity in MT receptive field centre and surround

We studied receptive field organization of motion-sensitive neurons in macaque middle temporal cortical area (MT), by mapping direction selectivity in space and in time. Stimuli consisted of pseudorandom sequences of single motion steps presented simultaneously at many different receptive field locations. Spatio-temporal receptive field profiles were constructed by cross-correlating stimuli and spikes. The resulting spike-triggered averages revealed centre-surround organization. The temporal dynamics of the receptive fields were generally biphasic with increased probability for the preferred direction at short latency (50-70 ms) and decreased probability at longer latency (80-100 ms). The response latency of the receptive field surround was on average 16 ms longer than that of the centre. Our results show that surround input and biphasic behaviour reflect two different mechanisms, which make MT cells specifically sensitive to motion contrast in space and time.

Stereoscopic depth magnitude estimation: effects of stimulus spatial frequency and eccentricity

To determine the effects of stimulus spatial frequency and retinal eccentricity on the perception of depth magnitude derived from disparity cues alone, subjects were asked to estimate the magnitude of depth of a stereoscopically viewed Gabor patch presented to the central or peripheral field with either crossed or uncrossed absolute disparity. Disparity vergence responses to the same Gabor stimuli were separately estimated subjectively by determining the offset required for dichoptic nonius alignment following presentation of the stimulus. The normalized stereoscopic magnitude estimation data generally showed that crossed disparities were perceived with greater depth than uncrossed disparities of the same magnitude, whether presented to the central or peripheral field. Asymmetries in magnitude of depth perception ranged from mild differences between depth directions to complete lack of depth perception for one direction. Disparity vergence response functions varied from (1) appropriate initiation of vergence to both directions of disparity, (2) initiation of vergence to only one direction of disparity, or (3) an attenuated initiation of vergence response to either direction of disparity. Within subjects, their asymmetries in magnitude of depth perception did not correlate with their asymmetries in vergence initiation. The similarity of the asymmetric depth magnitude estimation for a given individual at both stimulus locations tested suggests that common neural mechanisms are responsible for central and peripheral depth magnitude estimation. The lack of correlation between the perceptual and motor responses to the same stimuli suggests that the neural pathways for these responses diverge shortly after the detection of disparity in primary visual cortex.

Spatial interference among moving targets

Peripheral vision for static form is limited both by reduced spatial acuity and by interference among adjacent features ('crowding'). However, the visibility of acuity-corrected image motion is relatively constant across the visual field. We measured whether spatial interference among nearby moving elements is similarly invariant of retinal eccentricity and assessed if motion integration could account for any observed sensitivity loss. We report that sensitivity to the direction of motion of a central target-highly visible in isolation-was strongly impaired by four drifting flanking elements. The extent of spatial interference increased with eccentricity. Random-direction flanks and flanks whose directions formed global patterns of rotation or expansion were more disruptive than flanks forming global patterns of translation, regardless of the relative direction of the target element. Spatial interference was low-pass tuned for spatial frequency and broadly tuned for temporal frequency. We show that these results challenge the generality of models of spatial interference that are based on retinal image quality, masking, confusions between target and flanks, attentional resolution limits or (simple) "averaging" of element parameters. Instead, the results suggest that spatial interference is a consequence of the integration of meaningful image structure within large receptive fields. The underlying connectivity of this integration favours low spatial frequency structure but is broadly tuned for speed.

Effects of the noise level on induced motion

Motion in a part of the field induces motion in an adjoining region. In this study, it was investigated how the noise level affects induced motion of a counterphase flickering (target) grating due to adjacent drifting (inducer) gratings. It was shown that at low noise levels, motion contrast occurred, and at high noise levels, motion assimilation occurred. When the noise level was randomly set for each trial, the adaptive change with the noise level was also observed. The result suggests that the adaptive change occurs for a short period. It was also found that noise for the target as well as noise for the inducers contributes to the effect of noise on motion induction. It suggests that the overall noise level is crucial for the effect. The study provided evidence that motion integration changes from a spatially band-pass operation to a low-pass operation as the signal-to-noise ratio (SNR) decreases.

Correlations between fixation stability and visual motion sensitivity

To assess influences of fixational drift eye movements on motion detection, lower thresholds for motion and drift amplitudes were measured in normal subjects. The threshold was higher without visible surrounds than with a surround, and had a positive correlation with drift amplitude. The same effect, but more pronounced, was found when the surround was visible but flickered synchronously. In contrast, the correlation disappeared in the threshold with a static surround. These results suggest that, while spurious image motions by eye drift can have a detrimental effect, a mechanism tuned for differential motions normally counteracts it.

Signal strength determines the nature of the relationship between perception and working memory

Neurophysiological and behavioral studies have shown that perception and memory share neural substrates and functional properties. But are perception and the active working memory of a stimulus one and the same? To address this question in the spatial domain, we compared the percept and the working memory of the position of a target stimulus embedded within a surround of moving dots. Motion in a particular direction after the target's offset biased the memory of target location in the same direction. However, motion simultaneous with a high-contrast, perceptually strong target biased the percept of target location in the opposite direction. Thus, perception and working memory can be modified by motion in qualitatively different ways. Manipulations to strengthen the memory trace had no effect on the direction of the memory bias, indicating that memory signal strength can never equal that of the percept of a strong stimulus. However, the percept of a weak stimulus was biased in the direction of motion. Thus, although perception and working memory are not inherently different, they can differ behaviorally depending on the strength of the perceptual signal. Understanding how a changing surround biases neural representations in general, and postsensory processes in particular, can help one understand past reports of spatial mislocalization.

Detection of relative and uniform motion

We measured the lowest velocity (velocity threshold) for discriminating motion direction in relative and uniform motion stimuli, varying the contrast and the spatial frequency of the stimulus gratings. The results showed significant differences in the effects of contrast and spatial frequency on the threshold, as well as on the absolute threshold level between the two motion conditions, except when the contrast was 1% or lower. Little effect of spatial frequency was found for uniform motion, whereas a bandpass property with a peak at approximately 5 cycles per degree was found for relative motion. It was also found that contrast had little effect on uniform motion, whereas the threshold decreased with increases in contrast up to 85% for relative motion. These differences cannot be attributed to possible differences in eye movements between the relative and the uniform motion conditions, because the spatial-frequency characteristics differed in the two conditions even when the presentation duration was short enough to prevent eye movements. The differences also cannot be attributed to detecting positional changes, because the velocity threshold was not determined by the total distance of the stimulus movements. These results suggest that there are two different motion pathways: one that specializes in relative motion and one that specializes in uniform or global motion. A simulation showed that the difference in the response functions of the two possible pathways accounts for the differences in the spatial-frequency and contrast dependency of the velocity threshold.

Adaptation to relative and uniform motion

We compared the discriminability of motion direction with a relative motion stimulus after prolonged exposure to relative or uniform motion. Experiment 1 showed that the velocity threshold for the relative motion test after relative motion exposure was higher than that after uniform motion exposure, whereas no such difference was found when we tested with a uniform motion stimulus. Experiment 2 showed that prolonged exposure to relative motion decreased the discriminability of speed differences more than exposure to uniform motion. These results suggest that the visual system's pathway for relative motion signals is different from that for uniform motion signals.

Effects of attentional modulation of a stationary surround in adaptation to motion

The effect of varying the spatial relationships between an adapt/test grating and a stationary surrounding reference grating, and their interaction with diversion of attention during adaptation, were investigated in two experiments on the movement aftereffect (MAE). In experiment 1, MAEs were found to increase as the separation between the surrounding grating and the adapt/test grating decreased, but not with the area of the adapt/test grating. Although diversion during adaptation (repeating changing digits at the fixation point) reduced MAE durations, its effects did not interact with any of the stimulus variables. In experiment 2, MAE durations increased as the outer dimensions of the reference grating were increased, and this effect did interact with diversion, so that the effects of diversion were smaller when the surround grating was larger. This suggests that diversion may be affecting the inputs to an opponent process in motion adaptation, with a smaller effect on the surrounds than on the centres of antagonistic motion-contrast detectors with large receptive fields. A third experiment showed that, although repeating the word 'zero' during adaptation reduced MAEs, this reduction was smaller than that from naming a changing sequence of digits (and not significantly different from that from simply observing the changing digits), suggesting that MAE reductions are not produced only, if at all, by putative movements of the head and eyes caused by speaking.

On the perceived location of global motion

We measured the effects of coherent motion of one set of dots on the perceived location of Gaussian envelopes formed by luminance modulation of a second set of dots. Perceived shifts in envelope location in the direction of coherent motion were obtained even when the dots forming the envelopes did not physically move in the direction of coherent motion. In such cases, perceived shifts coincided with stimulus configurations that permitted motion integration of the envelope dots with the coherently moving dots, for example, when envelope dots moved in random directions as opposed to being static. In subsequent experiments we explored the type of motion integration underlying the positional shifts obtained. We discounted the possibility that the visual system incorrectly attributes motion signals associated with coherently moving dots to envelope dots by demonstrating that positional shifts could be obtained even when the coherent dots were laterally displaced to either side of the envelope dots such that the regions occupied by the dots did not overlap. We also discounted spatio-temporal summation within the receptive fields of low-spatial-frequency motion-sensitive mechanisms by demonstrating that positional shifts persisted even when the dot displays were high-pass filtered. These results, coupled with the observation that the proportion of coherently moving dots required to produce positional shifts correlated well with global motion thresholds measured for the same dot configurations, suggests that visual processes which underlie motion-dependent positional shifts are based at least in part on cooperative interactions of the type implicated in global motion.

Motion capture depends on signal strength

When flickering dots are superimposed onto a drifting grating, the dots appear to move coherently with the grating. In this study we examine: (i) how the perceived direction of a compound stimulus composed of superimposed grating and dots, moving in opposite directions with equal speeds, is influenced by the relative strength of the motion signals; (ii) how the perceived speed of a compound stimulus composed of superimposed grating and dots, moving in the same direction but at different speeds, is influenced by the relative strength of the motion signals; and (iii) whether this stimulus is discriminable from its metameric speed match. Dot signal strength was manipulated by using different proportions of signal dots in noise and different dot lifetimes. Both the perceived direction and speed of these compound stimuli depended upon the relative motion-signal strengths of the grating and the dots. Those compound stimuli that appeared coherent were not discriminable from the speed-matched metameric compound stimuli. When the signals were completely integrated into a coherent compound stimulus, the local motion signals were no longer perceptually available, though both contributed to the global percept. These data strongly support a weighted-combination model where the relative weights depend on signal strength, instead of a winner-takes-all model.

Modulation of spatial attention with unidirectional field motion: an implication for the shift of the OKN beating field

During optokinetic nystagmus (OKN) the mean eye position of gaze (the beating field) shifts in the direction of the fast phases. The function of this shift may be to re-orient the eyes in the direction of self-motion which optic flow implies (in-coming field). This idea leads to the hypothesis that visual attention may be directed toward the In-coming field. In Experiment 1, subjects detected a visual flash presented against unidirectional field motion. The OKN beating field was shifted toward the In-coming field, and manual reaction times were shorter when the target appeared in the In-coming field. Experiment 2 revealed that this In-coming field advantage occurred even when OKN (and thus the mean eye-position shift) was suppressed. Subsequent experiments showed that the In-coming field advantage is not due to a local motion interaction (Experiment 3), survives subject's voluntary allocation of attention (Experiment 4), and develops over less than 320 ms after the onset of the motion field (Experiment 5). These results suggest that unidirectional field motion tends to automatically shift visual attention toward the In-coming field.

The framing effect with rectangular and trapezoidal surfaces: actual and pictorial surface slant, frame orientation, and viewing condition

The perceived slant of a surface relative to the frontal plane can be reduced when the surface is viewed through a frame between the observer and the surface. Aspects of this framing effect were investigated in three experiments in which observers judged the orientations-in-depth of rectangular and trapezoidal surfaces which were matched for pictorial depth. In experiments 1 and 2, viewing was stationary-monocular. In experiment 1, a frontal rectangular frame was present or absent during viewing. The perceived slants of the surfaces were reduced in the presence of the frame; the reduction for the trapezoidal surface was greater, suggesting that conflict in stimulus information contributes to the phenomenon. In experiment 2, the rectangular frame was either frontal or slanted; in a third condition, a frame was trapezoidal and frontal. The conditions all elicited similar results, suggesting that the framing effect is not explained by pictorial perception of the display, or by assimilation of the surface orientation to the frame orientation. In experiment 3, viewing was moving-monocular to introduce motion parallax; the framing effect was reduced, being appreciable only for a trapezoidal surface. The results are related to other phenomena in which depth perception of points in space tends towards a frontal plane; this frontal-plane tendency is attributed to heavy experimental demands, mainly concerning impoverished, conflicting, and distracting information.

A neural model of smooth pursuit control and motion perception by cortical area MST

Smooth pursuit eye movements (SPEMs) are eye rotations that are used to maintain fixation on a moving target. Such rotations complicate the interpretation of the retinal image, because they nullify the retinal motion of the target, while generating retinal motion of stationary objects in the background. This poses a problem for the oculomotor system, which must track the stabilized target image while suppressing the optokinetic reflex, which would move the eye in the direction of the retinal background motion (opposite to the direction in which the target is moving). Similarly, the perceptual system must estimate the actual direction and speed of moving objects in spite of the confounding effects of the eye rotation. This paper proposes a neural model to account for the ability of primates to accomplish these tasks. The model simulates the neurophysiological properties of cell types found in the superior temporal sulcus of the macaque monkey, specifically the medial superior temporal (MST) region. These cells process signals related to target motion, background motion, and receive an efference copy of eye velocity during pursuit movements. The model focuses on the interactions between cells in the ventral and dorsal subdivisions of MST, which are hypothesized to process target velocity and background motion, respectively. The model explains how these signals can be combined to explain behavioral data about pursuit maintenance and perceptual data from human studies, including the Aubert--Fleischl phenomenon and the Filehne Illusion, thereby clarifying the functional significance of neurophysiological data about these MST cell properties. It is suggested that the connectivity used in the model may represent a general strategy used by the brain in analyzing the visual world.

Summation between nearby motion signals and facilitative/inhibitory interactions between distant motion signals

To explain the finding that motion assimilation was dominant between nearby motion signals while motion contrast between distant ones, a center-surround antagonistic mechanism was proposed [Nawrot & Sekuler (1990). Vision Research, 30, 1439-1451]. However, motion assimilation occurred not only between nearby signals but also between distant ones, suggesting the existence of a center-surround non-antagonistic mechanism [Ido. Ohtani & Ejima (1997). Vision Research, 37, 1565-1574]. The present study was designed to provide direct evidence for the non-antagonistic mechanism, and to examine further the motion interactions which operate in different spatial scales. The nature of motion interaction between the test and the inducer was examined by varying the size, the number of frames, the frame duration and the inter-frame displacement of random-dot kinematograms. The results were consistent with the notion that there are three types of interactions in human motion processing; one is a summation process effective within nearby regions, and the other two are facilitative and inhibitory induction processes operating over larger spatial scales. Analysis of the results in terms of the Fourier components suggests that the facilitative and the inhibitory induction processes may be sensitive, respectively to the lower and the higher temporal frequency components of the stimulus.

Motion capture of stationary lines by apparently moving terminators

Several studies and observations of a new form of motion capture are reported: frames containing identical rows of evenly spaced vertical lines are alternated in a standard apparent-motion paradigm. However, one vertical line in the first frame has short horizontal 'terminators' attached; the terminators are shifted to a different line in the second frame. Alternation that includes an unpatterned, nonzero interstimulus interval results in perceived motion of a vertical line along with the terminators. This motion can 'cross over' other stationary vertical lines and persists when light-filled interstimulus intervals and gaps between lines and terminators are introduced. It can also be obtained with different line sizes and spacings. The present motion capture does not appear to rely on a global-frame effect. Alternative explanations are considered.

Motion-transparent inducers have different effects on induced motion and motion capture

To assess the relationship among the underlying mechanisms of induced motion, motion capture, and motion transparency, directions of the former two illusions in the presence of motion-transparent inducers were examined. Two random-dot patterns (inducers) were superimposed upon a stationary disk (target), and moved in orthogonal directions. Either a high-contrast target (for induced motion) or a low-contrast target (for motion capture) was used. The task was to report the perceived direction of the target. The depth order of inducers was controlled either by adding binocular disparity or by asking the subject to report subjective depth order. For induced motion, the target appeared to move in the direction opposite to the inducer that had a disparity closer to the target; when there was no difference in disparity, induced motion occurred oppositely to the 'vector sum' of the inducers' directions. For motion capture, the target was captured by the inducer that subjectively appeared behind. These results suggest that the underlying mechanism of motion capture utilizes the output from the process for motion transparency, whereas induced motion has no clear relationship to the output of the process for motion transparency.

Local velocity representation: evidence from motion adaptation

Adaptation to a moving visual pattern induces shifts in the perceived motion of subsequently viewed moving patterns. Explanations of such effects are typically based on adaptation-induced sensitivity changes in spatio-temporal frequency tuned mechanisms (STFMs). An alternative hypothesis is that adaptation occurs in mechanisms that independently encode direction and speed (DSMs). Yet a third possibility is that adaptation occurs in mechanisms that encode 2D pattern velocity (VMs). We performed a series of psychophysical experiments to examine predictions made by each of the three hypotheses. The results indicate that: (1) adaptation-induced shifts are relatively independent of spatial pattern of both adapting and test stimuli; (2) the shift in perceived direction of motion of a plaid stimulus after adaptation to a grating indicates a shift in the motion of the plaid pattern, and not a shift in the motion of the plaid components; and (3) the 2D pattern of shift in perceived velocity radiates away from the adaptation velocity, and is inseparable in speed and direction of motion. Taken together, these results are most consistent with the VM adaptation hypothesis.