Attention modulates perception of transparent motion

Life motion signals bias the perception of apparent motion direction

Walking direction conveyed by biological motion (BM) cues, which humans are highly sensitive to since birth, can elicit involuntary shifts of attention to enhance the detection of static targets. Here, we demonstrated that such intrinsic sensitivity to walking direction could also modulate the direction perception of simultaneously presented dynamic stimuli. We showed that the perceived direction of apparent motion was biased towards the walking direction even though observers had been informed in advance that the walking direction of BM did not predict the apparent motion direction. In particular, rightward BM cues had an advantage over leftward BM cues in altering the perception of motion direction. Intriguingly, this perceptual bias disappeared when BM cues were shown inverted, or when the critical biological characteristics were removed from the cues. Critically, both the perceptual direction bias and the rightward advantage persisted even when only local BM cues were presented without any global configuration. Furthermore, the rightward advantage was found to be specific to social cues (i.e., BM), as it vanished when non-social cues (i.e., arrows) were utilized. Taken together, these findings support the existence of a specific processing mechanism for life motion signals and shed new light on their influences in a dynamic environment.

A bio-inspired, motion-based analysis of crowd behavior attributes relevance to motion transparency, velocity gradients, and motion patterns

The analysis of motion crowds is concerned with the detection of potential hazards for individuals of the crowd. Existing methods analyze the statistics of pixel motion to classify non-dangerous or dangerous behavior, to detect outlier motions, or to estimate the mean throughput of people for an image region. We suggest a biologically inspired model for the analysis of motion crowds that extracts motion features indicative for potential dangers in crowd behavior. Our model consists of stages for motion detection, integration, and pattern detection that model functions of the primate primary visual cortex area (V1), the middle temporal area (MT), and the medial superior temporal area (MST), respectively. This model allows for the processing of motion transparency, the appearance of multiple motions in the same visual region, in addition to processing opaque motion. We suggest that motion transparency helps to identify "danger zones" in motion crowds. For instance, motion transparency occurs in small exit passages during evacuation. However, motion transparency occurs also for non-dangerous crowd behavior when people move in opposite directions organized into separate lanes. Our analysis suggests: The combination of motion transparency and a slow motion speed can be used for labeling of candidate regions that contain dangerous behavior. In addition, locally detected decelerations or negative speed gradients of motions are a precursor of danger in crowd behavior as are globally detected motion patterns that show a contraction toward a single point. In sum, motion transparency, image speeds, motion patterns, and speed gradients extracted from visual motion in videos are important features to describe the behavioral state of a motion crowd.

Perceptual consequences of feature-based attentional enhancement and suppression

Feature-based attention has been shown to enhance the responses of neurons tuned to an attended feature while simultaneously suppressing responses of neurons tuned to unattended features. However, the influence of these suppressive neuronal-level modulations on perception is not well understood. Here, we investigated the perceptual consequences of feature-based attention by having subjects judge which of four random dot patterns (RDPs) contained a motion signal (Experiment 1) or which of four RDPs contained the most salient nonrandom motion signal (Experiment 2). Subjects viewed pre-cues which validly, invalidly, or neutrally cued the direction of the target RDP. Behavioral data were fit using the linear ballistic accumulator (LBA) model; the model design that best described the data revealed that the rate of sensory evidence accumulation (drift rate) was highest on valid trials and systematically decreased until the cued direction and the target direction were orthogonal. These results demonstrate behavioral correlates of both feature-based attentional enhancement and suppression.

A model of motion transparency processing with local center-surround interactions and feedback

Motion transparency occurs when multiple coherent motions are perceived in one spatial location. Imagine, for instance, looking out of the window of a bus on a bright day, where the world outside the window is passing by and movements of passengers inside the bus are reflected in the window. The overlay of both motions at the window leads to motion transparency, which is challenging to process. Noisy and ambiguous motion signals can be reduced using a competition mechanism for all encoded motions in one spatial location. Such a competition, however, leads to the suppression of multiple peak responses that encode different motions, as only the strongest response tends to survive. As a solution, we suggest a local center-surround competition for population-encoded motion directions and speeds. Similar motions are supported, and dissimilar ones are separated, by representing them as multiple activations, which occurs in the case of motion transparency. Psychophysical findings, such as motion attraction and repulsion for motion transparency displays, can be explained by this local competition. Besides this local competition mechanism, we show that feedback signals improve the processing of motion transparency. A discrimination task for transparent versus opaque motion is simulated, where motion transparency is generated by superimposing large field motion patterns of either varying size or varying coherence of motion. The model's perceptual thresholds with and without feedback are calculated. We demonstrate that initially weak peak responses can be enhanced and stabilized through modulatory feedback signals from higher stages of processing.

Feature-based attention involuntarily and simultaneously improves visual performance across locations

Selective attention can selectively increase sensitivity to particular visual features in order to prioritize behaviorally relevant stimuli. Moreover, neural responses to attended feature values are boosted even at ignored locations. We provide behavioral evidence for involuntary and simultaneous effects of this "global" feature-based attention on visual performance. Observers were cued to attend to dots moving in a particular direction at one location (the primary task), while discriminating which of two groups of moving dots on the other side of the screen contained coherent motion (the secondary task). An analogous experiment tested selective attention to orientation. The secondary tasks did not require observers to discriminate or selectively attend to the particular feature values present. Nonetheless, sensitivity was highest when the direction or orientation happened to match the one cued in the primary task. By comparing performance to a neutral condition, we revealed more enhancement of attended feature values than suppression of others.

Visual attention: the past 25 years

This review focuses on covert attention and how it alters early vision. I explain why attention is considered a selective process, the constructs of covert attention, spatial endogenous and exogenous attention, and feature-based attention. I explain how in the last 25 years research on attention has characterized the effects of covert attention on spatial filters and how attention influences the selection of stimuli of interest. This review includes the effects of spatial attention on discriminability and appearance in tasks mediated by contrast sensitivity and spatial resolution; the effects of feature-based attention on basic visual processes, and a comparison of the effects of spatial and feature-based attention. The emphasis of this review is on psychophysical studies, but relevant electrophysiological and neuroimaging studies and models regarding how and where neuronal responses are modulated are also discussed.

Does the noise matter? Effects of different kinematogram types on smooth pursuit eye movements and perception

We investigated how the human visual system and the pursuit system react to visual motion noise. We presented three different types of random-dot kinematograms at five different coherence levels. For transparent motion, the signal and noise labels on each dot were preserved throughout each trial, and noise dots moved with the same speed as the signal dots but in fixed random directions. For white noise motion, every 20 ms the signal and noise labels were randomly assigned to each dot and noise dots appeared at random positions. For Brownian motion, signal and noise labels were also randomly assigned, but the noise dots moved at the signal speed in a direction that varied randomly from moment to moment. Neither pursuit latency nor early eye acceleration differed among the different types of kinematograms. Late acceleration, pursuit gain, and perceived speed all depended on kinematogram type, with good agreement between pursuit gain and perceived speed. For transparent motion, pursuit gain and perceived speed were independent of coherence level. For white and Brownian motions, pursuit gain and perceived speed increased with coherence but were higher for white than for Brownian motion. This suggests that under our conditions, the pursuit system integrates across all directions of motion but not across all speeds.

A model of neural mechanisms in monocular transparent motion perception

Transparent motion is perceived when multiple motions are presented in the same part of visual space that move in different directions or with different speeds. Several psychophysical as well as physiological experiments have studied the conditions under which motion transparency occurs. Few computational mechanisms have been proposed that allow to segregate multiple motions. We present a novel neural model which investigates the necessary mechanisms underlying initial motion detection, the required representations for velocity coding, and the integration and segregation of motion stimuli to account for the perception of transparent motion. The model extends a previously developed architecture for neural computations along the dorsal pathway, particularly, in cortical areas V1, MT, and MSTd. It emphasizes the role of feedforward cascade processing and feedback from higher to earlier processing stages for selective feature enhancement and tuning. Our results demonstrate that the model reproduces several key psychophysical findings in perceptual motion transparency using random dot stimuli. Moreover, the model is able to process transparent motion as well as opaque surface motion in real-world sequences of 3-d scenes. As a main thesis, we argue that the perception of transparent motion relies on the representation of multiple velocities at one spatial location; however, this feature is necessary but not sufficient to perceive transparency. It is suggested that the activations simultaneously representing multiple activities are subsequently integrated by separate mechanisms leading to the segregation of different overlapping segments.

Early interactions between neuronal adaptation and voluntary control determine perceptual choices in bistable vision

At the onset of bistable stimuli, the brain needs to choose which of the competing perceptual interpretations will first reach awareness. Stimulus manipulations and cognitive control both influence this choice process, but the underlying mechanisms and interactions remain poorly understood. Using intermittent presentation of bistable visual stimuli, we demonstrate that short interruptions cause perceptual reversals upon the next presentation, whereas longer interstimulus intervals stabilize the percept. Top-down voluntary control biases this process but does not override the timing dependencies. Extending a recently introduced low-level neural model, we demonstrate that percept-choice dynamics in bistable vision can be fully understood with interactions in early neural processing stages. Our model includes adaptive neural processing preceding a rivalry resolution stage with cross-inhibition, adaptation, and an interaction of the adaptation levels with a neural baseline. Most importantly, our findings suggest that top-down attentional control over bistable stimuli interacts with low-level mechanisms at early levels of sensory processing before perceptual conflicts are resolved and perceptual choices about bistable stimuli are made.

An oblique effect for transparent-motion detection caused by variation in global-motion direction-tuning bandwidths

Despite evidence for the broad direction tuning of global-motion detectors, transparent motion can be detected with comparatively small angular separations. The exact means by which this broad population response is decoded to yield multiple signal directions remains unclear. Consequently, we sought to determine the relationship between angular separation thresholds for transparent motion and the direction-tuning bandwidth of global-motion detectors. Angular separation thresholds were assessed around four axes of motion, with thresholds lower around cardinal axes than the oblique axes. This was also found with lowered signal intensities, despite larger differences between the component directions at threshold, indicating that the transparency oblique effect relies more on the mean direction than the components. Simulations with a model global-motion population suggest this is likely to arise from variation in direction-tuning bandwidths around the cardinal and oblique axes. In a second experiment, adaptation to oblique unidirectional motion produced threshold elevation for a wider range of test directions than adaptation to a cardinal direction. This is consistent with tighter direction tuning around cardinal axes and provides a basis for the transparent-motion oblique effect. Our narrow bandwidth estimates also suggest that transparent-motion detection could rely on bimodal activity within the global-motion stage.

A neural model of feature attention in motion perception

We utilize a model of motion perception to link a physiological study of feature attention in cortical motion processing to a psychophysical experiment of motion perception. We explain effects of feature attention by modulatory excitation of neural activity patterns in a framework of biased competition. Our model allows us to qualitatively replicate physiological data concerning attentional modulation and to generate model behavior in a decision experiment that is consistent with psychophysical observations. Furthermore, our investigation makes predictions for future psychophysical experiments.

Feature-based attention influences contextual interactions during motion repulsion

Visual perception is strongly shaped by the spatial context in which stimuli are presented. Using center-surround configurations with oriented stimuli, recent studies suggest that voluntary attention critically determines which stimuli in the surround affect the percept of the central stimulus. However, evidence for attentional influences on center-surround interactions is restricted to the spatial selection of few among several surround stimuli of different orientations. Here, we extend these insights of center-surround interactions to the motion domain and show that the influence of surround information is critically shaped by feature-based attention. We used motion repulsion as an experimental test tool. When a central target motion was surrounded by a ring of motion, subjects misperceived the direction of the foveal target for particular center-surround direction differences (repulsion condition). Adding an appropriate second motion in the surround counterbalanced the effect, eliminating the repulsion. Introducing feature-based attention to one of the two superimposed directions of motion in the surround reinstated the strong contextual effects. The task relevance of the attended surround motion component effectively induced a strong motion repulsion on the foveally presented stimulus. In addition, the task relevance of the foveal stimulus also induced motion repulsion on the attended surround direction of motion. Our results show that feature-based attention to the surround strongly modulates the veridical perception of a foveally presented motion. The observed attentional effects reflect a feature-based mechanism affecting human perception, by modulating spatial interactions among sensory information and enhancing the attended direction of motion.

Pushing the limits of transparent-motion detection with binocular disparity

When transparent motion is defined purely by direction differences, observers fail to detect more than two signal directions simultaneously [Edwards, M., & Greenwood, J.A. (2005). The perception of motion transparency: A signal-to-noise limit. Vision Research, 45, 1877-1884]. This limit is strongly related to signal-detection thresholds for transparent motion, which are several times higher than uni-directional thresholds. When the effective signal intensities are elevated by speed differences that drive independent global-motion systems, the transparent-motion limit can be extended to allow detection of three signals [Greenwood, J.A., & Edwards, M. (2006). An extension of transparent-motion detection limit using speed-tuned global-motion systems. Vision Research, 46, 1440-1449]. Because there are independent disparity-tuned global-motion systems, distributing transparent-motion signals across distinct depth planes also allows an increase in their effective signal intensity. In the present study, the addition of depth differences enabled the simultaneous detection of three signals. However, as with the addition of speed differences, observers were not able to detect four signals, which would be predicted if signal intensity were the sole constraint on transparent-motion detection. The combination of depth and speed produced similar results, suggesting that there is a strict higher-order limit, possibly related to attention, restricting the maximum number of signals that can be detected simultaneously to three.

An extension of the transparent-motion detection limit using speed-tuned global-motion systems

When transparent motion is defined purely by direction differences, no more than two signal directions can be detected simultaneously. This limit appears to occur because higher signal intensities are required to detect transparent motion compared with uni-directional motion (Edwards, M., & Greenwood, J. A. (2005). The perception of motion transparency: A signal-to-noise limit. Vision Research, 45, 1877-1884). Increasing the effective signal intensities should therefore increase the number of signals that can be detected. We achieved this by adding speed differences, dividing transparent-motion signals between two speed-tuned global-motion systems. When some signals moved at appropriate low speeds and others at high speeds, up to three signals were detected. This is consistent, at least in part, with the signal-to-noise processing basis of the transparency limit. Differences in contrast polarity were also used to assess whether the limit could be extended using stimulus features without independent global-motion systems. A modest improvement in performance was obtained, suggesting that there may be multiple routes to extending the transparent-motion limit.