Surround motion silences signals from same-direction motion

Mechanisms of competitive selection: A canonical neural circuit framework

Competitive selection, the transformation of multiple competing sensory inputs and internal states into a unitary choice, is a fundamental component of animal behavior. Selection behaviors have been studied under several intersecting umbrellas including decision-making, action selection, perceptual categorization, and attentional selection. Neural correlates of these behaviors and computational models have been investigated extensively. However, specific, identifiable neural circuit mechanisms underlying the implementation of selection remain elusive. Here, we employ a first principles approach to map competitive selection explicitly onto neural circuit elements. We decompose selection into six computational primitives, identify demands that their execution places on neural circuit design, and propose a canonical neural circuit framework. The resulting framework has several links to neural literature, indicating its biological feasibility, and has several common elements with prominent computational models, suggesting its generality. We propose that this framework can help catalyze experimental discovery of the neural circuit underpinnings of competitive selection.

Spatial suppression promotes rapid figure-ground segmentation of moving objects

Segregation of objects from their backgrounds is a fundamental visual function and one that is particularly effective when objects are in motion. Theoretically, suppressive center-surround mechanisms are well suited for accomplishing motion segregation. This longstanding hypothesis, however, has received limited empirical support. We report converging correlational and causal evidence that spatial suppression of background motion signals is critical for rapid segmentation of moving objects. Motion segregation ability is strongly predicted by both individual and stimulus-driven variations in spatial suppression strength. Moreover, aging-related superiority in perceiving background motion is associated with profound impairments in motion segregation. This segregation deficit is alleviated via perceptual learning, but only when motion segregation training also causes decreased sensitivity to background motion. We argue that perceptual insensitivity to large moving stimuli effectively implements background subtraction, which, in turn, enhances the visibility of moving objects and accounts for the observed link between spatial suppression and motion segregation.

The visual system excels at segregating moving objects from their backgrounds, a key visual function hypothesized to be driven by suppressive centre-surround mechanisms. Here, the authors show that spatial suppression of background motion signals is critical for rapid segmentation of moving objects.

Spatiotemporal Filter for Visual Motion Integration from Pursuit Eye Movements in Humans and Monkeys

Despite the enduring interest in motion integration, a direct measure of the space-time filter that the brain imposes on a visual scene has been elusive. This is perhaps because of the challenge of estimating a 3D function from perceptual reports in psychophysical tasks. We take a different approach. We exploit the close connection between visual motion estimates and smooth pursuit eye movements to measure stimulus-response correlations across space and time, computing the linear space-time filter for global motion direction in humans and monkeys. Although derived from eye movements, we find that the filter predicts perceptual motion estimates quite well. To distinguish visual from motor contributions to the temporal duration of the pursuit motion filter, we recorded single-unit responses in the monkey middle temporal cortical area (MT). We find that pursuit response delays are consistent with the distribution of cortical neuron latencies and that temporal motion integration for pursuit is consistent with a short integration MT subpopulation. Remarkably, the visual system appears to preferentially weight motion signals across a narrow range of foveal eccentricities rather than uniformly over the whole visual field, with a transiently enhanced contribution from locations along the direction of motion. We find that the visual system is most sensitive to motion falling at approximately one-third the radius of the stimulus aperture. Hypothesizing that the visual drive for pursuit is related to the filtered motion energy in a motion stimulus, we compare measured and predicted eye acceleration across several other target forms.SIGNIFICANCE STATEMENT A compact model of the spatial and temporal processing underlying global motion perception has been elusive. We used visually driven smooth eye movements to find the 3D space-time function that best predicts both eye movements and perception of translating dot patterns. We found that the visual system does not appear to use all available motion signals uniformly, but rather weights motion preferentially in a narrow band at approximately one-third the radius of the stimulus. Although not universal, the filter predicts responses to other types of stimuli, demonstrating a remarkable degree of generalization that may lead to a deeper understanding of visual motion processing.

Suppressive mechanisms in visual motion processing: From perception to intelligence

Perception operates on an immense amount of incoming information that greatly exceeds the brain's processing capacity. Because of this fundamental limitation, the ability to suppress irrelevant information is a key determinant of perceptual efficiency. Here, I will review a series of studies investigating suppressive mechanisms in visual motion processing, namely perceptual suppression of large, background-like motions. These spatial suppression mechanisms are adaptive, operating only when sensory inputs are sufficiently robust to guarantee visibility. Converging correlational and causal evidence links these behavioral results with inhibitory center-surround mechanisms, namely those in cortical area MT. Spatial suppression is abnormally weak in several special populations, including the elderly and individuals with schizophrenia-a deficit that is evidenced by better-than-normal direction discriminations of large moving stimuli. Theoretical work shows that this abnormal weakening of spatial suppression should result in motion segregation deficits, but direct behavioral support of this hypothesis is lacking. Finally, I will argue that the ability to suppress information is a fundamental neural process that applies not only to perception but also to cognition in general. Supporting this argument, I will discuss recent research that shows individual differences in spatial suppression of motion signals strongly predict individual variations in IQ scores.

Structured synaptic inhibition has a critical role in multiple-choice motion-discrimination tasks

Neural network models have been constructed to explore the underlying neural mechanisms for decision-making in multiple-choice motion-discrimination tasks. Despite great progress made, several key experimental observations have not been interpreted. In contrast to homogeneous connectivity between pyramidal cells and interneurons in previous models, here their connectivity is totally structured in a continuous recurrent network model. Specifically, we assume two types of inhibitory connectivity: opposite-feature and similar-feature inhibition, representing that the connectivity strength has a maximum between neural pairs with opposite and identical preferred directions, respectively. With a common parameter set, the model accounted for a wide variety of physiological and behavioral data from monkey experiments, including those that previous models failed to reproduce. We found that the opposite-feature inhibition endows the decision-making circuit with an elimination strategy, which effectively reduces the number of choice alternatives for inspection to speed up the decision process at the cost of decision accuracy. Conversely, the similar-feature inhibition markedly enhances the ability of the network to make a choice among multiple options and improves the accuracy of decisions, while slowing down the decision process. A simplified mean-field model was also presented to analytically characterize the effect of structured inhibition on fine discrimination. We made a testable prediction: only the combination of cross-feature and similar-feature inhibition enables the circuit to make a categorical choice among 12 alternatives. Together, the current work highlights the importance of structured synaptic inhibition in multiple-choice decision-making processes and sheds light on the neural mechanisms for visual motion perception.

Perceptual fields reveal previously hidden dynamics of human visual motion sensitivity

Motion sensitivity is a fundamental property of human vision. Although its neural correlates are normally only directly accessible with neurophysiological approaches, Neri (Neri P. J Neurosci 34: 8449-8491, 2014) proposed psychophysical reverse correlation to derive perceptual fields, revealing previously unseen dynamics of human motion detection. In this Neuro Forum, these key findings are discussed, putting them into broader context and pointing out possible implications of spatial scale considerations on the interpretation of the findings and dynamic model proposed.

Dynamic engagement of human motion detectors across space-time coordinates

Motion detection is a fundamental property of the visual system. The gold standard for studying and understanding this function is the motion energy model. This computational tool relies on spatiotemporally selective filters that capture the change in spatial position over time afforded by moving objects. Although the filters are defined in space-time, their human counterparts have never been studied in their native spatiotemporal space but rather in the corresponding frequency domain. When this frequency description is back-projected to spatiotemporal description, not all characteristics of the underlying process are retained, leaving open the possibility that important properties of human motion detection may have remained unexplored. We derived descriptors of motion detectors in native space-time, and discovered a large unexpected dynamic structure involving a >2× change in detector amplitude over the first ∼100 ms. This property is not predicted by the energy model, generalizes across the visual field, and is robust to adaptation; however, it is silenced by surround inhibition and is contrast dependent. We account for all results by extending the motion energy model to incorporate a small network that supports feedforward spread of activation along the motion trajectory via a simple gain-control circuit.

Semantic control of feature extraction from natural scenes

In the early stages of image analysis, visual cortex represents scenes as spatially organized maps of locally defined features (e.g., edge orientation). As image reconstruction unfolds and features are assembled into larger constructs, cortex attempts to recover semantic content for object recognition. It is conceivable that higher level representations may feed back onto early processes and retune their properties to align with the semantic structure projected by the scene; however, there is no clear evidence to either support or discard the applicability of this notion to the human visual system. Obtaining such evidence is challenging because low and higher level processes must be probed simultaneously within the same experimental paradigm. We developed a methodology that targets both levels of analysis by embedding low-level probes within natural scenes. Human observers were required to discriminate probe orientation while semantic interpretation of the scene was selectively disrupted via stimulus inversion or reversed playback. We characterized the orientation tuning properties of the perceptual process supporting probe discrimination; tuning was substantially reshaped by semantic manipulation, demonstrating that low-level feature detectors operate under partial control from higher level modules. The manner in which such control was exerted may be interpreted as a top-down predictive strategy whereby global semantic content guides and refines local image reconstruction. We exploit the novel information gained from data to develop mechanistic accounts of unexplained phenomena such as the classic face inversion effect.

How inherently noisy is human sensory processing?

Like any physical information processing device, the human brain is inherently noisy: If a participant is presented with the same sensory stimulus multiple times and is asked to press one of two buttons in response to some property of the stimulus, the response may vary even though the stimulus did not. This response variability can be used to estimate the amount of so-called internal noise-that is, noise that is not present in the stimulus (such as random dynamic dots on the screen) but in the participant's brain. How large is this internally generated noise? We obtained >400 independent estimates on 40 participants for a range of protocols (yes/no, two-, four-, and eight-alternative forced choice), modalities (auditory and visual), attentional state, adaptation state, stimulus types (static, moving, stereoscopic), and other parameters (timing, size, contrast). Our final estimate at ~1.3 (units of external noise standard deviation) is generally somewhat larger than that previously inferred from smaller and less varied data sets. We discuss the impact of high levels of internal noise on a number of experimental and computational efforts aimed at understanding and characterizing human sensory processing.

Low-level mechanisms do not explain paradoxical motion percepts

Classic psychophysical studies have shown that increasing the size of low-contrast moving stimuli increases their discriminability, indicating spatial summation mechanisms. More recently, a number of studies have reported that for moderate and high contrasts, size increases yield substantial deteriorations of motion perception-a result described as psychophysical spatial suppression. While this result resembles known characteristics of suppressive center-surround neural mechanisms, a recent study (C. R. Aaen-Stockdale, B. Thompson, P. C. Huang, & R. F. Hess, 2009) argued that observed size-dependent changes in motion perception might be explained by differences in contrast sensitivity for stimuli of different sizes. Here, we tested this hypothesis using duration threshold measurements-an experimental approach used in several spatial suppression studies. The results replicated previous reports by demonstrating spatial suppression at a fixed, high contrast. Importantly, we observed strong spatial suppression even when stimuli were normalized relative to their contrast thresholds. While the exact mechanisms underlying spatial suppression still need to be adequately characterized, this study demonstrates that a low-level explanation proposed by Aaen-Stockdale et al. (2009) cannot account for spatial suppression results.