Contrast affects speed tuning, space-time slant, and receptive-field organization of simple cells in macaque V1

Excitatory and inhibitory neural dynamics jointly tune motion detection

Neurons integrate excitatory and inhibitory signals to produce their outputs, but the role of input timing in this integration remains poorly understood. Motion detection is a paradigmatic example of this integration, since theories of motion detection rely on different delays in visual signals. These delays allow circuits to compare scenes at different times to calculate the direction and speed of motion. Different motion detection circuits have different velocity sensitivity, but it remains untested how the response dynamics of individual cell types drive this tuning. Here, we sped up or slowed down specific neuron types in Drosophila's motion detection circuit by manipulating ion channel expression. Altering the dynamics of individual neuron types upstream of motion detectors increased their sensitivity to fast or slow visual motion, exposing distinct roles for excitatory and inhibitory dynamics in tuning directional signals, including a role for the amacrine cell CT1. A circuit model constrained by functional data and anatomy qualitatively reproduced the observed tuning changes. Overall, these results reveal how excitatory and inhibitory dynamics together tune a canonical circuit computation.

Additive effect of contrast and velocity suggests the role of strong excitatory drive in suppression of visual gamma response

It is commonly acknowledged that gamma-band oscillations arise from interplay between neural excitation and inhibition; however, the neural mechanisms controlling the power of stimulus-induced gamma responses (GR) in the human brain remain poorly understood. A moderate increase in velocity of drifting gratings results in GR power enhancement, while increasing the velocity beyond some 'transition point' leads to GR power attenuation. We tested two alternative explanations for this nonlinear input-output dependency in the GR power. First, the GR power can be maximal at the preferable velocity/temporal frequency of motion-sensitive V1 neurons. This 'velocity tuning' hypothesis predicts that lowering contrast either will not affect the transition point or shift it to a lower velocity. Second, the GR power attenuation at high velocities of visual motion can be caused by changes in excitation/inhibition balance with increasing excitatory drive. Since contrast and velocity both add to excitatory drive, this 'excitatory drive' hypothesis predicts that the 'transition point' for low-contrast gratings would be reached at a higher velocity, as compared to high-contrast gratings. To test these alternatives, we recorded magnetoencephalography during presentation of low (50%) and high (100%) contrast gratings drifting at four velocities. We found that lowering contrast led to a highly reliable shift of the GR suppression transition point to higher velocities, thus supporting the excitatory drive hypothesis. No effects of contrast or velocity were found in the alpha-beta range. The results have implications for understanding the mechanisms of gamma oscillations and developing gamma-based biomarkers of disturbed excitation/inhibition balance in brain disorders.

Feeling fooled: Texture contaminates the neural code for tactile speed

Motion is an essential component of everyday tactile experience: most manual interactions involve relative movement between the skin and objects. Much of the research on the neural basis of tactile motion perception has focused on how direction is encoded, but less is known about how speed is. Perceived speed has been shown to be dependent on surface texture, but previous studies used only coarse textures, which span a restricted range of tangible spatial scales and provide a limited window into tactile coding. To fill this gap, we measured the ability of human observers to report the speed of natural textures—which span the range of tactile experience and engage all the known mechanisms of texture coding—scanned across the skin. In parallel experiments, we recorded the responses of single units in the nerve and in the somatosensory cortex of primates to the same textures scanned at different speeds. We found that the perception of speed is heavily influenced by texture: some textures are systematically perceived as moving faster than are others, and some textures provide a more informative signal about speed than do others. Similarly, the responses of neurons in the nerve and in cortex are strongly dependent on texture. In the nerve, although all fibers exhibit speed-dependent responses, the responses of Pacinian corpuscle–associated (PC) fibers are most strongly modulated by speed and can best account for human judgments. In cortex, approximately half of the neurons exhibit speed-dependent responses, and this subpopulation receives strong input from PC fibers. However, speed judgments seem to reflect an integration of speed-dependent and speed-independent responses such that the latter help to partially compensate for the strong texture dependence of the former.

Our ability to sense the speed at which a surface moves across our skin is highly unreliable and depends on the texture of the surface. This study shows that speed illusions can be predicted from the responses of a specific population of nerve fibers and of their downstream targets; because the skin is too sparsely innervated to compute tactile speed accurately, the nervous system relies on a heuristic to estimate it.

Systematic misperceptions of 3-D motion explained by Bayesian inference

People make surprising but reliable perceptual errors. Here, we provide a unified explanation for systematic errors in the perception of three-dimensional (3-D) motion. To do so, we characterized the binocular retinal motion signals produced by objects moving through arbitrary locations in 3-D. Next, we developed a Bayesian model, treating 3-D motion perception as optimal inference given sensory noise in the measurement of retinal motion. The model predicts a set of systematic perceptual errors, which depend on stimulus distance, contrast, and eccentricity. We then used a virtual-reality headset as well as a standard 3-D desktop stereoscopic display to test these predictions in a series of perceptual experiments. As predicted, we found evidence that errors in 3-D motion perception depend on the contrast, viewing distance, and eccentricity of a stimulus. These errors include a lateral bias in perceived motion direction and a surprising tendency to misreport approaching motion as receding and vice versa. In sum, we present a Bayesian model that provides a parsimonious account for a range of systematic misperceptions of motion in naturalistic environments.

Sensory cortex is optimized for prediction of future input

Neurons in sensory cortex are tuned to diverse features in natural scenes. But what determines which features neurons become selective to? Here we explore the idea that neuronal selectivity is optimized to represent features in the recent sensory past that best predict immediate future inputs. We tested this hypothesis using simple feedforward neural networks, which were trained to predict the next few moments of video or audio in clips of natural scenes. The networks developed receptive fields that closely matched those of real cortical neurons in different mammalian species, including the oriented spatial tuning of primary visual cortex, the frequency selectivity of primary auditory cortex and, most notably, their temporal tuning properties. Furthermore, the better a network predicted future inputs the more closely its receptive fields resembled those in the brain. This suggests that sensory processing is optimized to extract those features with the most capacity to predict future input.

A large part of our brain is devoted to processing the sensory inputs that we receive from the world. This allows us to tell, for example, whether we are looking at a cat or a dog, and if we are hearing a bark or a meow. Neurons in the sensory cortex respond to these stimuli by generating spikes of activity. Within each sensory area, neurons respond best to stimuli with precise properties: those in the primary visual cortex prefer edge-like structures that move in a certain direction at a given speed, while neurons in the primary auditory cortex favour sounds that change in loudness over a particular range of frequencies.

Singer et al. sought to understand why neurons respond to the particular features of stimuli that they do. Why do visual neurons react more to moving edges than to, say, rotating hexagons? And why do auditory neurons respond more to certain changing sounds than to, say, constant tones? One leading idea is that the brain tries to use as few spikes as possible to represent real-world stimuli. Known as sparse coding, this principle can account for much of the behaviour of sensory neurons.

Another possibility is that sensory areas respond the way they do because it enables them to best predict future sensory input. To test this idea, Singer et al. used a computer to simulate a network of neurons and trained this network to predict the next few frames of video clips using the previous few frames. When the network had learned this task, Singer et al. examined the neurons’ preferred stimuli. Like neurons in primary visual cortex, the simulated neurons typically responded most to edges that moved over time.

The same network was also trained in a similar way, but this time using sound. As for neurons in primary auditory cortex, the simulated neurons preferred sounds that changed in loudness at particular frequencies. Notably, for both vision and audition, the simulated neurons favoured recent inputs over those further into the past. In this way and others, they were more similar to real neurons than simulated neurons that used sparse coding.

Both artificial networks trained to foretell sensory input and the brain therefore favour the same types of stimuli: the ones that are good at helping to grasp future information. This suggests that the brain represents the sensory world so as to be able to best predict the future.

Knowing how the brain handles information from our senses may help to understand disorders associated with sensory processing, such as dyslexia and tinnitus. It may also inspire approaches for training machines to process sensory inputs, improving artificial intelligence.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Direction Selectivity in Drosophila Emerges from Preferred-Direction Enhancement and Null-Direction Suppression

Across animal phyla, motion vision relies on neurons that respond preferentially to stimuli moving in one, preferred direction over the opposite, null direction. In the elementary motion detector of Drosophila, direction selectivity emerges in two neuron types, T4 and T5, but the computational algorithm underlying this selectivity remains unknown. We find that the receptive fields of both T4 and T5 exhibit spatiotemporally offset light-preferring and dark-preferring subfields, each obliquely oriented in spacetime. In a linear-nonlinear modeling framework, the spatiotemporal organization of the T5 receptive field predicts the activity of T5 in response to motion stimuli. These findings demonstrate that direction selectivity emerges from the enhancement of responses to motion in the preferred direction, as well as the suppression of responses to motion in the null direction. Thus, remarkably, T5 incorporates the essential algorithmic strategies used by the Hassenstein-Reichardt correlator and the Barlow-Levick detector. Our model for T5 also provides an algorithmic explanation for the selectivity of T5 for moving dark edges: our model captures all two- and three-point spacetime correlations relevant to motion in this stimulus class. More broadly, our findings reveal the contribution of input pathway visual processing, specifically center-surround, temporally biphasic receptive fields, to the generation of direction selectivity in T5. As the spatiotemporal receptive field of T5 in Drosophila is common to the simple cell in vertebrate visual cortex, our stimulus-response model of T5 will inform efforts in an experimentally tractable context to identify more detailed, mechanistic models of a prevalent computation.

SIGNIFICANCE STATEMENT

Feature selective neurons respond preferentially to astonishingly specific stimuli, providing the neurobiological basis for perception. Direction selectivity serves as a paradigmatic model of feature selectivity that has been examined in many species. While insect elementary motion detectors have served as premiere experimental models of direction selectivity for 60 years, the central question of their underlying algorithm remains unanswered. Using in vivo two-photon imaging of intracellular calcium signals, we measure the receptive fields of the first direction-selective cells in the Drosophila visual system, and define the algorithm used to compute the direction of motion. Computational modeling of these receptive fields predicts responses to motion and reveals how this circuit efficiently captures many useful correlations intrinsic to moving dark edges.

Efficient spiking neural network model of pattern motion selectivity in visual cortex

Simulating large-scale models of biological motion perception is challenging, due to the required memory to store the network structure and the computational power needed to quickly solve the neuronal dynamics. A low-cost yet high-performance approach to simulating large-scale neural network models in real-time is to leverage the parallel processing capability of graphics processing units (GPUs). Based on this approach, we present a two-stage model of visual area MT that we believe to be the first large-scale spiking network to demonstrate pattern direction selectivity. In this model, component-direction-selective (CDS) cells in MT linearly combine inputs from V1 cells that have spatiotemporal receptive fields according to the motion energy model of Simoncelli and Heeger. Pattern-direction-selective (PDS) cells in MT are constructed by pooling over MT CDS cells with a wide range of preferred directions. Responses of our model neurons are comparable to electrophysiological results for grating and plaid stimuli as well as speed tuning. The behavioral response of the network in a motion discrimination task is in agreement with psychophysical data. Moreover, our implementation outperforms a previous implementation of the motion energy model by orders of magnitude in terms of computational speed and memory usage. The full network, which comprises 153,216 neurons and approximately 40 million synapses, processes 20 frames per second of a 40 × 40 input video in real-time using a single off-the-shelf GPU. To promote the use of this algorithm among neuroscientists and computer vision researchers, the source code for the simulator, the network, and analysis scripts are publicly available.

Dynamic engagement of human motion detectors across space-time coordinates

Motion detection is a fundamental property of the visual system. The gold standard for studying and understanding this function is the motion energy model. This computational tool relies on spatiotemporally selective filters that capture the change in spatial position over time afforded by moving objects. Although the filters are defined in space-time, their human counterparts have never been studied in their native spatiotemporal space but rather in the corresponding frequency domain. When this frequency description is back-projected to spatiotemporal description, not all characteristics of the underlying process are retained, leaving open the possibility that important properties of human motion detection may have remained unexplored. We derived descriptors of motion detectors in native space-time, and discovered a large unexpected dynamic structure involving a >2× change in detector amplitude over the first ∼100 ms. This property is not predicted by the energy model, generalizes across the visual field, and is robust to adaptation; however, it is silenced by surround inhibition and is contrast dependent. We account for all results by extending the motion energy model to incorporate a small network that supports feedforward spread of activation along the motion trajectory via a simple gain-control circuit.

Chronic morphine exposure affects contrast response functions of V1 neurons in cats

Opiates disrupt neural functions in many brain areas, including visual cortex. Previous studies have indicated substantial changes of many neuronal response properties induced by chronic morphine exposure in the visual information processing system. However, it remains unclear whether neuronal contrast coding is also affected. To investigate this issue, we measured the contrast response functions (CRFs) of V1 neurons in chronic morphine-treated and saline-treated cats by using extra-cellular single-unit recording techniques. Our results indicated significantly lower contrast sensitivity in morphine-treated cats than in saline-treated cats and V1 neurons in morphine-treated cats exhibited enhanced maximum visual responses, higher baseline responses and lower signal-to-noise ratios compared with saline-treated cats. These findings provide some neurobiological evidence for the morphine-mediated degenerations of the visual cortex, which could underlie the opiate-induced deficits in visual function.

Frontal eye field neurons assess visual stability across saccades

The image on the retina may move because the eyes move, or because something in the visual scene moves. The brain is not fooled by this ambiguity. Even as we make saccades, we are able to detect whether visual objects remain stable or move. Here we test whether this ability to assess visual stability across saccades is present at the single-neuron level in the frontal eye field (FEF), an area that receives both visual input and information about imminent saccades. Our hypothesis was that neurons in the FEF report whether a visual stimulus remains stable or moves as a saccade is made. Monkeys made saccades in the presence of a visual stimulus outside of the receptive field. In some trials, the stimulus remained stable, but in other trials, it moved during the saccade. In every trial, the stimulus occupied the center of the receptive field after the saccade, thus evoking a reafferent visual response. We found that many FEF neurons signaled, in the strength and timing of their reafferent response, whether the stimulus had remained stable or moved. Reafferent responses were tuned for the amount of stimulus translation, and, in accordance with human psychophysics, tuning was better (more prevalent, stronger, and quicker) for stimuli that moved perpendicular, rather than parallel, to the saccade. Tuning was sometimes present as well for nonspatial transaccadic changes (in color, size, or both). Our results indicate that FEF neurons evaluate visual stability during saccades and may be general purpose detectors of transaccadic visual change.

Mechanisms underlying intensity-dependent changes in cortical selectivity for frequency-modulated sweeps

Frequency-modulated (FM) sweeps are common components of species-specific vocalizations. The intensity of FM sweeps can cover a wide range in the natural environment, but whether intensity affects neural selectivity for FM sweeps is unclear. Bats, such as the pallid bat, which use FM sweeps for echolocation, are suited to address this issue, because the intensity of echoes will vary with target distance. In this study, FM sweep rate selectivity of pallid bat auditory cortex neurons was measured using downward sweeps at different intensities. Neurons became more selective for FM sweep rates present in the bat's echolocation calls as intensity increased. Increased selectivity resulted from stronger inhibition of responses to slower sweep rates. The timing and bandwidth of inhibition generated by frequencies on the high side of the excitatory tuning curve [sideband high-frequency inhibition (HFI)] shape rate selectivity in cortical neurons in the pallid bat. To determine whether intensity-dependent changes in FM rate selectivity were due to altered inhibition, the timing and bandwidth of HFI were quantified at multiple intensities using the two-tone inhibition paradigm. HFI arrived faster relative to excitation as sound intensity increased. The bandwidth of HFI also increased with intensity. The changes in HFI predicted intensity-dependent changes in FM rate selectivity. These data suggest that neural selectivity for a sweep parameter is not static but shifts with intensity due to changes in properties of sideband inhibition.

Testing a simplified method for measuring velocity integration in saccades using a manipulation of target contrast

A growing number of studies in vision research employ analyses of how perturbations in visual stimuli influence behavior on single trials. Recently, we have developed a method along such lines to assess the time course over which object velocity information is extracted on a trial-by-trial basis in order to produce an accurate intercepting saccade to a moving target. Here, we present a simplified version of this methodology, and use it to investigate how changes in stimulus contrast affect the temporal velocity integration window used when generating saccades to moving targets. Observers generated saccades to one of two moving targets which were presented at high (80%) or low (7.5%) contrast. In 50% of trials, target velocity stepped up or down after a variable interval after the saccadic go signal. The extent to which the saccade endpoint can be accounted for as a weighted combination of the pre- or post-step velocities allows for identification of the temporal velocity integration window. Our results show that the temporal integration window takes longer to peak in the low when compared to high contrast condition. By enabling the assessment of how information such as changes in velocity can be used in the programming of a saccadic eye movement on single trials, this study describes and tests a novel methodology with which to look at the internal processing mechanisms that transform sensory visual inputs into oculomotor outputs.

Misperceptions of speed are accounted for by the responses of neurons in macaque cortical area MT

In humans, the perceived speed of random dot patterns (RDP) moving within small apertures is faster than that of RDPs moving within larger apertures at the same physical speed. To investigate the neural basis of this illusion, we recorded the responses of direction- and speed-selective neurons in the middle temporal area (MT) of macaque monkeys to stimuli varying in size and speed. Our results show that the preferred speed of MT neurons is slower for smaller stimuli. This effect was larger for neurons preferring faster speeds, matching our psychophysical observation in human subjects that the magnitude of the misperception is larger at higher stimulus speeds. Our physiological data indicate that, across a population of speed-tuned neurons in MT, decreasing the size of a stimulus would shift the activity profile to neurons tuned for higher speeds. Modeling a labeled-line readout of this shifted profile, we show an increased apparent speed, in line with the psychophysical observations. This link strengthens the evidence for a causal role of area MT in speed perception. The systematic shift in tuning curves of single neurons with stimulus size might reflect a general mechanism for feature-mismatch illusions in visual perception.

Applicability of White-Noise Techniques to Analyzing Motion Responses

Motion processing in visual neurons is often understood in terms of how they integrate light stimuli in space and time. These integrative properties, known as the spatiotemporal receptive fields (STRFs), are sometimes obtained using white-noise techniques where a continuous random contrast sequence is delivered to each spatial location within the cell's field of view. In contrast, motion stimuli such as moving bars are usually presented intermittently. Here we compare the STRF prediction of a neuron's response to a moving bar with the measured response in second-order interneurons (L-neurons) of dragonfly ocelli (simple eyes). These low-latency neurons transmit sudden changes in intensity and motion information to mediate flight and gaze stabilization reflexes. A white-noise analysis is made of the responses of L-neurons to random bar stimuli delivered either every frame (densely) or intermittently (sparsely) with a temporal sequence matched to the bar motion stimulus. Linear STRFs estimated using the sparse stimulus were significantly better at predicting the responses to moving bars than the STRFs estimated using a traditional dense white-noise stimulus, even when second-order nonlinear terms were added. Our results strongly suggest that visual adaptation significantly modifies the linear STRF properties of L-neurons in dragonfly ocelli during dense white-noise stimulation. We discuss the ability to predict the responses of visual neurons to arbitrary stimuli based on white-noise analysis. We also discuss the likely functional advantages that adaptive receptive field structures provide for stabilizing attitude during hover and forward flight in dragonflies.

Retinotopic coding of extraretinal pursuit signals in early visual cortex

During smooth pursuit, the image of the target is stabilized on the fovea, implying that speed judgments made during pursuit must rely on an extraretinal signal providing precise eye speed information. To characterize the introduction of such extraretinal signal into the human visual system, we performed a factorial, functional magnetic resonance imaging experiment, in which we manipulated the factor eye movement, with "fixation" and "pursuit" as levels, and the factor task, with "speed" and "form" judgments as levels. We hypothesized that the extraretinal speed signal is reflected as an interaction between speed judgments and pursuit. Random effects analysis yielded an interaction only in dorsal early visual cortex. Retinotopic mapping localized this interaction on the horizontal meridian (HM) between dorsal areas visual 2 and 3 (V2/V3) at 1-2 degrees azimuth. This corresponded to the position the pursuit target would have reached, if moving retinotopically, at the time of the subject's speed judgment. Because the 2 V2/V3 HMs are redundant, both may be involved in speed judgments, the ventral one involving judgments based on retinal motion and the dorsal one judgments requiring an internal signal. These results indicate that an extraretinal speed signal is injected into early visual cortex during pursuit.

What a difference a parameter makes: a psychophysical comparison of random dot motion algorithms

Random dot motion (RDM) displays have emerged as one of the standard stimulus types employed in psychophysical and physiological studies of motion processing. RDMs are convenient because it is straightforward to manipulate the relative motion energy for a given motion direction in addition to stimulus parameters such as the speed, contrast, duration, density, aperture, etc. However, as widely as RDMs are employed so do they vary in their details of implementation. As a result, it is often difficult to make direct comparisons across studies employing different RDM algorithms and parameters. Here, we systematically measure the ability of human subjects to estimate motion direction for four commonly used RDM algorithms under a range of parameters in order to understand how these different algorithms compare in their perceptibility. We find that parametric and algorithmic differences can produce dramatically different performances. These effects, while surprising, can be understood in relationship to pertinent neurophysiological data regarding spatiotemporal displacement tuning properties of cells in area MT and how the tuning function changes with stimulus contrast and retinal eccentricity. These data help give a baseline by which different RDM algorithms can be compared, demonstrate a need for clearly reporting RDM details in the methods of papers, and also pose new constraints and challenges to models of motion direction processing.

Aging affects contrast response functions and adaptation of middle temporal visual area neurons in rhesus monkeys

In the present study we studied the effects of aging on the coding of contrast in area V1 (primary visual cortex) and MT (middle temporal visual area) of the macaque monkey using single-neuron in vivo electrophysiology. Our results show that both MT and V1 neurons in old monkeys are less sensitive to contrast than those in young monkeys. Generally, contrast sensitivity is affected by aging more severely in MT cells than in V1 cells. Specifically, MT cells were affected more severely than motion direction selective V1 cells. Particularly, we found that MT neurons in old monkeys exhibited enhanced maximum visual responses, higher levels of spontaneous activity and decreased signal-to-noise ratios. In addition, we also found age-related changes in neuronal adaptation to visual motion in MT. Compared with young animals, the contrast gain of MT neurons in old monkeys is less affected, but the response gain by adaptation of MT neurons is more affected. Our results suggest that there may be an anomalous visual processing in both the magnocellular and parvocellular pathways. The neural changes described here are consistent with an age-related degeneration of intracortical inhibition and could underlie some deficits in visual function during normal aging.

Spatiotemporal structure of complex cell receptive fields and influence of GABAergic inhibition

Spatiotemporal receptive field (RF) profiles were mapped with reverse correlation technique for complex cells in the striate cortex of cat. The RFs were constituted with ON and OFF subfields that overlapped much extensively in space and also largely in time. The subfields had spatial width of 1.0-4.3 degrees and temporal duration of 33-139 ms, whereas late responses were absent in most cases. When microiontophoresis of gamma-aminobutyric acid type A (GABAA) antagonist bicuculline was performed on the cells, little change occurred in width and onset time of the subfields, but the duration was prolonged in a subset of cells. These results suggest that intracortical inhibition may contribute to improve the accuracy of visual signals encoded in neuronal activities, but is unlikely critical for determining the primary structure of complex cell RF.