Contrast-dependent phase sensitivity in V1 but not V2 of macaque visual cortex

Hierarchical temporal prediction captures motion processing along the visual pathway

Visual neurons respond selectively to features that become increasingly complex from the eyes to the cortex. Retinal neurons prefer flashing spots of light, primary visual cortical (V1) neurons prefer moving bars, and those in higher cortical areas favor complex features like moving textures. Previously, we showed that V1 simple cell tuning can be accounted for by a basic model implementing temporal prediction - representing features that predict future sensory input from past input (Singer et al., 2018). Here, we show that hierarchical application of temporal prediction can capture how tuning properties change across at least two levels of the visual system. This suggests that the brain does not efficiently represent all incoming information; instead, it selectively represents sensory inputs that help in predicting the future. When applied hierarchically, temporal prediction extracts time-varying features that depend on increasingly high-level statistics of the sensory input.

Learning receptive field properties of complex cells in V1

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.

Many cortical functions originate from the learning ability of the brain. How the properties of cortical cells are learned is vital for understanding how the brain works. There are many models that explain how V1 simple cells can be learned. However, how V1 complex cells are learned still remains unclear. In this paper, we propose a model of learning in complex cells based on the Bienenstock, Cooper, and Munro (BCM) rule. We demonstrate that properties of receptive fields of complex cells can be learned using this biologically plausible learning rule. Quantitative comparisons between the model and experimental data are performed. Results show that model complex cells can account for the diversity of complex cells found in experimental studies. In summary, this study provides a plausible explanation for how complex cells can be learned using biologically plausible plasticity mechanisms. Our findings help us to better understand biological vision processing and provide us with insights into the general signal processing principles that the visual cortex employs to process visual information.

Low-cost, microcontroller-based, two-channel piezoelectric bender device for somatosensory experiments

Understanding the joint encoding of multiple tactile stimulus features (e.g., spatial position, amplitude, and frequency of vibration) is a major goal of somatosensory neuroscience, and the development of experimental set-ups to probe joint encoding is important. We describe in detail a microcontroller-based, piezoelectric bender device for tactile experiments. The device comprises an Arduino Due microcontroller board with a 32-bit ARM Cortex-M3 RISC processor, and two 12-bit digital-to-analog converters, enabling precise, independent stimulation of adjacent epithelial points. Using laser doppler vibrometry, we developed a model of the benders' structural mechanics, which we implemented on the device. We used the device to delivered precise, reliable somatosensory stimulation in an experimental setting, recording electrophysiological responses in the peripheral nervous system of the Gisborne cockroach (Drymaplaneta semivitta) to sinusoidal vibration of tibial spines. We plotted tuning curves and derived bandwidths of multi-unit populations. We also stimulated rat facial vibrissae ex vivo. This microcontroller-based, low-cost, open-source system leverages a large developer community associated with Arduino, and may help speed advances in systems neuroscience.

Mechanisms of Feature Selectivity and Invariance in Primary Visual Cortex

Visual object identification requires both selectivity for specific visual features that are important to the object's identity and invariance to feature manipulations. For example, a hand can be shifted in position, rotated, or contracted but still be recognized as a hand. How are the competing requirements of selectivity and invariance built into the early stages of visual processing? Typically, cells in the primary visual cortex are classified as either simple or complex. They both show selectivity for edge-orientation but complex cells develop invariance to edge position within the receptive field (spatial phase). Using a data-driven model that extracts the spatial structures and nonlinearities associated with neuronal computation, we quantitatively describe the balance between selectivity and invariance in complex cells. Phase invariance is frequently partial, while invariance to orientation and spatial frequency are more extensive than expected. The invariance arises due to two independent factors: (1) the structure and number of filters and (2) the form of nonlinearities that act upon the filter outputs. Both vary more than previously considered, so primary visual cortex forms an elaborate set of generic feature sensitivities, providing the foundation for more sophisticated object processing.

Comparison of contrast-dependent phase sensitivity in primary visual cortex of mouse, cat and macaque

Neurones in the primary visual cortex (V1) are classified into simple and complex types. Simple cells are phase-sensitive, that is, they modulate their responses according to the position and brightness polarity of edges in their receptive fields. Complex cells are phase invariant, that is, they respond to edges in their receptive fields regardless of location or brightness polarity. Simple and complex cells are quantified by the degree of sensitivity to the spatial phases of drifting sinusoidal gratings. Some V1 complex cells become more phase-sensitive at low contrasts. Here we use a standardized analysis method for data derived from grating stimuli developed for macaques to reanalyse data previously collected from cats, and also collect and analyse the responses of 73 mouse V1 neurons. The analysis provides the first consistent comparative study of contrast-dependent phase sensitivity in V1 of mouse, cat and macaque monkey.

Synaptic Basis for Contrast-Dependent Shifts in Functional Identity in Mouse V1

A central transformation that occurs within mammalian visual cortex is the change from linear, polarity-sensitive responses to nonlinear, polarity-insensitive responses. These neurons are classically labelled as either simple or complex, respectively, on the basis of their response linearity (Skottun et al., 1991). While the difference between cell classes is clear when the stimulus strength is high, reducing stimulus strength diminishes the differences between the cell types and causes some complex cells to respond as simple cells (Crowder et al., 2007; van Kleef et al., 2010; Hietanen et al., 2013). To understand the synaptic basis for this shift in behavior, we used in vivo whole-cell recordings while systematically shifting stimulus contrast. We find systematic shifts in the degree of complex cell responses in mouse primary visual cortex (V1) at the subthreshold level, demonstrating that synaptic inputs change in concert with the shifts in response linearity and that the change in response linearity is not simply due to the threshold nonlinearity. These shifts are consistent with a visual cortex model in which the recurrent amplification acts as a critical component in the generation of complex cell responses (Chance et al., 1999).

Contrast-dependent phase sensitivity in area MT of macaque visual cortex

In primate visual cortex (V1), about half the neurons are sensitive to the spatial phases of grating stimuli and generate highly modulated responses to drifting gratings (simple cells). The remaining cells show far less phase sensitivity and relatively unmodulated responses to moving gratings (complex cells). In the second visual area (V2) and the motion processing area MT (or V5), the majority of cells have unmodulated responses to drifting gratings - they are phase invariant. At just-detectable contrasts, 44% of V1 complex cells show highly modulated responses, but this contrast-dependent phase sensitivity is found in only 7% of V2 complex cells. We recorded from 149 cells in macaque MT - 142 classed as complex cells at high contrast. Approximately 14% (20/142) of MT complex cells showed significantly modulated responses to drifting gratings at just-detectable contrasts. A general feature of MT cells is that they can be divided into pattern and component selective types, but we found no correlation between this classification and contrast-dependent phase sensitivity. Phase sensitivity in MT is discussed in relation to MT's input structure.

Neural coding of image structure and contrast polarity of Cartesian, hyperbolic, and polar gratings in the primary and secondary visual cortex of the tree shrew

We comprehensively characterize spiking and visual evoked potential (VEP) activity in tree shrew V1 and V2 using Cartesian, hyperbolic, and polar gratings. Neural selectivity to structure of Cartesian gratings was higher than other grating classes in both visual areas. From V1 to V2, structure selectivity of spiking activity increased, whereas corresponding VEP values tended to decrease, suggesting that single-neuron coding of Cartesian grating attributes improved while the cortical columnar organization of these neurons became less precise from V1 to V2. We observed that neurons in V2 generally exhibited similar selectivity for polar and Cartesian gratings, suggesting that structure of polar-like stimuli might be encoded as early as in V2. This hypothesis is supported by the preference shift from V1 to V2 toward polar gratings of higher spatial frequency, consistent with the notion that V2 neurons encode visual scene borders and contours. Neural sensitivity to modulations of polarity of hyperbolic gratings was highest among all grating classes and closely related to the visual receptive field (RF) organization of ON- and OFF-dominated subregions. We show that spatial RF reconstructions depend strongly on grating class, suggesting that intracortical contributions to RF structure are strongest for Cartesian and polar gratings. Hyperbolic gratings tend to recruit least cortical elaboration such that the RF maps are similar to those generated by sparse noise, which most closely approximate feedforward inputs. Our findings complement previous literature in primates, rodents, and carnivores and highlight novel aspects of shape representation and coding occurring in mammalian early visual cortex.

Spatial phase sensitivity of complex cells in primary visual cortex depends on stimulus contrast

Neurons in primary visual cortex are classified as simple, which are phase sensitive, or complex, which are significantly less phase sensitive. Previously, we have used drifting gratings to show that the phase sensitivity of complex cells increases at low contrast and after contrast adaptation while that of simple cells remains the same at all contrasts (Cloherty SL, Ibbotson MR. J Neurophysiol 113: 434-444, 2015; Crowder NA, van Kleef J, Dreher B, Ibbotson MR. J Neurophysiol 98: 1155-1166, 2007; van Kleef JP, Cloherty SL, Ibbotson MR. J Physiol 588: 3457-3470, 2010). However, drifting gratings confound the influence of spatial and temporal summation, so here we have stimulated complex cells with gratings that are spatially stationary but continuously reverse the polarity of the contrast over time (contrast-reversing gratings). By varying the spatial phase and contrast of the gratings we aimed to establish whether the contrast-dependent phase sensitivity of complex cells results from changes in spatial or temporal processing or both. We found that most of the increase in phase sensitivity at low contrasts could be attributed to changes in the spatial phase sensitivities of complex cells. However, at low contrasts the complex cells did not develop the spatiotemporal response characteristics of simple cells, in which paired response peaks occur 180° out of phase in time and space. Complex cells that increased their spatial phase sensitivity at low contrasts were significantly overrepresented in the supragranular layers of cortex. We conclude that complex cells in supragranular layers of cat cortex have dynamic spatial summation properties and that the mechanisms underlying complex cell receptive fields differ between cortical layers.