Mechanisms of Feature Selectivity and Invariance in Primary Visual Cortex

Data-driven modelling of visual receptive fields: comparison between the generalized quadratic model and the nonlinear input model

Objective: Neurons in primary visual cortex (V1) display a range of sensitivity in their response to translations of their preferred visual features within their receptive field: from high specificity to a precise position through to complete invariance. This visual feature selectivity and invariance is frequently modeled by applying a selection of linear spatial filters to the input image, that define the feature selectivity, followed by a nonlinear function that combines the filter outputs, that defines the invariance, to predict the neural response. We compare two such classes of model, that are both popular and parsimonious, the generalized quadratic model (GQM) and the nonlinear input model (NIM). These two classes of model differ primarily in that the NIM can accommodate a greater diversity in the form of nonlinearity that is applied to the outputs of the filters.Approach: We compare the two model types by applying them to data from multielectrode recordings from cat primary visual cortex in response to spatially white Gaussian noise After fitting both classes of model to a database of 342 single units (SUs), we analyze the qualitative and quantitative differences in the visual feature processing performed by the two models and their ability to predict neural response.Main results: We find that the NIM predicts response rates on a held-out data at least as well as the GQM for 95% of SUs. Superior performance occurs predominantly for those units with above average spike rates and is largely due to the NIMs ability to capture aspects of the model's nonlinear function cannot be captured with the GQM rather than differences in the visual features being processed by the two different models.Significance: These results can help guide model choice for data-driven receptive field modelling.

Estimating receptive fields of simple and complex cells in early visual cortex: A convolutional neural network model with parameterized rectification

Neurons in the primary visual cortex respond selectively to simple features of visual stimuli, such as orientation and spatial frequency. Simple cells, which have phase-sensitive responses, can be modeled by a single receptive field filter in a linear-nonlinear model. However, it is challenging to analyze phase-invariant complex cells, which require more elaborate models having a combination of nonlinear subunits. Estimating parameters of these models is made additionally more difficult by cortical neurons' trial-to-trial response variability. We develop a simple convolutional neural network method to estimate receptive field models for both simple and complex visual cortex cells from their responses to natural images. The model consists of a spatiotemporal filter, a parameterized rectifier unit (PReLU), and a two-dimensional Gaussian "map" of the receptive field envelope. A single model parameter determines the simple vs. complex nature of the receptive field, capturing complex cell responses as a summation of homogeneous subunits, and collapsing to a linear-nonlinear model for simple type cells. The convolutional method predicts simple and complex cell responses to natural image stimuli as well as grating tuning curves. The fitted models yield a continuum of values for the PReLU parameter across the sampled neurons, showing that the simple/complex nature of cells can vary in a continuous manner. We demonstrate that complex-like cells respond less reliably than simple-like cells. However, compensation for this unreliability with noise ceiling analysis reveals predictive performance for complex cells proportionately closer to that for simple cells. Most spatial receptive field structures are well fit by Gabor functions, whose parameters confirm well-known properties of cat A17/18 receptive fields.

Understanding visual processing of motion: completing the picture using experimentally driven computational models of MT

Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of neural computation. Computational modeling of the neuronal pathways of the visual cortex has been successful in developing theories of biological motion processing. This review describes a range of computational models that have been inspired by neurophysiological experiments. Theories of local motion integration and pattern motion processing are presented, together with suggested neurophysiological experiments designed to test those hypotheses.

Characterization of extracellular spike waveforms recorded in wallaby primary visual cortex

Extracellular recordings were made from 642 units in the primary visual cortex (V1) of a highly visual marsupial, the Tammar wallaby. The receptive field (RF) characteristics of the cells were objectively estimated using the non-linear input model (NIM), and these were correlated with spike shapes. We found that wallaby cortical units had 68% regular spiking (RS), 12% fast spiking (FS), 4% triphasic spiking (TS), 5% compound spiking (CS) and 11% positive spiking (PS). RS waveforms are most often associated with recordings from pyramidal or spiny stellate cell bodies, suggesting that recordings from these cell types dominate in the wallaby cortex. In wallaby, 70-80% of FS and RS cells had orientation selective RFs and had evenly distributed linear and nonlinear RFs. We found that 47% of wallaby PS units were non-orientation selective and they were dominated by linear RFs. Previous studies suggest that the PS units represent recordings from the axon terminals of non-orientation selective cells originating in the lateral geniculate nucleus (LGN). If this is also true in wallaby, as strongly suggested by their low response latencies and bursty spiking properties, the results suggest that significantly more neurons in wallaby LGN are already orientation selective. In wallaby, less than 10% of recorded spikes had triphasic (TS) or sluggish compound spiking (CS) waveforms. These units had a mixture of orientation selective and non-oriented properties, and their cellular origins remain difficult to classify.

Orientation pinwheels in primary visual cortex of a highly visual marsupial

Primary visual cortices in many mammalian species exhibit modular and periodic orientation preference maps arranged in pinwheel-like layouts. The role of inherited traits as opposed to environmental influences in determining this organization remains unclear. Here, we characterize the cortical organization of an Australian marsupial, revealing pinwheel organization resembling that of eutherian carnivores and primates but distinctly different from the simpler salt-and-pepper arrangement of eutherian rodents and rabbits. The divergence of marsupials from eutherians 160 million years ago and the later emergence of rodents and rabbits suggest that the salt-and-pepper structure is not the primitive ancestral form. Rather, the genetic code that enables complex pinwheel formation is likely widespread, perhaps extending back to the common therian ancestors of modern mammals.

Model-based characterization of the selectivity of neurons in primary visual cortex

Statistical models are increasingly being used to understand the complexity of stimulus selectivity in primary visual cortex (V1) in the context of complex time-varying stimuli, replacing averaging responses to simple parametric stimuli. Although such models often can more accurately reflect the computations performed by V1 neurons in more natural visual environments, they do not by themselves provide insight into V1 neural selectivity to basic stimulus features such as receptive field size, spatial frequency tuning, and phase invariance. Here, we present a battery of analyses that can be directly applied to encoding models to link complex encoding models to more interpretable aspects of stimulus selectivity. We apply this battery to nonlinear models of V1 neurons recorded in awake macaque during random bar stimuli. In linking model properties to more classical measurements, we demonstrate several novel aspects of V1 selectivity not available to simpler experimental measurements. For example, this approach reveals that individual spatiotemporal elements of the V1 models often have a smaller spatial scale than the neuron as a whole, resulting in nontrivial tuning to spatial frequencies. In addition, we propose measures of nonlinear integration that suggest that classical classifications of V1 neurons into simple versus complex cells will be spatial-frequency dependent. In total, rather than obfuscate classical characterizations of V1 neurons, model-based characterizations offer a means to more fully understand their selectivity, and link their classical tuning properties to their roles in more complex, natural, visual processing.NEW & NOTEWORTHY Visual neurons are increasingly being studied with more complex, natural visual stimuli, and increasingly complex models are necessary to characterize their response properties. Here, we describe a battery of analyses that relate these more complex models to classical characterizations. Using such model-based characterizations of V1 neurons furthermore yields several new insights into V1 processing not possible to capture in more classical means to measure their visual selectivity.

Periodic clustering of simple and complex cells in visual cortex

Neurons in the primary visual cortex (V1) are often classified as simple or complex cells, but it is debated whether they are discrete hierarchical classes of neurons or if they represent a continuum of variation within a single class of cells. Herein, we show that simple and complex cells may arise commonly from the feedforward projections from the retina. From analysis of the cortical receptive fields in cats, we show evidence that simple and complex cells originate from the periodic variation of ON-OFF segregation in the feedforward projection of retinal mosaics, by which they organize into periodic clusters in V1. From data in cats, we observed that clusters of simple and complex receptive fields correlate topographically with orientation maps, which supports our model prediction. Our results suggest that simple and complex cells are not two distinct neural populations but arise from common retinal afferents, simultaneous with orientation tuning.

Advances in Carbon-Based Microfiber Electrodes for Neural Interfacing

Neural interfacing devices using penetrating microelectrode arrays have emerged as an important tool in both neuroscience research and medical applications. These implantable microelectrode arrays enable communication between man-made devices and the nervous system by detecting and/or evoking neuronal activities. Recent years have seen rapid development of electrodes fabricated using flexible, ultrathin carbon-based microfibers. Compared to electrodes fabricated using rigid materials and larger cross-sections, these microfiber electrodes have been shown to reduce foreign body responses after implantation, with improved signal-to-noise ratio for neural recording and enhanced resolution for neural stimulation. Here, we review recent progress of carbon-based microfiber electrodes in terms of material composition and fabrication technology. The remaining challenges and future directions for development of these arrays will also be discussed. Overall, these microfiber electrodes are expected to improve the longevity and reliability of neural interfacing devices.

Analysis of extracellular spike waveforms and associated receptive fields of neurons in cat primary visual cortex

KEY POINTS

Extracellular spikes recorded in the visual cortex (Area 17/18, V1) are commonly classified into either regular-spiking (RS) or fast-spiking (FS). Using multi-electrode arrays positioned in cat V1 and a broadband stimulus, we show that there is also a distinct class with positive-spiking (PS) waveforms. PS units were associated mainly with non-oriented receptive fields while RS and FS units had orientation-selective receptive fields. We suggest that PS units are recordings of axons originating from the thalamus. This conclusion was reinforced by our finding that we could record PS units after cortical silencing, but not record RS and FS units. The importance of our findings is that we were able to correlate spike shapes with receptive field characteristics with high precision using multi-electrode extracellular recording techniques. This allows considerable increases in the amount of information that can be extracted from future cortical experiments.

ABSTRACT

Extracellular spike waveforms from recordings in the visual cortex have been classified into either regular-spiking (RS) or fast-spiking (FS) units. While both these types of spike waveforms are negative-dominant, we show that there are also distinct classes of spike waveforms in visual Area 17/18 (V1) of anaesthetised cats with positive-dominant waveforms, which are not regularly reported. The spatial receptive fields (RFs) of these different spike waveform types were estimated, which objectively revealed the existence of oriented and non-oriented RFs. We found that units with positive-dominant spikes, which have been associated with recordings from axons in the literature, had mostly non-oriented RFs (84%), which are similar to the centre-surround RFs observed in the dorsal lateral geniculate nucleus (dLGN). Thus, we hypothesise that these positive-dominant waveforms may be recordings from dLGN afferents. We recorded from V1 before and after the application of muscimol (a cortical silencer) and found that the positive-dominant spikes (PS) remained while the RS and FS cells did not. We also noted that the PS units had spiking characteristics normally associated with dLGN units (i.e. higher response spike rates, lower response latencies and higher proportion of burst spikes). Our findings show quantitatively that it is possible to correlate the RF properties of cortical neurons with particular spike waveforms. This has implications for how extracellular recordings should be interpreted and complex experiments can now be contemplated that would have been very challenging previously, such as assessing the feedforward connectivity between brain areas in the same location of cortical tissue.

Learning receptive field properties of complex cells in V1

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.

Many cortical functions originate from the learning ability of the brain. How the properties of cortical cells are learned is vital for understanding how the brain works. There are many models that explain how V1 simple cells can be learned. However, how V1 complex cells are learned still remains unclear. In this paper, we propose a model of learning in complex cells based on the Bienenstock, Cooper, and Munro (BCM) rule. We demonstrate that properties of receptive fields of complex cells can be learned using this biologically plausible learning rule. Quantitative comparisons between the model and experimental data are performed. Results show that model complex cells can account for the diversity of complex cells found in experimental studies. In summary, this study provides a plausible explanation for how complex cells can be learned using biologically plausible plasticity mechanisms. Our findings help us to better understand biological vision processing and provide us with insights into the general signal processing principles that the visual cortex employs to process visual information.