Complex cell receptive fields: evidence for a hierarchical mechanism

Effects of top-down influence suppression on behavioral and V1 neuronal contrast sensitivity functions in cats

To explore the relative contributions of higher-order and primary visual cortex (V1) to visual perception, we compared cats' behavioral and V1 neuronal contrast sensitivity functions (CSF) and threshold versus external noise contrast (TvC) functions before and after top-down influence of area 7 (A7) was modulated with transcranial direct current stimulation (tDCS). We found that suppressing top-down influence of A7 with cathode-tDCS, but not sham-tDCS, reduced behavioral and neuronal contrast sensitivity in the same range of spatial frequencies and increased behavioral and neuronal contrast thresholds in the same range of external noise levels. The neuronal CSF and TvC functions were highly correlated with their behavioral counterparts both before and after the top-down suppression. Analysis of TvC functions using the Perceptual Template Model (PTM) indicated that top-down influence of A7 increased both behavioral and V1 neuronal contrast sensitivity by reducing internal additive noise and the impact of external noise.

•

Top-down suppression lowers both behavioral and V1 neuronal CSF functions

•

Top-down suppression raises both behavioral and V1 neuronal TvC functions

•

The neuronal CSFs and TvCs are highly correlated with their behavioral counterparts

•

Top-down influence lowers internal additive noise and impact of external noise in V1

Learning receptive field properties of complex cells in V1

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.

Many cortical functions originate from the learning ability of the brain. How the properties of cortical cells are learned is vital for understanding how the brain works. There are many models that explain how V1 simple cells can be learned. However, how V1 complex cells are learned still remains unclear. In this paper, we propose a model of learning in complex cells based on the Bienenstock, Cooper, and Munro (BCM) rule. We demonstrate that properties of receptive fields of complex cells can be learned using this biologically plausible learning rule. Quantitative comparisons between the model and experimental data are performed. Results show that model complex cells can account for the diversity of complex cells found in experimental studies. In summary, this study provides a plausible explanation for how complex cells can be learned using biologically plausible plasticity mechanisms. Our findings help us to better understand biological vision processing and provide us with insights into the general signal processing principles that the visual cortex employs to process visual information.

Comparison of contrast-dependent phase sensitivity in primary visual cortex of mouse, cat and macaque

Neurones in the primary visual cortex (V1) are classified into simple and complex types. Simple cells are phase-sensitive, that is, they modulate their responses according to the position and brightness polarity of edges in their receptive fields. Complex cells are phase invariant, that is, they respond to edges in their receptive fields regardless of location or brightness polarity. Simple and complex cells are quantified by the degree of sensitivity to the spatial phases of drifting sinusoidal gratings. Some V1 complex cells become more phase-sensitive at low contrasts. Here we use a standardized analysis method for data derived from grating stimuli developed for macaques to reanalyse data previously collected from cats, and also collect and analyse the responses of 73 mouse V1 neurons. The analysis provides the first consistent comparative study of contrast-dependent phase sensitivity in V1 of mouse, cat and macaque monkey.

Synaptic Basis for Contrast-Dependent Shifts in Functional Identity in Mouse V1

A central transformation that occurs within mammalian visual cortex is the change from linear, polarity-sensitive responses to nonlinear, polarity-insensitive responses. These neurons are classically labelled as either simple or complex, respectively, on the basis of their response linearity (Skottun et al., 1991). While the difference between cell classes is clear when the stimulus strength is high, reducing stimulus strength diminishes the differences between the cell types and causes some complex cells to respond as simple cells (Crowder et al., 2007; van Kleef et al., 2010; Hietanen et al., 2013). To understand the synaptic basis for this shift in behavior, we used in vivo whole-cell recordings while systematically shifting stimulus contrast. We find systematic shifts in the degree of complex cell responses in mouse primary visual cortex (V1) at the subthreshold level, demonstrating that synaptic inputs change in concert with the shifts in response linearity and that the change in response linearity is not simply due to the threshold nonlinearity. These shifts are consistent with a visual cortex model in which the recurrent amplification acts as a critical component in the generation of complex cell responses (Chance et al., 1999).

Contrast-dependent phase sensitivity in area MT of macaque visual cortex

In primate visual cortex (V1), about half the neurons are sensitive to the spatial phases of grating stimuli and generate highly modulated responses to drifting gratings (simple cells). The remaining cells show far less phase sensitivity and relatively unmodulated responses to moving gratings (complex cells). In the second visual area (V2) and the motion processing area MT (or V5), the majority of cells have unmodulated responses to drifting gratings - they are phase invariant. At just-detectable contrasts, 44% of V1 complex cells show highly modulated responses, but this contrast-dependent phase sensitivity is found in only 7% of V2 complex cells. We recorded from 149 cells in macaque MT - 142 classed as complex cells at high contrast. Approximately 14% (20/142) of MT complex cells showed significantly modulated responses to drifting gratings at just-detectable contrasts. A general feature of MT cells is that they can be divided into pattern and component selective types, but we found no correlation between this classification and contrast-dependent phase sensitivity. Phase sensitivity in MT is discussed in relation to MT's input structure.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

The use of in vivo, ex vivo, in vitro, computational models and volunteer studies in vision research and therapy, and their contribution to the Three Rs

Much is known about mammalian vision, and considerable progress has been achieved in treating many vision disorders, especially those due to changes in the eye, by using various therapeutic methods, including stem cell and gene therapy. While cells and tissues from the main parts of the eye and the visual cortex (VC) can be maintained in culture, and many computer models exist, the current non-animal approaches are severely limiting in the study of visual perception and retinotopic imaging. Some of the early studies with cats and non-human primates (NHPs) are controversial for animal welfare reasons and are of questionable clinical relevance, particularly with respect to the treatment of amblyopia. More recently, the UK Home Office records have shown that attention is now more focused on rodents, especially the mouse. This is likely to be due to the perceived need for genetically-altered animals, rather than to knowledge of the similarities and differences of vision in cats, NHPs and rodents, and the fact that the same techniques can be used for all of the species. We discuss the advantages and limitations of animal and non-animal methods for vision research, and assess their relative contributions to basic knowledge and clinical practice, as well as outlining the opportunities they offer for implementing the principles of the Three Rs (Replacement, Reduction and Refinement).

Sensory experience modifies feature map relationships in visual cortex

The extent to which brain structure is influenced by sensory input during development is a critical but controversial question. A paradigmatic system for studying this is the mammalian visual cortex. Maps of orientation preference (OP) and ocular dominance (OD) in the primary visual cortex of ferrets, cats and monkeys can be individually changed by altered visual input. However, the spatial relationship between OP and OD maps has appeared immutable. Using a computational model we predicted that biasing the visual input to orthogonal orientation in the two eyes should cause a shift of OP pinwheels towards the border of OD columns. We then confirmed this prediction by rearing cats wearing orthogonally oriented cylindrical lenses over each eye. Thus, the spatial relationship between OP and OD maps can be modified by visual experience, revealing a previously unknown degree of brain plasticity in response to sensory input.

DOI:http://dx.doi.org/10.7554/eLife.13911.001

The structure of the brain results from a combination of nature (genes) and nurture (environment). The brain’s ability to adapt to changes in the environment is known as plasticity, and the young brain is especially plastic. An animal’s sensory experiences in early life help to determine how its brain will process sensory input as an adult. One of the best sensory systems in which to study this process is the visual system.

Within the visual system, some brain cells respond only to input from the left eye and others only to input from the right eye. Cells that respond to input from the same eye are arranged to form columns. Within each column, some cells respond only to lines with a particular orientation. Cells with different preferred orientations are grouped together in patterns that resemble pinwheels. The relative positions of the pinwheels and eye-specific columns within the brain tissue belonging to the visual system have so far been robust to changes in visual experience during development, suggesting that they are determined by an animal’s genes.

However, Cloherty, Hughes et al. have now tested the unexpected predictions of a computer model. The model suggested that rearing animals so that they saw mostly vertical lines through one eye, and mostly horizontal lines through the other, would cause a form of plasticity that had never been observed before. Specifically, it would change the relative positions of the pinwheels and eye-specific columns within the visual parts of the brain. This prediction turned out to be correct. Young cats that wore special lenses – which slightly distorted what they saw but did not obviously affect their behavior – showed the predicted changes in brain structure.

The results confirm that this aspect of brain structure is partly determined by nurture, as opposed to being entirely specified by nature. A key future challenge is to identify the chemical signaling that enables sensory input to have these effects on brain structure. It might then be possible to use drugs to restore normal brain activity in cases where abnormal sensory input has altered the brain, for example in the condition known as amblyopia (or “lazy eye”).

DOI:http://dx.doi.org/10.7554/eLife.13911.002

Contrast and response gain control depend on cortical map architecture

Visual cortical neurons are sensitive to visual stimulus contrast and most cells adapt their sensitivity to the prevailing visual environment. Specifically, they match the steepest region of their contrast response function to the prevailing contrast (contrast gain control), and reduce spike rates to limit saturation (response gain control). Most neurons are also tuned for stimulus orientation, and neurons with similar orientation preference are clustered together into iso-orientation zones arranged around pinwheels, i.e. points where all orientations are represented. Here we investigated the relationship between the contrast adaptation properties of neurons and their location relative to pinwheels in the orientation preference map. We measured orientation preference maps in cat cortex using optical intrinsic signal imaging. We then characterized the contrast adaptation properties of single neurons located close to pinwheels, in iso-orientation zones, and at regions in between. We found little evidence of differential contrast sensitivity of neurons adapted to zero contrast. However, after adaptation to their preferred orientation at high contrast, changes in both contrast and response gain were greater for neurons near pinwheels compared with other map regions. Therefore, in the adapted state, which is probably typical during natural viewing, there is a spatial map of contrast sensitivity that is associated with the orientation preference map. This differential adaptation revealed a new dimension of cortical functional organization, linking the contrast adaptation of cells with the orientation preference of their nearest neighbours.

Spatial phase sensitivity of complex cells in primary visual cortex depends on stimulus contrast

Neurons in primary visual cortex are classified as simple, which are phase sensitive, or complex, which are significantly less phase sensitive. Previously, we have used drifting gratings to show that the phase sensitivity of complex cells increases at low contrast and after contrast adaptation while that of simple cells remains the same at all contrasts (Cloherty SL, Ibbotson MR. J Neurophysiol 113: 434-444, 2015; Crowder NA, van Kleef J, Dreher B, Ibbotson MR. J Neurophysiol 98: 1155-1166, 2007; van Kleef JP, Cloherty SL, Ibbotson MR. J Physiol 588: 3457-3470, 2010). However, drifting gratings confound the influence of spatial and temporal summation, so here we have stimulated complex cells with gratings that are spatially stationary but continuously reverse the polarity of the contrast over time (contrast-reversing gratings). By varying the spatial phase and contrast of the gratings we aimed to establish whether the contrast-dependent phase sensitivity of complex cells results from changes in spatial or temporal processing or both. We found that most of the increase in phase sensitivity at low contrasts could be attributed to changes in the spatial phase sensitivities of complex cells. However, at low contrasts the complex cells did not develop the spatiotemporal response characteristics of simple cells, in which paired response peaks occur 180° out of phase in time and space. Complex cells that increased their spatial phase sensitivity at low contrasts were significantly overrepresented in the supragranular layers of cortex. We conclude that complex cells in supragranular layers of cat cortex have dynamic spatial summation properties and that the mechanisms underlying complex cell receptive fields differ between cortical layers.

Contrast-dependent phase sensitivity in V1 but not V2 of macaque visual cortex

Some neurons in early visual cortex are highly selective for the position of oriented edges in their receptive fields (simple cells), whereas others are largely position insensitive (complex cells). These characteristics are reflected in their sensitivity to the spatial phase of moving sine-wave gratings: simple cell responses oscillate at the fundamental frequency of the stimulus, whereas this is less so for complex cells. In primates, when assessed at high stimulus contrast, simple cells and complex cells are roughly equally represented in the first visual cortical area, V1, whereas in the second visual area, V2, the majority of cells are complex. Recent evidence has shown that phase sensitivity of complex cells is contrast dependent. This has led to speculation that reduced contrast may lead to changes in the spatial structure of receptive fields, perhaps due to changes in how feedforward and recurrent signals interact. Given the substantial interconnections between V1 and V2 and recent evidence for the emergence of unique functional capacity in V2, we assess the relationship between contrast and phase sensitivity in the two brain regions. We show that a substantial proportion of complex cells in macaque V1 exhibit significant increases in phase sensitivity at low contrast, whereas this is rarely observed in V2. Our results support a degree of hierarchical processing from V1 to V2 with the differences possibly relating to the fact that V1 combines both subcortical and cortical input, whereas V2 receives input purely from cortical circuits.

Spectral characteristics of phase sensitivity and discharge rate of neurons in the ascending tectofugal visual system

Drifting gratings can modulate the activity of visual neurons at the temporal frequency of the stimulus. In order to characterize the temporal frequency modulation in the cat’s ascending tectofugal visual system, we recorded the activity of single neurons in the superior colliculus, the suprageniculate nucleus, and the anterior ectosylvian cortex during visual stimulation with drifting sine-wave gratings. In response to such stimuli, neurons in each structure showed an increase in firing rate and/or oscillatory modulated firing at the temporal frequency of the stimulus (phase sensitivity). To obtain a more complete characterization of the neural responses in spatiotemporal frequency domain, we analyzed the mean firing rate and the strength of the oscillatory modulations measured by the standardized Fourier component of the response at the temporal frequency of the stimulus. We show that the spatiotemporal stimulus parameters that elicit maximal oscillations often differ from those that elicit a maximal discharge rate. Furthermore, the temporal modulation and discharge-rate spectral receptive fields often do not overlap, suggesting that the detection range for visual stimuli provided jointly by modulated and unmodulated response components is larger than the range provided by a one response component.

Stripe-rearing changes multiple aspects of the structure of primary visual cortex

An important example of brain plasticity is the change in the structure of the orientation map in mammalian primary visual cortex in response to a visual environment consisting of stripes of one orientation. In principle there are many different ways in which the structure of a normal map could change to accommodate increased preference for one orientation. However, until now these changes have been characterised only by the relative sizes of the areas of primary visual cortex representing different orientations. Here we extend to the stripe-reared case a recently proposed Bayesian method for reconstructing orientation maps from intrinsic signal optical imaging data. We first formulated a suitable prior for the stripe-reared case, and developed an efficient method for maximising the marginal likelihood of the model in order to determine the optimal parameters. We then applied this to a set of orientation maps from normal and stripe-reared cats. This analysis revealed that several parameters of overall map structure, specifically the difference between wavelength, scaling and mean of the two vector components of maps, changed in response to stripe-rearing, which together give a more nuanced assessment of the effect of rearing condition on map structure than previous measures. Overall this work expands our understanding of the effects of the environment on brain structure.

Phase sensitivity of complex cells in primary visual cortex

Neurons in the primary visual cortex are often classified as either simple or complex based on the linearity (or otherwise) of their response to spatial luminance contrast. In practice, classification is typically based on Fourier analysis of a cell's response to an optimal drifting sine-wave grating. Simple cells are generally considered to be linear and produce responses modulated at the fundamental frequency of the stimulus grating. In contrast, complex cells exhibit significant nonlinearities that reduce the response at the fundamental frequency. Cells can therefore be easily and objectively classified based on the relative modulation of their responses - the ratio of the phase-sensitive response at the fundamental frequency of the stimulus (F₁) to the phase-invariant sustained response (F₀). Cells are classified as simple if F₁/F₀>1 and complex if F₁/F₀<1. This classification is broadly consistent with criteria based on the spatial organisation of cells' receptive fields and is accordingly presumed to reflect disparate functional roles of simple and complex cells in coding visual information. However, Fourier analysis of spiking responses is sensitive to the number of spikes available - F₁/F₀ increases as the number of spikes is reduced, even for phase-invariant complex cells. Moreover, many complex cells encountered in the laboratory exhibit some phase sensitivity, evident as modulation of their responses at the fundamental frequency. There currently exists no objective quantitative means of assessing the significance or otherwise of these modulations. Here we derive a statistical basis for objectively assessing whether the modulation of neuronal responses is reliable, thereby adding a level of statistical certainty to measures of phase sensitivity. We apply our statistical analysis to neuronal responses to moving sine-wave gratings recorded from 367 cells in cat primary visual cortex. We find that approximately 60% of complex cells exhibit statistically significant (α<0.01) modulation of their responses to optimal moving gratings. These complex cells are phase sensitive and reliably encode spatial phase.

Stability of simple/complex classification with contrast and extraclassical receptive field modulation in macaque V1

A key property of neurons in primary visual cortex (V1) is the distinction between simple and complex cells. Recent reports in cat visual cortex indicate the categorization of simple and complex can change depending on stimulus conditions. We investigated the stability of the simple/complex classification with changes in drive produced by either contrast or modulation by the extraclassical receptive field (eCRF). These two conditions were reported to increase the proportion of simple cells in cat cortex. The ratio of the modulation depth of the response (F1) to the elevation of response (F0) to a drifting grating (F1/F0 ratio) was used as the measure of simple/complex. The majority of V1 complex cells remained classified as complex with decreasing contrast. Near contrast threshold, an equal proportion of simple and complex cells changed their classification. The F1/F0 ratio was stable between optimal and large stimulus areas even for those neurons that showed strong eCRF suppression. There was no discernible overall effect of surrounding spatial context on the F1/F0 ratio. Simple/complex cell classification is relatively stable across a range of stimulus drives, produced by either contrast or eCRF suppression.

Standardized F1: a consistent measure of strength of modulation of visual responses to sine-wave drifting gratings

The magnitude of spike-responses of neurons in the mammalian visual system to sine-wave luminance-contrast-modulated drifting gratings is modulated by the temporal frequency of the stimulation. However, there are serious problems with consistency and reliability of the traditionally used methods of assessment of strength of such modulation. Here we propose an intuitive and simple tool for assessment of the strength of modulations in the form of standardized F1 index, zF1. We define zF1 as the ratio of the difference between the F1 (component of amplitude spectrum of the spike-response at temporal frequency of stimulation) and the mean value of spectrum amplitudes to standard deviation along all frequencies in the spectrum. In order to assess the validity of this measure, we have: (1) examined behavior of zF1 using spike-responses to optimized drifting gratings of single neurons recorded from four 'visual' structures (area V1 of primary visual cortex, superior colliculus, suprageniculate nucleus and caudate nucleus) in the brain of commonly used visual mammal - domestic cat; (2) compared the behavior of zF1 with that of classical statistics commonly employed in the analysis of steady-state responses; (3) tested the zF1 index on simulated spike-trains generated with threshold-linear model. Our analyses indicate that zF1 is resistant to distortions due to the low spike count in responses and therefore can be particularly useful in the case of recordings from neurons with low firing rates and/or low net mean responses. While most V1 and a half of caudate neurons exhibit high zF1 indices, the majorities of collicular and suprageniculate neurons exhibit low zF1 indices. We conclude that despite the general shortcomings of measuring strength of modulation inherent in the linear system approach, zF1 can serve as a sensitive and easy to interpret tool for detection of modulation and assessment of its strength in responses of visual neurons.