Investigating cross-orientation inhibition with continuous tracking

We investigated cross-orientation inhibition with the recently developed continuous tracking technique. We designed an experiment where participants tracked the horizontal motion of a narrow vertical grating. The target was superimposed on one of three different backgrounds, in separate sessions: a uniform gray background or a sinusoidal grating oriented either parallel or orthogonal to the target. Both mask and target where phase reversed. We cross-correlated target and mouse movements and compared the peaks and lags of response with the different masks. Our results are in agreement with previous findings on cross-orientation inhibition: The orthogonal mask had a weak effect on the peaks and lags of correlation as a function of target contrast, consistently with a divisive effect of the mask, while the parallel mask acted subtractively on the response. Interestingly, lags of correlation decreased approximately linearly with contrast, with decrements of the order of 100 ms, even at 10 times the detection threshold, confirming that it is possible to investigate behavioral differences above threshold using the continuous tracking paradigm.

Orientation and direction tuning align with dendritic morphology and spatial connectivity in mouse visual cortex

The functional properties of neocortical pyramidal cells (PCs), such as direction and orientation selectivity in visual cortex, predominantly derive from their excitatory and inhibitory inputs. For layer 2/3 (L2/3) PCs, the detailed relationship between their functional properties and how they sample and integrate information across cortical space is not fully understood. Here, we study this relationship by combining functional in vivo two-photon calcium imaging, in vitro functional circuit mapping, and dendritic reconstruction of the same L2/3 PCs in mouse visual cortex. Our work reveals direct correlations between dendritic morphology and functional input connectivity and the orientation as well as direction tuning of L2/3 PCs. First, the apical dendritic tree is elongated along the postsynaptic preferred orientation, considering the representation of visual space in the cortex as determined by its retinotopic organization. Additionally, sharply orientation-tuned cells show a less complex apical tree compared with broadly tuned cells. Second, in direction-selective L2/3 PCs, the spatial distribution of presynaptic partners is offset from the soma opposite to the preferred direction. Importantly, although the presynaptic excitatory and inhibitory input distributions spatially overlap on average, the excitatory input distribution is spatially skewed along the preferred direction, in contrast to the inhibitory distribution. Finally, the degree of asymmetry is positively correlated with the direction selectivity of the postsynaptic L2/3 PC. These results show that the dendritic architecture and the spatial arrangement of excitatory and inhibitory presynaptic cells of L2/3 PCs play important roles in shaping their orientation and direction tuning.

Neocortex saves energy by reducing coding precision during food scarcity

Information processing is energetically expensive. In the mammalian brain, it is unclear how information coding and energy use are regulated during food scarcity. Using whole-cell recordings and two-photon imaging in layer 2/3 mouse visual cortex, we found that food restriction reduced AMPA receptor conductance, reducing synaptic ATP use by 29%. Neuronal excitability was nonetheless preserved by a compensatory increase in input resistance and a depolarized resting potential. Consequently, neurons spiked at similar rates as controls but spent less ATP on underlying excitatory currents. This energy-saving strategy had a cost because it amplified the variability of visually-evoked subthreshold responses, leading to a 32% broadening of orientation tuning and impaired fine visual discrimination. This reduction in coding precision was associated with reduced levels of the fat mass-regulated hormone leptin and was restored by exogenous leptin supplementation. Our findings reveal that metabolic state dynamically regulates the energy spent on coding precision in neocortex.

Columnar processing of border ownership in primate visual cortex

To understand a visual scene, the brain segregates figures from background by assigning borders to foreground objects. Neurons in primate visual cortex encode which object owns a border (border ownership), but the underlying circuitry is not understood. Here, we used multielectrode probes to record from border ownership-selective units in different layers in macaque visual area V4 to study the laminar organization and timing of border ownership selectivity. We find that border ownership selectivity occurs first in deep layer units, in contrast to spike latency for small stimuli in the classical receptive field. Units on the same penetration typically share the preferred side of border ownership, also across layers, similar to orientation preference. Units are often border ownership-selective for a range of border orientations, where the preferred sides of border ownership are systematically organized in visual space. Together our data reveal a columnar organization of border ownership in V4 where the earliest border ownership signals are not simply inherited from upstream areas, but computed by neurons in deep layers, and may thus be part of signals fed back to upstream cortical areas or the oculomotor system early after stimulus onset. The finding that preferred border ownership is clustered and can cover a wide range of spatially contiguous locations suggests that the asymmetric context integrated by these neurons is provided in a systematically clustered manner, possibly through corticocortical feedback and horizontal connections.

To understand a visual scene, the brain needs to identify objects and distinguish them from background. A border marks the transition from object to background, but to differentiate which side of the border belongs to the object and which to background, the brain must integrate information across space. An early signature of this computation is that brain cells signal which side of a border is ‘owned’ by an object, also known as border ownership. But how the brain computes border ownership remains unknown.

The optic nerve is a cable-like group of nerve cells that transmits information from the eye to the brain’s visual processing areas and into the visual cortex. This flow of information is often described as traveling in a feedforward direction, away from the eyes to progressively more specialized areas in the visual cortex. However, there are also numerous feedback connections in the brain, running backward from more specialized to less specialized cortical areas.

To better understand the role of these feedforward and feedback circuits in the visual processing of object borders, Franken and Reynolds made use of their stereotyped projection patterns across the cortex layers. Feedforward connections terminate in the middle layers of a cortical area, whereas feedback connections terminate in upper and lower layers. Since time is required for information to traverse the cortical layers, dissecting the timing of border ownership signals may reveal if border ownership is computed in a feedforward or feedback manner. To find out more, electrodes were used to record neural activity in the upper, middle and lower layers of the visual cortex of two rhesus monkeys as they were presented with a set of abstract scenes composed of simple shapes on a background.

This revealed that cells signaling border ownership in deep layers of the cortex did so before the signals appeared in the middle layer. This suggests that feedback rather than feedforward is required to compute border ownership. Moreover, Franken and Reynolds found evidence that cells that prefer the same side of border ownership are clustered in columns, showing how these neural circuits are organized within the visual cortex.

In summary, Franken and Reynolds found that the circuits of the primate brain that compute border ownership occur as columns, in which cells in deep layers signal border ownership first, suggesting that border ownership relies on feedback from more specialized areas. A better understanding of how feedback in the brain works to process visual information helps us appreciate what happens when these systems are impaired.

Spatial integration during active tactile sensation drives orientation perception

Active haptic sensation is critical for object identification, but its neural circuit basis is poorly understood. We combined optogenetics, two-photon imaging, and high-speed behavioral tracking in mice solving a whisker-based object orientation discrimination task. We found that orientation discrimination required animals to summate input from multiple whiskers specifically along the whisker arc. Animals discriminated the orientation of the stimulus per se as their performance was invariant to the location of the presented stimulus. Populations of barrel cortex neurons summated across whiskers to encode each orientation. Finally, acute optogenetic inactivation of the barrel cortex and cell-type-specific optogenetic suppression of layer 4 excitatory neurons degraded performance, implying that infragranular layers alone are not sufficient to solve the task. These data suggest that spatial summation over an active haptic array generates representations of an object's orientation, which may facilitate encoding of complex three-dimensional objects during active exploration.

Retino-Cortical Mapping Ratio Predicts Columnar and Salt-and-Pepper Organization in Mammalian Visual Cortex

In the mammalian primary visual cortex, neural tuning to stimulus orientation is organized in either columnar or salt-and-pepper patterns across species. For decades, this sharp contrast has spawned fundamental questions about the origin of functional architectures in visual cortex. However, it is unknown whether these patterns reflect disparate developmental mechanisms across mammalian taxa or simply originate from variation of biological parameters under a universal development process. In this work, after the analysis of data from eight mammalian species, we show that cortical organization is predictable by a single factor, the retino-cortical mapping ratio. Groups of species with or without columnar clustering are distinguished by the feedforward sampling ratio, and model simulations with controlled mapping conditions reproduce both types of organization. Prediction from the Nyquist theorem explains this parametric division of the patterns with high accuracy. Our results imply that evolutionary variation of physical parameters may induce development of distinct functional circuitry.

A Distinct Class of Bursting Neurons with Strong Gamma Synchronization and Stimulus Selectivity in Monkey V1

Cortical computation depends on interactions between excitatory and inhibitory neurons. The contributions of distinct neuron types to sensory processing and network synchronization in primate visual cortex remain largely undetermined. We show that in awake monkey V1, there exists a distinct cell type (››30% of neurons) that has narrow-waveform (NW) action potentials and high spontaneous discharge rates and fires in high-frequency bursts. These neurons are more stimulus selective and phase locked to 30- to 80-Hz gamma oscillations than other neuron types. Unlike other neuron types, their gamma-phase locking is highly predictive of orientation tuning. We find evidence for strong rhythmic inhibition in these neurons, suggesting that they interact with interneurons to act as excitatory pacemakers for the V1 gamma rhythm. We did not find a similar class of NW bursting neurons in L2-L4 of mouse V1. Given its properties, this class of NW bursting neurons should be pivotal for the encoding and transmission of stimulus information.

Fear-Related Signals in the Primary Visual Cortex

Neuronal responses in the primary visual cortex (V1) are driven by simple stimuli, but these stimulus-evoked responses can be markedly modulated by non-sensory factors, such as attention and reward [1], and shaped by perceptual training [2]. In real-life situations, neutral visual stimuli can become emotionally tagged by experience, resulting in altered perceptual abilities to detect and discriminate these stimuli [3-5]. Human imaging [4] and electroencephalography (EEG) studies [6-9] have shown that visual fear learning (the acquisition of aversive emotion associated with a visual stimulus) affects the activities in visual cortical areas as early as in V1. However, it remains elusive as to whether the fear-related activities seen in the early visual cortex have to do with feedback influences from other cortical areas; it is also unclear whether and how the response properties of V1 cells are modified during the fear learning. In the current study, we addressed these issues by recording from V1 of awake monkeys implanted with an array of microelectrodes. We found that responses of V1 neurons were rapidly modified when a given orientation of grating stimulus was repeatedly associated with an aversive stimulus. The output visual signals from V1 cells conveyed, from their response outset, fear-related signals that were specific to the fear-associated grating orientation and visual-field location. The specific fear signals were independent of neurons' orientation preferences and were present even though the fear-associated stimuli were rendered invisible. Our findings suggest a bottom-up mechanism that allows for proactive labeling of visual inputs that are predictive of imminent danger.

Divisive Inhibition Prevails During Simultaneous Optogenetic Activation of All Interneuron Subtypes in Mouse Primary Visual Cortex

The mouse primary visual cortex (V1) has become an important brain area for exploring how neural circuits process information. Optogenetic tools have helped to outline the connectivity of a local V1 circuit comprising excitatory pyramidal neurons and several genetically-defined inhibitory interneuron subtypes that express parvalbumin, somatostatin, or vasoactive intestinal peptide. Optogenetic modulation of individual interneuron subtypes can alter the visual responsiveness of pyramidal neurons with distinct forms of inhibition and disinhibition. However, different interneuron subtypes have potentially opposing actions, and the potency of their effects relative to each other remains unclear. Therefore, in this study we simultaneously optogenetically activated all interneuron subtypes during visual processing to explore whether any single inhibitory effect would predominate. This aggregate interneuron activation consistently inhibited pyramidal neurons in a divisive manner, which was essentially identical to the pattern of inhibition produced by activating parvalbumin-expressing interneurons alone.

Nonlinear Processing of Shape Information in Rat Lateral Extrastriate Cortex

In rodents, the progression of extrastriate areas located laterally to primary visual cortex (V1) has been assigned to a putative object-processing pathway (homologous to the primate ventral stream), based on anatomical considerations. Recently, we found functional support for such attribution (Tafazoli et al., 2017), by showing that this cortical progression is specialized for coding object identity despite view changes, the hallmark property of a ventral-like pathway. Here, we sought to clarify what computations are at the base of such specialization. To this aim, we performed multielectrode recordings from V1 and laterolateral area LL (at the apex of the putative ventral-like hierarchy) of male adult rats, during the presentation of drifting gratings and noise movies. We found that the extent to which neuronal responses were entrained to the phase of the gratings sharply dropped from V1 to LL, along with the quality of the receptive fields inferred through reverse correlation. Concomitantly, the tendency of neurons to respond to different oriented gratings increased, whereas the sharpness of orientation tuning declined. Critically, these trends are consistent with the nonlinear summation of visual inputs that is expected to take place along the ventral stream, according to the predictions of hierarchical models of ventral computations and a meta-analysis of the monkey literature. This suggests an intriguing homology between the mechanisms responsible for building up shape selectivity and transformation tolerance in the visual cortex of primates and rodents, reasserting the potential of the latter as models to investigate ventral stream functions at the circuitry level.SIGNIFICANCE STATEMENT Despite the growing popularity of rodents as models of visual functions, it remains unclear whether their visual cortex contains specialized modules for processing shape information. To addresses this question, we compared how neuronal tuning evolves from rat primary visual cortex (V1) to a downstream visual cortical region (area LL) that previous work has implicated in shape processing. In our experiments, LL neurons displayed a stronger tendency to respond to drifting gratings with different orientations while maintaining a sustained response across the whole duration of the drift cycle. These trends match the increased complexity of pattern selectivity and the augmented tolerance to stimulus translation found in monkey visual temporal cortex, thus revealing a homology between shape processing in rodents and primates.

Orientation and Contrast Tuning Properties and Temporal Flicker Fusion Characteristics of Primate Superior Colliculus Neurons

The primate superior colliculus is traditionally studied from the perspectives of gaze control, target selection, and selective attention. However, this structure is also visually responsive, and it is the primary visual structure in several species. Thus, understanding the visual tuning properties of the primate superior colliculus is important, especially given that the superior colliculus is part of an alternative visual pathway running in parallel to the predominant geniculo-cortical pathway. In recent previous studies, we have characterized receptive field organization and spatial frequency tuning properties in the primate (rhesus macaque) superior colliculus. Here, we explored additional aspects like orientation tuning, putative center-surround interactions, and temporal frequency tuning characteristics of visually-responsive superior colliculus neurons. We found that orientation tuning exists in the primate superior colliculus, but that such tuning is relatively moderate in strength. We also used stimuli of different sizes to explore contrast sensitivity and center-surround interactions. We found that stimulus size within a visual receptive field primarily affects the slope of contrast sensitivity curves without altering maximal firing rate. Additionally, sustained firing rates, long after stimulus onset, strongly depend on stimulus size, and this is also reflected in local field potentials. This suggests the presence of inhibitory interactions within and around classical receptive fields. Finally, primate superior colliculus neurons exhibit temporal frequency tuning for frequencies lower than 30 Hz, with critical flicker fusion frequencies of <20 Hz. These results support the hypothesis that the primate superior colliculus might contribute to visual performance, likely by mediating coarse, but rapid, object detection and identification capabilities for the purpose of facilitating or inhibiting orienting responses. Such mediation may be particularly amplified in blindsight subjects who lose portions of their primary visual cortex and therefore rely on alternative visual pathways including the pathway through the superior colliculus.

Computational Modeling of Contrast Sensitivity and Orientation Tuning in First-Episode and Chronic Schizophrenia

Computational modeling is a useful method for generating hypotheses about the contributions of impaired neurobiological mechanisms, and their interactions, to psychopathology. Modeling is being increasingly used to further our understanding of schizophrenia, but to date, it has not been applied to questions regarding the common perceptual disturbances in the disorder. In this article, we model aspects of low-level visual processing and demonstrate how this can lead to testable hypotheses about both the nature of visual abnormalities in schizophrenia and the relationships between the mechanisms underlying these disturbances and psychotic symptoms. Using a model that incorporates retinal, lateral geniculate nucleus (LGN), and V1 activity, as well as gain control in the LGN, homeostatic adaptation in V1, lateral excitation and inhibition in V1, and self-organization of synaptic weights based on Hebbian learning and divisive normalization, we show that (a) prior data indicating increased contrast sensitivity for low-spatial-frequency stimuli in first-episode schizophrenia can be successfully modeled as a function of reduced retinal and LGN efferent activity, leading to overamplification at the cortical level, and (b) prior data on reduced contrast sensitivity and broadened orientation tuning in chronic schizophrenia can be successfully modeled by a combination of reduced V1 lateral inhibition and an increase in the Hebbian learning rate at V1 synapses for LGN input. These models are consistent with many current findings, and they predict several relationships that have not yet been demonstrated. They also have implications for understanding changes in brain and visual function from the first psychotic episode to the chronic stage of illness.

Interlayer Repulsion of Retinal Ganglion Cell Mosaics Regulates Spatial Organization of Functional Maps in the Visual Cortex

In higher mammals, orientation tuning of neurons is organized into a quasi-periodic pattern in the primary visual cortex. Our previous model studies suggested that the topography of cortical orientation maps may originate from moiré interference of ON and OFF retinal ganglion cell (RGC) mosaics, but did not account for how the consistent spatial period of maps could be achieved. Here we address this issue with two crucial findings on the development of RGC mosaics: first, homotypic local repulsion between RGCs can develop a long-range hexagonal periodicity. Second, heterotypic interaction restrains the alignment of ON and OFF mosaics, and generates a periodic interference pattern map with consistent spatial frequency. To validate our model, we quantitatively analyzed the RGC mosaics in cat data, and confirmed that the observed retinal mosaics showed evidence of heterotypic interactions, contrary to the previous view that ON and OFF mosaics are developed independently.SIGNIFICANCE STATEMENT Orientation map is one of the most studied functional maps in the brain, but it has remained unanswered how the consistent spatial periodicity of maps could be developed. In the current study, we address this issue with our developmental model for the retinal origin of orientation map. We showed that local repulsive interactions between retinal ganglion cells (RGCs) can develop a hexagonal periodicity in the RGC mosaics and restrict the alignment between ON and OFF mosaics, so that they generate a periodic pattern with consistent spatial frequency for both the RGC mosaics and the cortical orientation maps. Our results demonstrate that the organization of functional maps in visual cortex, including its structural consistency, may be constrained by a retinal blueprint.

Ferret Interneurons Defy Expectations

Parvalbumin interneurons in the cortex are believed to pool inputs from most surrounding excitatory cells independent of their functional properties. Response properties of interneurons in columnar visual cortex of ferrets, described by Wilson et al. (2017) in this issue of Neuron, challenge this view.

Organization of orientation-specific whisker deflection responses in layer 2/3 of mouse somatosensory cortex

The rodent whisker-barrel system is characterized by its patterned somatotopic mapping between the sensory periphery and multiple regions of the brain. While somatotopy in the whisker system is established, we know far less about how preferences for stimulus orientation or other features are organized. Mouse somatosensation is an increasingly popular model for circuit-based dissection of perceptual decision making and learning, yet our understanding of how stimulus feature representations are organized in the cortex is incomplete. Here, we used in vivo two-photon calcium imaging to monitor activity of populations of layer (L) 2/3 neurons in the mouse primary somatosensory cortex during deflections of a single whisker in two orthogonal orientations (azimuthal or elevational). We split the population response to whisker deflections into an orientation-specific component and a non-specific component that reflected overall excitability in response to deflection of a single whisker. Orientation-specific responses were organized in a locally heterogeneous and spatially distributed manner. Correlations in the stimulus-independent trial-to-trial variability of pairs of neurons were higher among neurons that preferred the same orientation. These correlations depended on similarity in both orientation-specific and non-specific components of responses to single-whisker deflections. Our results shed light on L2/3 organization in mouse somatosensory cortex, and lay a foundation for dissecting circuit mechanisms of perceptual learning and decision-making during orientation discrimination tasks.

Adaptation-Induced Blindness Is Orientation-Tuned and Monocular

We examined the recently discovered phenomenon of Adaptation-Induced Blindness (AIB), in which highly visible gratings with gradual onset profiles become invisible after exposure to a rapidly flickering grating, even at very high contrasts. Using very similar stimuli to those in the original AIB experiment, we replicated the original effect across multiple contrast levels, with observers at chance in detecting the gradual onset stimuli at all contrasts. Then, using full-contrast target stimuli with either abrupt or gradual onsets, we tested both the orientation tuning and interocular transfer of AIB. If, as the original authors suggested, AIB were a high-level (perhaps parietally mediated) effect resulting from the ‘gating’ of awareness, we would not expect the effects of AIB to be tuned to the adapting orientation, and the effect should transfer interocularly. Instead, we find that AIB (which was present only for the gradual onset target stimuli) is both tightly orientation-tuned and shows absolutely no interocular transfer, consistent with a very early cortical locus.

Locomotion Induces Stimulus-Specific Response Enhancement in Adult Visual Cortex

The responses of neurons in the visual cortex (V1) of adult mammals have long been thought to be stable over long periods. Here, we investigated whether repeated exposure to specific stimuli would enhance V1 visual responses in mice using intrinsic signal imaging through the intact skull and two-photon imaging of calcium signals in single neurons. Mice ran on Styrofoam balls floating on air while viewing one of three different, high-contrast visual stimuli. V1 responses to the stimuli that were viewed by the animal were specifically enhanced, while responses to other stimuli were unaffected. Similar exposure in stationary mice or in mice in which NMDA receptors were partially blocked did not significantly enhance responses. These findings indicate that stimulus-specific plasticity in the adult visual cortex depends on concurrent locomotion, presumably as a result of the high-gain state of the visual cortex induced by locomotion.SIGNIFICANCE STATEMENT We report a rapid and persistent increase in visual cortical responses to visual stimuli presented during locomotion in intact mice. We first used a method that is completely noninvasive to image intrinsic signals through the intact skull. We then measured the same effects on single neurons using two-photon calcium imaging and found that the increase in response to a particular stimulus produced by locomotion depends on how well the neuron is initially driven by the stimulus. To our knowledge, this is the first time such enhancement has been described in single neurons or using noninvasive measurements.

Mice Can Use Second-Order, Contrast-Modulated Stimuli to Guide Visual Perception

Visual processing along the primate ventral stream takes place in a hierarchy of areas, characterized by an increase in both complexity of neuronal preferences and invariance to changes of low-level stimulus attributes. A basic type of invariance is form-cue invariance, where neurons have similar preferences in response to first-order stimuli, defined by changes in luminance, and global features of second-order stimuli, defined by changes in texture or contrast. Whether in mice, a now popular model system for early visual processing, visual perception can be guided by second-order stimuli is currently unknown. Here, we probed mouse visual perception and neural responses in areas V1 and LM using various types of second-order, contrast-modulated gratings with static noise carriers. These gratings differ in their spatial frequency composition and thus in their ability to invoke first-order mechanisms exploiting local luminance features. We show that mice can transfer learning of a coarse orientation discrimination task involving first-order, luminance-modulated gratings to the contrast-modulated gratings, albeit with markedly reduced discrimination performance. Consistent with these behavioral results, we demonstrate that neurons in area V1 and LM are less responsive and less selective to contrast-modulated than to luminance-modulated gratings, but respond with broadly similar preferred orientations. We conclude that mice can, at least in a rudimentary form, use second-order stimuli to guide visual perception.

SIGNIFICANCE STATEMENT

To extract object boundaries in natural scenes, the primate visual system does not only rely on differences in local luminance but can also take into account differences in texture or contrast. Whether the mouse, which has a much simpler visual system, can use such second-order information to guide visual perception is unknown. Here we tested mouse perception of second-order, contrast-defined stimuli and measured their neural representations in two areas of visual cortex. We find that mice can use contrast-defined stimuli to guide visual perception, although behavioral performance and neural representations were less robust than for luminance-defined stimuli. These findings shed light on basic steps of feature extraction along the mouse visual cortical hierarchy, which may ultimately lead to object recognition.

Synaptic Basis for Differential Orientation Selectivity between Complex and Simple Cells in Mouse Visual Cortex

In the primary visual cortex (V1), orientation-selective neurons can be categorized into simple and complex cells primarily based on their receptive field (RF) structures. In mouse V1, although previous studies have examined the excitatory/inhibitory interplay underlying orientation selectivity (OS) of simple cells, the synaptic bases for that of complex cells have remained obscure. Here, by combining in vivo loose-patch and whole-cell recordings, we found that complex cells, identified by their overlapping on/off subfields, had significantly weaker OS than simple cells at both spiking and subthreshold membrane potential response levels. Voltage-clamp recordings further revealed that although excitatory inputs to complex and simple cells exhibited a similar degree of OS, inhibition in complex cells was more narrowly tuned than excitation, whereas in simple cells inhibition was more broadly tuned than excitation. The differential inhibitory tuning can primarily account for the difference in OS between complex and simple cells. Interestingly, the differential synaptic tuning correlated well with the spatial organization of synaptic input: the inhibitory visual RF in complex cells was more elongated in shape than its excitatory counterpart and also was more elongated than that in simple cells. Together, our results demonstrate that OS of complex and simple cells is differentially shaped by cortical inhibition based on its orientation tuning profile relative to excitation, which is contributed at least partially by the spatial organization of RFs of presynaptic inhibitory neurons.

SIGNIFICANCE STATEMENT

Simple and complex cells, two classes of principal neurons in the primary visual cortex (V1), are generally thought to be equally selective for orientation. In mouse V1, we report that complex cells, identified by their overlapping on/off subfields, has significantly weaker orientation selectivity (OS) than simple cells. This can be primarily attributed to the differential tuning selectivity of inhibitory synaptic input: inhibition in complex cells is more narrowly tuned than excitation, whereas in simple cells inhibition is more broadly tuned than excitation. In addition, there is a good correlation between inhibitory tuning selectivity and the spatial organization of inhibitory inputs. These complex and simple cells with differential degree of OS may provide functionally distinct signals to different downstream targets.

Decoding Rich Spatial Information with High Temporal Resolution

New research suggests that magnetoencephalography (MEG) contains rich spatial information for decoding neural states. Even small differences in the angle of neighbouring dipoles generate subtle, but statistically separable field patterns. This implies MEG (and electroencephalography: EEG) is ideal for decoding neural states with high-temporal resolution in the human brain.

Attention and normalization circuits in macaque V1

Attention affects neuronal processing and improves behavioural performance. In extrastriate visual cortex these effects have been explained by normalization models, which assume that attention influences the circuit that mediates surround suppression. While normalization models have been able to explain attentional effects, their validity has rarely been tested against alternative models. Here we investigate how attention and surround/mask stimuli affect neuronal firing rates and orientation tuning in macaque V1. Surround/mask stimuli provide an estimate to what extent V1 neurons are affected by normalization, which was compared against effects of spatial top down attention. For some attention/surround effect comparisons, the strength of attentional modulation was correlated with the strength of surround modulation, suggesting that attention and surround/mask stimulation (i.e. normalization) might use a common mechanism. To explore this in detail, we fitted multiplicative and additive models of attention to our data. In one class of models, attention contributed to normalization mechanisms, whereas in a different class of models it did not. Model selection based on Akaike's and on Bayesian information criteria demonstrated that in most cells the effects of attention were best described by models where attention did not contribute to normalization mechanisms. This demonstrates that attentional influences on neuronal responses in primary visual cortex often bypass normalization mechanisms.

One "shape" fits all: the orientation bandwidth of contour integration

The ability of human participants to integrate fragmented stimulus elements into perceived coherent contours (amidst a field of distracter elements) has been intensively studied across a large number of contour element parameters, ranging from luminance contrast and chromaticity to motion and stereo. The evidence suggests that contour integration performance depends on the low-level Fourier properties of the stimuli. Thus, to understand contour integration, it would be advantageous to understand the properties of the low-level filters that the visual system uses to process contour stimuli. We addressed this issue by examining the role of stimulus element orientation bandwidth in contour integration, a previously unexplored area. We carried out three psychophysical experiments, and then simulated all of the experiments using a recently developed two-stage filter-overlap model whereby the contour grouping occurs by virtue of the overlap between the filter responses to different elements. The first stage of the model responds to the elements, while the second stage integrates the responses along the contour. We found that the first stage had to be fairly broadly tuned for orientation to account for our results. The model showed a very good fit to a large data set with relatively few free parameters, suggesting that this class of model may have an important role to play in helping us to better understand the mechanisms of contour integration.

Lack of functional specialization of neurons in the mouse primary visual cortex that have expressed calretinin

Calretinin is a calcium-binding protein often used as a marker for a subset of inhibitory interneurons in the mammalian neocortex. We studied the labeled cells in offspring from a cross of a Cre-dependent reporter line with the CR-ires-Cre mice, which express Cre-recombinase in the same pattern as calretinin. We found that in the mature visual cortex, only a minority of the cells that have expressed calretinin and Cre-recombinase during their lifetime is GABAergic and only about 20% are immunoreactive for calretinin. The reason behind this is that calretinin is transiently expressed in many cortical pyramidal neurons during development. To determine whether neurons that express or have expressed calretinin share any distinct functional characteristics, we recorded their visual response properties using GCaMP6s calcium imaging. The average orientation selectivity, size tuning, and temporal and spatial frequency tuning of this group of cells, however, match the response profile of the general neuronal population, revealing the lack of functional specialization for the features studied.

Population coding in mouse visual cortex: response reliability and dissociability of stimulus tuning and noise correlation

The primary visual cortex is an excellent model system for investigating how neuronal populations encode information, because of well-documented relationships between stimulus characteristics and neuronal activation patterns. We used two-photon calcium imaging data to relate the performance of different methods for studying population coding (population vectors, template matching, and Bayesian decoding algorithms) to their underlying assumptions. We show that the variability of neuronal responses may hamper the decoding of population activity, and that a normalization to correct for this variability may be of critical importance for correct decoding of population activity. Second, by comparing noise correlations and stimulus tuning we find that these properties have dissociated anatomical correlates, even though noise correlations have been previously hypothesized to reflect common synaptic input. We hypothesize that noise correlations arise from large non-specific increases in spiking activity acting on many weak synapses simultaneously, while neuronal stimulus response properties are dependent on more reliable connections. Finally, this paper provides practical guidelines for further research on population coding and shows that population coding cannot be approximated by a simple summation of inputs, but is heavily influenced by factors such as input reliability and noise correlation structure.

Semantic control of feature extraction from natural scenes

In the early stages of image analysis, visual cortex represents scenes as spatially organized maps of locally defined features (e.g., edge orientation). As image reconstruction unfolds and features are assembled into larger constructs, cortex attempts to recover semantic content for object recognition. It is conceivable that higher level representations may feed back onto early processes and retune their properties to align with the semantic structure projected by the scene; however, there is no clear evidence to either support or discard the applicability of this notion to the human visual system. Obtaining such evidence is challenging because low and higher level processes must be probed simultaneously within the same experimental paradigm. We developed a methodology that targets both levels of analysis by embedding low-level probes within natural scenes. Human observers were required to discriminate probe orientation while semantic interpretation of the scene was selectively disrupted via stimulus inversion or reversed playback. We characterized the orientation tuning properties of the perceptual process supporting probe discrimination; tuning was substantially reshaped by semantic manipulation, demonstrating that low-level feature detectors operate under partial control from higher level modules. The manner in which such control was exerted may be interpreted as a top-down predictive strategy whereby global semantic content guides and refines local image reconstruction. We exploit the novel information gained from data to develop mechanistic accounts of unexplained phenomena such as the classic face inversion effect.

Oblique effect in visual area 2 of macaque monkeys

The neural basis of an oblique effect, a reduced visual sensitivity for obliquely oriented stimuli, has been a matter of considerable debate. We have analyzed the orientation tuning of a relatively large number of neurons in the primary visual cortex (V1) and visual area 2 (V2) of anesthetized and paralyzed macaque monkeys. Neurons in V2 but not V1 of macaque monkeys showed clear oblique effects. This orientation anisotropy in V2 was more robust for those neurons that preferred higher spatial frequencies. We also determined whether V1 and V2 neurons exhibit a similar orientation anisotropy soon after birth. The oblique effect was absent in V1 of 4- and 8-week-old infant monkeys, but their V2 neurons showed a significant oblique effect. This orientation anisotropy in infant V2 was milder than that in adults. The results suggest that the oblique effect emerges in V2 based on the pattern of the connections that are established before birth and enhanced by the prolonged experience-dependent modifications of the neural circuitry in V2.

Spatial warping by oriented line detectors can counteract neural delays

The slow speed of neural transmission necessitates that cortical visual information from dynamic scenes will lag reality. The “perceiving the present” (PTP) hypothesis suggests that the visual system can mitigate the effect of such delays by spatially warping scenes to look as they will in ~100 ms from now (Changizi, 2001). We here show that the Hering illusion, in which straight lines appear bowed, can be induced by a background of optic flow, consistent with the PTP hypothesis. However, importantly, the bowing direction is the same whether the flow is inward or outward. This suggests that if the warping is meant to counteract latencies, it is accomplished by a simple strategy that is insensitive to motion direction, and that works only under typical (forward-moving) circumstances. We also find that the illusion strengthens with longer pulses of optic flow, demonstrating motion integration over ~80 ms. The illusion is identical whether optic flow precedes or follows the flashing of bars, exposing the spatial warping to be equally postdictive and predictive, i.e., peri-dictive. Additionally, the illusion is diminished by cues which suggest the bars are independent of the background movement. Collectively, our findings are consistent with a role for networks of visual orientation-tuned neurons (e.g., simple cells in primary visual cortex) in spatial warping. We conclude that under the common condition of forward ego-motion, spatial warping counteracts the disadvantage of neural latencies. It is not possible to prove that this is the purpose of spatial warping, but our findings at minimum place constraints on the PTP hypothesis, demonstrating that any spatial warping for the purpose of counteracting neural delays is not a precise, on-the-fly computation, but instead a heuristic achieved by a simple mechanism that succeeds under normal circumstances.

On the relation between receptive field structure and stimulus selectivity in the tree shrew primary visual cortex

There are notable differences in functional properties of primary visual cortex (V1) neurons among mammalian species, particularly those concerning the occurrence of simple and complex cells and the generation of orientation selectivity. Here, we present quantitative data on receptive field (RF) structure, response modulation, and orientation tuning for single neurons in V1 of the tree shrew, a close relative of primates. We find that spatial RF subfield segregation, a criterion for identifying simple cells, was exceedingly small in the tree shrew V1. In contrast, many neurons exhibited elevated F1/F0 modulation that is often used as a simple cell marker. This apparent discrepancy can be explained by the robust stimulus polarity preference in tree shrew V1, which inflates F1/F0 ratio values. RF structure mapped with sparse-noise-which is spatially restricted and emphasizes thalamo-cortical feed-forward inputs-appeared unrelated to orientation selectivity. However, RF structure mapped using the Hartley subspace stimulus-which covers a large area of the visual field and recruits considerable intracortical processing-did predict orientation preference. Our findings reveal a number of striking similarities in V1 functional organization between tree shrews and primates, emphasizing the important role of intracortical recurrent processing in shaping V1 response properties in these species.

Sensitivity to Information Conveyed by Horizontal Contours is Correlated with Face Identification Accuracy

We measured thresholds in a 1-of-10 face identification task in which stimuli were embedded in orientation-filtered Gaussian noise. For upright faces, the threshold elevation produced by the masking noise varied as a function of noise orientation: significantly greater masking was obtained with horizontal noise than with vertical noise. However, the orientation selectivity of masking was significantly less with inverted faces. The performance of an ideal observer was qualitatively similar to human observers viewing upright faces: the masking function exhibited a peak for horizontally oriented noise although the selectivity of masking was greater than what was observed in human observers. These results imply that significantly more information about facial identity was conveyed by horizontal contours than by vertical contours, and that human observers use this information more efficiently to identify upright faces than inverted faces. We also found a significant positive correlation between selectivity for horizontal information and face identification accuracy for upright, but not inverted faces. Finally, there was a significant positive correlation between horizontal tuning and the size of the face inversion effect. These results demonstrate that the use of information conveyed by horizontal contours is associated with face identification accuracy and the magnitude of the face inversion effect.

A computational study of how orientation bias in the lateral geniculate nucleus can give rise to orientation selectivity in primary visual cortex

Controversy remains about how orientation selectivity emerges in simple cells of the mammalian primary visual cortex. In this paper, we present a computational model of how the orientation-biased responses of cells in lateral geniculate nucleus (LGN) can contribute to the orientation selectivity in simple cells in cats. We propose that simple cells are excited by lateral geniculate fields with an orientation-bias and disynaptically inhibited by unoriented lateral geniculate fields (or biased fields pooled across orientations), both at approximately the same retinotopic co-ordinates. This interaction, combined with recurrent cortical excitation and inhibition, helps to create the sharp orientation tuning seen in simple cell responses. Along with describing orientation selectivity, the model also accounts for the spatial frequency and length-response functions in simple cells, in normal conditions as well as under the influence of the GABA(A) antagonist, bicuculline. In addition, the model captures the response properties of LGN and simple cells to simultaneous visual stimulation and electrical stimulation of the LGN. We show that the sharp selectivity for stimulus orientation seen in primary visual cortical cells can be achieved without the excitatory convergence of the LGN input cells with receptive fields along a line in visual space, which has been a core assumption in classical models of visual cortex. We have also simulated how the full range of orientations seen in the cortex can emerge from the activity among broadly tuned channels tuned to a limited number of optimum orientations, just as in the classical case of coding for color in trichromatic primates.

Attention and contrast differently affect contextual integration in an orientation discrimination task

Attention is often regarded as a mechanism by which attended objects become perceptually more salient, akin to increasing their contrast. We demonstrate that attention is better described as a mechanism by which task relevant information impacts on ongoing processing, while excluding task irrelevant information. We asked subjects to judge the orientation of a target relative to a reference, in a single and dual task setting. The target orientation percept was systematically influenced by the presentation of prior spatio-temporal context. We found that the sign of the context influence depended on target contrast, but its strength depended on the level of attention devoted to the task. Thus the effects of attention and contrast were fundamentally different; contrast influenced the sign of contextual interactions, while attention suppressed these interactions irrespective of their sign.

Different roles for simple-cell and complex-cell inhibition in V1

Previously, we proposed a model of the circuitry underlying simple-cell responses in cat primary visual cortex (V1) layer 4. We argued that the ordered arrangement of lateral geniculate nucleus inputs to a simple cell must be supplemented by a component of feedforward inhibition that is untuned for orientation and responds to high temporal frequencies to explain the sharp contrast-invariant orientation tuning and low-pass temporal frequency tuning of simple cells. The temporal tuning also requires a significant NMDA component in geniculocortical synapses. Recent experiments have revealed cat V1 layer 4 inhibitory neurons with two distinct types of receptive fields (RFs): complex RFs with mixed ON/OFF responses lacking in orientation tuning, and simple RFs with normal, sharp-orientation tuning (although, some respond to all orientations). We show that complex inhibitory neurons can provide the inhibition needed to explain simple-cell response properties. Given this complex cell inhibition, antiphase or "push-pull" inhibition from tuned simple inhibitory neurons acts to sharpen spatial frequency tuning, lower responses to low temporal frequency stimuli, and increase the stability of cortical activity.

Orientation sensitivity of ganglion cells in primate retina

The two-dimensional shape of the receptive field center of macaque retinal ganglion cells was determined by measuring responses to drifting sinusoidal gratings of different spatial frequency and orientation. The responses of most cells to high spatial frequencies depended on grating orientation, indicating that their centers were not circularly symmetric. In general, center shape was well described by an ellipse. The major axis of the ellipse tended to point towards the fovea or perpendicular to this. Parvocellular pathway cells had greater center ellipticity than magnocellular pathway cells; the median ratio of the major-to-minor axis was 1.72 and 1.38, respectively. Parvocellular pathway cells also had centers that were often bimodal in shape, suggesting that they received patchy cone/bipolar cell input. We conclude that most ganglion cells in primate retina have elongated receptive field centers and thus show orientation sensitivity.

Translation-invariant orientation tuning in visual "complex" cells could derive from intradendritic computations

first distinguished "simple" from "complex" cells in visual cortex and proposed a processing hierarchy in which rows of LGN cells are pooled to drive oriented simple cell subunits, which are pooled in turn to drive complex cells. Although parsimonious and highly influential, the pure hierarchical model has since been challenged by results indicating that many complex cells receive excitatory monosynaptic input from LGN cells or do not depend on simple cell input. Alternative accounts of complex cell orientation tuning remain scant, however, and the function of monosynaptic LGN contacts onto complex cell dendrites remains unknown. We have used a biophysically detailed compartmental model to investigate whether nonlinear integration of LGN synaptic inputs within the dendrites of individual pyramidal cells could contribute to complex-cell receptive field structure. We show that an isolated cortical neuron with "active" dendrites, driven only by excitatory inputs from overlapping ON- and OFF-center LGN subfields, can produce clear phase-invariant orientation tuning-a hallmark response characteristic of a complex cell. The tuning is shown to depend critically both on the spatial arrangement of LGN synaptic contacts across the complex cell dendritic tree, established by a Hebbian developmental principle, and on the physiological efficacy of excitatory voltage-dependent dendritic ion channels. We conclude that unoriented LGN inputs to a complex cell could contribute in a significant way to its orientation tuning, acting in concert with oriented inputs to the same cell provided by simple cells or other complex cells. As such, our model provides a novel, experimentally testable hypothesis regarding the basis of orientation tuning in the complex cell population, and more generally underscores the potential importance of nonlinear intradendritic subunit processing in cortical neurophysiology.