Quantification of optical images of cortical responses for inferring functional maps

Cone opponent functional domains in primary visual cortex combine signals for color appearance mechanisms

Studies of color perception have led to mechanistic models of how cone-opponent signals from retinal ganglion cells are integrated to generate color appearance. But it is unknown how this hypothesized integration occurs in the brain. Here we show that cone-opponent signals transmitted from retina to primary visual cortex (V1) are integrated through highly organized circuits within V1 to implement the color opponent interactions required for color appearance. Combining intrinsic signal optical imaging (ISI) and 2-photon calcium imaging (2PCI) at single cell resolution, we demonstrate cone-opponent functional domains (COFDs) that combine L/M cone-opponent and S/L + M cone-opponent signals following the rules predicted from psychophysical studies of color perception. These give rise to an orderly organization of hue preferences of the neurons within the COFDs and the generation of hue "pinwheels". Thus, spatially organized neural circuits mediate an orderly transition from cone-opponency to color appearance that begins in V1.

Functional Logic of Layer 2/3 Inhibitory Connectivity in the Ferret Visual Cortex

Understanding how cortical inhibition shapes circuit function requires identifying the connectivity rules relating the response properties of inhibitory interneurons and their postsynaptic targets. Here we explore the orientation tuning of layer 2/3 inhibitory inputs in the ferret visual cortex using a combination of in vivo axon imaging, functional input mapping, and physiology. Inhibitory boutons exhibit robust orientation-tuned responses with preferences that can differ significantly from the cortical column in which they reside. Inhibitory input fields measured with patterned optogenetic stimulation and intracellular recordings revealed that these inputs originate from a wide range of orientation domains, inconsistent with a model of co-tuned inhibition and excitation. Intracellular synaptic conductance measurements confirm that individual neurons can depart from a co-tuned regime. Our results argue against a simple rule for the arrangement of inhibitory inputs supplied by layer 2/3 circuits and suggest that heterogeneity in presynaptic inhibitory networks contributes to neural response properties.

Differential tuning of excitation and inhibition shapes direction selectivity in ferret visual cortex

To encode specific sensory inputs, cortical neurons must generate selective responses for distinct stimulus features. In principle, a variety of factors contribute to a cortical neuron’s response selectivity: the tuning and strength of excitatory^1–3 and inhibitory synaptic inputs^4–6, dendritic nonlinearities^7–9, and spike threshold^10,11. Here we employ a combination of techniques including in vivo whole-cell recording, synaptic and cellular resolution in vivo two photon calcium imaging, and GABAergic-selective optogenetic manipulation to dissect the factors contributing to direction selective responses of layer 2/3 neurons in ferret visual cortex (V1). Two-photon calcium imaging of dendritic spines^12,13 revealed that each neuron receives a mixture of excitatory synaptic inputs selective for the somatic preferred or null direction of motion. The relative number of preferred- and null-tuned excitatory inputs predicted a neuron’s somatic direction preference, but failed to account for the degree of direction selectivity. In contrast, in vivo whole-cell patch clamp recordings revealed a striking degree of direction selectivity in subthreshold responses that was significantly correlated with spiking direction selectivity. Subthreshold direction selectivity was predicted by the magnitude and variance of the response to the null direction of motion, and several lines of evidence including conductance measurements demonstrate that differential tuning of excitation and inhibition suppresses responses to the null direction of motion. Consistent with this idea, optogenetic inactivation of GABAergic neurons in layer 2/3 reduced direction selectivity by enhancing responses to the null direction. Furthermore, using a new technique to optogenetically map connections of inhibitory neurons in layer 2/3 in vivo, we find that layer 2/3 inhibitory neurons make long-range, intercolumnar projections to excitatory neurons that prefer the opposite direction of motion. We conclude that intracortical inhibition exerts a major influence on the degree of direction selectivity in layer 2/3 of ferret V1 by suppressing responses to the null direction of motion.

Pinwheel-dipole configuration in cat early visual cortex

In the early visual cortex, information is processed within functional maps whose layouts are thought to underlie visual perception. However, the precise organization of these functional maps as well as their interrelationships remain unsettled. Here, we show that spatial frequency representation in cat early visual cortex exhibits singularities around which the map organizes like an electric dipole potential. These singularities are precisely co-located with singularities of the orientation map: the pinwheel centers. To show this, we used high resolution intrinsic optical imaging in cat areas 17 and 18. First, we show that a majority of pinwheel centers exhibit in their neighborhood both semi-global maximum and minimum in the spatial frequency map (i.e. extreme values of the spatial frequency in a hypercolumn). This contradicts pioneering studies suggesting that pinwheel centers are placed at the locus of a single spatial frequency extremum. Based on an analogy with electromagnetism, we proposed a mathematical model for a dipolar structure, accurately fitting optical imaging data. We conclude that a majority of orientation pinwheel centers form spatial frequency dipoles in cat early visual cortex. Given the functional specificities of neurons at singularities in the visual cortex, it is argued that the dipolar organization of spatial frequency around pinwheel centers could be fundamental for visual processing.

Neural mechanisms of coarse-to-fine discrimination in the visual cortex

Vision is a dynamic process that refines the spatial scale of analysis over time, as evidenced by a progressive improvement in the ability to detect and discriminate finer details. To understand coarse-to-fine discrimination, we studied the dynamics of spatial frequency (SF) response using reverse correlation in the primary visual cortex (V1) of the primate. In a majority of V1 cells studied, preferred SF either increased monotonically with time (group 1) or changed nonmonotonically, with an initial increase followed by a decrease (group 2). Monotonic shift in preferred SF occurred with or without an early suppression at low SFs. Late suppression at high SFs always accompanied nonmonotonic SF dynamics. Bayesian analysis showed that SF discrimination performance and best discriminable SF frequencies changed with time in different ways in the two groups of neurons. In group 1 neurons, SF discrimination performance peaked on both left and right flanks of the SF tuning curve at about the same time. In group 2 neurons, peak discrimination occurred on the right flank (high SFs) later than on the left flank (low SFs). Group 2 neurons were also better discriminators of high SFs. We examined the relationship between the time at which SF discrimination performance peaked on either flank of the SF tuning curve and the corresponding best discriminable SFs in both neuronal groups. This analysis showed that the population best discriminable SF increased with time in V1. These results suggest neural mechanisms for coarse-to-fine discrimination behavior and that this process originates in V1 or earlier.

A Generalized ideal observer model for decoding sensory neural responses

We show that many ideal observer models used to decode neural activity can be generalized to a conceptually and analytically simple form. This enables us to study the statistical properties of this class of ideal observer models in a unified manner. We consider in detail the problem of estimating the performance of this class of models. We formulate the problem de novo by deriving two equivalent expressions for the performance and introducing the corresponding estimators. We obtain a lower bound on the number of observations (N) required for the estimate of the model performance to lie within a specified confidence interval at a specified confidence level. We show that these estimators are unbiased and consistent, with variance approaching zero at the rate of 1/N. We find that the maximum likelihood estimator for the model performance is not guaranteed to be the minimum variance estimator even for some simple parametric forms (e.g., exponential) of the underlying probability distributions. We discuss the application of these results for designing and interpreting neurophysiological experiments that employ specific instances of this ideal observer model.

Building a mechanistic model of the development and function of the primary visual cortex

Researchers have used a very wide range of different experimental and theoretical approaches to help understand mammalian visual systems. These approaches tend to have quite different assumptions, strengths, and weaknesses. Computational models of the visual cortex, in particular, have typically implemented either a proposed circuit for part of the visual cortex of the adult, assuming a very specific wiring pattern based on findings from adults, or else attempted to explain the long-term development of a visual cortex region from an initially undifferentiated starting point. Previous models of adult V1 have been able to account for many of the measured properties of V1 neurons, while not explaining how these properties arise or why neurons have those properties in particular. Previous developmental models have been able to reproduce the overall organization of specific feature maps in V1, such as orientation maps, but are generally formulated at an abstract level that does not allow testing with real images or analysis of detailed neural properties relevant for visual function. In this review of results from a large set of new, integrative models developed from shared principles and a set of shared software components, I show how these models now represent a single, consistent explanation for a wide body of experimental evidence, and form a compact hypothesis for much of the development and behavior of neurons in the visual cortex. The models are the first developmental models with wiring consistent with V1, the first to have realistic behavior with respect to visual contrast, and the first to include all of the demonstrated visual feature dimensions. The goal is to have a comprehensive explanation for why V1 is wired as it is in the adult, and how that circuitry leads to the observed behavior of the neurons during visual tasks.