Representation of Color Surfaces in V1: Edge Enhancement and Unfilled Holes

Encoding luminance surfaces in the visual cortex of mice and monkeys: difference in responses to edge and center

Luminance and spatial contrast provide information on the surfaces and edges of objects. We investigated neural responses to black and white surfaces in the primary visual cortex (V1) of mice and monkeys. Unlike primates that use their fovea to inspect objects with high acuity, mice lack a fovea and have low visual acuity. It thus remains unclear whether monkeys and mice share similar neural mechanisms to process surfaces. The animals were presented with white or black surfaces and the population responses were measured at high spatial and temporal resolution using voltage-sensitive dye imaging. In mice, the population response to the surface was not edge-dominated with a tendency to center-dominance, whereas in monkeys the response was edge-dominated with a "hole" in the center of the surface. The population response to the surfaces in both species exhibited suppression relative to a grating stimulus. These results reveal the differences in spatial patterns to luminance surfaces in the V1 of mice and monkeys and provide evidence for a shared suppression process relative to grating.

Cortical mechanisms of visual brightness

The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger.

Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.

Multiple gamma rhythms carry distinct spatial frequency information in primary visual cortex

Gamma rhythms in many brain regions, including the primary visual cortex (V1), are thought to play a role in information processing. Here, we report a surprising finding of 3 narrowband gamma rhythms in V1 that processed distinct spatial frequency (SF) signals and had different neural origins. The low gamma (LG; 25 to 40 Hz) rhythm was generated at the V1 superficial layer and preferred a higher SF compared with spike activity, whereas both the medium gamma (MG; 40 to 65 Hz), generated at the cortical level, and the high gamma HG; (65 to 85 Hz), originated precortically, preferred lower SF information. Furthermore, compared with the rates of spike activity, the powers of the 3 gammas had better performance in discriminating the edge and surface of simple objects. These findings suggest that gamma rhythms reflect the neural dynamics of neural circuitries that process different SF information in the visual system, which may be crucial for multiplexing SF information and synchronizing different features of an object.

Hierarchical Representation for Chromatic Processing across Macaque V1, V2, and V4

The perception of color is an internal label for the inferred spectral reflectance of visible surfaces. To study how spectral representation is transformed through modular subsystems of successive cortical areas, we undertook simultaneous optical imaging of intrinsic signals in macaque V1, V2, and V4, supplemented by higher-resolution electrophysiology and two-photon imaging in awake macaques. We find a progressive evolution in the scale and precision of chromotopic maps, expressed by a uniform blob-like architecture of hue responses within each area. Two-photon imaging reveals enhanced hue-specific cell clustering in V2 compared with V1. A phenomenon of endspectral (red and blue) responses that is clear in V1, recedes in V2, and is virtually absent in V4. The increase in mid- and extra-spectral hue representations through V2 and V4 reflects the nature of hierarchical processing as higher areas read out locations in chromatic space from progressive integration of signals relayed by V1.

When figure-ground segregation fails: Exploring antagonistic interactions in figure-ground perception

Perceptual fading of an artificial scotoma can be viewed as a failure of figure-ground segregation, providing a useful tool for investigating possible mechanisms and processes involved in figure-ground perception. Weisstein's antagonistic magnocellular/parvocellular stream figure-ground model proposes P stream activity encodes figure, and M stream activity encodes background. Where a boundary separates two regions, the region that is perceived as figure or ground is determined by the outcome of antagonism between M and P activity within each region and across the boundary between them. The region with the relatively stronger P "figure signal" is perceived as figure, and the region with the relatively stronger M "ground signal" is perceived as ground. From this perspective, fading occurs when the figure signal is overwhelmed by the ground signal. Strengthening the figure signal or weakening the ground signal should make the figure more resistant to fading. Based on research showing that red light suppresses M activity and short wavelength sensitive S-cones provide minimal input to M cells, we used red and blue light to reduce M activity in both figure and ground. The time to fade from stimulus onset until the figure completely disappeared was measured. Every combination of gray, green, red, and blue as figure and/or ground was tested. Compared with gray and green light, fade times were greatest when red or blue light either strengthened the figure signal by reducing M activity in the figure, or weakened the ground signal by reducing M activity in ground. The results support a dynamic antagonistic relationship between M and P activity contributing to figure-ground perception as envisioned in Weisstein's model.

Advanced Circuit and Cellular Imaging Methods in Nonhuman Primates

Novel genetically encoded tools and advanced microscopy methods have revolutionized neural circuit analyses in insects and rodents over the last two decades. Whereas numerous technical hurdles originally barred these methodologies from success in nonhuman primates (NHPs), current research has started to overcome those barriers. In some cases, methodological advances developed with NHPs have even surpassed their precursors. One such advance includes new ultra-large imaging windows on NHP cortex, which are larger than the entire rodent brain and allow analysis unprecedented ultra-large-scale circuits. NHP imaging chambers now remain patent for periods longer than a mouse's lifespan, allowing for long-term all-optical interrogation of identified circuits and neurons over timeframes that are relevant to human cognitive development. Here we present some recent imaging advances brought forth by research teams using macaques and marmosets. These include technical developments in optogenetics; voltage-, calcium- and glutamate-sensitive dye imaging; two-photon and wide-field optical imaging; viral delivery; and genetic expression of indicators and light-activated proteins that result in the visualization of tens of thousands of identified cortical neurons in NHPs. We describe a subset of the many recent advances in circuit and cellular imaging tools in NHPs focusing here primarily on the research presented during the corresponding mini-symposium at the 2019 Society for Neuroscience annual meeting.

A Neuronal Network Model of the Primate Visual System: Color Mechanisms in the Retina, LGN and V1

Color plays a key role in human vision but the neural machinery that underlies the transformation from stimulus to perception is not well understood. Here, we implemented a two-dimensional network model of the first stages in the primate parvocellular pathway (retina, lateral geniculate nucleus and layer 4C[Formula: see text] in V1) consisting of conductance-based point neurons. Model parameters were tuned based on physiological and anatomical data from the primate foveal and parafoveal vision, the most relevant visual field areas for color vision. We exhaustively benchmarked the model against well-established chromatic and achromatic visual stimuli, showing spatial and temporal responses of the model to disk- and ring-shaped light flashes, spatially uniform squares and sine-wave gratings of varying spatial frequency. The spatiotemporal patterns of parvocellular cells and cortical cells are consistent with their classification into chromatically single-opponent and double-opponent groups, and nonopponent cells selective for luminance stimuli. The model was implemented in the widely used neural simulation tool NEST and released as open source software. The aim of our modeling is to provide a biologically realistic framework within which a broad range of neuronal interactions can be examined at several different levels, with a focus on understanding how color information is processed.

Surface color and predictability determine contextual modulation of V1 firing and gamma oscillations

The integration of direct bottom-up inputs with contextual information is a core feature of neocortical circuits. In area V1, neurons may reduce their firing rates when their receptive field input can be predicted by spatial context. Gamma-synchronized (30–80 Hz) firing may provide a complementary signal to rates, reflecting stronger synchronization between neuronal populations receiving mutually predictable inputs. We show that large uniform surfaces, which have high spatial predictability, strongly suppressed firing yet induced prominent gamma synchronization in macaque V1, particularly when they were colored. Yet, chromatic mismatches between center and surround, breaking predictability, strongly reduced gamma synchronization while increasing firing rates. Differences between responses to different colors, including strong gamma-responses to red, arose from stimulus adaptation to a full-screen background, suggesting prominent differences in adaptation between M- and L-cone signaling pathways. Thus, synchrony signaled whether RF inputs were predicted from spatial context, while firing rates increased when stimuli were unpredicted from context.

Neural circuits for long-range color filling-in

Surface color appearance depends on both local surface chromaticity and global context. How are these inter-dependencies supported by cortical networks? Combining functional imaging and psychophysics, we examined if color from long-range filling-in engages distinct pathways from responses caused by a field of uniform chromaticity. We find that color from filling-in is best classified and best correlated with appearance by two dorsal areas, V3A and V3B/KO. In contrast, a field of uniform chromaticity is best classified by ventral areas hV4 and LO. Dynamic causal modeling revealed feedback modulation from area V3A to areas V1 and LO for filling-in, contrasting with feedback from LO modulating areas V1 and V3A for a matched uniform chromaticity. These results indicate a dorsal stream role in color filling-in via feedback modulation of area V1 coupled with a cross-stream modulation of ventral areas suggesting that local and contextual influences on color appearance engage distinct neural networks.

Luminance gradient at object borders communicates object location to the human oculomotor system

The locations of objects in our environment constitute arguably the most important piece of information our visual system must convey to facilitate successful visually guided behaviour. However, the relevant objects are usually not point-like and do not have one unique location attribute. Relatively little is known about how the visual system represents the location of such large objects as visual processing is, both on neural and perceptual level, highly edge dominated. In this study, human observers made saccades to the centres of luminance defined squares (width 4 deg), which appeared at random locations (8 deg eccentricity). The phase structure of the square was manipulated such that the points of maximum luminance gradient at the square's edges shifted from trial to trial. The average saccade endpoints of all subjects followed those shifts in remarkable quantitative agreement. Further experiments showed that the shifts were caused by the edge manipulations, not by changes in luminance structure near the centre of the square or outside the square. We conclude that the human visual system programs saccades to large luminance defined square objects based on edge locations derived from the points of maximum luminance gradients at the square's edges.

Cortical Double-Opponent Cells in Color Perception: Perceptual Scaling and Chromatic Visual Evoked Potentials

In the early visual cortex V1, there are currently only two known neural substrates for color perception: single-opponent and double-opponent cells. Our aim was to explore the relative contributions of these neurons to color perception. We measured the perceptual scaling of color saturation for equiluminant color checkerboard patterns (designed to stimulate double-opponent neurons preferentially) and uniformly colored squares (designed to stimulate only single-opponent neurons) at several cone contrasts. The spatially integrative responses of single-opponent neurons would produce the same response magnitude for checkerboards as for uniform squares of the same space-averaged cone contrast. However, perceived saturation of color checkerboards was higher than for the corresponding squares. The perceptual results therefore imply that double-opponent cells are involved in color perception of patterns. We also measured the chromatic visual evoked potential (cVEP) produced by the same stimuli; checkerboard cVEPs were much larger than those for corresponding squares, implying that double-opponent cells also contribute to the cVEP response. The total Fourier power of the cVEP grew sublinearly with cone contrast. However, the 6-Hz Fourier component's power grew linearly with contrast-like saturation perception. This may also indicate that cortical coding of color depends on response dynamics.

Contextual modulation revealed by optical imaging exhibits figural asymmetry in macaque V1 and V2

Neurons in early visual cortical areas are influenced by stimuli presented well beyond the confines of their classical receptive fields, endowing them with the ability to encode fine-scale features while also having access to the global context of the visual scene. This property can potentially define a role for the early visual cortex to contribute to a number of important visual functions, such as surface segmentation and figure-ground segregation. It is unknown how extraclassical response properties conform to the functional architecture of the visual cortex, given the high degree of functional specialization in areas V1 and V2. We examined the spatial relationships of contextual activations in macaque V1 and V2 with intrinsic signal optical imaging. Using figure-ground stimulus configurations defined by orientation or motion, we found that extraclassical modulation is restricted to the cortical representations of the figural component of the stimulus. These modulations were positive in sign, suggesting a relative enhancement in neuronal activity that may reflect an excitatory influence. Orientation and motion cues produced similar patterns of activation that traversed the functional subdivisions of V2. The asymmetrical nature of the enhancement demonstrated the capacity for visual cortical areas as early as V1 to contribute to figure-ground segregation, and the results suggest that this information can be extracted from the population activity constrained only by retinotopy, and not the underlying functional organization.

Study of single and multidigit activation in monkey somatosensory cortex using voltage-sensitive dye imaging

Toward the goal of understanding cutaneous sensory integration during manual behavior, we used voltage-sensitive dye (VSD) imaging to study the organization and dynamics of anesthetized monkey primary somatosensory cortex (SI) in response to single and multidigit tactile stimulation. We find that in both macaque and squirrel monkey SI, VSD reveals clear focal digit topography consistent with previous electrophysiological and intrinsic signal imaging studies. VSD also reveals interactions in SI in response to multidigit stimulation. With a tactile funneling paradigm in areas 3b and 1 in squirrel monkeys, VSD reveals two-digit induction of subthreshhold influences, consistent with lateral intracortical inhibition. In response to tactile apparent motion stimuli, VSD reveals preferential response to motion stimuli over static tactile stimuli in both areas 1 and 3b. Comparison of the response at different digit locations to "toward digit" stimuli suggests the presence of direction-selective response in area 1; however, further study is needed. These exciting results indicate that VSD constitutes a powerful tool for studying somatosensory cortical processing in nonhuman primates and should be further developed for future somatosensory studies in awake behaving monkeys.

Invariance of surface color representations across illuminant changes in the human cortex

A central problem in color vision is that the light reaching the eye from a given surface can vary dramatically depending on the illumination. Despite this, our color percept, the brain's estimate of surface reflectance, remains remarkably stable. This phenomenon is called color constancy. Here we investigated which human brain regions represent surface color in a way that is invariant with respect to illuminant changes. We used physically realistic rendering methods to display natural yet abstract 3D scenes that were displayed under three distinct illuminants. The scenes embedded, in different conditions, surfaces that differed in their surface color (i.e. in their reflectance property). We used multivariate fMRI pattern analysis to probe neural coding of surface reflectance and illuminant, respectively. While all visual regions encoded surface color when viewed under the same illuminant, we found that only in V1 and V4α surface color representations were invariant to illumination changes. Along the visual hierarchy there was a gradient from V1 to V4α to increasingly encode surface color rather than illumination. Finally, effects of a stimulus manipulation on individual behavioral color constancy indices correlated with neural encoding of the illuminant in hV4. This provides neural evidence for the Equivalent Illuminant Model. Our results provide a principled characterization of color constancy mechanisms across the visual hierarchy, and demonstrate complementary contributions in early and late processing stages.

Stimulus size dependence of hue changes induced by chromatic surrounds

A chromatic surround induces a change in the perceived hue of a stimulus. This shift in hue depends on the chromatic difference between the stimulus and the surround. We investigated how chromatic induction varies with stimulus size and whether the size dependence depends on the surround hue. Subjects performed asymmetric matching of color stimuli with different sizes in surrounds of different chromaticities. Generally, induced hue shifts decreased with increasing stimulus size. This decrease was quantitatively different for different surround hues. However, when size effects were normalized to an overall induction strength, the chromatic specificity was largely reduced. The separability of inducer chromaticity and stimulus size suggests that these effects are mediated by different neural mechanisms.