An illusion predicted by V1 population activity implicates cortical topography in shape perception

Adaptive smoothing of retinotopic maps based on Teichmüller parametrization

Retinotopic mapping, the mapping between visual inputs on the retina and neural responses on the cortical surface, is one of the fundamental topics in visual neuroscience. In human studies, retinotopic maps are conventionally constructed and processed by decoding blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to designed visual stimuli on the cortical surface. However, these methods frequently generate retinotopic maps that do not preserve topology, contradicting a fundamental property of retinotopic maps observed in neurophysiology. To address this problem, we propose an integrated approach to simultaneously refine the flattening from the 3D cortical surface to the 2D parametric space and adaptively smooth retinotopic perception centers in the visual space to make the retinotopic maps topological. One key element of the approach is the enhanced error tolerant Teichmüller mapping, which refines the parametrization by minimizing angle distortions and maximizing alignment to noisy landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets and applied it to compute cortical magnification factor (CMF). The results showed that the proposed approach was superior to other conventional retinotopic mapping methods in predicting BOLD fMRI time series and preserving topology.

Bounded contribution of human early visual cortex to the topographic anisotropy in spatial extent perception

To interact successfully with objects, it is crucial to accurately perceive their spatial extent, an enclosed region they occupy in space. Although the topographic representation of space in the early visual cortex (EVC) has been favored as a neural correlate of spatial extent perception, its exact nature and contribution to perception remain unclear. Here, we inspect the topographic representations of human individuals' EVC and perception in terms of how much their anisotropy is influenced by the orientation (co-axiality) and radial position (radiality) of stimuli. We report that while the anisotropy is influenced by both factors, its direction is primarily determined by radiality in EVC but by co-axiality in perception. Despite this mismatch, the individual differences in both radial and co-axial anisotropy are substantially shared between EVC and perception. Our findings suggest that spatial extent perception builds on EVC's spatial representation but requires an additional mechanism to transform its topographic bias.

Large-scale multimodal surface neural interfaces for primates

Deciphering the function of neural circuits can help with the understanding of brain function and treating neurological disorders. Progress toward this goal relies on the development of chronically stable neural interfaces capable of recording and modulating neural circuits with high spatial and temporal precision across large areas of the brain. Advanced innovations in designing high-density neural interfaces for small animal models have enabled breakthrough discoveries in neuroscience research. Developing similar neurotechnology for larger animal models such as nonhuman primates (NHPs) is critical to gain significant insights for translation to humans, yet still it remains elusive due to the challenges in design, fabrication, and system-level integration of such devices. This review focuses on implantable surface neural interfaces with electrical and optical functionalities with emphasis on the required technological features to realize scalable multimodal and chronically stable implants to address the unique challenges associated with nonhuman primate studies.

High resolution, wide field optical imaging of macaque visual cortex with a curved detector

Objective. Cortical activity can be recorded using a variety of tools, ranging in scale from the single neuron (microscopic) to the whole brain (macroscopic). There is usually a trade-off between scale and resolution; optical imaging techniques, with their high spatio-temporal resolution and wide field of view, are best suited to study brain activity at the mesoscale. Optical imaging of cortical areas is however in practice limited by the curvature of the brain, which causes the image quality to deteriorate significantly away from the center of the image.Approach. To address this issue and harness the full potential of optical cortical imaging techniques, we developed a new wide-field optical imaging system adapted to the macaque brain. Our system is composed of a curved detector, an aspherical lens and a ring composed of light emitting diodes providing uniform illumination at wavelengths relevant for the different optical imaging methods, including intrinsic and fluorescence imaging.Main results. The system was characterized and compared with the standard macroscope used for cortical imaging, and a three-fold increase of the area in focus was measured as well as a four-fold increase in the evenness of the optical qualityin vivo.Significance. This new instrument, which is to the best of our knowledge the first use of a curved detector for cortical imaging, should facilitate the observation of wide mesoscale phenomena such as dynamic propagating waves within and between cortical maps, which are otherwise difficult to observe due to technical limitations of the currently available recording tools.

Quantitative characterization of the human retinotopic map based on quasiconformal mapping

The retinotopic map depicts the cortical neurons' response to visual stimuli on the retina and has contributed significantly to our understanding of human visual system. Although recent advances in high field functional magnetic resonance imaging (fMRI) have made it possible to generate the in vivo retinotopic map with great detail, quantifying the map remains challenging. Existing quantification methods do not preserve surface topology and often introduce large geometric distortions to the map. In this study, we developed a new framework based on computational conformal geometry and quasiconformal Teichmüller theory to quantify the retinotopic map. Specifically, we introduced a general pipeline, consisting of cortical surface conformal parameterization, surface-spline-based cortical activation signal smoothing, and vertex-wise Beltrami coefficient-based map description. After correcting most of the violations of the topological conditions, the result was a "Beltrami coefficient map" (BCM) that rigorously and completely characterizes the retinotopic map by quantifying the local quasiconformal mapping distortion at each visual field location. The BCM provided topological and fully reconstructable retinotopic maps. We successfully applied the new framework to analyze the V1 retinotopic maps from the Human Connectome Project (n=181), the largest state of the art retinotopy dataset currently available. With unprecedented precision, we found that the V1 retinotopic map was quasiconformal and the local mapping distortions were similar across observers. The new framework can be applied to other visual areas and retinotopic maps of individuals with and without eye diseases, and improve our understanding of visual cortical organization in normal and clinical populations.

Population Receptive Field Shapes in Early Visual Cortex Are Nearly Circular

The visual field region where a stimulus evokes a neural response is called the receptive field (RF). Analytical tools combined with functional MRI (fMRI) can estimate the RF of the population of neurons within a voxel. Circular population RF (pRF) methods accurately specify the central position of the pRF and provide some information about the spatial extent (diameter) of the RF. A number of investigators developed methods to further estimate the shape of the pRF, for example, whether the shape is more circular or elliptical. There is a report that there are many pRFs with highly elliptical pRFs in early visual cortex (V1-V3; Silson et al., 2018). Large aspect ratios (>2) are difficult to reconcile with the spatial scale of orientation columns or visual field map properties in early visual cortex. We started to replicate the experiments and found that the software used in the publication does not accurately estimate RF shape: it produces elliptical fits to circular ground-truth data. We analyzed an independent data set with a different software package that was validated over a specific range of measurement conditions, to show that in early visual cortex the aspect ratios are <2. Furthermore, current empirical and theoretical methods do not have enough precision to discriminate ellipses with aspect ratios of 1.5 from circles. Through simulation we identify methods for improving sensitivity that may estimate ellipses with smaller aspect ratios. The results we present are quantitatively consistent with prior assessments using other methodologies.SIGNIFICANCE STATEMENT We evaluated whether the shape of many population receptive fields (RFs) in early visual cortex is elliptical and differs substantially from circular. We evaluated two tools for estimating elliptical models of the pRF; one tool was valid over the measured compliance range. Using the validated tool, we found no evidence that confidently rejects circular fits to the pRF in visual field maps V1, V2, and V3. The new measurements and analyses are consistent with prior theoretical and experimental assessments in the literature.

Uniform spatial pooling explains topographic organization and deviation from receptive-field scale invariance in primate V1

Receptive field (RF) size and preferred spatial frequency (SF) vary greatly across the primary visual cortex (V1), increasing in a scale invariant fashion with eccentricity. Recent studies reveal that preferred SF also forms a fine-scale periodic map. A fundamental open question is how local variability in preferred SF is tied to the overall spatial RF. Here, we use two-photon imaging to simultaneously measure maps of RF size, phase selectivity, SF bandwidth, and orientation bandwidth—all of which were found to be topographically organized and correlate with preferred SF. Each of these newly characterized inter-map relationships strongly deviate from scale invariance, yet reveal a common motif—they are all accounted for by a model with uniform spatial pooling from scale invariant inputs. Our results and model provide novel and quantitative understanding of the output from V1 to downstream circuits.

Two-photon imaging in macaque V1 captured maps of tuning selectivity for four spatial parameters, all of which correlated with peak spatial frequency. These inter-map relationships reveal a common motif—they are described by uniform spatial pooling from a family of scale invariant Gabor receptive fields.

Collinear Motion Strengthens Local Context in Visual Detection

Detection of elongated objects in the visual scene can be improved by additional elements flanking the object on the collinear axis. This is the collinear context effect (CE) and is represented in the long-range horizontal connection plexus in V1. The aim of this study was to test whether the visual collinear motion can improve the CE. In the three experiments of this study, the flank was presented with different types of motion. In particular, the collinear motion aligned with the longitudinal axis of the to-be-detected object: toward or away from it, and the orthogonal motion with a direction perpendicular to the collinear axis. Only collinear motion toward the target showed a robust and replicable empowerment of the CE. This dynamic modulation of the CE likely is implemented in the long-range horizontal connection plexus in V1, but, given that in addition it conveys the time information of motion, there must be a direct feedback in V1 from higher visual areas where motion perception is implemented, such as Middle Temporal (MT). Elongated visual objects moving along their longitudinal axis favor a propagation of activation in front of them via a network of interconnected units that allows the visual system to predict future positions of relevant items in the visual scene.

Advanced Circuit and Cellular Imaging Methods in Nonhuman Primates

Novel genetically encoded tools and advanced microscopy methods have revolutionized neural circuit analyses in insects and rodents over the last two decades. Whereas numerous technical hurdles originally barred these methodologies from success in nonhuman primates (NHPs), current research has started to overcome those barriers. In some cases, methodological advances developed with NHPs have even surpassed their precursors. One such advance includes new ultra-large imaging windows on NHP cortex, which are larger than the entire rodent brain and allow analysis unprecedented ultra-large-scale circuits. NHP imaging chambers now remain patent for periods longer than a mouse's lifespan, allowing for long-term all-optical interrogation of identified circuits and neurons over timeframes that are relevant to human cognitive development. Here we present some recent imaging advances brought forth by research teams using macaques and marmosets. These include technical developments in optogenetics; voltage-, calcium- and glutamate-sensitive dye imaging; two-photon and wide-field optical imaging; viral delivery; and genetic expression of indicators and light-activated proteins that result in the visualization of tens of thousands of identified cortical neurons in NHPs. We describe a subset of the many recent advances in circuit and cellular imaging tools in NHPs focusing here primarily on the research presented during the corresponding mini-symposium at the 2019 Society for Neuroscience annual meeting.

Nonlinear Lateral Interactions in V1 Population Responses Explained by a Contrast Gain Control Model

How do cortical responses to local image elements combine to form a spatial pattern of population activity in primate V1? Here, we used voltage-sensitive dye imaging, which measures summed membrane potential activity, to examine the rules that govern lateral interactions between the representations of two small local-oriented elements in macaque (Macaca mulatta) V1. We find strong subadditive and mostly orientation-independent interactions for nearby elements [2-4 mm interelement cortical distance (IED)] that gradually become linear at larger separations (>6 mm IED). These results are consistent with a population gain control model describing nonlinear V1 population responses to single oriented elements. However, because of the membrane potential-to-spiking accelerating nonlinearity, the model predicts supra-additive lateral interactions of spiking responses for intermediate separations at a range of locations between the two elements, consistent with some prior facilitatory effects observed in electrophysiology and psychophysics. Overall, our results suggest that population-level lateral interactions in V1 are primarily explained by a simple orientation-independent contrast gain control mechanism.SIGNIFICANCE STATEMENT Interactions between representations of simple visual elements such as oriented edges in primary visual cortex (V1) are thought to contribute to our ability to easily integrate contours and segment surfaces, but the mechanisms that govern these interactions are primarily unknown. Our study provides novel evidence that lateral interactions at the population level are governed by a simple contrast gain-control mechanism, and we show how this divisive gain-control mechanism can give rise to apparently facilitatory spiking responses.

Scale-Invariant Visual Capabilities Explained by Topographic Representations of Luminance and Texture in Primate V1

Humans have remarkable scale-invariant visual capabilities. For example, our orientation discrimination sensitivity is largely constant over more than two orders of magnitude of variations in stimulus spatial frequency (SF). Orientation-selective V1 neurons are likely to contribute to orientation discrimination. However, because at any V1 location neurons have a limited range of receptive field (RF) sizes, we predict that at low SFs V1 neurons will carry little orientation information. If this were the case, what could account for the high behavioral sensitivity at low SFs? Using optical imaging in behaving macaques, we show that, as predicted, V1 orientation-tuned responses drop rapidly with decreasing SF. However, we reveal a surprising coarse-scale signal that corresponds to the projection of the luminance layout of low-SF stimuli to V1's retinotopic map. This homeomorphic and distributed representation, which carries high-quality orientation information, is likely to contribute to our striking scale-invariant visual capabilities.

Linking V1 Activity to Behavior

A long-term goal of visual neuroscience is to develop and test quantitative models that account for the moment-by-moment relationship between neural responses in early visual cortex and human performance in natural visual tasks. This review focuses on efforts to address this goal by measuring and perturbing the activity of primary visual cortex (V1) neurons while nonhuman primates perform demanding, well-controlled visual tasks. We start by describing a conceptual approach-the decoder linking model (DLM) framework-in which candidate decoding models take neural responses as input and generate predicted behavior as output. The ultimate goal in this framework is to find the actual decoder-the model that best predicts behavior from neural responses. We discuss key relevant properties of primate V1 and review current literature from the DLM perspective. We conclude by discussing major technological and theoretical advances that are likely to accelerate our understanding of the link between V1 activity and behavior.

Visual Working Memory Is Independent of the Cortical Spacing Between Memoranda

The sensory recruitment hypothesis states that visual short-term memory is maintained in the same visual cortical areas that initially encode a stimulus' features. Although it is well established that the distance between features in visual cortex determines their visibility, a limitation known as crowding, it is unknown whether short-term memory is similarly constrained by the cortical spacing of memory items. Here, we investigated whether the cortical spacing between sequentially presented memoranda affects the fidelity of memory in humans (of both sexes). In a first experiment, we varied cortical spacing by taking advantage of the log-scaling of visual cortex with eccentricity, presenting memoranda in peripheral vision sequentially along either the radial or tangential visual axis with respect to the fovea. In a second experiment, we presented memoranda sequentially either within or beyond the critical spacing of visual crowding, a distance within which visual features cannot be perceptually distinguished due to their nearby cortical representations. In both experiments and across multiple measures, we found strong evidence that the ability to maintain visual features in memory is unaffected by cortical spacing. These results indicate that the neural architecture underpinning working memory has properties inconsistent with the known behavior of sensory neurons in visual cortex. Instead, the dissociation between perceptual and memory representations supports a role of higher cortical areas such as posterior parietal or prefrontal regions or may involve an as yet unspecified mechanism in visual cortex in which stimulus features are bound to their temporal order.

SIGNIFICANCE STATEMENT Although much is known about the resolution with which we can remember visual objects, the cortical representation of items held in short-term memory remains contentious. A popular hypothesis suggests that memory of visual features is maintained via the recruitment of the same neural architecture in sensory cortex that encodes stimuli. We investigated this claim by manipulating the spacing in visual cortex between sequentially presented memoranda such that some items shared cortical representations more than others while preventing perceptual interference between stimuli. We found clear evidence that short-term memory is independent of the intracortical spacing of memoranda, revealing a dissociation between perceptual and memory representations. Our data indicate that working memory relies on different neural mechanisms from sensory perception.

Age-related differences in the legibility of degraded text

Aging-related changes in the visual system diminish the capacity to perceive the world with the ease and fidelity younger adults are accustomed to. Among many consequences of this, older adults find that text that they could once read easily proves difficult to read, even with sufficient acuity correction. Building on previous work examining visual factors in legibility, we examine potential causes for these age-related effects in the absence of other ocular pathology. We asked participants to discriminate words from non-words in a lexical decision task. The stimuli participants viewed were either blurred or presented in a noise field to simulate, respectively, decreased sensitivity to fine detail (loss of acuity) and detuning of visually selective neurons. We then use the differences in performance between older and younger participants to suggest how older participants’ performance could be approximated to facilitate maximally usable designs.

An Orientation Dependent Size Illusion Is Underpinned by Processing in the Extrastriate Visual Area, LO1

We use the simple, but prominent Helmholtz's squares illusion in which a vertically striped square appears wider than a horizontally striped square of identical physical dimensions to determine whether functional magnetic resonance imaging (fMRI) BOLD responses in V1 underpin illusions of size. We report that these simple stimuli which differ in only one parameter, orientation, to which V1 neurons are highly selective elicited activity in V1 that followed their physical, not perceived size. To further probe the role of V1 in the illusion and investigate plausible extrastriate visual areas responsible for eliciting the Helmholtz squares illusion, we performed a follow-up transcranial magnetic stimulation (TMS) experiment in which we compared perceptual judgments about the aspect ratio of perceptually identical Helmholtz squares when no TMS was applied against selective stimulation of V1, LO1, or LO2. In agreement with fMRI results, we report that TMS of area V1 does not compromise the strength of the illusion. Only stimulation of area LO1, and not LO2, compromised significantly the strength of the illusion, consistent with previous research that LO1 plays a role in the processing of orientation information. These results demonstrate the involvement of a specific extrastriate area in an illusory percept of size.

Probing the functional impact of sub-retinal prosthesis

Retinal prostheses are promising tools for recovering visual functions in blind patients but, unfortunately, with still poor gains in visual acuity. Improving their resolution is thus a key challenge that warrants understanding its origin through appropriate animal models. Here, we provide a systematic comparison between visual and prosthetic activations of the rat primary visual cortex (V1). We established a precise V1 mapping as a functional benchmark to demonstrate that sub-retinal implants activate V1 at the appropriate position, scalable to a wide range of visual luminance, but with an aspect-ratio and an extent much larger than expected. Such distorted activation profile can be accounted for by the existence of two sources of diffusion, passive diffusion and activation of ganglion cells’ axons en passant. Reverse-engineered electrical pulses based on impedance spectroscopy is the only solution we tested that decreases the extent and aspect-ratio, providing a promising solution for clinical applications.

DOI:http://dx.doi.org/10.7554/eLife.12687.001

One of the most common causes of blindness is a disorder called retinitis pigmentosa. In a healthy eye, the surface at the back of the eye – called the retina – contains cells called photoreceptors that detect light and convert it into electrical signals for the brain to process. In people with retinitis pigmentosa, these photoreceptor cells die off gradually, which leads to loss of vision.

The only treatment available for retinitis pigmentosa is to have an artificial retina implanted into the eye. The artificial retina consists of an array of tiny electrodes, which take over from the damaged photoreceptors and generate electrical signals. The person with the implant perceives these electrical signals as bright flashes called “phosphenes”. However, the phosphenes are too large and imprecise to provide the person with vision that is good enough for tasks such as walking unaided or reading.

To find out why artificial retinas produce such poor resolution, Roux et al. compared how a rat’s brain responds to either natural visual stimuli or activation of implanted an array of micro-electrodes. Both the micro-electrodes and the natural stimuli activated the same areas of the brain. However, the micro-electrodes produced larger and more elongated patterns of activation. This is because the electrical currents generated by the micro-electrodes diffused throughout the retinal tissue and activated other neurons besides those intended. To overcome this problem, Roux et al. tested different ways of stimulating the micro-electrodes in order to identify those that induce the desired patterns of brain activity. This approach – known as reverse engineering – did indeed improve the performance of the micro-electrode array.

The next step is to extend these findings, which were obtained in healthy rats, to non-human primates or animal models of retinitis pigmentosa to better understand the condition in humans. In addition, combining the current approach with other existing techniques should further improve the vision that can be achieved with artificial retinas.

DOI:http://dx.doi.org/10.7554/eLife.12687.002

Efficient Receptive Field Tiling in Primate V1

The primary visual cortex (V1) encodes a diverse set of visual features, including orientation, ocular dominance (OD), and spatial frequency (SF), whose joint organization must be precisely structured to optimize coverage within the retinotopic map. Prior experiments have only identified efficient coverage based on orthogonal maps. Here we used two-photon calcium imaging to reveal an alternative arrangement for OD and SF maps in macaque V1; their gradients run parallel but with unique spatial periods, whereby low-SF regions coincide with monocular regions. Next we mapped receptive fields and found surprisingly precise micro-retinotopy that yields a smaller point-image and requires more efficient inter-map geometry, thus underscoring the significance of map relationships. While smooth retinotopy is constraining, studies suggest that it improves both wiring economy and the V1 population code read downstream. Altogether, these data indicate that connectivity within V1 is finely tuned and precise at the level of individual neurons.

Calcium imaging with genetically encoded indicators in behaving primates

Understanding the neural basis of behaviour requires studying brain activity in behaving subjects using complementary techniques that measure neural responses at multiple spatial scales, and developing computational tools for understanding the mapping between these measurements. Here we report the first results of widefield imaging of genetically encoded calcium indicator (GCaMP6f) signals from V1 of behaving macaques. This technique provides a robust readout of visual population responses at the columnar scale over multiple mm² and over several months. To determine the quantitative relation between the widefield GCaMP signals and the locally pooled spiking activity, we developed a computational model that sums the responses of V1 neurons characterized by prior single unit measurements. The measured tuning properties of the GCaMP signals to stimulus contrast, orientation and spatial position closely match the predictions of the model, suggesting that widefield GCaMP signals are linearly related to the summed local spiking activity.

DOI:http://dx.doi.org/10.7554/eLife.16178.001

An important question in brain research is how neurons and the circuits they form process information to produce behavior. To understand what happens in a human brain, it is necessary to study a brain of similar complexity, such as that of a primate. Examining how the neurons in a brain region called the visual cortex process information about what we see is especially informative. This is because animals can be taught to perform different visual tasks, and because the visual cortex is relatively easy to access. In principle, therefore, it should be possible to use modern genetic and imaging techniques to study the primate visual system, but, until now, that has not been the case.

Like much of the brain, the visual cortex consists of different classes of neurons that can excite, inhibit or modulate the activity of neighboring neurons. One way to study how these different classes of neurons interact with each other is to alter the animal’s DNA, such that only one cell type stands out during the experiment, allowing its role in the brain to be closely monitored. This technique has been used to study the interactions among neurons in the rodent brain, because rodent DNA is easy to alter. However, it is not easy to manipulate primate DNA.

Seidemann et al. have, therefore, developed a new technique that can target a specific class of neurons, allowing the activity of just these cells to be distinguished from the rest. The method uses specially designed harmless viruses to produce foreign proteins in the excitatory neurons of the visual cortex in an adult macaque. The optical properties of the proteins change when the neuron they are in is active, allowing the activity of the excitatory neurons to be detected and tracked in awake animals while they perform a visual task.

Previously, the activity of neurons in the primate visual cortex could only be measured using dyes that indiscriminately reported the activity of all the neurons present. Seidemann et al. found that, in addition to being more selective than the dye-based method, the new technique also more accurately depicted neuronal action potentials, which are the primary units of information in the brain.

Seidemann et al. now plan to use a similar method to study the activity of the inhibitory neurons of the primate visual cortex. Further examination of both excitatory and inhibitory neurons at much higher magnification, using a different microscopy technique, will also reveal more subtle features of their responses during visual tasks.

DOI:http://dx.doi.org/10.7554/eLife.16178.002

Temporal Asymmetry in Dark-Bright Processing Initiates Propagating Activity across Primary Visual Cortex

Differences between visual pathways representing darks and lights have been shown to affect spatial resolution and detection timing. Both psychophysical and physiological studies suggest an underlying retinal origin with amplification in primary visual cortex (V1). Here we show that temporal asymmetries in the processing of darks and lights create motion in terms of propagating activity across V1. Exploiting the high spatiotemporal resolution of voltage-sensitive dye imaging, we captured population responses to abrupt local changes of luminance in cat V1. For stimulation we used two neighboring small squares presented on either bright or dark backgrounds. When a single square changed from dark to bright or vice versa, we found coherent population activity emerging at the respective retinal input locations. However, faster rising and decay times were obtained for the bright to dark than the dark to bright changes. When the two squares changed luminance simultaneously in opposite polarities, we detected a propagating wave front of activity that originated at the cortical location representing the darkened square and rapidly expanded toward the region representing the brightened location. Thus, simultaneous input led to sequential activation across cortical retinotopy. Importantly, this effect was independent of the squares' contrast with the background. We suggest imbalance in dark-bright processing as a driving force in the generation of wave-like activity. Such propagation may convey motion signals and influence perception of shape whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.

SIGNIFICANCE STATEMENT

An elementary process in vision is the detection of darks and lights through the retina via ON and OFF channels. Psychophysical and physiological studies suggest that differences between these channels affect spatial resolution and detection thresholds. Here we show that temporal asymmetries in the processing of darks and lights create motion signals across visual cortex. Using two neighboring squares, which simultaneously counterchanged luminance, we discovered propagating activity that was strictly drawn out from cortical regions representing the darkened location. Thus, a synchronous stimulus event translated into sequential wave-like brain activation. Such propagation may convey motion signals accessible in higher brain areas, whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.

Parsimony, Exhaustivity and Balanced Detection in Neocortex

The layout of sensory brain areas is thought to subtend perception. The principles shaping these architectures and their role in information processing are still poorly understood. We investigate mathematically and computationally the representation of orientation and spatial frequency in cat primary visual cortex. We prove that two natural principles, local exhaustivity and parsimony of representation, would constrain the orientation and spatial frequency maps to display a very specific pinwheel-dipole singularity. This is particularly interesting since recent experimental evidences show a dipolar structures of the spatial frequency map co-localized with pinwheels in cat. These structures have important properties on information processing capabilities. In particular, we show using a computational model of visual information processing that this architecture allows a trade-off in the local detection of orientation and spatial frequency, but this property occurs for spatial frequency selectivity sharper than reported in the literature. We validated this sharpening on high-resolution optical imaging experimental data. These results shed new light on the principles at play in the emergence of functional architecture of cortical maps, as well as their potential role in processing information.

Edge co-occurrences can account for rapid categorization of natural versus animal images

Making a judgment about the semantic category of a visual scene, such as whether it contains an animal, is typically assumed to involve high-level associative brain areas. Previous explanations require progressively analyzing the scene hierarchically at increasing levels of abstraction, from edge extraction to mid-level object recognition and then object categorization. Here we show that the statistics of edge co-occurrences alone are sufficient to perform a rough yet robust (translation, scale, and rotation invariant) scene categorization. We first extracted the edges from images using a scale-space analysis coupled with a sparse coding algorithm. We then computed the “association field” for different categories (natural, man-made, or containing an animal) by computing the statistics of edge co-occurrences. These differed strongly, with animal images having more curved configurations. We show that this geometry alone is sufficient for categorization, and that the pattern of errors made by humans is consistent with this procedure. Because these statistics could be measured as early as the primary visual cortex, the results challenge widely held assumptions about the flow of computations in the visual system. The results also suggest new algorithms for image classification and signal processing that exploit correlations between low-level structure and the underlying semantic category.

Correlated activity supports efficient cortical processing

Visual recognition is a computational challenge that is thought to occur via efficient coding. An important concept is sparseness, a measure of coding efficiency. The prevailing view is that sparseness supports efficiency by minimizing redundancy and correlations in spiking populations. Yet, we recently reported that "choristers", neurons that behave more similarly (have correlated stimulus preferences and spontaneous coincident spiking), carry more generalizable object information than uncorrelated neurons ("soloists") in macaque inferior temporal (IT) cortex. The rarity of choristers (as low as 6% of IT neurons) indicates that they were likely missed in previous studies. Here, we report that correlation strength is distinct from sparseness (choristers are not simply broadly tuned neurons), that choristers are located in non-granular output layers, and that correlated activity predicts human visual search efficiency. These counterintuitive results suggest that a redundant correlational structure supports efficient processing and behavior.

Vigorous orientation signal propagates best from collinear motion

In the present study, the Poggendorff illusion was tested with four types of stimuli: A moving dot, a moving bar parallel to the inducing lines, a moving bar collinear to the motion trajectory, and static bars as in the classic illusion. Psychometric functions of the alignment task showed that the collinear bar, where orientation and motion trajectory matched, yielded the best alignment performance almost eliminating the illusion; the vertical bar, on the contrary, showed the worst alignment, finally the dot and the static bars led to intermediate alignments. These results demonstrate the interaction between orientation and motion trajectory that likely takes place in the primary visual cortex (V1) where these two signals might be modulated by top-down activity from higher order areas such as the middle temporal (MT). This vigorous orientation-motion trajectory interaction allows extremely accurate positional predictions of moving objects in the visual scene, in particular during occlusion.

Object-centered shifts of receptive field positions in monkey primary visual cortex

Stimuli that project the same retinal visual angle can appear to occupy very different proportions of the visual field if they are perceived to be at different distances [1-8]. Previous research shows that perceived angular size alters the spatial distribution of activity in early retinotopic visual cortex [7, 9-11]. For example, a sphere superimposed on the far end of a corridor scene appears to occupy a larger visual angle and activates a larger region of primary visual cortex (V1) compared with the same sphere superimposed on the near end of the corridor [7]. These previous results, however, were obtained from human subjects using psychophysics and fMRI, a fact that fundamentally limits our understanding of the underlying neuronal mechanisms. Here, we present an animal model that allows for a finer examination of size perception at the level of single neurons. We first show that macaque monkeys perceive a size-distance illusion similarly to humans. Then, using extracellular recordings, we test the specific hypothesis [12] that neurons in V1 shift the position of their receptive fields (RFs) in response to complex monocular depth cues. Consistent with this hypothesis, we found that when ring-shaped stimuli appeared at the back of the corridor, RFs of V1 neurons shifted toward the center of the rings. When the same stimuli appeared at the front of the corridor, RFs shifted outward. Thus, our results show for the first time that V1 RFs can shift, potentially serving as the neural basis for the perception of angular size.

Coding space-time stimulus dynamics in auditory brain maps

Sensory maps are often distorted representations of the environment, where ethologically-important ranges are magnified. The implication of a biased representation extends beyond increased acuity for having more neurons dedicated to a certain range. Because neurons are functionally interconnected, non-uniform representations influence the processing of high-order features that rely on comparison across areas of the map. Among these features are time-dependent changes of the auditory scene generated by moving objects. How sensory representation affects high order processing can be approached in the map of auditory space of the owl's midbrain, where locations in the front are over-represented. In this map, neurons are selective not only to location but also to location over time. The tuning to space over time leads to direction selectivity, which is also topographically organized. Across the population, neurons tuned to peripheral space are more selective to sounds moving into the front. The distribution of direction selectivity can be explained by spatial and temporal integration on the non-uniform map of space. Thus, the representation of space can induce biased computation of a second-order stimulus feature. This phenomenon is likely observed in other sensory maps and may be relevant for behavior.