The "silent" surround of V1 receptive fields: theory and experiments

Generalizing biological surround suppression based on center surround similarity via deep neural network models

Sensory perception is dramatically influenced by the context. Models of contextual neural surround effects in vision have mostly accounted for Primary Visual Cortex (V1) data, via nonlinear computations such as divisive normalization. However, surround effects are not well understood within a hierarchy, for neurons with more complex stimulus selectivity beyond V1. We utilized feedforward deep convolutional neural networks and developed a gradient-based technique to visualize the most suppressive and excitatory surround. We found that deep neural networks exhibited a key signature of surround effects in V1, highlighting center stimuli that visually stand out from the surround and suppressing responses when the surround stimulus is similar to the center. We found that in some neurons, especially in late layers, when the center stimulus was altered, the most suppressive surround surprisingly can follow the change. Through the visualization approach, we generalized previous understanding of surround effects to more complex stimuli, in ways that have not been revealed in visual cortices. In contrast, the suppression based on center surround similarity was not observed in an untrained network. We identified further successes and mismatches of the feedforward CNNs to the biology. Our results provide a testable hypothesis of surround effects in higher visual cortices, and the visualization approach could be adopted in future biological experimental designs.

Computational methods to study information processing in neural circuits

The brain is an information processing machine and thus naturally lends itself to be studied using computational tools based on the principles of information theory. For this reason, computational methods based on or inspired by information theory have been a cornerstone of practical and conceptual progress in neuroscience. In this Review, we address how concepts and computational tools related to information theory are spurring the development of principled theories of information processing in neural circuits and the development of influential mathematical methods for the analyses of neural population recordings. We review how these computational approaches reveal mechanisms of essential functions performed by neural circuits. These functions include efficiently encoding sensory information and facilitating the transmission of information to downstream brain areas to inform and guide behavior. Finally, we discuss how further progress and insights can be achieved, in particular by studying how competing requirements of neural encoding and readout may be optimally traded off to optimize neural information processing.

DRFnet: Dynamic receptive field network for object detection and image recognition

Biological experiments discovered that the receptive field of neurons in the primary visual cortex of an animal's visual system is dynamic and capable of being altered by the sensory context. However, in a typical convolution neural network (CNN), a unit's response only comes from a fixed receptive field, which is generally determined by the preset kernel size in each layer. In this work, we simulate the dynamic receptive field mechanism in the biological visual system (BVS) for application in object detection and image recognition. We proposed a Dynamic Receptive Field module (DRF), which can realize the global information-guided responses under the premise of a slight increase in parameters and computational cost. Specifically, we design a transformer-style DRF module, which defines the correlation coefficient between two feature points by their relative distance. For an input feature map, we first divide the relative distance corresponding to different receptive field regions between the target feature point and its surrounding feature points into N different discrete levels. Then, a vector containing N different weights is automatically learned from the dataset and assigned to each feature point, according to the calculated discrete level that this feature point belongs. In this way, we achieve a correlation matrix primarily measuring the relationship between the target feature point and its surrounding feature points. The DRF-processed responses of each feature point are computed by multiplying its corresponding correlation matrix with the input feature map, which computationally equals to accomplish a weighted sum of all feature points exploiting the global and long-range information as the weight. Finally, by superimposing the local responses calculated by a traditional convolution layer with DRF responses, our proposed approach can integrate the rich context information among neighbors and the long-range dependencies of background into the feature maps. With the proposed DRF module, we achieved significant performance improvement on four benchmark datasets for both tasks of object detection and image recognition. Furthermore, we also proposed a new matching strategy that can improve the detection results of small targets compared with the traditional IOU-max matching strategy.

Temporal resolution and temporal extent of orientation repulsion

A vertical target is perceived as tilted against a slightly tilted inducer surrounding it. To identify the temporal resolution and temporal extent of this phenomenon of orientation repulsion in the same paradigm, we used an alternating pair of inducer stimuli having complementary orientation distributions and quantified repulsion at various alternation frequencies. The duration of each inducer stimulus was inversely proportional to the frequency. When an orthogonal pair of D2 patterns, a type of grating whose luminance modulation in a particular orientation was the second-order partial derivative of an isotropic 2D-Gaussian, was used as the inducer, repulsion occurred when the duration exceeded 20 ms and leveled off at 30 ms and beyond. When a custom-made texture with a narrowband orientation distribution and another texture with a complementary orientation distribution were alternated as the inducer, repulsion gradually increased until the inducer duration reached 200 ms. The gradual increase in repulsion was observed regardless of whether the orientation of the inducer that appeared simultaneously with the target was discernible. These findings reveal that contextual modulation in orientation occurs at a high temporal resolution and continues to a long temporal extent under optimal conditions.

Self-monitoring in schizophrenia: Weighting exteroceptive visual signals against self-generated vestibular cues

Disturbances in self-monitoring are core symptoms of schizophrenia. Some research suggests an over-reliance on exteroceptive cues and a reduced weighting of self-generated interoceptive signals to guide perception. The vestibular sense provides important self-generated information about the body in space. Alterations of vestibular function are reported in schizophrenia, but it is unknown whether internally generated vestibular information is discounted in favour of exteroceptive input. In this study, we test for evidence of an over-reliance on exteroceptive visual cues and a reduced weighting of vestibular signals in guiding perception. In a group of individuals with schizophrenia and healthy controls, we used a well-studied visual illusion - the Tilt Illusion - to probe the respective weight given to visual and vestibular cues in judging line orientation. The Tilt Illusion reveals that perceived orientation of a vertical grating is biased by the orientation in its surround. This illusion increases when the head is tilted, due to the reduced reliability of vestibular information that would otherwise provide an internally generated reference for vertical. We predicted that an over-reliance on exteroceptive cues in schizophrenia would lead to a reduced susceptibility to the effects of head position on Tilt Illusion strength. We find no difference between patients and controls. Both groups show comparable Tilt Illusion magnitudes that increase when the head is tilted. Thus, our findings suggest that chronic patients with schizophrenia adequately combine self-generated vestibular cues and exteroceptive visual input to judge line verticality. A stronger reliance on exteroceptive information over internally generated signals in guiding perception is not evident in our data. Deficits in self-monitoring might therefore be modality specific or state dependant.

Surround Modulation Properties of Tectal Neurons in Pigeons Characterized by Moving and Flashed Stimuli

Simple Summary

Surround modulation is a basic visual attribute of sensory neurons in many species and has been extensively characterized in mammal primary visual cortex, lateral geniculate nucleus, and superior colliculus. Little attention has been paid to birds, which have a highly developed visual system. We undertook a systematic analysis on surround modulation properties of tectal neurons in pigeons (Columba livia). This study complements existing studies on surrounding modulation properties in non-mammalian species and deepens the understanding of mechanisms of figure–background segmentation performed by avians.

Abstract

Surround modulation has been abundantly studied in several mammalian brain areas, including the primary visual cortex, lateral geniculate nucleus, and superior colliculus (SC), but systematic analysis is lacking in the avian optic tectum (OT, homologous to mammal SC). Here, multi-units were recorded from pigeon (Columba livia) OT, and responses to different sizes of moving, flashed squares, and bars were compared. The statistical results showed that most tectal neurons presented suppressed responses to larger stimuli in both moving and flashed paradigms, and suppression induced by flashed squares was comparable with moving ones when the stimuli center crossed the near classical receptive field (CRF) center, which corresponded to the full surrounding condition. Correspondingly, the suppression grew weaker when the stimuli center moved across the CRF border, equivalent to partially surrounding conditions. Similarly, suppression induced by full surrounding flashed squares was more intense than by partially surrounding flashed bars. These results suggest that inhibitions performed on tectal neurons appear to be full surrounding rather than locally lateral. This study enriches the understanding of surround modulation properties of avian tectum neurons and provides possible hypotheses about the arrangement of inhibitions from other nuclei, both of which are important for clarifying the mechanism of target detection against clutter background performed by avians.

Periodic clustering of simple and complex cells in visual cortex

Neurons in the primary visual cortex (V1) are often classified as simple or complex cells, but it is debated whether they are discrete hierarchical classes of neurons or if they represent a continuum of variation within a single class of cells. Herein, we show that simple and complex cells may arise commonly from the feedforward projections from the retina. From analysis of the cortical receptive fields in cats, we show evidence that simple and complex cells originate from the periodic variation of ON-OFF segregation in the feedforward projection of retinal mosaics, by which they organize into periodic clusters in V1. From data in cats, we observed that clusters of simple and complex receptive fields correlate topographically with orientation maps, which supports our model prediction. Our results suggest that simple and complex cells are not two distinct neural populations but arise from common retinal afferents, simultaneous with orientation tuning.

Illusions, Delusions, and Your Backwards Bayesian Brain: A Biased Visual Perspective

The retinal image is insufficient for determining what is "out there," because many different real-world geometries could produce any given retinal image. Thus, the visual system must infer which external cause is most likely, given both the sensory data and prior knowledge that is either innate or learned via interactions with the environment. We will describe a general framework of "hierarchical Bayesian inference" that we and others have used to explore the role of cortico-cortical feedback in the visual system, and we will further argue that this approach to "seeing" makes our visual systems prone to perceptual errors in a variety of different ways. In this deliberately provocative and biased perspective, we argue that the neuromodulator, dopamine, may be a crucial link between neural circuits performing Bayesian inference and the perceptual idiosyncrasies of people with schizophrenia.

Perceptual learning improves visual functions in patients with albinistic bilateral amblyopia: A pilot study

BACKGROUND

Several visual functions are impaired in patients with oculocutaneous albinism (OCA) associated to albinistic bilateral amblyopia (ABA).

OBJECTIVE

In this study, we aimed at exploring whether perceptual learning (PL) can improve visual functions in albinism.

METHOD

Six patients and six normal sighted controls, were trained in a contrast detection task with lateral masking. Participants were asked to choose which of the two intervals contained a foveally presented low-contrast Gabor patch. Targets were presented between higher contrast collinear flankers with equal spatial frequency. When increasing target-to-flanker distance, lateral interactions effect normally switches from inhibition to facilitation, up to no effect.

RESULTS

Our findings showed that before PL, only controls showed facilitation. After PL, results suggest that facilitatory lateral interactions are found both in controls as well as in albino patients. These results suggest that PL could induce higher processing efficiency at early cortical level. Moreover, PL positive effect seems to transfer to higher-level visual functions, but results were not very consistent among tasks (visual acuity, contrast sensitivity function, hyperacuity and foveal crowding).

CONCLUSIONS

Although a small sample size was tested, our findings suggest a rehabilitative potential of PL in improving visual functions in albinism.

The time-course of prediction formation and revision in human visual motion processing

Establishing the real-time position of a moving object poses a challenge to the visual system due to neural processing delays. While sensory information is travelling through the visual hierarchy, the object continues moving and information about its position becomes outdated. By extrapolating the position of a moving object along its trajectory, predictive mechanisms might effectively decrease the processing time associated with these objects. Here, we use time-resolved decoding of electroencephalographic (EEG) data from an apparent motion paradigm to demonstrate the interaction of two separate predictive mechanisms. First, we reveal predictive latency advantages for position representations as soon as the second object in an apparent motion sequence - even before the stimulus contains any physical motion energy. This is consistent with the existence of omni-directional, within-layer waves of sub-threshold activity that bring neurons coding for adjacent positions closer to their firing threshold, thereby reducing the processing time of the second stimulus in one of those positions. Second, we show that an additional direction-specific latency advantage emerges from the third sequence position onward, once the direction of the apparent motion stimulus is uniquely determined. Because the receptive fields of early visual areas are too small to encompass sequential apparent motion positions (as evidenced by the lack of latency modulation for the second stimulus position), this latency advantage most likely arises from descending predictions from higher to lower visual areas through feedback connections. Finally, we reveal that the same predictive activation that facilitates the processing of the object in its expected position needs to be overcome when the object's trajectory unexpectedly reverses, causing an additional latency disadvantage for stimuli that violate predictions. Altogether, our results suggest that two complementary mechanisms interact to form and revise predictions in visual motion processing, modulating the latencies of neural position representations at different levels of visual processing.

Sparse deep predictive coding captures contour integration capabilities of the early visual system

Both neurophysiological and psychophysical experiments have pointed out the crucial role of recurrent and feedback connections to process context-dependent information in the early visual cortex. While numerous models have accounted for feedback effects at either neural or representational level, none of them were able to bind those two levels of analysis. Is it possible to describe feedback effects at both levels using the same model? We answer this question by combining Predictive Coding (PC) and Sparse Coding (SC) into a hierarchical and convolutional framework applied to realistic problems. In the Sparse Deep Predictive Coding (SDPC) model, the SC component models the internal recurrent processing within each layer, and the PC component describes the interactions between layers using feedforward and feedback connections. Here, we train a 2-layered SDPC on two different databases of images, and we interpret it as a model of the early visual system (V1 & V2). We first demonstrate that once the training has converged, SDPC exhibits oriented and localized receptive fields in V1 and more complex features in V2. Second, we analyze the effects of feedback on the neural organization beyond the classical receptive field of V1 neurons using interaction maps. These maps are similar to association fields and reflect the Gestalt principle of good continuation. We demonstrate that feedback signals reorganize interaction maps and modulate neural activity to promote contour integration. Third, we demonstrate at the representational level that the SDPC feedback connections are able to overcome noise in input images. Therefore, the SDPC captures the association field principle at the neural level which results in a better reconstruction of blurred images at the representational level.

A Disinhibitory Circuit for Contextual Modulation in Primary Visual Cortex

Context guides perception by influencing stimulus saliency. Accordingly, in visual cortex, responses to a stimulus are modulated by context, the visual scene surrounding the stimulus. Responses are suppressed when stimulus and surround are similar but not when they differ. The underlying mechanisms remain unclear. Here, we use optical recordings, manipulations, and computational modeling to show that disinhibitory circuits consisting of vasoactive intestinal peptide (VIP)-expressing and somatostatin (SOM)-expressing inhibitory neurons modulate responses in mouse visual cortex depending on similarity between stimulus and surround, primarily by modulating recurrent excitation. When stimulus and surround are similar, VIP neurons are inactive, and activity of SOM neurons leads to suppression of excitatory neurons. However, when stimulus and surround differ, VIP neurons are active, inhibiting SOM neurons, which leads to relief of excitatory neurons from suppression. We have identified a canonical cortical disinhibitory circuit that contributes to contextual modulation and may regulate perceptual saliency.

Multi-regional circuits underlying visually guided decision-making in Drosophila

Visually guided decision-making requires integration of information from distributed brain areas, necessitating a brain-wide approach to examine its neural mechanisms. New tools in Drosophila melanogaster enable circuits spanning the brain to be charted with single cell-type resolution. Here, we highlight recent advances uncovering the computations and circuits that transform and integrate visual information across the brain to make behavioral choices. Visual information flows from the optic lobes to three primary central brain regions: a sensorimotor mapping area and two 'higher' centers for memory or spatial orientation. Rapid decision-making during predator evasion emerges from the spike timing dynamics in parallel sensorimotor cascades. Goal-directed decisions may occur through memory, navigation and valence processing in the central complex and mushroom bodies.

Using psychophysical performance to predict short-term ocular dominance plasticity in human adults

Binocular rivalry has become an important index of visual performance, both to measure ocular dominance or its plasticity, and to index bistable perception. We investigated its interindividual variability across 50 normal adults and found that the duration of dominance phases in rivalry is linked with the duration of dominance phases in another bistable phenomenon (structure from motion). Surprisingly, it also correlates with the strength of center-surround interactions (indexed by the tilt illusion), suggesting a common mechanism supporting both competitive interactions: center-surround and rivalry. In a subset of 34 participants, we further investigated the variability of short-term ocular dominance plasticity, measured with binocular rivalry before and after 2 hours of monocular deprivation. We found that ocular dominance shifts in favor of the deprived eye and that a large portion of ocular dominance variability after deprivation can be predicted from the dynamics of binocular rivalry before deprivation. The single best predictor is the proportion of mixed percepts (phases without dominance of either eye) before deprivation, which is positively related to ocular dominance unbalance after deprivation. Another predictor is the duration of dominance phases, which interacts with mixed percepts to explain nearly 50% of variance in ocular dominance unbalance after deprivation. A similar predictive power is achieved by substituting binocular rivalry dominance phase durations with tilt illusion magnitude, or structure from motion phase durations. Thus, we speculate that ocular dominance plasticity is modulated by two types of signals, estimated from psychophysical performance before deprivation, namely, interocular inhibition (promoting binocular fusion, hence mixed percepts) and inhibition for perceptual competition (promoting longer dominance phases and stronger center-surround interactions).

Feedback generates a second receptive field in neurons of the visual cortex

Animals sense the environment through pathways that link sensory organs to the brain. In the visual system, these feedforward pathways define the classical feedforward receptive field (ffRF), the area in space in which visual stimuli excite a neuron1. The visual system also uses visual context-the visual scene surrounding a stimulus-to predict the content of the stimulus2, and accordingly, neurons have been identified that are excited by stimuli outside their ffRF3-8. However, the mechanisms that generate excitation to stimuli outside the ffRF are unclear. Here we show that feedback projections onto excitatory neurons in the mouse primary visual cortex generate a second receptive field that is driven by stimuli outside the ffRF. The stimulation of this feedback receptive field (fbRF) elicits responses that are slower and are delayed in comparison with those resulting from the stimulation of the ffRF. These responses are preferentially reduced by anaesthesia and by silencing higher visual areas. Feedback inputs from higher visual areas have scattered receptive fields relative to their putative targets in the primary visual cortex, which enables the generation of the fbRF. Neurons with fbRFs are located in cortical layers that receive strong feedback projections and are absent in the main input layer, which is consistent with a laminar processing hierarchy. The observation that large, uniform stimuli-which cover both the fbRF and the ffRF-suppress these responses indicates that the fbRF and the ffRF are mutually antagonistic. Whereas somatostatin-expressing inhibitory neurons are driven by these large stimuli, inhibitory neurons that express parvalbumin and vasoactive intestinal peptide have mutually antagonistic fbRF and ffRF, similar to excitatory neurons. Feedback projections may therefore enable neurons to use context to estimate information that is missing from the ffRF and to report differences in stimulus features across visual space, regardless of whether excitation occurs inside or outside the ffRF. By complementing the ffRF, the fbRF that we identify here could contribute to predictive processing.

Excitatory and inhibitory lateral interactions effects on contrast detection are modulated by tRNS

Contrast sensitivity for a Gabor signal is affected by collinear high-contrast Gabor flankers. The flankers reduce (inhibitory effect) or increase (facilitatory effect) sensitivity, at short (2λ) and intermediate (6λ) target-to-flanker separation respectively. We investigated whether these inhibitory/facilitatory sensitivity effects are modulated by transcranial random noise stimulation (tRNS) applied to the occipital and frontal cortex of human observers during task performance. Signal detection theory was used to measure sensitivity (d’) and the Criterion (C) in a contrast detection task, performed with sham or tRNS applied over the occipital or the frontal cortex. After occipital stimulation results show a tRNS-dependent increased sensitivity for the single Gabor signal of low but not high contrast. Moreover, results suggest a dissociation of the tRNS effect when the Gabor signal is presented with the flankers, consisting in a general increased sensitivity at 2λ where the flankers had an inhibitory effect (reduction of inhibition) and a decreased sensitivity at 6λ where the flankers had a facilitatory effect on the Gabor signal (reduction of facilitation). After a frontal stimulation, no specific effect of the tRNS was found. We account for these complex interactions between tRNS and flankers by assuming that tRNS not only enhances feedforward input from the Gabor signal to the cortex, but also enhances the excitatory or inhibitory lateral intracortical input from the flankers. The boosted lateral input depends on the excitation-inhibition (E/I) ratio, namely when the lateral input is weak, it is boosted by tRNS with consequent modification of the contrast-dependent E/I ratio.

Constrained inference in sparse coding reproduces contextual effects and predicts laminar neural dynamics

When probed with complex stimuli that extend beyond their classical receptive field, neurons in primary visual cortex display complex and non-linear response characteristics. Sparse coding models reproduce some of the observed contextual effects, but still fail to provide a satisfactory explanation in terms of realistic neural structures and cortical mechanisms, since the connection scheme they propose consists only of interactions among neurons with overlapping input fields. Here we propose an extended generative model for visual scenes that includes spatial dependencies among different features. We derive a neurophysiologically realistic inference scheme under the constraint that neurons have direct access only to local image information. The scheme can be interpreted as a network in primary visual cortex where two neural populations are organized in different layers within orientation hypercolumns that are connected by local, short-range and long-range recurrent interactions. When trained with natural images, the model predicts a connectivity structure linking neurons with similar orientation preferences matching the typical patterns found for long-ranging horizontal axons and feedback projections in visual cortex. Subjected to contextual stimuli typically used in empirical studies, our model replicates several hallmark effects of contextual processing and predicts characteristic differences for surround modulation between the two model populations. In summary, our model provides a novel framework for contextual processing in the visual system proposing a well-defined functional role for horizontal axons and feedback projections.

Cortical suppression in human primary visual cortex predicts individual differences in illusory tilt perception

Neural responses to visual stimuli are modulated by spatial and temporal context. For example, in primary visual cortex (V1), responses to an oriented target stimulus will be suppressed when embedded within an oriented surround stimulus. This suppression is orientation-specific, with the largest suppression observed when stimuli in the neuron's classical receptive field and surround are of similar orientation. In human psychological experiments, the tilt illusion and tilt aftereffect demonstrate an effect of context on perceived orientation of a target stimulus. Similar to the neurophysiological data, the strength of these effects is modulated by the orientation difference between the target stimulus and context. It has been hypothesized that the neural mechanism underlying both the tilt illusion and tilt aftereffect involves orientation-tuned inhibition in V1. However, to date there is no direct evidence linking human perception of these illusions with measurements of inhibition from human visual cortex. Here, we measured context-induced suppression of neural responses in human visual cortex using functional magnetic resonance imaging (fMRI). In the same participants, we also measured magnitudes of their tilt illusion and tilt aftereffect. Our data revealed a significant relationship between the magnitude of neural suppression in V1 and size of the tilt illusion and tilt aftereffect. That is, participants who showed stronger blood oxygenation level dependent (BOLD) suppression in V1 also perceived stronger shifts in illusory tilt. This agreement between perception and neural responses in human V1 suggests a shared inhibitory mechanism that mediates both spatial and temporal effects of context in human perception.

Effects of V1 surround modulation tuning on visual saliency and the tilt illusion

Neurons in the primary visual cortex respond to oriented stimuli placed in the center of their receptive field, yet their response is modulated by stimuli outside the receptive field (the surround). Classically, this surround modulation is assumed to be strongest if the orientation of the surround stimulus aligns with the neuron's preferred orientation, irrespective of the actual center stimulus. This neuron-dependent surround modulation has been used to explain a wide range of psychophysical phenomena, such as biased tilt perception and saliency of stimuli with contrasting orientation. However, several neurophysiological studies have shown that for most neurons surround modulation is instead center dependent: it is strongest if the surround orientation aligns with the center stimulus. As the impact of such center-dependent modulation on the population level is unknown, we examine this using computational models. We find that with neuron-dependent modulation the biases in orientation coding, commonly used to explain the tilt illusion, are larger than psychophysically reported, but disappear with center-dependent modulation. Therefore we suggest that a mixture of the two modulation types is necessary to quantitatively explain the psychophysically observed biases. Next, we find that under center-dependent modulation average population responses are more sensitive to orientation differences between stimuli, which in theory could improve saliency detection. However, this effect depends on the specific saliency model. Overall, our results thus show that center-dependent modulation reduces coding bias, while possibly increasing the sensitivity to salient features. NEW & NOTEWORTHY Neural responses in the primary visual cortex are modulated by stimuli surrounding the receptive field. Most earlier studies assume this modulation depends on the neuron's tuning properties, but experiments have shown that instead it depends mostly on the stimulus characteristics. We show that this simple change leads to neural coding that is less biased and under some conditions more sensitive to salient features.

Visually Evoked Response Differences to Contrast and Motion in Children with Autism Spectrum Disorder

High-density electroencephalography (EEG) was used to examine the utility of the P1 event-related potential (ERP) as a marker of visual motion sensitivity to luminance defined low-spatial frequency drifting gratings in 16 children with autism and 16 neurotypical children. Children with autism displayed enhanced sensitivity to large, high-contrast low-spatial frequency stimuli as indexed by significantly shorter P1 response latencies to large vs. small gratings. The current study also found that children with autism had larger amplitude responses to large gratings irrespective of contrast. A linear regression established that P1 adaptive mean amplitude for large, high-contrast sinusoidal gratings significantly predicted hyperresponsiveness item mean scores on the Sensory Experiences Questionnaire for children with autism, but not for neurotypical children. We conclude that children with autism have differences in the mechanisms that underlie low-level visual processing potentially related to altered visual spatial suppression or contrast gain control.

Beyond Rehabilitation of Acuity, Ocular Alignment, and Binocularity in Infantile Strabismus

Infantile strabismus impairs the perception of all attributes of the visual scene. High spatial frequency components are no longer visible, leading to amblyopia. Binocularity is altered, leading to the loss of stereopsis. Spatial perception is impaired as well as detection of vertical orientation, the fastest movements, directions of movement, the highest contrasts and colors. Infantile strabismus also affects other vision-dependent processes such as control of postural stability. But presently, rehabilitative therapies for infantile strabismus by ophthalmologists, orthoptists and optometrists are restricted to preventing or curing amblyopia of the deviated eye, aligning the eyes and, whenever possible, preserving or restoring binocular vision during the critical period of development, i.e., before ~10 years of age. All the other impairments are thus ignored; whether they may recover after strabismus treatment even remains unknown. We argue here that medical and paramedical professionals may extend their present treatments of the perceptual losses associated with infantile strabismus. This hypothesis is based on findings from fundamental research on visual system organization of higher mammals in particular at the cortical level. In strabismic subjects (as in normal-seeing ones), information about all of the visual attributes converge, interact and are thus inter-dependent at multiple levels of encoding ranging from the single neuron to neuronal assemblies in visual cortex. Thus if the perception of one attribute is restored this may help to rehabilitate the perception of other attributes. Concomitantly, vision-dependent processes may also improve. This could occur spontaneously, but still should be assessed and validated. If not, medical and paramedical staff, in collaboration with neuroscientists, will have to break new ground in the field of therapies to help reorganize brain circuitry and promote more comprehensive functional recovery. Findings from fundamental research studies in both young and adult patients already support our hypothesis and are reviewed here. For example, presenting different contrasts to each eye of a strabismic patient during training sessions facilitates recovery of acuity in the amblyopic eye as well as of 3D perception. Recent data also demonstrate that visual recoveries in strabismic subjects improve postural stability. These findings form the basis for a roadmap for future research and clinical development to extend presently applied rehabilitative therapies for infantile strabismus.

Phase-specific Surround suppression in Mouse Primary Visual Cortex Correlates with Figure Detection Behavior Based on Phase Discontinuity

In the primary visual cortex (V1), neuronal responses to stimuli within the receptive field (RF) are modulated by stimuli in the RF surround. A common effect of surround modulation is surround suppression, which is dependent on the feature difference between stimuli within and surround the RF and is suggested to be involved in the perceptual phenomenon of figure-ground segregation. In this study, we examined the relationship between feature-specific surround suppression of V1 neurons and figure detection behavior based on figure-ground feature difference. We trained freely moving mice to perform a figure detection task using figure and ground gratings that differed in spatial phase. The performance of figure detection increased with the figure-ground phase difference, and was modulated by stimulus contrast. Electrophysiological recordings from V1 in head-fixed mice showed that the increase in phase difference between stimuli within and surround the RF caused a reduction in surround suppression, which was associated with an increase in V1 neural discrimination between stimuli with and without RF-surround phase difference. Consistent with the behavioral performance, the sensitivity of V1 neurons to RF-surround phase difference could be influenced by stimulus contrast. Furthermore, inhibiting V1 by optogenetically activating either parvalbumin (PV)- or somatostatin (SOM)-expressing inhibitory neurons both decreased the behavioral performance of figure detection. Thus, the phase-specific surround suppression in V1 represents a neural correlate of figure detection behavior based on figure-ground phase discontinuity.

Increased gamma band activity for lateral interactions in humans

Collinear facilitation of contrast sensitivity supported by lateral interactions within primary visual cortex is implicated in contour and object perception, with neural correlates in several frequency bands. Although higher component of the ERP power spectrum, the gamma-band, is postulated to reflect object representation, attention and memory, its neuronal source has been questioned, suggesting it is an artifact reflecting saccadic eye movements. Here we explored the gamma-band activity during collinear facilitation with no saccade-related confounds. We used single-trial spectral analysis of ERP in occipital channels in a time-window of nearly complete saccadic suppression and discarded sporadic trials containing saccades, in order to avoid saccadic artifacts. Although converging evidence suggests that gamma-band oscillations emerge from local excitatory–inhibitory balance involving GABAergic inhibition, here we show activity amplification during facilitatory collinear interactions, presumably dominated by excitations, in the gamma-band 150–350 milliseconds following onset of low near-threshold contrast stimulus. This result highlights the potential role of gamma-band oscillations in neuronal encoding of basic processes in visual perception. Thus, our findings suggest that gamma-band ERP spectrum analysis may serve as a useful and reliable tool for exploring basic perception, both in normal adults and in special populations.

Normalized value coding explains dynamic adaptation in the human valuation process

The notion of subjective value is central to choice theories in ecology, economics, and psychology, serving as an integrated decision variable by which options are compared. Subjective value is often assumed to be an absolute quantity, determined in a static manner by the properties of an individual option. Recent neurobiological studies, however, have shown that neural value coding dynamically adapts to the statistics of the recent reward environment, introducing an intrinsic temporal context dependence into the neural representation of value. Whether valuation exhibits this kind of dynamic adaptation at the behavioral level is unknown. Here, we show that the valuation process in human subjects adapts to the history of previous values, with current valuations varying inversely with the average value of recently observed items. The dynamics of this adaptive valuation are captured by divisive normalization, linking these temporal context effects to spatial context effects in decision making as well as spatial and temporal context effects in perception. These findings suggest that adaptation is a universal feature of neural information processing and offer a unifying explanation for contextual phenomena in fields ranging from visual psychophysics to economic choice.

Nonuniform surround suppression of visual responses in mouse V1

Complex receptive field characteristics, distributed across a population of neurons, are thought to be critical for solving perceptual inference problems that arise during motion and image segmentation. For example, in a class of neurons referred to as "end-stopped," increasing the length of stimuli outside of the bar-responsive region into the surround suppresses responsiveness. It is unknown whether these properties exist for receptive field surrounds in the mouse. We examined surround modulation in layer 2/3 neurons of the primary visual cortex in mice using two-photon calcium imaging. We found that surround suppression was significantly asymmetric in 17% of the visually responsive neurons examined. Furthermore, the magnitude of asymmetry was correlated with orientation selectivity. Our results demonstrate that neurons in mouse primary visual cortex are differentially sensitive to the addition of elements in the surround and that individual neurons can be described as being either uniformly suppressed by the surround, end-stopped, or side-stopped. NEW & NOTEWORTHY Perception of visual scenes requires active integration of both local and global features to successfully segment objects from the background. Although the underlying circuitry and development of perceptual inference is not well understood, converging evidence indicates that asymmetry and diversity in surround modulation are likely fundamental for these computations. We determined that these key features are present in the mouse. Our results support the mouse as a model to explore the neural basis and development of surround modulation as it relates to perceptual inference.

The neural basis of spatial vision losses in the dysfunctional visual system

Human vision relies on correct information processing from the eye to various visual areas. Disturbances in the visual perception of simple features are believed to come from low-level network (e.g., V1) disruptions. In the present study, we modelled monocular losses in spatial vision through plausible multiple network modifications in early visual coding. We investigated perceptual deficits in anisometropic amblyopia and used the monocular tilt illusion as a probe of primary visual cortex orientation coding and inhibitory interactions. The psychophysical results showed that orientation misperception was higher in amblyopic eyes (AE) than in the fellow and neurotypical eyes and was correlated with the subject’s AE peak contrast sensitivity. The model fitted to the experimental results allowed to split these observations between different network characteristics by showing that these observations were explained by broader orientation tuning widths in AEs and stronger lateral inhibition in abnormal amblyopic system that had strong contrast sensitivity losses. Through psychophysics measures and computational modelling of V1, our study links multiple perceptual changes with localized modifications in the primary visual cortex.

Catching the voltage gradient-asymmetric boost of cortical spread generates motion signals across visual cortex: a brief review with special thanks to Amiram Grinvald

Wide-field voltage imaging is unique in its capability to capture snapshots of activity-across the full gradient of average changes in membrane potentials from subthreshold to suprathreshold levels-of hundreds of thousands of superficial cortical neurons that are simultaneously active. Here, I highlight two examples where voltage-sensitive dye imaging (VSDI) was exploited to track gradual space-time changes of activity within milliseconds across several millimeters of cortex at submillimeter resolution: the line-motion condition, measured in Amiram Grinvald's Laboratory more than 10 years ago and-coming full circle running VSDI in my laboratory-another motion-inducing condition, in which two neighboring stimuli counterchange luminance simultaneously. In both examples, cortical spread is asymmetrically boosted, creating suprathreshold activity drawn out over primary visual cortex. These rapidly propagating waves may integrate brain signals that encode motion independent of direction-selective circuits.

Apparent Motion Suppresses Responses in Early Visual Cortex: A Population Code Model

Two stimuli alternately presented at different locations can evoke a percept of a stimulus continuously moving between the two locations. The neural mechanism underlying this apparent motion (AM) is thought to be increased activation of primary visual cortex (V1) neurons tuned to locations along the AM path, although evidence remains inconclusive. AM masking, which refers to the reduced detectability of stimuli along the AM path, has been taken as evidence for AM-related V1 activation. AM-induced neural responses are thought to interfere with responses to physical stimuli along the path and as such impair the perception of these stimuli. However, AM masking can also be explained by predictive coding models, predicting that responses to stimuli presented on the AM path are suppressed when they match the spatio-temporal prediction of a stimulus moving along the path. In the present study, we find that AM has a distinct effect on the detection of target gratings, limiting the maximum performance at high contrast levels. This masking is strongest when the target orientation is identical to the orientation of the inducers. We developed a V1-like population code model of early visual processing, based on a standard contrast normalization model. We find that AM-related activation in early visual cortex is too small to either cause masking or to be perceived as motion. Our model instead predicts strong suppression of early sensory responses during AM, consistent with the theoretical framework of predictive coding.

Two spatially separate stimuli presented in rapid succession often induce the illusory perception of a moving stimulus (apparent motion or AM). Its underlying mechanism is thought to be increased activation in primary visual cortex representing the motion path. Indirect evidence for this account comes from the reduced detectability of stimuli presented along the motion path (AM masking). Here, we developed a computational model of AM-related effects on visual processing in early visual cortex, which predicted a neural activation that is too small to either account for the observed masking or the perception of motion. Instead, our model predicts strong suppression of neural responses to stimuli presented along the motion path, especially when they match the spatio-temporal prediction of a stimulus moving along the path. Our findings support predictive coding models of visual processing, in which higher-level predictions about motion explain away lower-level responses to expected sensory input.

Decoding information about dynamically occluded objects in visual cortex

During dynamic occlusion, an object passes behind an occluding surface and then later reappears. Even when completely occluded from view, such objects are experienced as continuing to exist or persist behind the occluder even though they are no longer visible. The contents and neural basis of this persistent representation remain poorly understood. Questions remain as to whether there is information maintained about the object itself (i.e. its shape or identity) or non-object-specific information such as its position or velocity as it is tracked behind an occluder, as well as which areas of visual cortex represent such information. Recent studies have found that early visual cortex is activated by "invisible" objects during visual imagery and by unstimulated regions along the path of apparent motion, suggesting that some properties of dynamically occluded objects may also be neurally represented in early visual cortex. We applied functional magnetic resonance imaging in human subjects to examine representations within visual cortex during dynamic occlusion. For gradually occluded, but not for instantly disappearing objects, there was an increase in activity in early visual cortex (V1, V2, and V3). This activity was spatially-specific, corresponding to the occluded location in the visual field. However, the activity did not encode enough information about object identity to discriminate between different kinds of occluded objects (circles vs. stars) using MVPA. In contrast, object identity could be decoded in spatially-specific subregions of higher-order, topographically organized areas such as ventral, lateral, and temporal occipital areas (VO, LO, and TO) as well as the functionally defined LOC and hMT+. These results suggest that early visual cortex may only represent the dynamically occluded object's position or motion path, while later visual areas represent object-specific information.

Chloride Regulation: A Dynamic Equilibrium Crucial for Synaptic Inhibition

Fast synaptic inhibition relies on tight regulation of intracellular Cl(-). Chloride dysregulation is implicated in several neurological and psychiatric disorders. Beyond mere disinhibition, the consequences of Cl(-) dysregulation are multifaceted and best understood in terms of a dynamical system involving complex interactions between multiple processes operating on many spatiotemporal scales. This dynamical perspective helps explain many unintuitive manifestations of Cl(-) dysregulation. Here we discuss how taking into account dynamical regulation of intracellular Cl(-) is important for understanding how synaptic inhibition fails, how to best detect that failure, why Cl(-) regulation is energetically so expensive, and the overall consequences for therapeutics.

Push-Pull Receptive Field Organization and Synaptic Depression: Mechanisms for Reliably Encoding Naturalistic Stimuli in V1

Neurons in the primary visual cortex are known for responding vigorously but with high variability to classical stimuli such as drifting bars or gratings. By contrast, natural scenes are encoded more efficiently by sparse and temporal precise spiking responses. We used a conductance-based model of the visual system in higher mammals to investigate how two specific features of the thalamo-cortical pathway, namely push-pull receptive field organization and fast synaptic depression, can contribute to this contextual reshaping of V1 responses. By comparing cortical dynamics evoked respectively by natural vs. artificial stimuli in a comprehensive parametric space analysis, we demonstrate that the reliability and sparseness of the spiking responses during natural vision is not a mere consequence of the increased bandwidth in the sensory input spectrum. Rather, it results from the combined impacts of fast synaptic depression and push-pull inhibition, the later acting for natural scenes as a form of “effective” feed-forward inhibition as demonstrated in other sensory systems. Thus, the combination of feedforward-like inhibition with fast thalamo-cortical synaptic depression by simple cells receiving a direct structured input from thalamus composes a generic computational mechanism for generating a sparse and reliable encoding of natural sensory events.

Synaptic Correlates of Low-Level Perception in V1

The computational role of primary visual cortex (V1) in low-level perception remains largely debated. A dominant view assumes the prevalence of higher cortical areas and top-down processes in binding information across the visual field. Here, we investigated the role of long-distance intracortical connections in form and motion processing by measuring, with intracellular recordings, their synaptic impact on neurons in area 17 (V1) of the anesthetized cat. By systematically mapping synaptic responses to stimuli presented in the nonspiking surround of V1 receptive fields, we provide the first quantitative characterization of the lateral functional connectivity kernel of V1 neurons. Our results revealed at the population level two structural-functional biases in the synaptic integration and dynamic association properties of V1 neurons. First, subthreshold responses to oriented stimuli flashed in isolation in the nonspiking surround exhibited a geometric organization around the preferred orientation axis mirroring the psychophysical "association field" for collinear contour perception. Second, apparent motion stimuli, for which horizontal and feedforward synaptic inputs summed in-phase, evoked dominantly facilitatory nonlinear interactions, specifically during centripetal collinear activation along the preferred orientation axis, at saccadic-like speeds. This spatiotemporal integration property, which could constitute the neural correlate of a human perceptual bias in speed detection, suggests that local (orientation) and global (motion) information is already linked within V1. We propose the existence of a "dynamic association field" in V1 neurons, whose spatial extent and anisotropy are transiently updated and reshaped as a function of changes in the retinal flow statistics imposed during natural oculomotor exploration.

SIGNIFICANCE STATEMENT

The computational role of primary visual cortex in low-level perception remains debated. The expression of this "pop-out" perception is often assumed to require attention-related processes, such as top-down feedback from higher cortical areas. Using intracellular techniques in the anesthetized cat and novel analysis methods, we reveal unexpected structural-functional biases in the synaptic integration and dynamic association properties of V1 neurons. These structural-functional biases provide a substrate, within V1, for contour detection and, more unexpectedly, global motion flow sensitivity at saccadic speed, even in the absence of attentional processes. We argue for the concept of a "dynamic association field" in V1 neurons, whose spatial extent and anisotropy changes with retinal flow statistics, and more generally for a renewed focus on intracortical computation.

Mild KCC2 Hypofunction Causes Inconspicuous Chloride Dysregulation that Degrades Neural Coding

Disinhibition caused by Cl⁻ dysregulation is implicated in several neurological disorders. This form of disinhibition, which stems primarily from impaired Cl⁻ extrusion through the co-transporter KCC2, is typically identified by a depolarizing shift in GABA reversal potential (E_GABA). Here we show, using computer simulations, that intracellular [Cl⁻] exhibits exaggerated fluctuations during transient Cl⁻ loads and recovers more slowly to baseline when KCC2 level is even modestly reduced. Using information theory and signal detection theory, we show that increased Cl⁻ lability and settling time degrade neural coding. Importantly, these deleterious effects manifest after less KCC2 reduction than needed to produce the gross changes in E_GABA required for detection by most experiments, which assess KCC2 function under weak Cl⁻ load conditions. By demonstrating the existence and functional consequences of “occult” Cl⁻ dysregulation, these results suggest that modest KCC2 hypofunction plays a greater role in neurological disorders than previously believed.

Covariation between Spike and LFP Modulations Revealed with Focal and Asynchronous Stimulation of Receptive Field Surround in Monkey Primary Visual Cortex

A focal visual stimulus outside the classical receptive field (RF) of a V1 neuron does not evoke a spike response by itself, and yet evokes robust changes in the local field potential (LFP). This subthreshold LFP provides a unique opportunity to investigate how changes induced by surround stimulation leads to modulation of spike activity. In the current study, two identical Gabor stimuli were sequentially presented with a variable stimulus onset asynchrony (SOA) ranging from 0 to 100 ms: the first (S1) outside the RF and the second (S2) over the RF of primary visual cortex neurons, while trained monkeys performed a fixation task. This focal and asynchronous stimulation of the RF surround enabled us to analyze the modulation of S2-evoked spike activity and covariation between spike and LFP modulation across SOA. In this condition, the modulation of S2-evoked spike response was dominantly facilitative and was correlated with the change in LFP amplitude, which was pronounced for the cells recorded in the upper cortical layers. The time course of covariation between the SOA-dependent spike modulation and LFP amplitude suggested that the subthreshold LFP evoked by the S1 can predict the magnitude of upcoming spike modulation.

Limitations of short range Mexican hat connection for driving target selection in a 2D neural field: activity suppression and deviation from input stimuli

Dynamic Neural Field models (DNF) often use a kernel of connection with short range excitation and long range inhibition. This organization has been suggested as a model for brain structures or for artificial systems involved in winner-take-all processes such as saliency localization, perceptual decision or target/action selection. A good example of such a DNF is the superior colliculus (SC), a key structure for eye movements. Recent results suggest that the superficial layers of the SC (SCs) exhibit relatively short range inhibition with a longer time constant than excitation. The aim of the present study was to further examine the properties of a DNF with such an inhibition pattern in the context of target selection. First we tested the effects of stimulus size and shape on when and where self-maintained clusters of firing neurons appeared, using three variants of the model. In each model variant, small stimuli led to rapid formation of a spiking cluster, a range of medium sizes led to the suppression of any activity on the network and hence to no target selection, while larger sizes led to delayed selection of multiple loci. Second, we tested the model with two stimuli separated by a varying distance. Again single, none, or multiple spiking clusters could occur, depending on distance and relative stimulus strength. For short distances, activity attracted toward the strongest stimulus, reminiscent of well-known behavioral data for saccadic eye movements, while for larger distances repulsion away from the second stimulus occurred. All these properties predicted by the model suggest that the SCs, or any other neural structure thought to implement a short range MH, is an imperfect winner-take-all system. Although, those properties call for systematic testing, the discussion gathers neurophysiological and behavioral data suggesting that such properties are indeed present in target selection for saccadic eye movements.

Potential roles of the interaction between model V1 neurons with orientation-selective and non-selective surround inhibition in contour detection

Both the neurons with orientation-selective and with non-selective surround inhibition have been observed in the primary visual cortex (V1) of primates and cats. Though the inhibition coming from the surround region (named as non-classical receptive field, nCRF) has been considered playing critical role in visual perception, the specific role of orientation-selective and non-selective inhibition in the task of contour detection is less known. To clarify above question, we first carried out computational analysis of the contour detection performance of V1 neurons with different types of surround inhibition, on the basis of which we then proposed two integrated models to evaluate their role in this specific perceptual task by combining the two types of surround inhibition with two different ways. The two models were evaluated with synthetic images and a set of challenging natural images, and the results show that both of the integrated models outperform the typical models with orientation-selective or non-selective inhibition alone. The findings of this study suggest that V1 neurons with different types of center–surround interaction work in cooperative and adaptive ways at least when extracting organized structures from cluttered natural scenes. This work is expected to inspire efficient phenomenological models for engineering applications in field of computational machine-vision.

Silent suppressive surrounds and optimal spatial frequencies of single neurons in cat V1

The receptive fields of the clear majority of neurons in the primary visual cortex (V1) of cats contain silent surround regions beyond the classical receptive field (CRF). When stimulated on their own, the silent surround regions do not generate action potentials (spikes); instead, they modulate (and usually partially suppress) spike responses to stimuli presented in the CRF. In the present study, we subdivided our sample of single V1 neurons recorded from anesthetized cats into two distinct categories: surround-suppressive (SS) cells and surround-non-suppressive (SN) cells. Consistent with previous reports, we found a negative correlation between the size of the CRF and the optimal spatial frequency (SF) of circular patches of achromatic gratings presented in the cells' receptive fields. Furthermore, we found a positive correlation between the strength of the surround suppression and the optimal spatial frequency of the achromatic gratings presented in the cells' receptive fields. The correlation between the strength of surround suppression and the optimal spatial frequency was stronger in neurons with suppressive regions located in the so-called 'end' zones. The functional implications of these relationships are discussed.

Effects of surround suppression on response adaptation of V1 neurons to visual stimuli

The influence of intracortical inhibition on the response adaptation of visual cortical neurons remains in debate. To clarify this issue, in the present study the influence of surround suppression evoked through the local inhibitory interneurons on the adaptation effects of neurons in the primary visual cortex (V1) were observed. Moreover, the adaptations of V1 neurons to both the high-contrast visual stimuli presented in the classical receptive field (CRF) and to the costimulation presented in the CRF and the surrounding nonclassical receptive field (nCRF) were compared. The intensities of surround suppression were modulated with different sized grating stimuli. The results showed that the response adaptation of V1 neurons decreased significantly with the increase of surround suppression and this adaptation decrease was due to the reduction of the initial response of V1 neurons to visual stimuli. However, the plateau response during adaptation showed no significant changes. These findings indicate that the adaptation effects of V1 neurons may not be directly affected by surround suppression, but may be dynamically regulated by a negative feedback network and be finely adjusted by its initial spiking response to stimulus. This adaptive regulation is not only energy efficient for the central nervous system, but also beneficially acts to maintain the homeostasis of neuronal response to long-presenting visual signals.

On the functions, mechanisms, and malfunctions of intracortical contextual modulation

A broad neuron-centric conception of contextual modulation is reviewed and re-assessed in the light of recent neurobiological studies of amplification, suppression, and synchronization. Behavioural and computational studies of perceptual and higher cognitive functions that depend on these processes are outlined, and evidence that those functions and their neuronal mechanisms are impaired in schizophrenia is summarized. Finally, we compare and assess the long-term biological functions of contextual modulation at the level of computational theory as formalized by the theories of coherent infomax and free energy reduction. We conclude that those theories, together with the many empirical findings reviewed, show how contextual modulation at the neuronal level enables the cortex to flexibly adapt the use of its knowledge to current circumstances by amplifying and grouping relevant activities and by suppressing irrelevant activities.

Multifeature-based surround inhibition improves contour detection in natural images

To effectively perform visual tasks like detecting contours, the visual system normally needs to integrate multiple visual features. Sufficient physiological studies have revealed that for a large number of neurons in the primary visual cortex (V1) of monkeys and cats, neuronal responses elicited by the stimuli placed within the classical receptive field (CRF) are substantially modulated, normally inhibited, when difference exists between the CRF and its surround, namely, non-CRF, for various local features. The exquisite sensitivity of V1 neurons to the center-surround stimulus configuration is thought to serve important perceptual functions, including contour detection. In this paper, we propose a biologically motivated model to improve the performance of perceptually salient contour detection. The main contribution is the multifeature-based center-surround framework, in which the surround inhibition weights of individual features, including orientation, luminance, and luminance contrast, are combined according to a scale-guided strategy, and the combined weights are then used to modulate the final surround inhibition of the neurons. The performance was compared with that of single-cue-based models and other existing methods (especially other biologically motivated ones). The results show that combining multiple cues can substantially improve the performance of contour detection compared with the models using single cue. In general, luminance and luminance contrast contribute much more than orientation to the specific task of contour extraction, at least in gray-scale natural images.

Contextual modulation and stimulus selectivity in extrastriate cortex

Contextual modulation is observed throughout the visual system, using techniques ranging from single-neuron recordings to behavioral experiments. Its role in generating feature selectivity within the retina and primary visual cortex has been extensively described in the literature. Here, we describe how similar computations can also elaborate feature selectivity in the extrastriate areas of both the dorsal and ventral streams of the primate visual system. We discuss recent work that makes use of normalization models to test specific roles for contextual modulation in visual cortex function. We suggest that contextual modulation renders neuronal populations more selective for naturalistic stimuli. Specifically, we discuss contextual modulation's role in processing optic flow in areas MT and MST and for representing naturally occurring curvature and contours in areas V4 and IT. We also describe how the circuitry that supports contextual modulation is robust to variations in overall input levels. Finally, we describe how this theory relates to other hypothesized roles for contextual modulation.

Experience-dependent specialization of receptive field surround for selective coding of natural scenes

At eye opening, neurons in primary visual cortex (V1) are selective for stimulus features, but circuits continue to refine in an experience-dependent manner for some weeks thereafter. How these changes contribute to the coding of visual features embedded in complex natural scenes remains unknown. Here we show that normal visual experience after eye opening is required for V1 neurons to develop a sensitivity for the statistical structure of natural stimuli extending beyond the boundaries of their receptive fields (RFs), which leads to improvements in coding efficiency for full-field natural scenes (increased selectivity and information rate). These improvements are mediated by an experience-dependent increase in the effectiveness of natural surround stimuli to hyperpolarize the membrane potential specifically during RF-stimulus epochs triggering action potentials. We suggest that neural circuits underlying surround modulation are shaped by the statistical structure of visual input, which leads to more selective coding of features in natural scenes.

•

V1 firing is more selective to natural than phase-scrambled surround stimuli

•

Improved selectivity is caused by Vm hyperpolarisation prior to RF-spiking events

•

Natural surround sensitivity is experience dependent, absent in immature/deprived V1

•

Vision shapes circuits to improve V1 coding of natural scenes across RF and surround

Very-long-range disynaptic V1 connections through layer 6 pyramidal neurons revealed by transneuronal tracing with rabies virus

Neurons in primary visual cortex (V1) integrate across the representation of the visual field through networks of long-range projecting pyramidal neurons. These projections, which originate from within V1 and through feedback from higher visual areas, are likely to play a key role in such visual processes as low contrast facilitation and extraclassical surround suppression. The extent of the visual field representation covered by feedback is generally much larger than that covered through monosynaptic horizontal connections within V1, and, although it may be possible that multisynaptic horizontal connections across V1 could also lead to more widespread spatial integration, nothing is known regarding such circuits. In this study, we used injections of the CVS-11 strain of rabies virus to examine disynaptic long-range horizontal connections within macaque monkey V1. Injections were made around the representation of 5° eccentricity in the lower visual field. Along the opercular surface of V1, we found that the majority of connected neurons extended up to 8 mm in most layers, consistent with twice the typically reported distances of monosynaptic connections. In addition, mainly in layer 6, a steady presence of connected neurons within V1 was observed up to 16 mm away. A relatively high percentage of these connected neurons had large-diameter somata characteristic of Meynert cells, which are known to project as far as 8 mm individually. Several neurons, predominantly in layer 6, were also found deep within the calcarine sulcus, reaching as far as 20° of eccentricity, based on estimates, and extending well into the upper visual field representation. Thus, our anatomical results provide evidence for a wide-ranging disynaptic circuit within V1, mediated largely through layer 6, that accounts for integration across a large region of the visual field.

Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain

How the visual field is represented by neurons in the cerebral cortex is one of the most basic questions in visual neuroscience. However, research to date has focused heavily on the small part of the visual field within, and immediately surrounding the fovea. Studies on the cortical representation of the full visual field in the primate brain are still scarce. We have been investigating this issue with electrophysiological and anatomical methods, taking advantage of the small and lissencephalic marmoset brain, which allows easy access to the representation of the full visual field in many cortical areas. This review summarizes our main findings to date, and relates the results to a broader question: is the peripheral visual field processed in a similar manner to the central visual field, but with lower spatial acuity? Given the organization of the visual cortex, the issue can be addressed by asking: (1) Is visual information processed in the same way within a single cortical area? and (2) Are different cortical areas specialized for different parts of the visual field? The electrophysiological data from the primary visual cortex indicate that many aspects of spatiotemporal computation are remarkably similar across the visual field, although subtle variations are detectable. Our anatomical and electrophysiological studies of the extrastriate cortex, on the other hand, suggest that visual processing in the far peripheral visual field is likely to involve a distinct network of specialized cortical areas, located in the depths of the calcarine sulcus and interhemispheric fissure.

Dissociable processes for orientation discrimination learning and contextual illusion magnitude

Previous research suggests an inverse relationship between human orientation discrimination sensitivity and tilt illusion magnitude. To test whether these perceptual functions are inherently linked, we measured both orientation discrimination sensitivity and the magnitude of the tilt illusion before and after participants had been trained for three days on an orientation discrimination task. Discrimination sensitivity improved with training and this improvement remained one month after the initial learning. However, tilt illusion magnitude remained unchanged before and after orientation training, at either trained or untrained orientations. Our results suggest that orientation discrimination sensitivity and illusion magnitude are not inherently linked. They also provide further evidence that, at least for the training periods we employed, perceptual learning of orientation discrimination may involve high-level processes.

Selective stimulation of neurons in visual cortex enables segregation of slow and fast connections

Organization of the central visual pathway is generally studied from a perspective of feedforward processes. However, there are horizontal connections and also strong feedback from extra striate to visual cortex. Here, we use visual stimuli designed to maximize relative differential involvements of these three main types of connections. The approach relies on differences between stimulation within the classical receptive field (CRF) and that of the surround region. Although previous studies have used similar approaches, they were limited primarily to spatial segregation of neural connections. Our experimental design provides clear segregation of fast and slow components of surround modulation. We assume these are mediated by feedback and horizontal connections, respectively, but other factors may be involved. Our results imply that both horizontal and feedback connections contribute to integration of visual information outside the CRF and provide suppressive or facilitative modulation. For a given cell, modulation may change in strength and sign from suppression to facilitation or the reverse depending on surround parameters. Sub-threshold input from the CRF surround increases local field potential (LFP) power in distinct frequency ranges which differ for suppression and facilitation. Horizontal connections have delayed CRF-surround modulation and are sensitive to position changes in the surround. Therefore, surround information beyond the CRF is initially processed by fast connections which we consider to be feedback, whereas spatially tuned mechanisms are relatively slow and presumably mediated by horizontal connections. Overall, results suggest that convergent fast (feedforward) inputs determine size and structure of the CRFs of recipient cells in visual cortex. And fast connections from extra striate regions (feedback) plus slow-tuned connections (horizontal) within visual cortex contribute to spatial influences of CRF surround activation.

Impaired functional organization in the visual cortex of muscarinic receptor knock-out mice

Acetylcholine modulates maturation and neuronal activity through muscarinic and nicotinic receptors in the primary visual cortex. However, the specific contribution of different muscarinic receptor subtypes in these neuromodulatory mechanisms is not fully understood. The present study evaluates in vivo the functional organization and the properties of the visual cortex of different groups of muscarinic receptor knock-out (KO) mice. Optical imaging of intrinsic signals coupled to continuous and episodic visual stimulation paradigms was used. Retinotopic maps along elevation and azimuth were preserved among the different groups of mice. However, compared to their wild-type counterparts, the apparent visual field along elevation was larger in M2/M4-KO mice but smaller in M1-KO. There was a reduction in the estimated relative receptive field size of V1 neurons in M1/M3-KO and M1-KO mice. Spatial frequency and contrast selectivity of V1 neuronal populations were affected only in M1/M3-KO and M1-KO mice. Finally, the neuronal connectivity was altered by the absence of M2/M4 muscarinic receptors. All these effects suggest the distinct roles of different subtypes of muscarinic receptors in the intrinsic organization of V1 and a strong involvement of the muscarinic transmission in the detectability of visual stimuli.