Anatomical origins of the classical receptive field and modulatory surround field of single neurons in macaque visual cortical area V1

Adaptation of the inferior temporal neurons and efficient visual processing

Numerous studies examining the responses of individual neurons in the inferior temporal (IT) cortex have revealed their characteristics such as two-dimensional or three-dimensional shape tuning, objects, or category selectivity. While these basic selectivities have been studied assuming that their response to stimuli is relatively stable, physiological experiments have revealed that the responsiveness of IT neurons also depends on visual experience. The activity changes of IT neurons occur over various time ranges; among these, repetition suppression (RS), in particular, is robustly observed in IT neurons without any behavioral or task constraints. I observed a similar phenomenon in the ventral visual neurons in macaque monkeys while they engaged in free viewing and actively fixated on one consistent object multiple times. This observation indicates that the phenomenon also occurs in natural situations during which the subject actively views stimuli without forced fixation, suggesting that this phenomenon is an everyday occurrence and widespread across regions of the visual system, making it a default process for visual neurons. Such short-term activity modulation may be a key to understanding the visual system; however, the circuit mechanism and the biological significance of RS remain unclear. Thus, in this review, I summarize the observed modulation types in IT neurons and the known properties of RS. Subsequently, I discuss adaptation in vision, including concepts such as efficient and predictive coding, as well as the relationship between adaptation and psychophysical aftereffects. Finally, I discuss some conceptual implications of this phenomenon as well as the circuit mechanisms and the models that may explain adaptation as a fundamental aspect of visual processing.

A neural modeling approach to study mechanisms underlying the heterogeneity of visual spatial frequency sensitivity in schizophrenia

Patients with schizophrenia exhibit abnormalities in spatial frequency sensitivity, and it is believed that these abnormalities indicate more widespread dysfunction and dysregulation of bottom-up processing. The early visual system, including the first-order Lateral Geniculate Nucleus of the thalamus (LGN) and the primary visual cortex (V1), are key contributors to spatial frequency sensitivity. Medicated and unmedicated patients with schizophrenia exhibit contrasting changes in spatial frequency sensitivity, thus making it a useful probe for examining potential effects of the disorder and antipsychotic medications in neural processing. We constructed a parameterized, rate-based neural model of on-center/off-surround neurons in the early visual system to investigate the impacts of changes to the excitatory and inhibitory receptive field subfields. By incorporating changes in both the excitatory and inhibitory subfields that are associated with pathophysiological findings in schizophrenia, the model successfully replicated perceptual data from behavioral/functional studies involving medicated and unmedicated patients. Among several plausible mechanisms, our results highlight the dampening of excitation and/or increase in the spread and strength of the inhibitory subfield in medicated patients and the contrasting decreased spread and strength of inhibition in unmedicated patients. Given that the model was successful at replicating results from perceptual data under a variety of conditions, these elements of the receptive field may be useful markers for the imbalances seen in patients with schizophrenia.

Bounded contribution of human early visual cortex to the topographic anisotropy in spatial extent perception

To interact successfully with objects, it is crucial to accurately perceive their spatial extent, an enclosed region they occupy in space. Although the topographic representation of space in the early visual cortex (EVC) has been favored as a neural correlate of spatial extent perception, its exact nature and contribution to perception remain unclear. Here, we inspect the topographic representations of human individuals' EVC and perception in terms of how much their anisotropy is influenced by the orientation (co-axiality) and radial position (radiality) of stimuli. We report that while the anisotropy is influenced by both factors, its direction is primarily determined by radiality in EVC but by co-axiality in perception. Despite this mismatch, the individual differences in both radial and co-axial anisotropy are substantially shared between EVC and perception. Our findings suggest that spatial extent perception builds on EVC's spatial representation but requires an additional mechanism to transform its topographic bias.

A neural modeling approach to study mechanisms underlying the heterogeneity of visual spatial frequency sensitivity in schizophrenia

Patients with schizophrenia exhibit abnormalities in spatial frequency sensitivity, and it is believed that these abnormalities indicate more widespread dysfunction and dysregulation of bottom-up processing. The early visual system, including the first-order Lateral Geniculate Nucleus of the thalamus (LGN) and the primary visual cortex (V1), are key contributors to spatial frequency sensitivity. Medicated and unmedicated patients with schizophrenia exhibit contrasting changes in spatial frequency sensitivity, thus making it a useful probe for examining potential effects of the disorder and antipsychotic medications in neural processing. We constructed a parameterized, rate-based neural model of on-center/off-surround neurons in the early visual system to investigate the impacts of changes to the excitatory and inhibitory receptive field subfields. By incorporating changes in both the excitatory and inhibitory subfields that are associated with pathophysiological findings in schizophrenia, the model successfully replicated perceptual data from behavioral/functional studies involving medicated and unmedicated patients. Among several plausible mechanisms, our results highlight the dampening of excitation and/or increase in the spread and strength of the inhibitory subfield in medicated patients and the contrasting decreased spread and strength of inhibition in unmedicated patients. Given that the model was successful at replicating results from perceptual data under a variety of conditions, these elements of the receptive field may be useful markers for the imbalances seen in patients with schizophrenia.

Spiking neural P systems with lateral inhibition

As a member of the third generation of artificial neural network models, spiking neural P systems (SN P systems) have gained a hot research spot in recent years. This work introduces the phenomenon of lateral inhibition in biological nervous systems into SN P systems, and proposes SN P systems with lateral inhibition (LISN P systems). LISN P systems add the property of synaptic length to portray the lateral distance between neurons, and adopt a new form of rules, lateral interaction rules, to describe the reception of spikes by postsynaptic neurons with different lateral distances from the presynaptic neuron. Specifically, an excited neuron produces lateral inhibition on surrounding postsynaptic neurons. Postsynaptic neurons close to the excited neuron, i.e., neurons with small lateral distances, are more susceptible to lateral inhibition and either receive a fewer number of spikes generated by the excited neuron or fail to receive spikes. As the lateral distance increases, the lateral inhibition weakens, and the number of spikes received by postsynaptic neurons increases. Based on the above mechanism, four specific LISN P systems are designed for generating arbitrary odd numbers, arbitrary even numbers, arbitrary natural numbers and arithmetic series, respectively, as examples. By designing working modules, LISN P systems provide equivalence in computational power to the universal register machines in both generating and accepting modes. This verifies the computational completeness of LISN P systems. A universal LISN P system using merely 65 neurons is devised for function computation. According to comparisons among several systems, universal LISN P systems require fewer computational resources.

A neural model of modified excitation/inhibition and feedback levels in schizophrenia

Introduction

The strength of certain visual illusions, including contrast-contrast and apparent motion, is weakened in individuals with schizophrenia. Such phenomena have been interpreted as the impaired integration of inhibitory and excitatory neural responses, and impaired top-down feedback mechanisms.

Methods

To investigate whether and how these factors influence the perceived contrast-contrast and apparent motion illusions in individuals with schizophrenia, we propose a two-layer network, with top-down feedback from layer 2 to layer 1 that can model visual receptive fields (RFs) and their inhibitory and excitatory subfields.

Results

Our neural model suggests that illusion perception changes in individuals with schizophrenia can be influenced by altered top-down mechanisms and the organization of the on-center off-surround receptive fields. Alteration of the RF inhibitory surround and/or the excitatory center can replicate the difference of illusion precepts between individuals with schizophrenia within certain clinical states and normal controls. The results show that the simulated top-down feedback modulation enlarges the difference of the model illusion representations, replicating the difference between the two groups.

Discussion

We propose that the heterogeneity of visual and in general sensory processing in certain clinical states of schizophrenia can be largely explained by the degree of top-down feedback reduction, emphasizing the critical role of top-down feedback in illusion perception, and to a lesser extent on the imbalance of excitation/inhibition. Our neural model provides a mechanistic explanation for the modulated visual percepts of contrast-contrast and apparent motion in schizophrenia with findings that can explain a broad range of visual perceptual observations in previous studies. The two-layer motif of the current model provides a general framework that can be tailored to investigate subcortico-cortical (such as thalamocortical) and cortico-cortical networks, bridging neurobiological changes in schizophrenia and perceptual processing.

The Spatial Precision of Contextual Feedback Signals in Human V1

Neurons in the primary visual cortex (V1) receive sensory inputs that describe small, local regions of the visual scene and cortical feedback inputs from higher visual areas processing the global scene context. Investigating the spatial precision of this visual contextual modulation will contribute to our understanding of the functional role of cortical feedback inputs in perceptual computations. We used human functional magnetic resonance imaging (fMRI) to test the spatial precision of contextual feedback inputs to V1 during natural scene processing. We measured brain activity patterns in the stimulated regions of V1 and in regions that we blocked from direct feedforward input, receiving information only from non-feedforward (i.e., feedback and lateral) inputs. We measured the spatial precision of contextual feedback signals by generalising brain activity patterns across parametrically spatially displaced versions of identical images using an MVPA cross-classification approach. We found that fMRI activity patterns in cortical feedback signals predicted our scene-specific features in V1 with a precision of approximately 4 degrees. The stimulated regions of V1 carried more precise scene information than non-stimulated regions; however, these regions also contained information patterns that generalised up to 4 degrees. This result shows that contextual signals relating to the global scene are similarly fed back to V1 when feedforward inputs are either present or absent. Our results are in line with contextual feedback signals from extrastriate areas to V1, describing global scene information and contributing to perceptual computations such as the hierarchical representation of feature boundaries within natural scenes.

Severely Attenuated Visual Feedback Processing in Children on the Autism Spectrum

Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened "priors" may play a role in the visual processing anomalies seen in autism.SIGNIFICANCE STATEMENT Children on the autism spectrum differ from typically developing children in many aspects of their processing of sensory stimuli. One proposed mechanism for these differences is an imbalance in higher-order feedback to primary sensory regions, leading to an increased focus on local object features rather than global context. However, systematic investigation of these feedback mechanisms remains limited. Using EEG and a visual illusion paradigm that is highly dependent on intact feedback processing, we demonstrated significant disruptions to visual feedback processing in children with autism. This provides much needed experimental evidence that advances our understanding of the contribution of feedback processing to visual perception in autism spectrum disorder.

Clinical utilization of fast-acting sub-perception therapy (FAST) in SCS-implanted patients for treatment of mixed pain

Objectives

A significant proportion of patients with chronic pain exhibit mixed pain and thus do not display symptoms exclusively associated with either nociceptive or neuropathic pain syndromes. We aimed to explore whether Fast-Acting Sub-Perception Therapy, FAST - a new Spinal Cord Stimulation (SCS)-based approach capable of inducing a rapid-onset of analgesia using electrical neurostimulation applied below patient-perception threshold - could potentially be useful as a treatment for chronic mixed pain.

Methods

Fourteen consecutively-enrolled patients diagnosed with chronic mixed pain and implanted with an SCS device were enrolled in this single-center case-series. All patients completed a validated, self-administered painDETECT questionnaire prior to SCS-device implantation (baseline). The painDETECT questionnaire was used to characterize each patient's chronic pain as likely neuropathic only, uncertain (but potential for presence of a non-neuropathic component), or likely presence of a non-neuropathic component. Overall pain scores (Numeric Rating Scale, NRS), Oswestry Disability Index (ODI) and Quality-of-life (EQ-5D-5L) were collected (per standard-of-care) at baseline, 3-months, and 6-months post-implantation.

Results

The average age of those assessed in this study was 64.7 ​± ​11.5 (SD) years and 43% (6/14) were female. Fifty-percent (7/14) of patients were classified with non-neuropathic pain (painDETECT), while the remainder exhibited chronic pain that could not be characterized as either neuropathic or non-neuropathic (uncertain). Mean overall pain (NRS) among all patients was 8.3 ​± ​0.3 (SE) at baseline. At 6-months post-implant, a mean 6.9-points NRS score reduction was observed (1.4 ​± ​0.3 (SE); p ​< ​0.0001). Notable improvements in disability (ODI) and Quality of Life (EQ-5D-5L) were also observed at 6-month follow-up.

Conclusions

The data from this observational case-series indicate that FAST-SCS can improve outcomes in patients reporting complex symptoms of mixed pain with a likely non-neuropathic component. These results suggest that neurostimulation modalities such as FAST may be a suitable treatment approach for non-neuropathic pain indications.

Cascaded normalizations for spatial integration in the primary visual cortex of primates

Spatial integration of visual information is an important function in the brain. However, neural computation for spatial integration in the visual cortex remains unclear. In this study, we recorded laminar responses in V1 of awake monkeys driven by visual stimuli with grating patches and annuli of different sizes. We find three important response properties related to spatial integration that are significantly different between input and output layers: neurons in output layers have stronger surround suppression, smaller receptive field (RF), and higher sensitivity to grating annuli partially covering their RFs. These interlaminar differences can be explained by a descriptive model composed of two global divisions (normalization) and a local subtraction. Our results suggest suppressions with cascaded normalizations (CNs) are essential for spatial integration and laminar processing in the visual cortex. Interestingly, the features of spatial integration in convolutional neural networks, especially in lower layers, are different from our findings in V1.

Stimulus dependence of directed information exchange between cortical layers in macaque V1

Perception and cognition require the integration of feedforward sensory information with feedback signals. Using different sized stimuli, we isolate spectral signatures of feedforward and feedback signals, and their effect on communication between layers in primary visual cortex of male macaque monkeys. Small stimuli elicited gamma frequency oscillations predominantly in the superficial layers. These Granger-causally originated in upper layer 4 and lower supragranular layers. Unexpectedly, large stimuli generated strong narrow band gamma oscillatory activity across cortical layers. They Granger-causally arose in layer 5, were conveyed through layer six to superficial layers, and violated existing models of feedback spectral signatures. Equally surprising, with large stimuli, alpha band oscillatory activity arose predominantly in granular and supragranular layers and communicated in a feedforward direction. Thus, oscillations in specific frequency bands are dynamically modulated to serve feedback and feedforward communication and are not restricted to specific cortical layers in V1.

Predictive masking of an artificial scotoma is associated with a system-wide reconfiguration of neural populations in the human visual cortex

The visual brain has the remarkable capacity to complete our percept of the world even when the information extracted from the visual scene is incomplete. This ability to predict missing information based on information from spatially adjacent regions is an intriguing attribute of healthy vision. Yet, it gains particular significance when it masks the perceptual consequences of a retinal lesion, leaving patients unaware of their partial loss of vision and ultimately delaying diagnosis and treatment. At present, our understanding of the neural basis of this masking process is limited which hinders both quantitative modeling as well as translational application. To overcome this, we asked the participants to view visual stimuli with and without superimposed artificial scotoma (AS). We used fMRI to record the associated cortical activity and applied model-based analyzes to track changes in cortical population receptive fields and connectivity in response to the introduction of the AS. We found that throughout the visual field and cortical hierarchy, pRFs shifted their preferred position towards the AS border. Moreover, extrastriate areas biased their sampling of V1 towards sections outside the AS projection zone, thereby effectively masking the AS with signals from spared portions of the visual field. We speculate that the signals that drive these system-wide population modifications originate in extrastriate visual areas and, through feedback, also reconfigure the neural populations in the earlier visual areas.

Recurrent dynamics in the cerebral cortex: Integration of sensory evidence with stored knowledge

Current concepts of sensory processing in the cerebral cortex emphasize serial extraction and recombination of features in hierarchically structured feed-forward networks in order to capture the relations among the components of perceptual objects. These concepts are implemented in convolutional deep learning networks and have been validated by the astounding similarities between the functional properties of artificial systems and their natural counterparts. However, cortical architectures also display an abundance of recurrent coupling within and between the layers of the processing hierarchy. This massive recurrence gives rise to highly complex dynamics whose putative function is poorly understood. Here a concept is proposed that assigns specific functions to the dynamics of cortical networks and combines, in a unifying approach, the respective advantages of recurrent and feed-forward processing. It is proposed that the priors about regularities of the world are stored in the weight distributions of feed-forward and recurrent connections and that the high-dimensional, dynamic space provided by recurrent interactions is exploited for computations. These comprise the ultrafast matching of sensory evidence with the priors covertly represented in the correlation structure of spontaneous activity and the context-dependent grouping of feature constellations characterizing natural objects. The concept posits that information is encoded not only in the discharge frequency of neurons but also in the precise timing relations among the discharges. Results of experiments designed to test the predictions derived from this concept support the hypothesis that cerebral cortex exploits the high-dimensional recurrent dynamics for computations serving predictive coding.

Signals Related to Color in the Early Visual Cortex

Visual images can be described in terms of the illuminants and objects that are causal to the light reaching the eye, the retinal image, its neural representation, or how the image is perceived. Respecting the differences among these distinct levels of description can be challenging but is crucial for a clear understanding of color vision. This article approaches color by reviewing what is known about its neural representation in the early visual cortex, with a brief description of signals in the eye and the thalamus for context. The review focuses on the properties of single neurons and advances the general theme that experimental approaches based on knowledge of feedforward signals have promoted greater understanding of the neural code for color than approaches based on correlating single-unit responses with color perception. New data from area V1 illustrate the strength of the feedforward approach. Future directions for progress in color neurophysiology are discussed: techniques for improved single-neuron characterization, for investigations of neural populations and small circuits, and for the analysis of natural image statistics.

Changes in Corticospinal Circuits During Premovement Facilitation in Physiological Conditions

Changes in corticospinal excitability have been well documented in the preparatory period before movement, however, their mechanisms and physiological role have not been entirely elucidated. We aimed to investigate the functional changes of excitatory corticospinal circuits during a reaction time (RT) motor task (thumb abduction) in healthy subjects (HS). 26 HS received single pulse transcranial magnetic stimulation (TMS) over the primary motor cortex (M1). After a visual go signal, we calculated RT and delivered TMS at three intervals (50, 100, and 150 ms) within RT and before movement onset, recording motor evoked potentials (MEP) from the abductor pollicis brevis (APB) and the task-irrelevant abductor digiti minimi (ADM). We found that TMS increased MEP_APB amplitude when delivered at 150, 100, and 50 ms before movement onset, demonstrating the occurrence of premovement facilitation (PMF). MEP increase was greater at the shorter interval (MEP₅₀) and restricted to APB (no significant effects were detected recording from ADM). We also reported time-dependent changes of the RT and a TMS side-dependent effect on MEP amplitude (greater on the dominant side). In conclusion, we here report changes of RT and side-dependent, selective and facilitatory effects on the MEP_APB amplitude when TMS is delivered before movement onset (PMF), supporting the role of excitatory corticospinal mechanisms at the basis of the selective PMF of the target muscle during the RT protocol.

Early recurrence enables figure border ownership

Rubin's face-vase illusion demonstrates how one can switch back and forth between two different interpretations depending on how the figure outlines are assigned. In the primate visual system, assigning ownership along figure borders is encoded by neurons called the border ownership (BO) cells. Studies show that the responses of these neurons not only depend on the local features within their receptive fields, but also on contextual information. Despite two decades of studies on BO neurons, the ownership assignment mechanism in the brain is still unknown. Here, we propose a hierarchical recurrent model grounded on the hypothesis that neurons in the dorsal stream provide the context required for ownership assignment. Our proposed model incorporates early recurrence from the dorsal pathway as well as lateral modulations within the ventral stream. While dorsal modulations initiate the response difference to figure on either side of the border, lateral modulations enhance the difference. We found responses of our dorsally-modulated BO cells, similar to their biological counterparts, are invariant to size, position and solid/outlined figures. Moreover, our model BO cells exhibit comparable levels of reliability in the ownership signal to biological BO neurons. We found dorsal modulations result in high levels of accuracy and robustness for BO assignments in complex scenes compared to previous models based on ventral feedback. Finally, our experiments with illusory contours suggest that BO encoding could explain the perception of such contours in higher processing stages in the brain.

Stream-specific feedback inputs to the primate primary visual cortex

The sensory neocortex consists of hierarchically-organized areas reciprocally connected via feedforward and feedback circuits. Feedforward connections shape the receptive field properties of neurons in higher areas within parallel streams specialized in processing specific stimulus attributes. Feedback connections have been implicated in top-down modulations, such as attention, prediction and sensory context. However, their computational role remains unknown, partly because we lack knowledge about rules of feedback connectivity to constrain models of feedback function. For example, it is unknown whether feedback connections maintain stream-specific segregation, or integrate information across parallel streams. Using viral-mediated labeling of feedback connections arising from specific cytochrome-oxidase stripes of macaque visual area V2, here we show that feedback to the primary visual cortex (V1) is organized into parallel streams resembling the reciprocal feedforward pathways. This suggests that functionally-specialized V2 feedback channels modulate V1 responses to specific stimulus attributes, an organizational principle potentially extending to feedback pathways in other sensory systems.

Coding Perceptual Decisions: From Single Units to Emergent Signaling Properties in Cortical Circuits

Spiking activity in single neurons of the primate visual cortex has been tightly linked to perceptual decisions. Any mechanism that reads out these perceptual signals to support behavior must respect the underlying neuroanatomy that shapes the functional properties of sensory neurons. Spatial distribution and timing of inputs to the next processing levels are critical, as conjoint activity of precursor neurons increases the spiking rate of downstream neurons and ultimately drives behavior. I set out how correlated activity might coalesce into a micropool of task-sensitive neurons signaling a particular percept to determine perceptual decision signals locally and for flexible interarea transmission depending on the task context. As data from more and more neurons and their complex interactions are analyzed, the space of computational mechanisms must be constrained based on what is plausible within neurobiological limits. This review outlines experiments to test the new perspectives offered by these extended methods.

Postnatal Development of Visual Cortical Function in the Mammalian Brain

This review aims to discuss (1) the refinement of mammalian visual cortical circuits and the maturation of visual functions they subserve in primary visual cortex (V1) and other visual cortical areas, and (2) existing evidence supporting the notion of differential rates of maturation of visual functions in different species. It is well known that different visual functions and their underlying circuitry mature and attain adultlike characteristics at different stages in postnatal development with varying growth rates. The developmental timecourse and duration of refinement varies significantly both in V1 of various species and among different visual cortical areas; while basic visual functions like spatial acuity mature earlier requiring less time, higher form perception such as contour integration is more complex and requires longer postnatal time to refine. This review will highlight the importance of systematic comparative analysis of the differential rates of refinement of visual circuitry and function as that may help reveal underlying key mechanisms necessary for healthy visual development during infancy and adulthood. This type of approach will help future studies to establish direct links between various developmental aspects of different visual cortical areas in both human and animal models; thus enhancing our understanding of vision related neurological disorders and their potential therapeutic remedies.

The growth of cognition: Free energy minimization and the embryogenesis of cortical computation

The assumption that during cortical embryogenesis neurons and synaptic connections are selected to form an ensemble maximising synchronous oscillation explains mesoscopic cortical development, and a mechanism for cortical information processing is implied by consistency with the Free Energy Principle and Dynamic Logic. A heteroclinic network emerges, with stable and unstable fixed points of oscillation corresponding to activity in symmetrically connected, versus asymmetrically connected, sets of neurons. Simulations of growth explain a wide range of anatomical observations for columnar and non-columnar cortex, superficial patch connections, and the organization and dynamic interactions of neurone response properties. An antenatal scaffold is created, upon which postnatal learning can establish continuously ordered neuronal representations, permitting matching of co-synchronous fields in multiple cortical areas to solve optimization problems as in Dynamic Logic. Fast synaptic competition partitions equilibria, minimizing "the curse of dimensionality", while perturbations between imperfectly partitioned synchronous fields, under internal reinforcement, enable the cortex to become adaptively self-directed. As learning progresses variational free energy is minimized and entropy bounded.

Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models

The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.

Diversity of Feature Selectivity in Macaque Visual Cortex Arising from a Limited Number of Broadly Tuned Input Channels

Spike (action potential) responses of most primary visual cortical cells in the macaque are sharply tuned for the orientation of a line or an edge, and neurons preferring similar orientations are clustered together in cortical columns. The preferred stimulus orientation of these columns span the full range of orientations, as observed in recordings of spikes and in classical optical imaging of intrinsic signals. However, when we imaged the putative thalamic input to striate cortical cells that can be seen in imaging of intrinsic signals when they are analyzed on a larger spatial scale, we found that the orientation domain map of the primary visual cortex did not show the same diversity of orientations. This map was dominated by just the one orientation that is most commonly preferred by neurons in the retina and the lateral geniculate nucleus. This supports cortical feature selectivity and columnar architecture being built upon feed-forward signals transmitted from the thalamus in a very limited number of broadly tuned input channels.

Altered dynamics of visual contextual interactions in Parkinson's disease

Over the last decades, psychophysical and electrophysiological studies in patients and animal models of Parkinson's disease (PD), have consistently revealed a number of visual abnormalities. In particular, specific alterations of contrast sensitivity curves, electroretinogram (ERG), and visual-evoked potentials (VEP), have been attributed to dopaminergic retinal depletion. However, fundamental mechanisms of cortical visual processing, such as normalization or "gain control" computations, have not yet been examined in PD patients. Here, we measured electrophysiological indices of gain control in both space (surround suppression) and time (sensory adaptation) in PD patients based on steady-state VEP (ssVEP). Compared with controls, patients exhibited a significantly higher initial ssVEP amplitude that quickly decayed over time, and greater relative suppression of ssVEP amplitude as a function of surrounding stimulus contrast. Meanwhile, EEG frequency spectra were broadly elevated in patients relative to controls. Thus, contrary to what might be expected given the reduced contrast sensitivity often reported in PD, visual neural responses are not weaker; rather, they are initially larger but undergo an exaggerated degree of spatial and temporal gain control and are embedded within a greater background noise level. These differences may reflect cortical mechanisms that compensate for dysfunctional center-surround interactions at the retinal level.

Intracortical Inhibition and Surround Inhibition in the Motor Cortex: A TMS-EEG Study

BACKGROUND

Short-latency intracortical inhibition (SICI) and motor surround inhibition (mSI) are cortical phenomena that have been investigated with transcranial magnetic stimulation (TMS). mSI is believed to be necessary for the execution of fine finger movements, SICI may participate in mSI genesis, and however, the mechanisms underlying both mSI and SICI are not entirely clear.

OBJECTIVE

We explored the cortical physiology of SICI and mSI in healthy subjects by TMS-evoked cortical potentials (TEPs).

METHODS

Single (sp) and paired-pulse (pp) TMS were delivered on the ADM muscle cortical hotspot while recording EEG and EMG. Three conditions were tested: spTMS and ppTMS at rest, and spTMS at the onset of an index finger movement. SICI and mSI were calculated on the ADM motor evoked potential (MEP) and two groups were defined based on the presence of mSI. Average TEPs were calculated for each condition and for five regions of interest.

RESULTS

At movement onset we observed a widespread reduction of the inhibitory late component N100 suggesting cortical facilitation associated with motor performance. At motor cortex level, SICI and mSI are associated with similar modulation of TEPs consisting in a reduction of P30 and an increase of N45 amplitude.

CONCLUSION

Our findings suggest that SICI and mSI modulate cortical excitability with shared inhibitory mechanisms.

Working memory capacity is enhanced by distributed prefrontal activation and invariant temporal dynamics

The amount of information that can be stored in working memory is limited but may be improved with practice. The basis of improved efficiency at the level of neural activity is unknown. To investigate this question, we trained monkeys to perform a working memory task that required memory for multiple stimuli. Performance decreased as a function of number of stimuli to be remembered, but improved as the animals practiced the task. Neuronal recordings acquired during this training revealed two hitherto unknown mechanisms of working memory capacity improvement. First, more prefrontal neurons became active as working memory improved, but their baseline activity decreased. Second, improved working memory capacity was characterized by less variable temporal dynamics, resulting in a more consistent firing rate at each time point during the course of a trial. Our results reveal that improved performance of working memory tasks is achieved through more distributed activation and invariant neuronal dynamics.

Scale-Invariant Visual Capabilities Explained by Topographic Representations of Luminance and Texture in Primate V1

Humans have remarkable scale-invariant visual capabilities. For example, our orientation discrimination sensitivity is largely constant over more than two orders of magnitude of variations in stimulus spatial frequency (SF). Orientation-selective V1 neurons are likely to contribute to orientation discrimination. However, because at any V1 location neurons have a limited range of receptive field (RF) sizes, we predict that at low SFs V1 neurons will carry little orientation information. If this were the case, what could account for the high behavioral sensitivity at low SFs? Using optical imaging in behaving macaques, we show that, as predicted, V1 orientation-tuned responses drop rapidly with decreasing SF. However, we reveal a surprising coarse-scale signal that corresponds to the projection of the luminance layout of low-SF stimuli to V1's retinotopic map. This homeomorphic and distributed representation, which carries high-quality orientation information, is likely to contribute to our striking scale-invariant visual capabilities.

Development of Cross-Orientation Suppression and Size Tuning and the Role of Experience

Many sensory neural circuits exhibit response normalization, which occurs when the response of a neuron to a combination of multiple stimuli is less than the sum of the responses to the individual stimuli presented alone. In the visual cortex, normalization takes the forms of cross-orientation suppression and surround suppression. At the onset of visual experience, visual circuits are partially developed and exhibit some mature features such as orientation selectivity, but it is unknown whether cross-orientation suppression is present at the onset of visual experience or requires visual experience for its emergence. We characterized the development of normalization and its dependence on visual experience in female ferrets. Visual experience was varied across the following three conditions: typical rearing, dark rearing, and dark rearing with daily exposure to simple sinusoidal gratings (14-16 h total). Cross-orientation suppression and surround suppression were noted in the earliest observations, and did not vary considerably with experience. We also observed evidence of continued maturation of receptive field properties in the second month of visual experience: substantial length summation was observed only in the oldest animals (postnatal day 90); evoked firing rates were greatly increased in older animals; and direction selectivity required experience, but declined slightly in older animals. These results constrain the space of possible circuit implementations of these features.SIGNIFICANCE STATEMENT The development of the brain depends on both nature-factors that are independent of the experience of an individual animal-and nurture-factors that depend on experience. While orientation selectivity, one of the major response properties of neurons in visual cortex, is already present at the onset of visual experience, it is unknown whether response properties that depend on interactions among multiple stimuli develop without experience. We find that the properties of cross-orientation suppression and surround suppression are present at eye opening, and do not depend on visual experience. Our results are consistent with the idea that a majority of the basic properties of sensory neurons in primary visual cortex are derived independent of the experience of an individual animal.

Surround inhibition can instantly be modulated by changing the attentional focus

To further investigate the mechanism of surround inhibition (SI) and to determine whether adopting different attentional strategies might have an impact on the modulation of SI, the effects of adopting an external (EF) or internal focus of attention (IF) on SI and motor performance were investigated. While performing an index flexion with either an EF or IF, transcranial magnetic stimulation was applied at various time points in 14 healthy subjects. When adopting an EF compared to an IF, the results show an improved motor performance (+14.7% in MVC) and a reduced bEMG in the adjacent APB (−22.3%) during maximal index flexion. This was accompanied by an increased SI in the APB with an EF (+26.4%). Additionally, the decrease in bEMG correlated with the magnitude of SI in APB. The current results demonstrate an efficient way to modulate SI by changing the attentional focus in healthy subjects and might, at least in part, explain the better motor performance being associated with an EF. The present findings help to better understand the positive mechanisms of an EF on SI in the healthy motor system and may also points towards a treatment strategy in pathologies with disturbed SI such as focal hand dystonia.

Multi-scale account of the network structure of macaque visual cortex

Cortical network structure has been extensively characterized at the level of local circuits and in terms of long-range connectivity, but seldom in a manner that integrates both of these scales. Furthermore, while the connectivity of cortex is known to be related to its architecture, this knowledge has not been used to derive a comprehensive cortical connectivity map. In this study, we integrate data on cortical architecture and axonal tracing data into a consistent multi-scale framework of the structure of one hemisphere of macaque vision-related cortex. The connectivity model predicts the connection probability between any two neurons based on their types and locations within areas and layers. Our analysis reveals regularities of cortical structure. We confirm that cortical thickness decays with cell density. A gradual reduction in neuron density together with the relative constancy of the volume density of synapses across cortical areas yields denser connectivity in visual areas more remote from sensory inputs and of lower structural differentiation. Further, we find a systematic relation between laminar patterns on source and target sides of cortical projections, extending previous findings from combined anterograde and retrograde tracing experiments. Going beyond the classical schemes, we statistically assign synapses to target neurons based on anatomical reconstructions, which suggests that layer 4 neurons receive substantial feedback input. Our derived connectivity exhibits a community structure that corresponds more closely with known functional groupings than previous connectivity maps and identifies layer-specific directional differences in cortico-cortical pathways. The resulting network can form the basis for studies relating structure to neural dynamics in mammalian cortex at multiple scales.

Lateral masking effects on contrast sensitivity in rats

Changes in target visibility may be produced by additional stimulus elements at adjacent locations. Such contextual effects may reflect lateral interactions of stimulus representations in early cortical areas. It has been reported that the organization of orientation preference found in primates and cats visual cortex differs from that found in rodents, suggesting functional distinctions across species. In order to examine effects of lateral interactions at a perceptual level, contrast sensitivity in rats was measured for Gabor patches masked by two additional patches. Rats responded to target onset, and perceptual indices were based upon reaction time distributions across levels of luminance contrast. It was found that contrast sensitivity of targets without lateral masks corresponded to levels previously reported. For all measurements, the presence of sustained lateral masks systematically reduced sensitivity to targets, demonstrating interference by adjacent elements across levels of contrast. Effects of mask orientation or separation were not observed. These results may reflect reported non-systematic topography of orientation tuning across the cortex in rodents. Results suggest that intrinsic lateral connections in early processing areas play a minimal role in stimulus integration for rats.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Altered Balance of Receptive Field Excitation and Suppression in Visual Cortex of Amblyopic Macaque Monkeys

In amblyopia, a visual disorder caused by abnormal visual experience during development, the amblyopic eye (AE) loses visual sensitivity whereas the fellow eye (FE) is largely unaffected. Binocular vision in amblyopes is often disrupted by interocular suppression. We used 96-electrode arrays to record neurons and neuronal groups in areas V1 and V2 of six female macaque monkeys (Macaca nemestrina) made amblyopic by artificial strabismus or anisometropia in early life, as well as two visually normal female controls. To measure suppressive binocular interactions directly, we recorded neuronal responses to dichoptic stimulation. We stimulated both eyes simultaneously with large sinusoidal gratings, controlling their contrast independently with raised-cosine modulators of different orientations and spatial frequencies. We modeled each eye's receptive field at each cortical site using a difference of Gaussian envelopes and derived estimates of the strength of central excitation and surround suppression. We used these estimates to calculate ocular dominance separately for excitation and suppression. Excitatory drive from the FE dominated amblyopic visual cortex, especially in more severe amblyopes, but suppression from both the FE and AEs was prevalent in all animals. This imbalance created strong interocular suppression in deep amblyopes: increasing contrast in the AE decreased responses at binocular cortical sites. These response patterns reveal mechanisms that likely contribute to the interocular suppression that disrupts vision in amblyopes.SIGNIFICANCE STATEMENT Amblyopia is a developmental visual disorder that alters both monocular vision and binocular interaction. Using microelectrode arrays, we examined binocular interaction in primary visual cortex and V2 of six amblyopic macaque monkeys (Macaca nemestrina) and two visually normal controls. By stimulating the eyes dichoptically, we showed that, in amblyopic cortex, the binocular combination of signals is altered. The excitatory influence of the two eyes is imbalanced to a degree that can be predicted from the severity of amblyopia, whereas suppression from both eyes is prevalent in all animals. This altered balance of excitation and suppression reflects mechanisms that may contribute to the interocular perceptual suppression that disrupts vision in amblyopes.

Short Term Motor-Skill Acquisition Improves with Size of Self-Controlled Virtual Hands

Visual feedback in general, and from the body in particular, is known to influence the performance of motor skills in humans. However, it is unclear how the acquisition of motor skills depends on specific visual feedback parameters such as the size of performing effector. Here, 21 healthy subjects physically trained to perform sequences of finger movements with their right hand. Through the use of 3D Virtual Reality devices, visual feedback during training consisted of virtual hands presented on the screen, tracking subject’s hand movements in real time. Importantly, the setup allowed us to manipulate the size of the displayed virtual hands across experimental conditions. We found that performance gains increase with the size of virtual hands. In contrast, when subjects trained by mere observation (i.e., in the absence of physical movement), manipulating the size of the virtual hand did not significantly affect subsequent performance gains. These results demonstrate that when it comes to short-term motor skill learning, the size of visual feedback matters. Furthermore, these results suggest that highest performance gains in individual subjects are achieved when the size of the virtual hand matches their real hand size. These results may have implications for optimizing motor training schemes.

Further Work on the Shaping of Cortical Development and Function by Synchrony and Metabolic Competition

This paper furthers our attempts to resolve two major controversies-whether gamma synchrony plays a role in cognition, and whether cortical columns are functionally important. We have previously argued that the configuration of cortical cells that emerges in development is that which maximizes the magnitude of synchronous oscillation and minimizes metabolic cost. Here we analyze the separate effects in development of minimization of axonal lengths, and of early Hebbian learning and selective distribution of resources to growing synapses, by showing in simulations that these effects are partially antagonistic, but their interaction during development produces accurate anatomical and functional properties for both columnar and non-columnar cortex. The resulting embryonic anatomical order can provide a cortex-wide scaffold for postnatal learning that is dimensionally consistent with the representation of moving sensory objects, and, as learning progressively overwrites the embryonic order, further associations also occur in a dimensionally consistent framework. The role ascribed to cortical synchrony does not demand specific frequency, amplitude or phase variation of pulses to mediate "feature linking." Instead, the concerted interactions of pulse synchrony with short-term synaptic dynamics, and synaptic resource competition can further explain cortical information processing in analogy to Hopfield networks and quantum computation.

More Gamma More Predictions: Gamma-Synchronization as a Key Mechanism for Efficient Integration of Classical Receptive Field Inputs with Surround Predictions

During visual stimulation, neurons in visual cortex often exhibit rhythmic and synchronous firing in the gamma-frequency (30–90 Hz) band. Whether this phenomenon plays a functional role during visual processing is not fully clear and remains heavily debated. In this article, we explore the function of gamma-synchronization in the context of predictive and efficient coding theories. These theories hold that sensory neurons utilize the statistical regularities in the natural world in order to improve the efficiency of the neural code, and to optimize the inference of the stimulus causes of the sensory data. In visual cortex, this relies on the integration of classical receptive field (CRF) data with predictions from the surround. Here we outline two main hypotheses about gamma-synchronization in visual cortex. First, we hypothesize that the precision of gamma-synchronization reflects the extent to which CRF data can be accurately predicted by the surround. Second, we hypothesize that different cortical columns synchronize to the extent that they accurately predict each other’s CRF visual input. We argue that these two hypotheses can account for a large number of empirical observations made on the stimulus dependencies of gamma-synchronization. Furthermore, we show that they are consistent with the known laminar dependencies of gamma-synchronization and the spatial profile of intercolumnar gamma-synchronization, as well as the dependence of gamma-synchronization on experience and development. Based on our two main hypotheses, we outline two additional hypotheses. First, we hypothesize that the precision of gamma-synchronization shows, in general, a negative dependence on RF size. In support, we review evidence showing that gamma-synchronization decreases in strength along the visual hierarchy, and tends to be more prominent in species with small V1 RFs. Second, we hypothesize that gamma-synchronized network dynamics facilitate the emergence of spiking output that is particularly information-rich and sparse.

The Effects of Context and Attention on Spiking Activity in Human Early Visual Cortex

Here we report the first quantitative analysis of spiking activity in human early visual cortex. We recorded multi-unit activity from two electrodes in area V2/V3 of a human patient implanted with depth electrodes as part of her treatment for epilepsy. We observed well-localized multi-unit receptive fields with tunings for contrast, orientation, spatial frequency, and size, similar to those reported in the macaque. We also observed pronounced gamma oscillations in the local-field potential that could be used to estimate the underlying spiking response properties. Spiking responses were modulated by visual context and attention. We observed orientation-tuned surround suppression: responses were suppressed by image regions with a uniform orientation and enhanced by orientation contrast. Additionally, responses were enhanced on regions that perceptually segregated from the background, indicating that neurons in the human visual cortex are sensitive to figure-ground structure. Spiking responses were also modulated by object-based attention. When the patient mentally traced a curve through the neurons' receptive fields, the accompanying shift of attention enhanced neuronal activity. These results demonstrate that the tuning properties of cells in the human early visual cortex are similar to those in the macaque and that responses can be modulated by both contextual factors and behavioral relevance. Our results, therefore, imply that the macaque visual system is an excellent model for the human visual cortex.

Cortical Correlates of Low-Level Perception: From Neural Circuits to Percepts

Low-level perception results from neural-based computations, which build a multimodal skeleton of unconscious or self-generated inferences on our environment. This review identifies bottleneck issues concerning the role of early primary sensory cortical areas, mostly in rodent and higher mammals (cats and non-human primates), where perception substrates can be searched at multiple scales of neural integration. We discuss the limitation of purely bottom-up approaches for providing realistic models of early sensory processing and the need for identification of fast adaptive processes, operating within the time of a percept. Future progresses will depend on the careful use of comparative neuroscience (guiding the choices of experimental models and species adapted to the questions under study), on the definition of agreed-upon benchmarks for sensory stimulation, on the simultaneous acquisition of neural data at multiple spatio-temporal scales, and on the in vivo identification of key generic integration and plasticity algorithms validated experimentally and in simulations.

Feedback to distal dendrites links fMRI signals to neural receptive fields in a spiking network model of the visual cortex

The blood oxygenation level-dependent (BOLD) response has been strongly associated with neuronal activity in the brain. However, some neuronal tuning properties are consistently different from the BOLD response. We studied the spatial extent of neural and hemodynamic responses in the primary visual cortex, where the BOLD responses spread and interact over much longer distances than the small receptive fields of individual neurons would predict. Our model shows that a feedforward-feedback loop between V1 and a higher visual area can account for the observed spread of the BOLD response. In particular, anisotropic landing of inputs to compartmental neurons were necessary to account for the BOLD signal spread, while retaining realistic spiking responses. Our work shows that simple dendrites can separate tuning at the synapses and at the action potential output, thus bridging the BOLD signal to the neural receptive fields with high fidelity.

Attention and normalization circuits in macaque V1

Attention affects neuronal processing and improves behavioural performance. In extrastriate visual cortex these effects have been explained by normalization models, which assume that attention influences the circuit that mediates surround suppression. While normalization models have been able to explain attentional effects, their validity has rarely been tested against alternative models. Here we investigate how attention and surround/mask stimuli affect neuronal firing rates and orientation tuning in macaque V1. Surround/mask stimuli provide an estimate to what extent V1 neurons are affected by normalization, which was compared against effects of spatial top down attention. For some attention/surround effect comparisons, the strength of attentional modulation was correlated with the strength of surround modulation, suggesting that attention and surround/mask stimulation (i.e. normalization) might use a common mechanism. To explore this in detail, we fitted multiplicative and additive models of attention to our data. In one class of models, attention contributed to normalization mechanisms, whereas in a different class of models it did not. Model selection based on Akaike's and on Bayesian information criteria demonstrated that in most cells the effects of attention were best described by models where attention did not contribute to normalization mechanisms. This demonstrates that attentional influences on neuronal responses in primary visual cortex often bypass normalization mechanisms.

Orientation-specific surround suppression in the primary visual cortex varies as a function of autistic tendency

Individuals with autism spectrum disorder (ASD) exhibit superior performance on tasks that rely on local details in an image, and they exhibit deficits in tasks that require integration of local elements into a unified whole. These perceptual abnormalities have been proposed to underlie many of the characteristic features of ASD, but the underlying neural mechanisms are poorly understood. Here, we investigated the degree to which orientation-specific surround suppression, a well-known form of contextual modulation in visual cortex, is associated with autistic tendency in neurotypical (NT) individuals. Surround suppression refers to the phenomenon that the response to a stimulus in the receptive field of a neuron is suppressed when it is surrounded by stimuli just outside the receptive field. The suppression is greatest when the center and surrounding stimuli share perceptual features such as orientation. Surround suppression underlies a number of fundamental perceptual processes that are known to be atypical in individuals with ASD, including perceptual grouping and perceptual pop-out. However, whether surround suppression in the primary visual cortex (V1) is related to autistic traits has not been directly tested before. We used fMRI to measure the neural response to a center Gabor when it was surrounded by Gabors having the same or orthogonal orientation, and calculated a suppression index (SI) for each participant that denoted the magnitude of suppression in the same vs. orthogonal conditions. SI was positively correlated with degree of autistic tendency in each individual, as measured by the Autism Quotient (AQ) scale, a questionnaire designed to assess autistic traits in the general population. Age also correlated with SI and with autistic tendency in our sample, but did not account for the correlation between SI and autistic tendency. These results suggest a reduction in orientation-specific surround suppression in V1 with increasing autistic tendency.

Temporal and spatial limits of pattern motion sensitivity in macaque MT neurons

Many neurons in visual cortical area MT signal the direction of motion of complex visual patterns, such as plaids composed of two superimposed drifting gratings. To compute the direction of pattern motion, MT neurons combine component motion signals over time and space. To determine the spatial and temporal limits of signal integration, we measured the responses of single MT neurons to a novel set of "pseudoplaid" stimuli in which the component gratings were alternated in time or space. As the temporal or spatial separation of the component gratings increased, neuronal selectivity for the direction of pattern motion decreased. Using descriptive models of signal integration, we inferred the temporal and spatial structure of the mechanisms that compute pattern direction selectivity. The median time constant for integration was roughly 10 ms, a timescale characteristic of integration by single cortical pyramidal neurons. The median spatial integration field was roughly one-third of the MT receptive field diameter, suggesting that the spatial limits are set by stages of processing in earlier areas of visual cortex where receptive fields are smaller than in MT. Interestingly, pattern direction-selective neurons had shorter temporal integration times than component direction-selective neurons but similar spatial integration windows. We conclude that pattern motion can only be signaled by MT neurons when the component motion signals co-occur within relatively narrow spatial and temporal limits. We interpret these results in the framework of recent hierarchical models of MT.

Contextual modulation and stimulus selectivity in extrastriate cortex

Contextual modulation is observed throughout the visual system, using techniques ranging from single-neuron recordings to behavioral experiments. Its role in generating feature selectivity within the retina and primary visual cortex has been extensively described in the literature. Here, we describe how similar computations can also elaborate feature selectivity in the extrastriate areas of both the dorsal and ventral streams of the primate visual system. We discuss recent work that makes use of normalization models to test specific roles for contextual modulation in visual cortex function. We suggest that contextual modulation renders neuronal populations more selective for naturalistic stimuli. Specifically, we discuss contextual modulation's role in processing optic flow in areas MT and MST and for representing naturally occurring curvature and contours in areas V4 and IT. We also describe how the circuitry that supports contextual modulation is robust to variations in overall input levels. Finally, we describe how this theory relates to other hypothesized roles for contextual modulation.

Surround suppression supports second-order feature encoding by macaque V1 and V2 neurons

Single neurons in areas V1 and V2 of macaque visual cortex respond selectively to luminance-modulated stimuli. These responses are often influenced by context, for example when stimuli extend outside the classical receptive field (CRF). These contextual phenomena, observed in many sensory areas, reflect a fundamental cortical computation and may inform perception by signaling second-order visual features which are defined by spatial relationships of contrast, orientation and spatial frequency. In the anesthetized, paralyzed macaque, we measured single-unit responses to a drifting preferred sinusoidal grating; low spatial frequency sinusoidal contrast modulations were applied to the grating, creating contrast-modulated, second-order forms. Most neurons responded selectively to the orientation of the contrast modulation of the preferred grating and were therefore second-order orientation-selective. Second-order selectivity was created by the asymmetric spatial organization of the excitatory CRF and suppressive extraclassical surround. We modeled these receptive field subregions using spatial Gaussians, sensitive to the modulation of contrast (not luminance) of the preferred carrier grating, that summed linearly and were capable of recovering asymmetrical receptive field organizations. Our modeling suggests that second-order selectivity arises both from elongated excitatory CRFs, asymmetrically organized extraclassical surround suppression, or both. We validated the model by successfully testing its predictions against conventional surround suppression measurements and spike-triggered analysis of second-order form responses. Psychophysical adaptation measurements on human observers revealed a pattern of second-order form selectivity consistent with neural response patterns. We therefore propose that cortical cells in primates do double duty, providing signals about both first- and second-order forms.

Associative plasticity in surround inhibition circuits in human motor cortex

Surround inhibition is a physiological mechanism that is hypothesised to improve contrast between signals in the central nervous system. In the human motor system, motor surround inhibition (mSI) can be assessed using transcranial magnetic stimulation (TMS). We evaluated whether it is possible to modulate mSI, using a paradigm able to induce plastic effects in primary motor cortex (M1). Fifteen healthy volunteers participated in the experiments. To assess mSI, we delivered single pulses at rest and at the onset of a right thumb abduction. TMS pulses over abductor digiti minimi (ADM; surround muscle) hotspot were delivered when EMG activity in right abductor pollicis brevis (APB; active muscle) > 100 μV was detected. Paired associative stimulation (PAS) was delivered using peripheral median nerve electric stimulation and TMS over APB M1 area at an interstimulus interval of 21.5 ms for the real PAS (PAS21.5) and 100 ms for the sham PAS (PAS100). To verify the effect of PAS21.5 on mSI we collected 20 MEPs from ADM at rest and during APB movements before (T0) and 5 (T1), 15 (T2) and 30 (T3) minutes after PAS21.5. mSI from APB to ADM was present at baseline. PAS21.5 increased the amount of mSI compared with baseline whereas there was no effect after PAS100. Our results suggest that mSI is an adaptable phenomenon depending on prior experience.

Orientation-tuned surround suppression in mouse visual cortex

The firing rates of neurons in primary visual cortex (V1) are suppressed by large stimuli, an effect known as surround suppression. In cats and monkeys, the strength of suppression is sensitive to orientation; responses to regions containing uniform orientations are more suppressed than those containing orientation contrast. This effect is thought to be important for scene segmentation, but the underlying neural mechanisms are poorly understood. We asked whether it is possible to study these mechanisms in the visual cortex of mice, because of recent advances in technology for studying the cortical circuitry in mice. It is unknown whether neurons in mouse V1 are sensitive to orientation contrast. We measured the orientation selectivity of surround suppression in the different layers of mouse V1. We found strong surround suppression in layer 4 and the superficial layers, part of which was orientation tuned: iso-oriented surrounds caused more suppression than cross-oriented surrounds. Surround suppression was delayed relative to the visual response and orientation-tuned suppression was delayed further, suggesting two separate suppressive mechanisms. Previous studies proposed that surround suppression depends on the activity of inhibitory somatostatin-positive interneurons in the superficial layers. To test the involvement of the superficial layers we topically applied lidocaine. Silencing of the superficial layers did not prevent orientation-tuned suppression in layer 4. These results show that neurons in mouse V1, which lacks orientation columns, show orientation-dependent surround suppression in layer 4 and the superficial layers and that surround suppression in layer 4 does not require contributions from neurons in the superficial layers.

Reduced visual surround suppression in schizophrenia shown by measuring contrast detection thresholds

Visual perception in schizophrenia is attracting a broad interest given the deep knowledge that we have about the visual system in healthy populations. One example is the class of effects known collectively as visual surround suppression. For example, the visibility of a grating located in the visual periphery is impaired by the presence of a surrounding grating of the same spatial frequency and orientation. Previous studies have suggested abnormal visual surround suppression in patients with schizophrenia. Given that schizophrenia patients have cortical alterations including hypofunction of NMDA receptors and reduced concentration of GABA neurotransmitter, which affect lateral inhibitory connections, then they should be relatively better than controls at detecting visual stimuli that are usually suppressed. We tested this hypothesis by measuring contrast detection thresholds using a new stimulus configuration. We tested two groups: 21 schizophrenia patients and 24 healthy subjects. Thresholds were obtained using Bayesian staircases in a four-alternative forced-choice detection task where the target was a grating within a 3∘ Butterworth window that appeared in one of four possible positions at 5∘ eccentricity. We compared three conditions, (a) target with no-surround, (b) target embedded within a surrounding grating of 20∘ diameter and 25% contrast with same spatial frequency and orthogonal orientation, and (c) target embedded within a surrounding grating with parallel (same) orientation. Previous results with healthy populations have shown that contrast thresholds are lower for orthogonal and no-surround (NS) conditions than for parallel surround (PS). The log-ratios between parallel and NS thresholds are used as an index quantifying visual surround suppression. Patients performed poorly compared to controls in the NS and orthogonal-surround conditions. However, they performed as well as controls when the surround was parallel, resulting in significantly lower suppression indices in patients. To examine whether the difference in suppression was driven by the lower NS thresholds for controls, we examined a matched subgroup of controls and patients, selected to have similar thresholds in the NS condition. Patients performed significantly better in the PS condition than controls. This analysis therefore indicates that a PS raised contrast thresholds less in patients than in controls. Our results support the hypothesis that inhibitory connections in early visual cortex are impaired in schizophrenia patients.

The detection of orientation continuity and discontinuity by cat V1 neurons

The orientation tuning properties of the non-classical receptive field (nCRF or “surround”) relative to that of the classical receptive field (CRF or “center”) were tested for 119 neurons in the cat primary visual cortex (V1). The stimuli were concentric sinusoidal gratings generated on a computer screen with the center grating presented at an optimal orientation to stimulate the CRF and the surround grating with variable orientations stimulating the nCRF. Based on the presence or absence of surround suppression, measured by the suppression index at the optimal orientation of the cells, we subdivided the neurons into two categories: surround-suppressive (SS) cells and surround-non-suppressive (SN) cells. When stimulated with an optimally oriented grating centered at CRF, the SS cells showed increasing surround suppression when the stimulus grating was expanded beyond the boundary of the CRF, whereas for the SN cells, expanding the stimulus grating beyond the CRF caused no suppression of the center response. For the SS cells, strength of surround suppression was dependent on the relative orientation between CRF and nCRF: an iso-orientation grating over center and surround at the optimal orientation evoked strongest suppression and a surround grating orthogonal to the optimal center grating evoked the weakest or no suppression. By contrast, the SN cells showed slightly increased responses to an iso-orientation stimulus and weak suppression to orthogonal surround gratings. This iso-/orthogonal orientation selectivity between center and surround was analyzed in 22 SN and 97 SS cells, and for the two types of cells, the different center-surround orientation selectivity was dependent on the suppressive strength of the cells. We conclude that SN cells are suitable to detect orientation continuity or similarity between CRF and nCRF, whereas the SS cells are adapted to the detection of discontinuity or differences in orientation between CRF and nCRF.

GABA-induced inactivation of Cebus apella V2 neurons: effects on orientation tuning and direction selectivity

We investigated the GABA-induced inactivation of V2 neurons and terminals on the receptive field properties of this area in an anesthetized and paralyzed Cebus apella monkey. Extracellular single-unit activity was recorded using tungsten microelectrodes in a monkey before and after pressure-injection of a 0.25 or 0.5 M GABA solution. The visual stimulus consisted of a bar moving in 8 possible directions. In total, 24 V2 neurons were studied before and after blocker injections in 4 experimental sessions following GABA injection into area V2. A group of 10 neurons were studied over a short period. An additional 6 neurons were investigated over a long period after the GABA injection. A third group of 8 neurons were studied over a very long period. Overall, these 24 neurons displayed an early (1-20 min) significant general decrease in excitability with concomitant changes in orientation or direction selectivity. GABA inactivation in area V2 produced robust inhibition in 80% and a significant change in directional selectivity in 60% of the neurons examined. These GABA projections are capable of modulating not only levels of spontaneous and driven activity of V2 neurons but also receptive field properties such as direction selectivity.

One hertz repetitive transcranial magnetic stimulation over dorsal premotor cortex enhances offline motor memory consolidation for sequence-specific implicit learning

Consolidation of motor memories associated with skilled practice can occur both online, concurrent with practice, and offline, after practice has ended. The current study investigated the role of dorsal premotor cortex (PMd) in early offline motor memory consolidation of implicit sequence-specific learning. Thirty-three participants were assigned to one of three groups of repetitive transcranial magnetic stimulation (rTMS) over left PMd (5 Hz, 1 Hz or control) immediately following practice of a novel continuous tracking task. There was no additional practice following rTMS. This procedure was repeated for 4 days. The continuous tracking task contained a repeated sequence that could be learned implicitly and random sequences that could not. On a separate fifth day, a retention test was performed to assess implicit sequence-specific motor learning of the task. Tracking error was decreased for the group who received 1 Hz rTMS over the PMd during the early consolidation period immediately following practice compared with control or 5 Hz rTMS. Enhanced sequence-specific learning with 1 Hz rTMS following practice was due to greater offline consolidation, not differences in online learning between the groups within practice days. A follow-up experiment revealed that stimulation of PMd following practice did not differentially change motor cortical excitability, suggesting that changes in offline consolidation can be largely attributed to stimulation-induced changes in PMd. These findings support a differential role for the PMd in support of online and offline sequence-specific learning of a visuomotor task and offer converging evidence for competing memory systems.