The role of feedback in shaping the extra-classical receptive field of cortical neurons: a recurrent network model

A large-scale neuronal network modelling study: Stimulus size modulates gamma oscillations in the primary visual cortex by long-range connections

Stimulus size modulation of neuronal firing activity is a fundamental property of the primary visual cortex. Numerous biological experiments have shown that stimulus size modulation is affected by multiple factors at different spatiotemporal scales, but the exact pathways and mechanisms remain incompletely understood. In this paper, we establish a large-scale neuronal network model of primary visual cortex with layer 2/3 to study how gamma oscillation properties are modulated by stimulus size and especially how long-range connections affect the modulation as realistic neuronal properties and spatial distributions of synaptic connections are considered. It is shown that long-range horizontal synaptic connections are sufficient to produce dimensional modulation of firing rates and gamma oscillations. In particular, with increasing grating stimulus size, the firing rate increases and then decreases, the peak frequency of gamma oscillations decreases and the spectral power increases. These are consistent with biological experimental observations. Furthermore, we explain in detail how the number and spatial distribution of long-range connections affect the size modulation of gamma oscillations by using the analysis of neuronal firing activity and synaptic current fluctuations. Our results provide a mechanism explanation for size modulation of gamma oscillations in the primary visual cortex and reveal the important and unique role played by long-range connections, which contributes to a deeper understanding of the cognitive function of gamma oscillations in visual cortex.

Dependence of Contextual Modulation in Macaque V1 on Interlaminar Signal Flow

In visual cortex, neural correlates of subjective perception can be generated by modulation of activity from beyond the classical receptive field (CRF). In macaque V1, activity generated by nonclassical receptive field (nCRF) stimulation involves different intracortical circuitry than activity generated by CRF stimulation, suggesting that interactions between neurons across V1 layers differ under CRF and nCRF stimulus conditions. We measured border ownership modulation within large populations of V1 neurons. We found that neurons in single columns preferred the same side of objects located outside of the CRF. In addition, we found that interactions between pairs of neurons situated across feedback/horizontal and input layers differed between CRF and nCRF stimulation. Furthermore, the magnitude of border ownership modulation was predicted by greater information flow from feedback/horizontal to input layers. These results demonstrate that the flow of signals between layers covaries with the degree to which neurons integrate information from beyond the CRF.

Top-down influence of areas 21a and 7 differently affects the surround suppression of V1 neurons in cats

Surround suppression (SS) is a phenomenon whereby a neuron's response to stimuli in its central receptive field (cRF) is suppressed by stimuli extending to its surround receptive field (sRF). Recent evidence show that top-down influence contributed to SS in the primary visual cortex (V1). However, how the top-down influence from different high-level cortical areas affects SS in V1 has not been comparatively observed. The present study applied transcranial direct current stimulation (tDCS) to modulate the neural activity in area 21a (A21a) and area 7 (A7) of cats and examined the changes in the cRF and sRF of V1 neurons. We found that anode-tDCS at A21a reduced V1 neurons' cRF size and increased their response to visual stimuli in cRF, causing an improved SS strength. By contrast, anode-tDCS at A7 increased V1 neurons' sRF size and response to stimuli in cRF, also enhancing the SS. Modeling analysis based on DoG function indicated that the increased SS of V1 neurons after anode-tDCS at A21a could be explained by a center-only mechanism, whereas the improved SS after anode-tDCS at A7 might be mediated through a combined center and surround mechanism. In conclusion, A21a and A7 may affect the SS of V1 neurons through different mechanisms.

Size tuning of neural response variability in laminar circuits of macaque primary visual cortex

A defining feature of the cortex is its laminar organization, which is likely critical for cortical information processing. For example, visual stimuli of different size evoke distinct patterns of laminar activity. Visual information processing is also influenced by the response variability of individual neurons and the degree to which this variability is correlated among neurons. To elucidate laminar processing, we studied how neural response variability across the layers of macaque primary visual cortex is modulated by visual stimulus size. Our laminar recordings revealed that single neuron response variability and the shared variability among neurons are tuned for stimulus size, and this size-tuning is layer-dependent. In all layers, stimulation of the receptive field (RF) reduced single neuron variability, and the shared variability among neurons, relative to their pre-stimulus values. As the stimulus was enlarged beyond the RF, both single neuron and shared variability increased in supragranular layers, but either did not change or decreased in other layers. Surprisingly, we also found that small visual stimuli could increase variability relative to baseline values. Our results suggest multiple circuits and mechanisms as the source of variability in different layers and call for the development of new models of neural response variability.

Object Boundary Detection in Natural Images May Depend on "Incitatory" Cell-Cell Interactions

Detecting object boundaries is crucial for recognition, but how the process unfolds in visual cortex remains unknown. To study the problem faced by a hypothetical boundary cell, and to predict how cortical circuitry could produce a boundary cell from a population of conventional "simple cells," we labeled 30,000 natural image patches and used Bayes' rule to help determine how a simple cell should influence a nearby boundary cell depending on its relative offset in receptive field position and orientation. We identified the following three basic types of cell-cell interactions: rising and falling interactions with a range of slopes and saturation rates, and nonmonotonic (bump-shaped) interactions with varying modes and amplitudes. Using simple models, we show that a ubiquitous cortical circuit motif consisting of direct excitation and indirect inhibition-a compound effect we call "incitation"-can produce the entire spectrum of simple cell-boundary cell interactions found in our dataset. Moreover, we show that the synaptic weights that parameterize an incitation circuit can be learned by a single-layer "delta" rule. We conclude that incitatory interconnections are a generally useful computing mechanism that the cortex may exploit to help solve difficult natural classification problems.SIGNIFICANCE STATEMENT Simple cells in primary visual cortex (V1) respond to oriented edges and have long been supposed to detect object boundaries, yet the prevailing model of a simple cell-a divisively normalized linear filter-is a surprisingly poor natural boundary detector. To understand why, we analyzed image statistics on and off object boundaries, allowing us to characterize the neural-style computations needed to perform well at this difficult natural classification task. We show that a simple circuit motif known to exist in V1 is capable of extracting high-quality boundary probability signals from local populations of simple cells. Our findings suggest a new, more general way of conceptualizing cell-cell interconnections in the cortex.

Cascaded normalizations for spatial integration in the primary visual cortex of primates

Spatial integration of visual information is an important function in the brain. However, neural computation for spatial integration in the visual cortex remains unclear. In this study, we recorded laminar responses in V1 of awake monkeys driven by visual stimuli with grating patches and annuli of different sizes. We find three important response properties related to spatial integration that are significantly different between input and output layers: neurons in output layers have stronger surround suppression, smaller receptive field (RF), and higher sensitivity to grating annuli partially covering their RFs. These interlaminar differences can be explained by a descriptive model composed of two global divisions (normalization) and a local subtraction. Our results suggest suppressions with cascaded normalizations (CNs) are essential for spatial integration and laminar processing in the visual cortex. Interestingly, the features of spatial integration in convolutional neural networks, especially in lower layers, are different from our findings in V1.

Mechanisms of Surround Suppression Effect on the Contrast Sensitivity of V1 Neurons in Cats

Surround suppression (SS) is a phenomenon that a neuron’s response to visual stimuli within the classical receptive field (cRF) is suppressed by a concurrent stimulation in the surrounding receptive field (sRF) beyond the cRF. Studies show that SS affects neuronal response contrast sensitivity in the primary visual cortex (V1). However, the underlying mechanisms remain unclear. Here, we examined SS effect on the contrast sensitivity of cats’ V1 neurons with different preferred SFs using external noise-masked visual stimuli and perceptual template model (PTM) analysis at the system level. The contrast sensitivity was evaluated by the inverted threshold contrast of neurons in response to circular gratings of different contrasts in the cRF with or without an annular grating in the sRF. Our results showed that SS significantly reduced the contrast sensitivity of cats’ V1 neurons. The SS-induced reduction of contrast sensitivity was not correlated with SS strength but was dependent on neuron’s preferred SF, with a larger reduction for neurons with low preferred SFs than those with high preferred SFs. PTM analysis of threshold versus external noise contrast (TvC) functions indicated that SS decreased contrast sensitivity by increasing both the internal additive noise and impact of external noise for neurons with low preferred SFs, but improving only internal additive noise for neurons with high preferred SFs. Furthermore, the SS effect on the contrast-response function of low- and high-SF neurons also exhibited different mechanisms in contrast gain and response gain. Collectively, these results suggest that the mechanisms of SS effect on neuronal contrast sensitivity may depend on neuronal populations with different SFs.

The neural hierarchy of consciousness

The chief undertaking in the studies of consciousness is that of unravelling "the minimal set of neural processes that are together sufficient for the conscious experience of a particular content - the neural correlates of consciousness". To this day, this crusade remains at an impasse, with a clash of two main theories: consciousness may arise either in a graded and cortically-localised fashion, or in an all-or-none and widespread one. In spite of the long-lasting theoretical debates, neurophysiological theories of consciousness have been mostly dissociated from them. Herein, a theoretical review will be put forth with the aim to change that. In its first half, we will cover the hard available evidence on the neurophysiology of consciousness, whereas in its second half we will weave a series of considerations on both theories and substantiate a novel take on conscious awareness: the levels of processing approach, partitioning the conscious architecture into lower- and higher-order, graded and nonlinear.

The role of lateral modulation in orientation-specific adaptation effect

Center-surround modulation in visual processing reflects a normalization process of contrast gain control in the responsive neurons. Prior adaptation to a clockwise (CW) tilted grating, for example, leads to the percept of counterclockwise tilt in a vertical grating, referred to as the tilt-aftereffect (TAE). We previously reported that the magnitude of the TAE is modulated by adding a same-orientation annular surround to an adapter, suggesting inhibitory lateral modulation. To further examine the property of this lateral modulation effect on the perception of a central target, we here used center-surround sinusoidal patterns as adapters and varied the adapter surround and center orientations independently. The target had the same spatial extent as the adapter center with no physical overlap with the adapter surround. Participants were asked to judge the target orientation as tilted either CW or counterclockwise from vertical after adaptation. Results showed that, when the surround orientation was held constant, the TAE magnitude was determined by the adapter center, peaking between 10° and 20° of tilt. More important, the adapter surround orientation modulated the adaptation effect such that the TAE magnitude first decreased and then increased as the surround orientation became increasingly more different from that of the center, suggesting that the surround modulation effect was indeed orientation specific. Our data can be accounted for by a divisive inhibition model, in which (1) the adaptation effect is represented by increasing the normalizing constant and (2) the surround modulation is captured by two multiplicative sensitivity parameters determined by the adapter surround orientation.

Resting-state Functional Connectivity After Occipital Stroke

BACKGROUND

Resting-state functional magnetic resonance imaging (rsfMRI) reflects spontaneous activation of cortical networks. After stroke, these networks reorganize, both due to structural lesion and reorganization of functional connectivity (FC).

OBJECTIVE

We studied FC in chronic phase occipital stroke patients with homonymous visual field defects before and after repetitive transorbital alternating current stimulation (rtACS).

METHODS

This spin-off study, embedded in the randomized, sham-controlled REVIS trial, comprised 16 chronic occipital stroke patients with visual field defect and 12 healthy control subjects. The patients underwent rsfMRI at baseline, after two weeks of rtACS or sham treatment, and after two months of treatment-free follow-up, whereas the control subjects were measured once. We used a multivariate regression connectivity model to determine mutual prediction accuracy between 74 cortical regions of interest. Additionally, the model parameters were included into a graph to analyze average path length, centrality eigenvector, centrality degree, and clustering of the network. The patients and controls at baseline and the two treatment groups were compared with multilevel modeling.

RESULTS

Before treatment, the patients and controls had similar whole-network prediction accuracy and network parameters, whereas centrality eigenvector differed in perilesional regions, indicating local modification in connectivity. In line with behavioral results, neither prediction accuracy nor any network parameter changed systematically as a result of rtACS rehabilitation compared to sham.

CONCLUSIONS

Whole-network FC showed no difference between occipital stroke patients and healthy population, congruent with the peripheral location of the visual network in relation to the high-density cortical core. rtACS treatment in the given setting did not affect FC.

From Receptive to Perceptive Fields: Size-Dependent Asymmetries in Both Negative Afterimages and Subcortical On and Off Post-Stimulus Responses

Negative afterimages are perceptual phenomena that occur after physical stimuli disappear from sight. Their origin is linked to transient post-stimulus responses of visual neurons. The receptive fields (RFs) of these subcortical ON- and OFF-center neurons exhibit antagonistic interactions between central and surrounding visual space, resulting in selectivity for stimulus polarity and size. These two features are closely intertwined, yet their relationship to negative afterimage perception remains unknown. Here we tested whether size differentially affects the perception of bright and dark negative afterimages in humans of both sexes, and how this correlates with neural mechanisms in subcortical ON and OFF cells. Psychophysically, we found a size-dependent asymmetry whereby dark disks produce stronger and longer-lasting negative afterimages than bright disks of equal contrast at sizes >0.8°. Neurophysiological recordings from retinal and relay cells in female cat dorsal lateral geniculate nucleus showed that subcortical ON cells exhibited stronger sustained post-stimulus responses to dark disks, than OFF cells to bright disks, at sizes >1°. These sizes agree with the emergence of center-surround antagonism, revealing stronger suppression to opposite-polarity stimuli for OFF versus ON cells, particularly in dorsal lateral geniculate nucleus. Using a network-based retino-geniculate model, we confirmed stronger antagonism and temporal transience for OFF-cell post-stimulus rebound responses. A V1 population model demonstrated that both strength and duration asymmetries can be propagated to downstream cortical areas. Our results demonstrate how size-dependent antagonism impacts both the neuronal post-stimulus response and the resulting afterimage percepts, thereby supporting the idea of perceptual RFs reflecting the underlying neuronal RF organization of single cells.SIGNIFICANCE STATEMENT Visual illusions occur when sensory inputs and perceptual outcomes do not match, and provide a valuable tool to understand transformations from neural to perceptual responses. A classic example are negative afterimages that remain visible after a stimulus is removed from view. Such perceptions are linked to responses in early visual neurons, yet the details remain poorly understood. Combining human psychophysics, neurophysiological recordings in cats and retino-thalamo-cortical computational modeling, our study reveals how stimulus size and the receptive-field structure of subcortical ON and OFF cells contributes to the parallel asymmetries between neural and perceptual responses to bright versus dark afterimages. Thus, this work provides a deeper link from the underlying neural mechanisms to the resultant perceptual outcomes.

A touch of hierarchy: population receptive fields reveal fingertip integration in Brodmann areas in human primary somatosensory cortex

Several neuroimaging studies have shown the somatotopy of body part representations in primary somatosensory cortex (S1), but the functional hierarchy of distinct subregions in human S1 has not been adequately addressed. The current study investigates the functional hierarchy of cyto-architectonically distinct regions, Brodmann areas BA3, BA1, and BA2, in human S1. During functional MRI experiments, we presented participants with vibrotactile stimulation of the fingertips at three different vibration frequencies. Using population Receptive Field (pRF) modeling of the fMRI BOLD activity, we identified the hand region in S1 and the somatotopy of the fingertips. For each voxel, the pRF center indicates the finger that most effectively drives the BOLD signal, and the pRF size measures the spatial somatic pooling of fingertips. We find a systematic relationship of pRF sizes from lower-order areas to higher-order areas. Specifically, we found that pRF sizes are smallest in BA3, increase slightly towards BA1, and are largest in BA2, paralleling the increase in visual receptive field size as one ascends the visual hierarchy. Additionally, we find that the time-to-peak of the hemodynamic response in BA3 is roughly 0.5 s earlier compared to BA1 and BA2, further supporting the notion of a functional hierarchy of subregions in S1. These results were obtained during stimulation of different mechanoreceptors, suggesting that different afferent fibers leading up to S1 feed into the same cortical hierarchy.

Effects of muscarinic and nicotinic receptors on contextual modulation in macaque area V1

Context affects the salience and visibility of image elements in visual scenes. Collinear flankers can enhance or decrease the perceptual and neuronal sensitivity to flanked stimuli. These effects are mediated through lateral interactions between neurons in the primary visual cortex (area V1), in conjunction with feedback from higher visual areas. The strength of lateral interactions is affected by cholinergic neuromodulation. Blockade of muscarinic receptors should increase the strength of lateral intracortical interactions, while nicotinic blockade should reduce thalamocortical feed-forward drive. Here we test this proposal through local iontophoretic application of the muscarinic receptor antagonist scopolamine and the nicotinic receptor antagonist mecamylamine, while recording single cells in parafoveal representations in awake fixating macaque V1. Collinear flankers generally reduced neuronal contrast sensitivity. Muscarinic and nicotinic receptor blockade equally reduced neuronal contrast sensitivity. Contrary to our hypothesis, flanker interactions were not systematically affected by either receptor blockade.

Reduced visual contrast suppression during major depressive episodes

BACKGROUND

Previous studies have suggested that processing of visual contrast information could be altered in major depressive disorder. To clarify the changes at different levels of the visual hierarchy, we behaviourally measured contrast perception in 2 centre-surround conditions, assessing retinal and cortical processing.

METHODS

As part of a prospective cohort study, our sample consisted of controls (n = 29; 21 female) and patients with unipolar depression, bipolar disorder and borderline personality disorder who had baseline major depressive episodes (n = 111; 74 female). In a brightness induction test that assessed retinal processing, participants compared the perceived luminance of uniform patches (presented on a computer screen) as the luminance of the backgrounds was varied. In a contrast suppression test that assessed cortical processing, participants compared the perceived contrast of gratings, which were presented with collinearly or orthogonally oriented backgrounds.

RESULTS

Brightness induction was similar for patients with major depressive episodes and controls (p = 0.60, d = 0.115, Bayes factor = 3.9), but contrast suppression was significantly lower for patients than for controls (p < 0.006, d = 0.663, Bayes factor = 35.2). We observed no statistically significant associations between contrast suppression and age, sex, or medication or diagnostic subgroup. At follow-up (n = 74), we observed some normalization of contrast perception.

LIMITATIONS

We assessed contrast perception using behavioural tests instead of electrophysiology.

CONCLUSION

The reduced contrast suppression we observed may have been caused by decreased retinal feedforward or cortical feedback signals. Because we observed intact brightness induction, our results suggest normal retinal but altered cortical processing of visual contrast during a major depressive episode. This alteration is likely to be present in multiple types of depression and to partially normalize upon remission.

The Generation and Modulation of Distinct Gamma Oscillations with Local, Horizontal, and Feedback Connections in the Primary Visual Cortex: A Model Study on Large-Scale Networks

Gamma oscillation (GAMMA) in the local field potential (LFP) is a synchronized activity commonly found in many brain regions, and it has been thought as a functional signature of network connectivity in the brain, which plays important roles in information processing. Studies have shown that the response property of GAMMA is related to neural interaction through local recurrent connections (RC), feed-forward (FF), and feedback (FB) connections. However, the relationship between GAMMA and long-range horizontal connections (HC) in the brain remains unclear. Here, we aimed to understand this question in a large-scale network model for the primary visual cortex (V1). We created a computational model composed of multiple excitatory and inhibitory units with biologically plausible connectivity patterns for RC, FF, FB, and HC in V1; then, we quantitated GAMMA in network models at different strength levels of HC and other connection types. Surprisingly, we found that HC and FB, the two types of large-scale connections, play very different roles in generating and modulating GAMMA. While both FB and HC modulate a fast gamma oscillation (around 50-60 Hz) generated by FF and RC, HC generates a new GAMMA oscillating around 30 Hz, whose power and peak frequency can also be modulated by FB. Furthermore, response properties of the two GAMMAs in a network with both HC and FB are different in a way that is highly consistent with a recent experimental finding for distinct GAMMAs in macaque V1. The results suggest that distinct GAMMAs are signatures for neural connections in different spatial scales and they might be related to different functions for information integration. Our study, for the first time, pinpoints the underlying circuits for distinct GAMMAs in a mechanistic model for macaque V1, which might provide a new framework to study multiple gamma oscillations in other cortical regions.

Characterization of Feedback Neurons in the High-Level Visual Cortical Areas That Project Directly to the Primary Visual Cortex in the Cat

Previous studies indicate that top-down influence plays a critical role in visual information processing and perceptual detection. However, the substrate that carries top-down influence remains poorly understood. Using a combined technique of retrograde neuronal tracing and immunofluorescent double labeling, we characterized the distribution and cell type of feedback neurons in cat's high-level visual cortical areas that send direct connections to the primary visual cortex (V1: area 17). Our results showed: (1) the high-level visual cortex of area 21a at the ventral stream and PMLS area at the dorsal stream have a similar proportion of feedback neurons back projecting to the V1 area, (2) the distribution of feedback neurons in the higher-order visual area 21a and PMLS was significantly denser than in the intermediate visual cortex of area 19 and 18, (3) feedback neurons in all observed high-level visual cortex were found in layer II-III, IV, V, and VI, with a higher proportion in layer II-III, V, and VI than in layer IV, and (4) most feedback neurons were CaMKII-positive excitatory neurons, and few of them were identified as inhibitory GABAergic neurons. These results may argue against the segregation of ventral and dorsal streams during visual information processing, and support "reverse hierarchy theory" or interactive model proposing that recurrent connections between V1 and higher-order visual areas constitute the functional circuits that mediate visual perception. Also, the corticocortical feedback neurons from high-level visual cortical areas to the V1 area are mostly excitatory in nature.

Top-down influence affects the response adaptation of V1 neurons in cats

The visual system lowers its perceptual sensitivity to a prolonged presentation of the same visual signal. This brain plasticity, called visual adaptation, is generally attributed to the response adaptation of neurons in the visual cortex. Although well-studied in the neurons of the primary visual cortex (V1), the contribution of high-level visual cortical regions to the response adaptation of V1 neurons is unclear. In the present study, we measured the response adaptation strength of V1 neurons before and after the top-down influence of the area 21a (A21a), a higher-order visual cortex homologous to the primate V4 area, was modulated with a noninvasive tool of transcranial direct current stimulation (tDCS). Our results showed that the response adaptation of V1 neurons enhanced significantly after applying anode (a-) tDCS in A21a when compared with that before a-tDCS, whereas the response adaptation of V1 neurons weakened after cathode (c-) tDCS relative to before c-tDCS in A21a. By contrast, sham (s-) tDCS in A21a had no significant impact on the response adaptation of V1 neurons. Further analysis indicated that a-tDCS in A21a significantly increased both the initial response (IR) of V1 neurons to the first several (five) trails of visual stimulation and the plateau response (PR) to the prolonged visual stimulation; the increase in PR was lower than in IR, which caused an enhancement in response adaptation. Conversely, c-tDCS significantly decreased both IR and PR of V1 neurons; the reduction in PR was smaller than in IR, which resulted in a weakness in response adaptation. Furthermore, the tDCS-induced changes of V1 neurons in response and response adaptation could recover after tDCS effect vanished, but did not occur after the neuronal activity in A21a was silenced by electrolytic lesions. These results suggest that the top-down influence of A21a may alter the response adaptation of V1 neurons through activation of local inhibitory circuitry, which enhances network inhibition in the V1 area upon an increased top-down input, weakens inhibition upon a decreased top-down input, and thus maintains homeostasis of V1 neurons in response to the long-presenting visual signals.

Propagation of BOLD Activity Reveals Task-dependent Directed Interactions Across Human Visual Cortex

It has recently been shown that large-scale propagation of blood-oxygen-level-dependent (BOLD) activity is constrained by anatomical connections and reflects transitions between behavioral states. It remains to be seen, however, if the propagation of BOLD activity can also relate to the brain's anatomical structure at a more local scale. Here, we hypothesized that BOLD propagation reflects structured neuronal activity across early visual field maps. To explore this hypothesis, we characterize the propagation of BOLD activity across V1, V2, and V3 using a modeling approach that aims to disentangle the contributions of local activity and directed interactions in shaping BOLD propagation. It does so by estimating the effective connectivity (EC) and the excitability of a noise-diffusion network to reproduce the spatiotemporal covariance structure of the data. We apply our approach to 7T fMRI recordings acquired during resting state (RS) and visual field mapping (VFM). Our results reveal different EC interactions and changes in cortical excitability in RS and VFM, and point to a reconfiguration of feedforward and feedback interactions across the visual system. We conclude that the propagation of BOLD activity has functional relevance, as it reveals directed interactions and changes in cortical excitability in a task-dependent manner.

The Role of Temporal and Spatial Attention in Size Adaptation

One of the most important tasks for the visual system is to construct an internal representation of the spatial properties of objects, including their size. Size perception includes a combination of bottom-up (retinal inputs) and top-down (e.g., expectations) information, which makes the estimates of object size malleable and susceptible to numerous contextual cues. For example, it has been shown that size perception is prone to adaptation: brief previous presentations of larger or smaller adapting stimuli at the same region of space changes the perceived size of a subsequent test stimulus. Large adapting stimuli cause the test to appear smaller than its veridical size and vice versa. Here, we investigated whether size adaptation is susceptible to attentional modulation. First, we measured the magnitude of adaptation aftereffects for a size discrimination task. Then, we compared these aftereffects (on average 15–20%) with those measured while participants were engaged, during the adaptation phase, in one of the two highly demanding central visual tasks: Multiple Object Tracking (MOT) or Rapid Serial Visual Presentation (RSVP). Our results indicate that deploying visual attention away from the adapters did not significantly affect the distortions of perceived size induced by adaptation, with accuracy and precision in the discrimination task being almost identical in all experimental conditions. Taken together, these results suggest that visual attention does not play a key role in size adaptation, in line with the idea that this phenomenon can be accounted for by local gain control mechanisms within area V1.

Distinct spatiotemporal mechanisms underlie extra-classical receptive field modulation in macaque V1 microcircuits

Complex scene perception depends upon the interaction between signals from the classical receptive field (CRF) and the extra-classical receptive field (eCRF) in primary visual cortex (V1) neurons. Although much is known about V1 eCRF properties, we do not yet know how the underlying mechanisms map onto the cortical microcircuit. We probed the spatio-temporal dynamics of eCRF modulation using a reverse correlation paradigm, and found three principal eCRF mechanisms: tuned-facilitation, untuned-suppression, and tuned-suppression. Each mechanism had a distinct timing and spatial profile. Laminar analysis showed that the timing, orientation-tuning, and strength of eCRF mechanisms had distinct signatures within magnocellular and parvocellular processing streams in the V1 microcircuit. The existence of multiple eCRF mechanisms provides new insights into how V1 responds to spatial context. Modeling revealed that the differences in timing and scale of these mechanisms predicted distinct patterns of net modulation, reconciling many previous disparate physiological and psychophysical findings.

Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models

The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.

Improved fidelity of orientation perception: a learning effect dissociable from enhanced discriminability

Visual perception can be influenced by stimulus context, selective attention, and prior experience. Many previous studies have shown complex interactions among these influencing factors, but it remains unclear whether context-induced illusions could be reduced by perceptual training and whether such a change in perceptual fidelity is linked to improved perceptual discriminability. To address this question, we introduced a context-induced tilt illusion into an orientation discrimination training paradigm. This resulted in parallel and long-term improvements in the discriminability and fidelity of orientation perception. The improved discriminability was specific to the task-relevant target stimulus but nonspecific to the task-irrelevant context. By contrast, the improved perceptual fidelity was specific to the task-irrelevant contextual stimulus that induced the illusion, but not specific to the task-relevant target stimulus or task performed on one of its features. These results indicate two dissociable learning effects associated with the same training procedure. Such a dissociation was further supported by the observation that the sizes of the two learning effects were uncorrelated across the subjects. Our findings suggest two parallel learning processes: a task-dependent process giving rise to enhanced discriminability for the task-relevant stimulus attribute, and a context-dependent process leading to improved perceptual fidelity for the attended stimuli.

Activity in Lateral Visual Areas Contributes to Surround Suppression in Awake Mouse V1

Neuronal response to sensory stimuli depends on the context. The response in primary visual cortex (V1), for instance, is reduced when a stimulus is surrounded by a similar stimulus [1-3]. The source of this surround suppression is partially known. In mouse, local horizontal integration by somatostatin-expressing interneurons contributes to surround suppression [4]. In primates, however, surround suppression arises too quickly to come from local horizontal integration alone, and myelinated axons from higher visual areas, where cells have larger receptive fields, are thought to provide additional surround suppression [5, 6]. Silencing higher visual areas indeed decreased surround suppression in the awake primate by increasing responses to large stimuli [7, 8], although not under anesthesia [9, 10]. In smaller mammals, like mice, fast surround suppression could be possible without feedback. Recent studies revealed a small reduction in V1 responses when silencing higher areas [11, 12] but have not investigated surround suppression. To determine whether higher visual areas contribute to V1 surround suppression, even when this is not necessary for fast processing, we inhibited the areas lateral to V1, particularly the lateromedial area (LM), a possible homolog of primate V2 [13], while recording in V1 of awake and anesthetized mice. We found that part of the surround suppression depends on activity from lateral visual areas in the awake, but not anesthetized, mouse. Inhibiting the lateral visual areas specifically increased responses in V1 to large stimuli. We present a model explaining how excitatory feedback to V1 can have these suppressive effects for large stimuli.

Constrained inference in sparse coding reproduces contextual effects and predicts laminar neural dynamics

When probed with complex stimuli that extend beyond their classical receptive field, neurons in primary visual cortex display complex and non-linear response characteristics. Sparse coding models reproduce some of the observed contextual effects, but still fail to provide a satisfactory explanation in terms of realistic neural structures and cortical mechanisms, since the connection scheme they propose consists only of interactions among neurons with overlapping input fields. Here we propose an extended generative model for visual scenes that includes spatial dependencies among different features. We derive a neurophysiologically realistic inference scheme under the constraint that neurons have direct access only to local image information. The scheme can be interpreted as a network in primary visual cortex where two neural populations are organized in different layers within orientation hypercolumns that are connected by local, short-range and long-range recurrent interactions. When trained with natural images, the model predicts a connectivity structure linking neurons with similar orientation preferences matching the typical patterns found for long-ranging horizontal axons and feedback projections in visual cortex. Subjected to contextual stimuli typically used in empirical studies, our model replicates several hallmark effects of contextual processing and predicts characteristic differences for surround modulation between the two model populations. In summary, our model provides a novel framework for contextual processing in the visual system proposing a well-defined functional role for horizontal axons and feedback projections.

Stimulus- and Neural-Referred Visual Receptive Field Properties following Hemispherectomy: A Case Study Revisited

Damage to the visual system can result in (a partial) loss of vision, in response to which the visual system may functionally reorganize. Yet the timing, extent, and conditions under which this occurs are not well understood. Hence, studies in individuals with diverse congenital and acquired conditions and using various methods are needed to better understand this. In the present study, we examined the visual system of a young girl who received a hemispherectomy at the age of three and who consequently suffered from hemianopia. We did so by evaluating the corticocortical and retinocortical projections in the visual system of her remaining hemisphere. For the examination of these aspects, we analyzed the characteristics of the connective fields ("neural-referred" receptive fields) based on both resting-state (RS) and retinotopy data. The evaluation of RS data, reflecting brain activity independent from visual stimulation, is of particular interest as it is not biased by the patient's atypical visual percept. We found that, primarily when the patient was at rest, the connective fields between V1 and both early and late visual areas were larger than normal. These abnormally large connective fields could be a sign either of functional reorganization or of unmasked suppressive feedback signals that are normally masked by interhemispheric signals. Furthermore, we confirmed our previous finding of abnormal retinocortical or "stimulus-referred" projections in both early and late visual areas. More specifically, we found an enlarged foveal representation and smaller population receptive fields. These differences could also be a sign of functional reorganization or rather a reflection of the interruption visual information that travels, via the remainder of the visual pathway, from the retina to the visual cortex. To conclude, while we do find indications for relatively subtle changes in visual field map properties, we found no evidence of large-scale reorganization-even though the patient could have benefitted from this. Our work suggests that at a later developmental stage, large-scale reorganization of the visual system no longer occurs, while small-scale properties may still change to facilitate adaptive processing and viewing strategies.

Lateral effects in pattern vision

There is a large literature on lateral effects in pattern vision but no consensus about them or comprehensive model of them. This paper reviews the literature with a focus on the effects of parallel context in the central fovea. It describes seven experiments that measure detection and discrimination thresholds in annular and Gabor-pattern contexts at different separations. It presents a model of these effects, which is an elaboration of Foley's (1994) model. The model describes the results well, and it shows that lateral context affects the response to the target by both multiplicative excitation and additive inhibition. Both lateral effects extend for several wavelengths beyond the target. They vary in relative strength, producing near suppression and far enhancement of the response to the target. The model describes the detection and discrimination results well, and it also describes the results of experiments on lateral effects on perceived contrast. The model is consistent with the physiology of V1 cells.

Stochastic neural field model of stimulus-dependent variability in cortical neurons

We use stochastic neural field theory to analyze the stimulus-dependent tuning of neural variability in ring attractor networks. We apply perturbation methods to show how the neural field equations can be reduced to a pair of stochastic nonlinear phase equations describing the stochastic wandering of spontaneously formed tuning curves or bump solutions. These equations are analyzed using a modified version of the bivariate von Mises distribution, which is well-known in the theory of circular statistics. We first consider a single ring network and derive a simple mathematical expression that accounts for the experimentally observed bimodal (or M-shaped) tuning of neural variability. We then explore the effects of inter-network coupling on stimulus-dependent variability in a pair of ring networks. These could represent populations of cells in two different layers of a cortical hypercolumn linked via vertical synaptic connections, or two different cortical hypercolumns linked by horizontal patchy connections within the same layer. We find that neural variability can be suppressed or facilitated, depending on whether the inter-network coupling is excitatory or inhibitory, and on the relative strengths and biases of the external stimuli to the two networks. These results are consistent with the general observation that increasing the mean firing rate via external stimuli or modulating drives tends to reduce neural variability.

Beyond Rehabilitation of Acuity, Ocular Alignment, and Binocularity in Infantile Strabismus

Infantile strabismus impairs the perception of all attributes of the visual scene. High spatial frequency components are no longer visible, leading to amblyopia. Binocularity is altered, leading to the loss of stereopsis. Spatial perception is impaired as well as detection of vertical orientation, the fastest movements, directions of movement, the highest contrasts and colors. Infantile strabismus also affects other vision-dependent processes such as control of postural stability. But presently, rehabilitative therapies for infantile strabismus by ophthalmologists, orthoptists and optometrists are restricted to preventing or curing amblyopia of the deviated eye, aligning the eyes and, whenever possible, preserving or restoring binocular vision during the critical period of development, i.e., before ~10 years of age. All the other impairments are thus ignored; whether they may recover after strabismus treatment even remains unknown. We argue here that medical and paramedical professionals may extend their present treatments of the perceptual losses associated with infantile strabismus. This hypothesis is based on findings from fundamental research on visual system organization of higher mammals in particular at the cortical level. In strabismic subjects (as in normal-seeing ones), information about all of the visual attributes converge, interact and are thus inter-dependent at multiple levels of encoding ranging from the single neuron to neuronal assemblies in visual cortex. Thus if the perception of one attribute is restored this may help to rehabilitate the perception of other attributes. Concomitantly, vision-dependent processes may also improve. This could occur spontaneously, but still should be assessed and validated. If not, medical and paramedical staff, in collaboration with neuroscientists, will have to break new ground in the field of therapies to help reorganize brain circuitry and promote more comprehensive functional recovery. Findings from fundamental research studies in both young and adult patients already support our hypothesis and are reviewed here. For example, presenting different contrasts to each eye of a strabismic patient during training sessions facilitates recovery of acuity in the amblyopic eye as well as of 3D perception. Recent data also demonstrate that visual recoveries in strabismic subjects improve postural stability. These findings form the basis for a roadmap for future research and clinical development to extend presently applied rehabilitative therapies for infantile strabismus.

Top-down feedback controls spatial summation and response amplitude in primate visual cortex

Sensory information travels along feedforward connections through a hierarchy of cortical areas, which, in turn, send feedback connections to lower-order areas. Feedback has been implicated in attention, expectation, and sensory context, but the mechanisms underlying these diverse feedback functions are unknown. Using specific optogenetic inactivation of feedback connections from the secondary visual area (V2), we show how feedback affects neural responses in the primate primary visual cortex (V1). Reducing feedback activity increases V1 cells' receptive field (RF) size, decreases their responses to stimuli confined to the RF, and increases their responses to stimuli extending into the proximal surround, therefore reducing surround suppression. Moreover, stronger reduction of V2 feedback activity leads to progressive increase in RF size and decrease in response amplitude, an effect predicted by a recurrent network model. Our results indicate that feedback modulates RF size, surround suppression and response amplitude, similar to the modulatory effects of visual spatial attention.

Adaptive scales of integration and response latencies in a critically-balanced model of the primary visual cortex

The primary visual cortex (V1) integrates information over scales in visual space, which have been shown to vary, in an input-dependent manner, as a function of contrast and other visual parameters. Which algorithms the brain uses to achieve this feat are largely unknown and an open problem in visual neuroscience. We demonstrate that a simple dynamical mechanism can account for this contrast-dependent scale of integration in visuotopic space as well as connect this property to two other stimulus-dependent features of V1: extents of lateral integration on the cortical surface and response latencies.

Impaired Center-Surround Suppression in Patients with Alzheimer's Disease

Alzheimer's disease (AD) is often associated with declined visual processing abilities. Here we tested whether the functions of center-surround suppression- a hallmark property in the visual system- are altered by AD. To this end, we recruited three groups of participants (AD, elderly, and young) in a motion direction discrimination task, in which we measured the temporal duration threshold of a  drifting Gabor with varying stimulus sizes. We first replicated the phenomena of center-surround suppression that the required duration for discriminating a high contrast grating decreases with increasing stimulus size. We then showed that the magnitudes of suppression varied among the three groups. There was progressive reduction of suppression in the elderly and AD groups compared with the young group. Interestingly, we found that the levels of suppression can predict the severity of dementia in the AD group. Our results suggest that AD is associated with impaired center-surround functions in the visual motion processing pathway.

Adaptation without Plasticity

Sensory adaptation is a phenomenon in which neurons are affected not only by their immediate input but also by the sequence of preceding inputs. In visual cortex, for example, neurons shift their preferred orientation after exposure to an oriented stimulus. This adaptation is traditionally attributed to plasticity. We show that a recurrent network generates tuning curve shifts observed in cat and macaque visual cortex, even when all synaptic weights and intrinsic properties in the model are fixed. This demonstrates that, in a recurrent network, adaptation on timescales of hundreds of milliseconds does not require plasticity. Given the ubiquity of recurrent connections, this phenomenon likely contributes to responses observed across cortex and shows that plasticity cannot be inferred solely from changes in tuning on these timescales. More broadly, our findings show that recurrent connections can endow a network with a powerful mechanism to store and integrate recent contextual information.

Distinct Aging Effects on Motion Repulsion and Surround Suppression in Humans

Elderly exhibit accumulating deficits in visual motion perception, which is critical for humans to interact with their environment. Previous studies have suggested that aging generally reduces neuronal inhibition in the visual system. Here, we investigated how aging affects the local intra-cortical inhibition using a motion direction discrimination task based on the motion repulsion phenomenon. Motion repulsion refers to the phenomenon by which observers overestimate the perceived angle when two superimposed dot patterns are moving at an acute angle. The misperception has been interpreted as local mutual inhibition between nearby direction-tuned neurons within the same cortical area. We found that elderly exhibited much stronger motion repulsion than young adults. We then compared this effect to how aging affects the global inter-cortical inhibition by adopting the surround suppression paradigm previously used by Betts et al. (2005). We found that elderly showed less change in the discrimination threshold when the size of a high-contrast drifting Gabor was increased, indicating reduced surround suppression compared to young adults. Our results indicate that aging may not always lead to a decrease of neuronal inhibition in the visual system. These distinct effects of aging on inhibitory functions might be one of the reasons that elderly people often exhibit deficits of motion perception in a real-world situation.

Daily vision testing can expose the prodromal phase of migraine

Background

Several visual tasks have been proposed as indirect assays of the balance between cortical inhibition and excitation in migraine. This study aimed to determine whether daily measurement of performance on such tasks can reveal perceptual changes in the build up to migraine events.

Methods

Visual performance was measured daily at home in 16 non-headache controls and 18 individuals with migraine using a testing protocol on a portable tablet device. Observers performed two tasks: luminance increment detection in spatial luminance noise and centre surround contrast suppression.

Results

Luminance thresholds were reduced in migraine compared to control groups ( p < 0.05), but thresholds did not alter across the migraine cycle; while headache-free, centre-surround contrast suppression was stronger for the migraine group relative to controls ( p < 0.05). Surround suppression weakened at around 48 hours prior to a migraine attack and strengthened to approach their headache-free levels by 24 hours post-migraine (main effect of timing, p < 0.05).

Conclusions

Daily portable testing of vision enabled insight into perceptual performance in the lead up to migraine events, a time point that is typically difficult to capture experimentally. Perceptual surround suppression of contrast fluctuates during the migraine cycle, supporting the utility of this measure as an indirect, non-invasive assay of the balance between cortical inhibition and excitation.

A Neural Signature of Divisive Normalization at the Level of Multisensory Integration in Primate Cortex

Studies of multisensory integration by single neurons have traditionally emphasized empirical principles that describe nonlinear interactions between inputs from two sensory modalities. We previously proposed that many of these empirical principles could be explained by a divisive normalization mechanism operating in brain regions where multisensory integration occurs. This normalization model makes a critical diagnostic prediction: a non-preferred sensory input from one modality, which activates the neuron on its own, should suppress the response to a preferred input from another modality. We tested this prediction by recording from neurons in macaque area MSTd that integrate visual and vestibular cues regarding self-motion. We show that many MSTd neurons exhibit the diagnostic form of cross-modal suppression, whereas unisensory neurons in area MT do not. The normalization model also fits population responses better than a model based on subtractive inhibition. These findings provide strong support for a divisive normalization mechanism in multisensory integration.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Circuits and Mechanisms for Surround Modulation in Visual Cortex

Surround modulation (SM) is a fundamental property of sensory neurons in many species and sensory modalities. SM is the ability of stimuli in the surround of a neuron's receptive field (RF) to modulate (typically suppress) the neuron's response to stimuli simultaneously presented inside the RF, a property thought to underlie optimal coding of sensory information and important perceptual functions. Understanding the circuit and mechanisms for SM can reveal fundamental principles of computations in sensory cortices, from mouse to human. Current debate is centered over whether feedforward or intracortical circuits generate SM, and whether this results from increased inhibition or reduced excitation. Here we present a working hypothesis, based on theoretical and experimental evidence, that SM results from feedforward, horizontal, and feedback interactions with local recurrent connections, via synaptic mechanisms involving both increased inhibition and reduced recurrent excitation. In particular, strong and balanced recurrent excitatory and inhibitory circuits play a crucial role in the computation of SM.

Abnormal Size-Dependent Modulation of Motion Perception in Children with Autism Spectrum Disorder (ASD)

Excitation/Inhibition (E/I) imbalance in neural networks is now considered among the core neural underpinnings of autism psychopathology. In motion perception at least two phenomena critically depend on E/I balance in visual cortex: spatial suppression (SS), and spatial facilitation (SF) corresponding to impoverished or improved motion perception with increasing stimuli size, respectively. While SS is dominant at high contrast, SF is evident for low contrast stimuli, due to the prevalence of inhibitory contextual modulations in the former, and excitatory ones in the latter case. Only one previous study (Foss-Feig et al., 2013) investigated SS and SF in Autism Spectrum Disorder (ASD). Our study aimed to replicate previous findings, and to explore the putative contribution of deficient inhibitory influences into an enhanced SF index in ASD—a cornerstone for interpretation proposed by Foss-Feig et al. (2013). The SS and SF were examined in 40 boys with ASD, broad spectrum of intellectual abilities (63 < IQ < 127) and 44 typically developing (TD) boys, aged 6–15 years. The stimuli of small (1°) and large (12°) radius were presented under high (100%) and low (1%) contrast conditions. Social Responsiveness Scale and Sensory Profile Questionnaire were used to assess the autism severity and sensory processing abnormalities. We found that the SS index was atypically reduced, while SF index abnormally enhanced in children with ASD. The presence of abnormally enhanced SF in children with ASD was the only consistent finding between our study and that of Foss-Feig et al. While the SS and SF indexes were strongly interrelated in TD participants, this correlation was absent in their peers with ASD. In addition, the SF index but not the SS index correlated with the severity of autism and the poor registration abilities. The pattern of results is partially consistent with the idea of hypofunctional inhibitory transmission in visual areas in ASD. Nonetheless, the absence of correlation between SF and SS indexes paired with a strong direct link between abnormally enhanced SF and autism symptoms in our ASD sample emphasizes the role of the enhanced excitatory influences by themselves in the observed abnormalities in low-level visual phenomena found in ASD.

Dynamics of contextual modulation of perceived shape in human vision

In biological vision, contextual modulation refers to the influence of a surround pattern on either the perception of, or the neural responses to, a target pattern. One studied form of contextual modulation deals with the effect of a surround texture on the perceived shape of a contour, in the context of the phenomenon known as the shape aftereffect. In the shape aftereffect, prolonged viewing, or adaptation to a particular contour's shape causes a shift in the perceived shape of a subsequently viewed contour. Shape aftereffects are suppressed when the adaptor contour is surrounded by a texture of similarly-shaped contours, a surprising result given that the surround contours are all potential adaptors. Here we determine the motion and temporal properties of this form of contextual modulation. We varied the relative motion directions, speeds and temporal phases between the central adaptor contour and the surround texture and measured for each manipulation the degree to which the shape aftereffect was suppressed. Results indicate that contextual modulation of shape processing is selective to motion direction, temporal frequency and temporal phase. These selectivities are consistent with one aim of vision being to segregate contours that define objects from those that form textured surfaces.

Contextual Interactions in Grating Plaid Configurations Are Explained by Natural Image Statistics and Neural Modeling

Processing natural scenes requires the visual system to integrate local features into global object descriptions. To achieve coherent representations, the human brain uses statistical dependencies to guide weighting of local feature conjunctions. Pairwise interactions among feature detectors in early visual areas may form the early substrate of these local feature bindings. To investigate local interaction structures in visual cortex, we combined psychophysical experiments with computational modeling and natural scene analysis. We first measured contrast thresholds for 2 × 2 grating patch arrangements (plaids), which differed in spatial frequency composition (low, high, or mixed), number of grating patch co-alignments (0, 1, or 2), and inter-patch distances (1° and 2° of visual angle). Contrast thresholds for the different configurations were compared to the prediction of probability summation (PS) among detector families tuned to the four retinal positions. For 1° distance the thresholds for all configurations were larger than predicted by PS, indicating inhibitory interactions. For 2° distance, thresholds were significantly lower compared to PS when the plaids were homogeneous in spatial frequency and orientation, but not when spatial frequencies were mixed or there was at least one misalignment. Next, we constructed a neural population model with horizontal laminar structure, which reproduced the detection thresholds after adaptation of connection weights. Consistent with prior work, contextual interactions were medium-range inhibition and long-range, orientation-specific excitation. However, inclusion of orientation-specific, inhibitory interactions between populations with different spatial frequency preferences were crucial for explaining detection thresholds. Finally, for all plaid configurations we computed their likelihood of occurrence in natural images. The likelihoods turned out to be inversely related to the detection thresholds obtained at larger inter-patch distances. However, likelihoods were almost independent of inter-patch distance, implying that natural image statistics could not explain the crowding-like results at short distances. This failure of natural image statistics to resolve the patch distance modulation of plaid visibility remains a challenge to the approach.

Toward an Integration of Deep Learning and Neuroscience

Neuroscience has focused on the detailed implementation of computation, studying neural codes, dynamics and circuits. In machine learning, however, artificial neural networks tend to eschew precisely designed codes, dynamics or circuits in favor of brute force optimization of a cost function, often using simple and relatively uniform initial architectures. Two recent developments have emerged within machine learning that create an opportunity to connect these seemingly divergent perspectives. First, structured architectures are used, including dedicated systems for attention, recursion and various forms of short- and long-term memory storage. Second, cost functions and training procedures have become more complex and are varied across layers and over time. Here we think about the brain in terms of these ideas. We hypothesize that (1) the brain optimizes cost functions, (2) the cost functions are diverse and differ across brain locations and over development, and (3) optimization operates within a pre-structured architecture matched to the computational problems posed by behavior. In support of these hypotheses, we argue that a range of implementations of credit assignment through multiple layers of neurons are compatible with our current knowledge of neural circuitry, and that the brain's specialized systems can be interpreted as enabling efficient optimization for specific problem classes. Such a heterogeneously optimized system, enabled by a series of interacting cost functions, serves to make learning data-efficient and precisely targeted to the needs of the organism. We suggest directions by which neuroscience could seek to refine and test these hypotheses.

Early suppression effect in human primary visual cortex during Kanizsa illusion processing: A magnetoencephalographic evidence

Detection of illusory contours (ICs) such as Kanizsa figures is known to depend primarily upon the lateral occipital complex. Yet there is no universal agreement on the role of the primary visual cortex in this process; some existing evidence hints that an early stage of the visual response in V1 may involve relative suppression to Kanizsa figures compared with controls. Iso-oriented luminance borders, which are responsible for Kanizsa illusion, may evoke surround suppression in V1 and adjacent areas leading to the reduction in the initial response to Kanizsa figures. We attempted to test the existence, as well as to find localization and timing of the early suppression effect produced by Kanizsa figures in adult nonclinical human participants. We used two sizes of visual stimuli (4.5 and 9.0°) in order to probe the effect at two different levels of eccentricity; the stimuli were presented centrally in passive viewing conditions. We recorded magnetoencephalogram, which is more sensitive than electroencephalogram to activity originating from V1 and V2 areas. We restricted our analysis to the medial occipital area and the occipital pole, and to a 40-120 ms time window after the stimulus onset. By applying threshold-free cluster enhancement technique in combination with permutation statistics, we were able to detect the inverted IC effect-a relative suppression of the response to the Kanizsa figures compared with the control stimuli. The current finding is highly compatible with the explanation involving surround suppression evoked by iso-oriented collinear borders. The effect may be related to the principle of sparse coding, according to which V1 suppresses representations of inner parts of collinear assemblies as being informationally redundant. Such a mechanism is likely to be an important preliminary step preceding object contour detection.

Is the Cortical Deficit in Amblyopia Due to Reduced Cortical Magnification, Loss of Neural Resolution, or Neural Disorganization?

The neural basis of amblyopia is a matter of debate. The following possibilities have been suggested: loss of foveal cells, reduced cortical magnification, loss of spatial resolution of foveal cells, and topographical disarray in the cellular map. To resolve this we undertook a population receptive field (pRF) functional magnetic resonance imaging analysis in the central field in humans with moderate-to-severe amblyopia. We measured the relationship between averaged pRF size and retinal eccentricity in retinotopic visual areas. Results showed that cortical magnification is normal in the foveal field of strabismic amblyopes. However, the pRF sizes are enlarged for the amblyopic eye. We speculate that the pRF enlargement reflects loss of cellular resolution or an increased cellular positional disarray within the representation of the amblyopic eye.

SIGNIFICANCE STATEMENT

The neural basis of amblyopia, a visual deficit affecting 3% of the human population, remains a matter of debate. We undertook the first population receptive field functional magnetic resonance imaging analysis in participants with amblyopia and compared the projections from the amblyopic and fellow normal eye in the visual cortex. The projection from the amblyopic eye was found to have a normal cortical magnification factor, enlarged population receptive field sizes, and topographic disorganization in all early visual areas. This is consistent with an explanation of amblyopia as an immature system with a normal complement of cells whose spatial resolution is reduced and whose topographical map is disordered. This bears upon a number of competing theories for the psychophysical defect and affects future treatment therapies.

Single additive mechanism predicts lateral interactions effects-computational model

The mechanism underlying the lateral interactions (LI) phenomenon is still an enigma. Over the years, several groups have tried to explain the phenomenon and suggested models to predict its psychophysical results. Most of these models comprise both inhibitory and facilitatory mechanisms for describing the LI phenomenon. Their studies' assumption that a significant inhibition mechanism exists is based on the classical interpretation of the threshold elevation perceived in psychophysical experiments. In this work, we suggest a different interpretation of the threshold elevation obtained experimentally. Our model proposes and demonstrates how a facilitatory additive mechanism can solely predict both the facilitation and "inhibition" aspects of the phenomenon, without the need for an additional inhibitory mechanism, at least for the two flankers' configurations. Though the model is simple it succeeds to predict the LI effect under a large variety of stimuli configurations and parameters. The model is in agreement with both classical and recent psychophysical and neurophysiological results. We suggest that the LI mechanism plays a role in creating an educated guess to form a continuation of gratings and textures based on the surrounding visual stimuli.

Limitations of short range Mexican hat connection for driving target selection in a 2D neural field: activity suppression and deviation from input stimuli

Dynamic Neural Field models (DNF) often use a kernel of connection with short range excitation and long range inhibition. This organization has been suggested as a model for brain structures or for artificial systems involved in winner-take-all processes such as saliency localization, perceptual decision or target/action selection. A good example of such a DNF is the superior colliculus (SC), a key structure for eye movements. Recent results suggest that the superficial layers of the SC (SCs) exhibit relatively short range inhibition with a longer time constant than excitation. The aim of the present study was to further examine the properties of a DNF with such an inhibition pattern in the context of target selection. First we tested the effects of stimulus size and shape on when and where self-maintained clusters of firing neurons appeared, using three variants of the model. In each model variant, small stimuli led to rapid formation of a spiking cluster, a range of medium sizes led to the suppression of any activity on the network and hence to no target selection, while larger sizes led to delayed selection of multiple loci. Second, we tested the model with two stimuli separated by a varying distance. Again single, none, or multiple spiking clusters could occur, depending on distance and relative stimulus strength. For short distances, activity attracted toward the strongest stimulus, reminiscent of well-known behavioral data for saccadic eye movements, while for larger distances repulsion away from the second stimulus occurred. All these properties predicted by the model suggest that the SCs, or any other neural structure thought to implement a short range MH, is an imperfect winner-take-all system. Although, those properties call for systematic testing, the discussion gathers neurophysiological and behavioral data suggesting that such properties are indeed present in target selection for saccadic eye movements.