Lateral inhibition between orientation detectors in the cat's visual cortex

Transformers and cortical waves: encoders for pulling in context across time

The capabilities of transformer networks such as ChatGPT and other large language models (LLMs) have captured the world's attention. The crucial computational mechanism underlying their performance relies on transforming a complete input sequence - for example, all the words in a sentence - into a long 'encoding vector' that allows transformers to learn long-range temporal dependencies in naturalistic sequences. Specifically, 'self-attention' applied to this encoding vector enhances temporal context in transformers by computing associations between pairs of words in the input sequence. We suggest that waves of neural activity traveling across single cortical areas, or multiple regions on the whole-brain scale, could implement a similar encoding principle. By encapsulating recent input history into a single spatial pattern at each moment in time, cortical waves may enable a temporal context to be extracted from sequences of sensory inputs, the same computational principle as that used in transformers.

Synapse-type-specific competitive Hebbian learning forms functional recurrent networks

Cortical networks exhibit complex stimulus-response patterns that are based on specific recurrent interactions between neurons. For example, the balance between excitatory and inhibitory currents has been identified as a central component of cortical computations. However, it remains unclear how the required synaptic connectivity can emerge in developing circuits where synapses between excitatory and inhibitory neurons are simultaneously plastic. Using theory and modeling, we propose that a wide range of cortical response properties can arise from a single plasticity paradigm that acts simultaneously at all excitatory and inhibitory connections-Hebbian learning that is stabilized by the synapse-type-specific competition for a limited supply of synaptic resources. In plastic recurrent circuits, this competition enables the formation and decorrelation of inhibition-balanced receptive fields. Networks develop an assembly structure with stronger synaptic connections between similarly tuned excitatory and inhibitory neurons and exhibit response normalization and orientation-specific center-surround suppression, reflecting the stimulus statistics during training. These results demonstrate how neurons can self-organize into functional networks and suggest an essential role for synapse-type-specific competitive learning in the development of cortical circuits.

Non-uniform contextual interactions in the visual cortex place fundamental limits on spatial vision

A prevailing assumption in our understanding of how neurons in the primary visual cortex (V1) integrate contextual information is that such processes are spatially uniform. Conversely, perceptual phenomena such as visual crowding, the impaired ability to accurately recognize a target stimulus among distractors, suggest that interactions among stimuli are distinctly non-uniform. Prior studies have shown flankers at specific spatial geometries exert differential effects on target perception. To resolve this discrepancy, we investigated how flanker geometry impacted the representation of a target stimulus in the laminar microcircuits of V1. Our study reveals flanker location differentially impairs stimulus representation in excitatory neurons in the superficial and input layers of V1 by tuned suppression and untuned facilitation of orientation responses. Mechanistically, this effect can be explained by asymmetrical spatial kernels in a normalization model of cortical activity. Strikingly, these non-uniform modulations of neural representation mirror perceptual anisotropies. These results establish the non-uniform spatial integration of information in the earliest stages of cortical processing as a fundamental limitation of spatial vision.

Waves traveling over a map of visual space can ignite short-term predictions of sensory input

Recent analyses have found waves of neural activity traveling across entire visual cortical areas in awake animals. These traveling waves modulate the excitability of local networks and perceptual sensitivity. The general computational role of these spatiotemporal patterns in the visual system, however, remains unclear. Here, we hypothesize that traveling waves endow the visual system with the capacity to predict complex and naturalistic inputs. We present a network model whose connections can be rapidly and efficiently trained to predict individual natural movies. After training, a few input frames from a movie trigger complex wave patterns that drive accurate predictions many frames into the future solely from the network's connections. When the recurrent connections that drive waves are randomly shuffled, both traveling waves and the ability to predict are eliminated. These results suggest traveling waves may play an essential computational role in the visual system by embedding continuous spatiotemporal structures over spatial maps.

Surround suppression in mouse auditory cortex underlies auditory edge detection

Surround suppression (SS) is a fundamental property of sensory processing throughout the brain. In the auditory system, the early processing stream encodes sounds using a one dimensional physical space-frequency. Previous studies in the auditory system have shown SS to manifest as bandwidth tuning around the preferred frequency. We asked whether bandwidth tuning can be found around frequencies away from the preferred frequency. We exploited the simplicity of spectral representation of sounds to study SS by manipulating both sound frequency and bandwidth. We recorded single unit spiking activity from the auditory cortex (ACx) of awake mice in response to an array of broadband stimuli with varying central frequencies and bandwidths. Our recordings revealed that a significant portion of neuronal response profiles had a preferred bandwidth that varied in a regular way with the sound's central frequency. To gain insight into the possible mechanism underlying these responses, we modelled neuronal activity using a variation of the "Mexican hat" function often used to model SS. The model accounted for response properties of single neurons with high accuracy. Our data and model show that these responses in ACx obey simple rules resulting from the presence of lateral inhibitory sidebands, mostly above the excitatory band of the neuron, that result in sensitivity to the location of top frequency edges, invariant to other spectral attributes. Our work offers a simple explanation for auditory edge detection and possibly other computations of spectral content in sounds.

Exercise does not enhance short-term deprivation-induced ocular dominance plasticity: evidence from dichoptic surround suppression

The input from the two eyes is combined in the brain. In this combination, the relative strength of the input from each eye is determined by the ocular dominance. Recent work has shown that this dominance can be temporarily shifted. Covering one eye with an eye patch for a few hours makes its contribution stronger. It has been proposed that this shift can be enhanced by exercise. Here, we test this hypothesis using a dichoptic surround suppression task, and with exercise performed according to American College of Sport Medicine guidelines. We measured detection thresholds for patches of sinusoidal grating shown to one eye. When an annular mask grating was shown simultaneously to the other eye, thresholds were elevated. The difference in the elevation found in each eye is our measure of relative eye dominance. We made these measurements before and after 120 min of monocular deprivation (with an eye patch). In the control condition, subjects rested during this time. For the exercise condition, 30 min of exercise were performed at the beginning of the patching period. This was followed by 90 min of rest. We find that patching results in a shift in ocular dominance that can be measured using dichoptic surround suppression. However, we find no effect of exercise on the magnitude of this shift. We further performed a meta-analysis on the four studies that have examined the effects of exercise on the dominance shift. Looking across these studies, we find no evidence for such an effect.

Tuning Convolutional Spiking Neural Network With Biologically Plausible Reward Propagation

Spiking neural networks (SNNs) contain more biologically realistic structures and biologically inspired learning principles than those in standard artificial neural networks (ANNs). SNNs are considered the third generation of ANNs, powerful on the robust computation with a low computational cost. The neurons in SNNs are nondifferential, containing decayed historical states and generating event-based spikes after their states reaching the firing threshold. These dynamic characteristics of SNNs make it difficult to be directly trained with the standard backpropagation (BP), which is also considered not biologically plausible. In this article, a biologically plausible reward propagation (BRP) algorithm is proposed and applied to the SNN architecture with both spiking-convolution (with both 1-D and 2-D convolutional kernels) and full-connection layers. Unlike the standard BP that propagates error signals from postsynaptic to presynaptic neurons layer by layer, the BRP propagates target labels instead of errors directly from the output layer to all prehidden layers. This effort is more consistent with the top-down reward-guiding learning in cortical columns of the neocortex. Synaptic modifications with only local gradient differences are induced with pseudo-BP that might also be replaced with the spike-timing-dependent plasticity (STDP). The performance of the proposed BRP-SNN is further verified on the spatial (including MNIST and Cifar-10) and temporal (including TIDigits and DvsGesture) tasks, where the SNN using BRP has reached a similar accuracy compared to other state-of-the-art (SOTA) BP-based SNNs and saved 50% more computational cost than ANNs. We think that the introduction of biologically plausible learning rules to the training procedure of biologically realistic SNNs will give us more hints and inspiration toward a better understanding of the biological system's intelligent nature.

Unification of free energy minimization, spatiotemporal energy, and dimension reduction models of V1 organization: Postnatal learning on an antenatal scaffold

Developmental selection of neurons and synapses so as to maximize pulse synchrony has recently been used to explain antenatal cortical development. Consequences of the same selection process—an application of the Free Energy Principle—are here followed into the postnatal phase in V1, and the implications for cognitive function are considered. Structured inputs transformed via lag relay in superficial patch connections lead to the generation of circumferential synaptic connectivity superimposed upon the antenatal, radial, “like-to-like” connectivity surrounding each singularity. The spatiotemporal energy and dimension reduction models of cortical feature preferences are accounted for and unified within the expanded model, and relationships of orientation preference (OP), space frequency preference (SFP), and temporal frequency preference (TFP) are resolved. The emergent anatomy provides a basis for “active inference” that includes interpolative modification of synapses so as to anticipate future inputs, as well as learn directly from present stimuli. Neurodynamic properties are those of heteroclinic networks with coupled spatial eigenmodes.

Gamma oscillations in primate primary visual cortex are severely attenuated by small stimulus discontinuities

Gamma oscillations (30 to 80 Hz) have been hypothesized to play an important role in feature binding, based on the observation that continuous long bars induce stronger gamma in the visual cortex than bars with a small gap. Recently, many studies have shown that natural images, which have discontinuities in several low-level features, do not induce strong gamma oscillations, questioning their role in feature binding. However, the effect of different discontinuities on gamma has not been well studied. To address this, we recorded spikes and local field potential from 2 monkeys while they were shown gratings with discontinuities in 4 attributes: space, orientation, phase, or contrast. We found that while these discontinuities only had a modest effect on spiking activity, gamma power drastically reduced in all cases, suggesting that gamma could be a resonant phenomenon. An excitatory–inhibitory population model with stimulus-tuned recurrent inputs showed such resonant properties. Therefore, gamma could be a signature of excitation–inhibition balance, which gets disrupted due to discontinuities.

Gamma oscillations (30-80 Hz) in visual cortex have been hypothesized to play an important role in feature binding, but this role has recently been questioned. This study shows that visual stimulus-induced gamma oscillations are highly attenuated with even small discontinuities in the stimulus. This "resonant" behaviour can be explained by a simple excitatory-inhibitory model in which discontinuities lead to a small reduction in lateral inputs.

Surround Modulation Properties of Tectal Neurons in Pigeons Characterized by Moving and Flashed Stimuli

Simple Summary

Surround modulation is a basic visual attribute of sensory neurons in many species and has been extensively characterized in mammal primary visual cortex, lateral geniculate nucleus, and superior colliculus. Little attention has been paid to birds, which have a highly developed visual system. We undertook a systematic analysis on surround modulation properties of tectal neurons in pigeons (Columba livia). This study complements existing studies on surrounding modulation properties in non-mammalian species and deepens the understanding of mechanisms of figure–background segmentation performed by avians.

Abstract

Surround modulation has been abundantly studied in several mammalian brain areas, including the primary visual cortex, lateral geniculate nucleus, and superior colliculus (SC), but systematic analysis is lacking in the avian optic tectum (OT, homologous to mammal SC). Here, multi-units were recorded from pigeon (Columba livia) OT, and responses to different sizes of moving, flashed squares, and bars were compared. The statistical results showed that most tectal neurons presented suppressed responses to larger stimuli in both moving and flashed paradigms, and suppression induced by flashed squares was comparable with moving ones when the stimuli center crossed the near classical receptive field (CRF) center, which corresponded to the full surrounding condition. Correspondingly, the suppression grew weaker when the stimuli center moved across the CRF border, equivalent to partially surrounding conditions. Similarly, suppression induced by full surrounding flashed squares was more intense than by partially surrounding flashed bars. These results suggest that inhibitions performed on tectal neurons appear to be full surrounding rather than locally lateral. This study enriches the understanding of surround modulation properties of avian tectum neurons and provides possible hypotheses about the arrangement of inhibitions from other nuclei, both of which are important for clarifying the mechanism of target detection against clutter background performed by avians.

The role of lateral modulation in orientation-specific adaptation effect

Center-surround modulation in visual processing reflects a normalization process of contrast gain control in the responsive neurons. Prior adaptation to a clockwise (CW) tilted grating, for example, leads to the percept of counterclockwise tilt in a vertical grating, referred to as the tilt-aftereffect (TAE). We previously reported that the magnitude of the TAE is modulated by adding a same-orientation annular surround to an adapter, suggesting inhibitory lateral modulation. To further examine the property of this lateral modulation effect on the perception of a central target, we here used center-surround sinusoidal patterns as adapters and varied the adapter surround and center orientations independently. The target had the same spatial extent as the adapter center with no physical overlap with the adapter surround. Participants were asked to judge the target orientation as tilted either CW or counterclockwise from vertical after adaptation. Results showed that, when the surround orientation was held constant, the TAE magnitude was determined by the adapter center, peaking between 10° and 20° of tilt. More important, the adapter surround orientation modulated the adaptation effect such that the TAE magnitude first decreased and then increased as the surround orientation became increasingly more different from that of the center, suggesting that the surround modulation effect was indeed orientation specific. Our data can be accounted for by a divisive inhibition model, in which (1) the adaptation effect is represented by increasing the normalizing constant and (2) the surround modulation is captured by two multiplicative sensitivity parameters determined by the adapter surround orientation.

Feedforward mechanisms of cross-orientation interactions in mouse V1

Sensory neurons are modulated by context. For example, in mouse primary visual cortex (V1), neuronal responses to the preferred orientation are modulated by the presence of superimposed orientations ("plaids"). The effects of this modulation are diverse; some neurons are suppressed, while others have larger responses to a plaid than its components. We investigated whether this diversity could be explained by a unified circuit mechanism. We report that this masking is maintained during suppression of cortical activity, arguing against cortical mechanisms. Instead, the heterogeneity of plaid responses is explained by an interaction between stimulus geometry and orientation tuning. Highly selective neurons are uniformly suppressed by plaids, whereas the effects in weakly selective neurons depend on the spatial configuration of the stimulus, transitioning systematically between suppression and facilitation. Thus, the diverse responses emerge as a consequence of the spatial structure of feedforward inputs, with no need to invoke cortical interactions.

Synthesis of a comprehensive population code for contextual features in the awake sensory cortex

How cortical circuits build representations of complex objects is poorly understood. Individual neurons must integrate broadly over space, yet simultaneously obtain sharp tuning to specific global stimulus features. Groups of neurons identifying different global features must then assemble into a population that forms a comprehensive code for these global stimulus properties. Although the logic for how single neurons summate over their spatial inputs has been well explored in anesthetized animals, how large groups of neurons compose a flexible population code of higher-order features in awake animals is not known. To address this question, we probed the integration and population coding of higher-order stimuli in the somatosensory and visual cortices of awake mice using two-photon calcium imaging across cortical layers. We developed a novel tactile stimulator that allowed the precise measurement of spatial summation even in actively whisking mice. Using this system, we found a sparse but comprehensive population code for higher-order tactile features that depends on a heterogeneous and neuron-specific logic of spatial summation beyond the receptive field. Different somatosensory cortical neurons summed specific combinations of sensory inputs supra-linearly, but integrated other inputs sub-linearly, leading to selective responses to higher-order features. Visual cortical populations employed a nearly identical scheme to generate a comprehensive population code for contextual stimuli. These results suggest that a heterogeneous logic of input-specific supra-linear summation may represent a widespread cortical mechanism for the synthesis of sparse higher-order feature codes in neural populations. This may explain how the brain exploits the thalamocortical expansion of dimensionality to encode arbitrary complex features of sensory stimuli.

Optimizing the strength of the Bourdon effect by varying the triangle arrangement

The Bourdon illusion refers to the perceived bentness of the straight collinear edges when two right-angled triangles are placed apex to apex. We studied this illusion using a cancellation method. In the first of three experiments, we manipulated the apex angle, with six different angles ranging from 4° to 45°. Results indicated that the Bourdon illusion is strongest when the angle is around 12°. In the second experiment, we compared four scalene triangles with a right-angled triangle. The angular shift was most salient when the shape corresponded to a right-angled triangle. In the third experiment, the patterns were created by varying the size of one right-angled triangle while holding the size of the second right-angled triangle constant. Results indicated that the Bourdon illusion was strongest when both right-angled triangles were of equal size. Our data suggest that the Bourdon illusion depends critically upon the specific arrangement of shapes in the display.

Chromatic Induction in Migraine

The human visual system is not a colorimeter. The perceived colour of a region does not only depend on its colour spectrum, but also on the colour spectra and geometric arrangement of neighbouring regions, a phenomenon called chromatic induction. Chromatic induction is thought to be driven by lateral interactions: the activity of a central neuron is modified by stimuli outside its classical receptive field through excitatory-inhibitory mechanisms. As there is growing evidence of an excitation/inhibition imbalance in migraine, we compared chromatic induction in migraine and control groups. As hypothesised, we found a difference in the strength of induction between the two groups, with stronger induction effects in migraine. On the other hand, given the increased prevalence of visual phenomena in migraine with aura, we also hypothesised that the difference between migraine and control would be more important in migraine with aura than in migraine without aura. Our experiments did not support this hypothesis. Taken together, our results suggest a link between excitation/inhibition imbalance and increased induction effects.

Encoding of Partially Occluded and Occluding Objects in Primate Inferior Temporal Cortex

Object segmentation-the process of parsing visual scenes-is essential for object recognition and scene understanding. We investigated how responses of neurons in macaque inferior temporal (IT) cortex contribute to object segmentation under partial occlusion. Specifically, we asked whether IT responses to occluding and occluded objects are bound together as in the visual image or linearly separable reflecting their segmentation. We recorded the activity of 121 IT neurons while two male animals performed a shape discrimination task under partial occlusion. We found that for a majority (60%) of neurons, responses were enhanced by partial occlusion, but they were only weakly shape selective for the discriminanda at all levels of occlusion. Enhancement of IT responses in these neurons depended largely on the area of occlusion but only minimally on the color and shape of the occluding dots. In contrast to the above group of neurons, a sizable minority responded best to the unoccluded stimulus and showed strong selectivity for the shape of the discriminanda. In these neurons, response magnitude and shape selectivity declined with increasing levels of occlusion. Simulations revealed that the response characteristics of both classes of neurons were consistent with a model in which the responses to the occluded shape and the occluders are weighted separately and linearly combined. Overall, our results support the hypothesis that information about occluded and occluding stimuli are linearly separable and easily decodable from IT responses and that IT neurons encode a segmented representation of the visual scene.SIGNIFICANCE STATEMENT Recognizing partially occluded objects can be challenging, yet the primate visual system achieves it rapidly and effortlessly. For successful recognition in the face of occlusion, segmentation of the occluded and occluding objects is a critical first step. Using a combination of experimental data and simulations, here we demonstrate that responses of neurons in macaque IT cortex, the highest stage of the form processing pathway, reflect occluded and occluding stimuli as segmented components and are not bound together as they appear in the visual image. These results support the idea that segmentation and perception of occluded and occluding stimuli are directly mirrored in the responses of neurons in the highest form processing stages.

Learning divisive normalization in primary visual cortex

Divisive normalization (DN) is a prominent computational building block in the brain that has been proposed as a canonical cortical operation. Numerous experimental studies have verified its importance for capturing nonlinear neural response properties to simple, artificial stimuli, and computational studies suggest that DN is also an important component for processing natural stimuli. However, we lack quantitative models of DN that are directly informed by measurements of spiking responses in the brain and applicable to arbitrary stimuli. Here, we propose a DN model that is applicable to arbitrary input images. We test its ability to predict how neurons in macaque primary visual cortex (V1) respond to natural images, with a focus on nonlinear response properties within the classical receptive field. Our model consists of one layer of subunits followed by learned orientation-specific DN. It outperforms linear-nonlinear and wavelet-based feature representations and makes a significant step towards the performance of state-of-the-art convolutional neural network (CNN) models. Unlike deep CNNs, our compact DN model offers a direct interpretation of the nature of normalization. By inspecting the learned normalization pool of our model, we gained insights into a long-standing question about the tuning properties of DN that update the current textbook description: we found that within the receptive field oriented features were normalized preferentially by features with similar orientation rather than non-specifically as currently assumed.

The density effect in centroid estimation is blind to contrast polarity

Human vision is highly efficient in estimating the centroids of spatially scattered items. However, the processes underlying this remarkable skill remain poorly understood. A salient fact is that in estimating the centroids of dot-clouds, observers underweight densely packed dots relative to isolated dots; thus, when an observer estimates the centroid of a dot cloud, the weight exerted on the subject's response by a given dot tends to be suppressed by other dots near it. The current experiment sought to determine whether dots of contrast polarity equal vs. opposite to a given dot differ in how they alter the weight it exerts. Six observers were tested in a task that used brief (180 ms), Gaussian clouds that mixed 9 white and 9 black dots on a gray background. On each trial, the observer strove to mouse-click the centroid of the stimulus cloud weighting all dots equally. The model used to describe the results allows the weight exerted on the subject's response by a given dot to depend on its peripherality in the stimulus cloud as well as on the density of same- and opposite-polarity dots surrounding it. For four observers, peripheral dots exerted lower influence than central dots on responses; the other two showed little effect of peripherality. For all observers, dots in high-density regions exerted less weight on responses than dots in low-density regions. Concerning the primary research question: dots of opposite vs. the same polarity as a given dot suppressed the weight it exerted with equal effectiveness. This suggests that the site of the interaction producing the density effect is a neural population that registers positive and negative contrast polarities in the same way.

The attentional template in high and low similarity search: Optimal tuning or tuning to relations?

The attentional template is often described as the mental representation that drives attentional selection and guidance, for instance, in visual search. Recent research suggests that this template is not a veridical representation of the sought-for target, but instead an altered representation that allows more efficient search. The current paper contrasts two such theories. Firstly, the Optimal Tuning account which posits that the attentional template shifts to an exaggerated target value to maximise the signal-to-noise ratio between similar targets and non-targets. Secondly, the Relational account which states that instead of tuning to feature values, attention is directed to the relative value created by the search context, e.g. all redder items or the reddest item. Both theories are empirically supported, but used different paradigms (perceptual decision tasks vs. visual search), and different attentional measures (probe response accuracy vs. gaze capture). The current design incorporates both paradigms and measures. The results reveal that while Optimal Tuning shifts are observed in probe trials they do not drive early attention or eye- movement behaviour in visual search. Instead, early attention follows the Relational Account, selecting all items with the relative target colour (e.g., redder). This suggests that the masked probe trials used in Optimal Tuning do not probe the attentional template that guides attention. In Experiment 3 we find that optimal tuning shifts correspond in magnitude to purely perceptual shifts created by contrast biases in the visual search arrays. This suggests that the shift in probe responses may in fact be a perceptual artefact rather than a strategic adaptation to optimise the signal-to-noise ratio. These results highlight the distinction between early attentional mechanisms and later, target identification mechanisms. SIGNIFICANCE STATEMENT: Classical theories of attention suggest that attention is guided by a feature-specific target template. In recent designs this has been challenged by an apparent non- veridical tuning of the template in situations where the target stimulus is similar to non-targets. The current studies compare two theories that propose different explanations for non-veridical tuning; the Relational and the Optimal Tuning account. We show that the Relational account describes the mechanism that guides early search behaviour, while the Optimal Tuning account describes perceptual decision-making. Optimal Tuning effects may be due to an artefact that has not been described in visual search before (simultaneous contrast).

Contradictory influence of context on predominance during binocular rivalry

BACKGROUND

Binocular rivalry is a complex process characterised by alternations in perceptual suppression and dominance that result when two different images are presented simultaneously to the left and right eyes. It has been reported recently that the addition of contextual cues will promote the predominance of the context consistent rivalry target. In contrast to Levelt's second proposition (1965), this effect has been found to result exclusively from an increase in the dominance phase duration, while the suppression phase duration remains unaffected.

METHODS

Human subjects were simultaneously presented with a small (2 degrees ) disc consisting of gratings (four cycles per degree) of different orientations to the two eyes. Four experiments were conducted to ascertain the effects of background gratings and contextual colour information on target predominance and phase duration. For each of the four experimental conditions, the orientation and colour of the target gratings and surrounding contextual background were systematically manipulated.

RESULTS

In this study, we report an effect opposite to that of Levelt. Contradictory contextual information increases target predominance and phase duration during binocular rivalry. Our results demonstrate that it is possible to promote the dominance of the context contradictory percept with co-linearity, co-chromaticity and orientation cues. In line with previous studies involving context, we find that this effect on predominance is due to an increase in the duration of the dominance rather than the suppression phase.

DISCUSSION

We discuss our findings in respect to those from previous studies and consider high- and low-level processes that may be responsible for these apparently 'contradictory' roles of context on binocular rivalry. In addition, we discuss how the apparent 'anti-Levelt' effect of context can be reinterpreted in a manner that brings it back in line with Levelt's second proposition and raises the question of whether 'suppressability' plays a disproportionately large role in determining the duration of perceptual phases in binocular rivalry.

Exploitation of image statistics with sparse coding in the case of stereo vision

The sparse coding algorithm has served as a model for early processing in mammalian vision. It has been assumed that the brain uses sparse coding to exploit statistical properties of the sensory stream. We hypothesize that sparse coding discovers patterns from the data set, which can be used to estimate a set of stimulus parameters by simple readout. In this study, we chose a model of stereo vision to test our hypothesis. We used the Locally Competitive Algorithm (LCA), followed by a naïve Bayes classifier, to infer stereo disparity. From the results we report three observations. First, disparity inference was successful with this naturalistic processing pipeline. Second, an expanded, highly redundant representation is required to robustly identify the input patterns. Third, the inference error can be predicted from the number of active coefficients in the LCA representation. We conclude that sparse coding can generate a suitable general representation for subsequent inference tasks.

A Disinhibitory Circuit for Contextual Modulation in Primary Visual Cortex

Context guides perception by influencing stimulus saliency. Accordingly, in visual cortex, responses to a stimulus are modulated by context, the visual scene surrounding the stimulus. Responses are suppressed when stimulus and surround are similar but not when they differ. The underlying mechanisms remain unclear. Here, we use optical recordings, manipulations, and computational modeling to show that disinhibitory circuits consisting of vasoactive intestinal peptide (VIP)-expressing and somatostatin (SOM)-expressing inhibitory neurons modulate responses in mouse visual cortex depending on similarity between stimulus and surround, primarily by modulating recurrent excitation. When stimulus and surround are similar, VIP neurons are inactive, and activity of SOM neurons leads to suppression of excitatory neurons. However, when stimulus and surround differ, VIP neurons are active, inhibiting SOM neurons, which leads to relief of excitatory neurons from suppression. We have identified a canonical cortical disinhibitory circuit that contributes to contextual modulation and may regulate perceptual saliency.

Somatosensory evoked potentials that index lateral inhibition are modulated according to the mode of perceptual processing: comparing or combining multi-digit tactile motion

Many perceptual studies focus on the brain's capacity to discriminate between stimuli. However, our normal experience of the world also involves integrating multiple stimuli into a single perceptual event. Neural mechanisms such as lateral inhibition are believed to enhance local differences between sensory inputs from nearby regions of the receptor surface. However, this mechanism would seem dysfunctional when sensory inputs need to be combined rather than contrasted. Here, we investigated whether the brain can strategically regulate the strength of suppressive interactions that underlie lateral inhibition between finger representations in human somatosensory processing. To do this, we compared sensory processing between conditions that required either comparing or combining information. We delivered two simultaneous tactile motion trajectories to index and middle fingertips of the right hand. Participants had to either compare the directions of the two stimuli, or to combine them to form their average direction. To reveal preparatory tuning of somatosensory cortex, we used an established event-related potential design to measure the interaction between cortical representations evoked by digital nerve shocks immediately before each tactile stimulus. Consistent with previous studies, we found a clear suppression between cortical activations when participants were instructed to compare the tactile motion directions. Importantly, this suppression was significantly reduced when participants had to combine the same stimuli. These findings suggest that the brain can strategically switch between a comparative and a combinative mode of somatosensory processing, according to the perceptual goal, by preparatorily adjusting the strength of a process akin to lateral inhibition.

Characterising the orientation-specific pattern-onset visual evoked potentials in children with bilateral refractive amblyopia and non-amblyopic controls

PURPOSE

An orientation-specific visual evoked potential (osVEP) protocol was developed to probe meridional anisotropies in children with refractive amblyopia. The aim was to characterise the osVEP response in children with bilateral refractive amblyopia, evaluate the intra-session repeatability of the main osVEP components (C1, C2 and C3), coefficient of repeatability (CoR) of the response to gratings in different meridians and determine if refractive amblyopes have poorer repeatability as compared with non-amblyopic controls.

METHODS

Children aged 4-7 years with newly diagnosed and untreated bilateral refractive amblyopia and non-amblyopic controls were recruited. Orientation-specific pattern-onset VEPs were recorded in response to an achromatic sinewave grating stimulus of 4 cycles per degree under monocular and binocular stimulation. The grating lines used for monocular stimulation were parallel with the subjects' most positive and negative astigmatic meridians when considered in sphero-minus cylinder form (Meridians 1 and 2, respectively). In subjects without astigmatism, meridians 1 and 2 were designated horizontal and vertical gratings, respectively. Binocular stimuli were presented with grating lines parallel to meridians 45, 90, 135 and 180°. The repeatability of latencies of the main osVEP components (C1, C2 and C3) were investigated using two successive osVEPs recordings for each stimulus meridian and the CoR for each component's latencies were assessed.

RESULTS

Seven amblyopic children (Visual acuity (VA) ranging from 0.08 to 0.40 LogMAR in the less amblyopic eye and 0.26-0.52 LogMAR in the more amblyopic eye) and 7 non-amblyopic controls (VA ranging from 0.00 to 0.02 LogMAR in either eye), with a median age of 4.6 and 7.0 years, respectively, completed the study. C1 had the highest CoR for most conditions assessed. Ratio of CoRs C1:C2 was > 2 for all binocular meridians in controls and the 90 and 180 meridians in the amblyopes; C1:C3 was > 2 for the binocularly assessed 45, 90 and 135 meridians in the controls and the 90 and 180 meridians in the amblyopes; C2:C3 were all < 2 for all meridians assessed in both groups.

CONCLUSIONS

The osVEP waveforms are reliable and useful for future investigations into the meridional anisotropies in children with refractive amblyopia, particularly the C3 component. Component C1 had the poorest repeatability, which consequentially affected C2 amplitude estimation. Only C3 amplitude and latency could be consistently estimated as C2 and C3 latencies were similarly repeatable. Coefficients of repeatability of osVEP latencies did not appear to systematically differ between non-amblyopic and amblyopic children.

Visual Functions of Primate Area V4

Area V4-the focus of this review-is a mid-level processing stage along the ventral visual pathway of the macaque monkey. V4 is extensively interconnected with other visual cortical areas along the ventral and dorsal visual streams, with frontal cortical areas, and with several subcortical structures. Thus, it is well poised to play a broad and integrative role in visual perception and recognition-the functional domain of the ventral pathway. Neurophysiological studies in monkeys engaged in passive fixation and behavioral tasks suggest that V4 responses are dictated by tuning in a high-dimensional stimulus space defined by form, texture, color, depth, and other attributes of visual stimuli. This high-dimensional tuning may underlie the development of object-based representations in the visual cortex that are critical for tracking, recognizing, and interacting with objects. Neurophysiological and lesion studies also suggest that V4 responses are important for guiding perceptual decisions and higher-order behavior.

Lateral modulation of orientation perception in center-surround sinusoidal stimuli: Divisive inhibition in perceptual filling-in

The perception of a target stimulus may be altered by its context. Perceptual filling-in is thought to be one example of lateral modulation, in which the percept of a central blank area is replaced by that of the surround. We investigated the mechanisms in eccentric vision underlying filling-in by selectively adapting the center (pedestal adapter), surround (annulus adapter), or both (disk adapter) in a sinusoidal grating and observed how the adaptation influences the orientation percept of a subsequently presented Gabor target, located at the same position as the adapter center. In a binary choice task, observers were to judge the orientation (clockwise or counterclockwise) of the target after adaptation. The tilt aftereffect (TAE), corresponding to an illusory tilt of a physically vertical Gabor target, depended both on the adapter orientation and the adapter type. The TAE, peaked between 10 degrees and 20 degrees adapter orientation, was strongest in the pedestal, followed by the disk, and weakest in the annulus adapter conditions. The difference between the disk and pedestal conditions implies lateral inhibition from the surround. Lacking physical overlap with the target, the annulus adapter nonetheless induced a small but significant TAE in the central area. The effect of filling-in on the TAE was estimated by comparing the results from trials with and without subjectively reported filling-in during adaptation to the annulus adapter. The TAE was greater when filling-in occurred during adaptation, suggesting a stronger lateral modulation effect on trials where filling-in was induced. The data were fit by a variant of a divisive inhibition model, in which the adaptation effect is captured by the increase of an additive constant in the denominator of the response function, whereas the surround modulation in the adapter is modeled by an excitatory sensitivity in the numerator.

Four-dot masking in monoptic and dichoptic viewing

In visual backward masking paradigms, the visibility of a target is reduced using various kinds of mask stimuli presented immediately after the target. Four-dot masking is one such kind of backward masking, caused by four surrounding dots neither spatially adjacent nor similar to the target. Four-dot masking is often considered to involve object-level interferences. However, low-level contributions such as lateral inhibition and motion detection are also possible. To elucidate the loci of the underlying mechanism within the visual hierarchy, we compared the masking effect between monoptic and dichoptic viewing conditions. A target and a four-dot mask, which also served as a spatial cue to the target location, were presented to the same eye in monoptic viewing, whereas they were presented to different eyes in dichoptic viewing. Observers were then asked to discriminate the target shape. We found a significant decline in the correct response rate compared to the baseline condition in which the four-dot mask was not presented, and the masking effect was equivalent between the monoptic and dichoptic viewings. These results demonstrate that four-dot masking stems exclusively from processing within the binocular pathway.

Visual objects interact differently during encoding and memory maintenance

The storage mechanisms of working memory are the matter of an ongoing debate. The sensory recruitment hypothesis states that memory maintenance and perceptual encoding rely on the same neural substrate. This suggests that the same cortical mechanisms that shape object perception also apply to maintained memory content. We tested this prediction using the Direction Illusion, i.e., the mutual repulsion of two concurrently visible motion directions. Participants memorized the directions of two random dot patterns for later recall. In Experiments 1 and 2, we varied the temporal separation of spatially distinct stimuli to manipulate perceptual concurrency, while keeping concurrency within working memory constant. We observed mutual motion repulsion only under simultaneous stimulus presentation, but proactive repulsion and retroactive attraction under immediate stimulus succession. At inter-stimulus intervals of 0.5 and 2 s, however, proactive repulsion vanished, while the retroactive attraction remained. In Experiment 3, we presented both stimuli at the same spatial position and observed a reappearance of the repulsion effect. Our results indicate that the repulsive mechanisms that shape object perception across space fade during the transition from a perceptual representation to a consolidated memory content. This suggests differences in the underlying structure of perceptual and mnemonic representations. The persistence of local interactions, however, indicates different mechanisms of spatially global and local feature interactions.

Neural Model of Coding Stimulus Orientation and Adaptation

The coding of line orientation in the visual system has been investigated extensively. During the prolonged viewing of a stimulus, the perceived orientation continuously changes (normalization effect). Also, the orientation of the adapting stimulus and the background stimuli influence the perceived orientation of the subsequently displayed stimulus: tilt after-effect (TAE) or tilt illusion (TI). The neural mechanisms of these effects are not fully understood. The proposed model includes many local analyzers, each consisting of two sets of neurons. The first set has two independent cardinal detectors (CDs), whose responses depend on stimulus orientation. The second set has many orientation detectors (OD) tuned to different orientations of the stimulus. The ODs sum up the responses of the two CDs with respective weightings and output a preferred orientation depending on the ratio of CD responses. It is suggested that during prolonged viewing, the responses of the CDs decrease: the greater the excitation of the detector, the more rapid the decrease in its response. Thereby, the ratio of CD responses changes during the adaptation, causing the normalization effect and the TAE. The CDs of the different local analyzers laterally inhibit each other and cause the TI. We show that the properties of this model are consistent with both psychophysical and neurophysiological findings related to the properties of orientation perception, and we investigate how these mechanisms can affect the orientation's sensitivity.

Resolving the Spatial Profile of Figure Enhancement in Human V1 through Population Receptive Field Modeling

The detection and segmentation of meaningful figures from their background is one of the primary functions of vision. While work in nonhuman primates has implicated early visual mechanisms in this figure-ground modulation, neuroimaging in humans has instead largely ascribed the processing of figures and objects to higher stages of the visual hierarchy. Here, we used high-field fMRI at 7 Tesla to measure BOLD responses to task-irrelevant orientation-defined figures in human early visual cortex (N = 6, four females). We used a novel population receptive field mapping-based approach to resolve the spatial profiles of two constituent mechanisms of figure-ground modulation: a local boundary response, and a further enhancement spanning the full extent of the figure region that is driven by global differences in features. Reconstructing the distinct spatial profiles of these effects reveals that figure enhancement modulates responses in human early visual cortex in a manner consistent with a mechanism of automatic, contextually driven feedback from higher visual areas.SIGNIFICANCE STATEMENT A core function of the visual system is to parse complex 2D input into meaningful figures. We do so constantly and seamlessly, both by processing information about visible edges and by analyzing large-scale differences between figure and background. While influential neurophysiology work has characterized an intriguing mechanism that enhances V1 responses to perceptual figures, we have a poor understanding of how the early visual system contributes to figure-ground processing in humans. Here, we use advanced computational analysis methods and high-field human fMRI data to resolve the distinct spatial profiles of local edge and global figure enhancement in the early visual system (V1 and LGN); the latter is distinct and consistent with a mechanism of automatic, stimulus-driven feedback from higher-level visual areas.

Activity in Lateral Visual Areas Contributes to Surround Suppression in Awake Mouse V1

Neuronal response to sensory stimuli depends on the context. The response in primary visual cortex (V1), for instance, is reduced when a stimulus is surrounded by a similar stimulus [1-3]. The source of this surround suppression is partially known. In mouse, local horizontal integration by somatostatin-expressing interneurons contributes to surround suppression [4]. In primates, however, surround suppression arises too quickly to come from local horizontal integration alone, and myelinated axons from higher visual areas, where cells have larger receptive fields, are thought to provide additional surround suppression [5, 6]. Silencing higher visual areas indeed decreased surround suppression in the awake primate by increasing responses to large stimuli [7, 8], although not under anesthesia [9, 10]. In smaller mammals, like mice, fast surround suppression could be possible without feedback. Recent studies revealed a small reduction in V1 responses when silencing higher areas [11, 12] but have not investigated surround suppression. To determine whether higher visual areas contribute to V1 surround suppression, even when this is not necessary for fast processing, we inhibited the areas lateral to V1, particularly the lateromedial area (LM), a possible homolog of primate V2 [13], while recording in V1 of awake and anesthetized mice. We found that part of the surround suppression depends on activity from lateral visual areas in the awake, but not anesthetized, mouse. Inhibiting the lateral visual areas specifically increased responses in V1 to large stimuli. We present a model explaining how excitatory feedback to V1 can have these suppressive effects for large stimuli.

Increased Noise in Cortico-Cortical Integration After Mild TBI Measured With the Equivalent Noise Technique

The bulk of deficits accompanying mild traumatic brain injury (mTBI) is understood in terms of cortical integration—mnemonic, attentional, and cognitive disturbances are believed to involve integrative action across brain regions. Independent of integrative disturbances, mTBI may increase cortical noise, and this has not been previously considered. High-level integrative deficits are exceedingly difficult to measure and model, motivating us to utilize a tightly-controlled task within an established quantitative model to separately estimate internal noise and integration efficiency. First, we utilized a contour integration task modeled as a cortical-integration process involving multiple adjacent cortical columns in early visual areas. Second, we estimated internal noise and integration efficiency using the linear amplifier model (LAM). Fifty-seven mTBI patients and 24 normal controls performed a 4AFC task where they had to identify a valid contour amongst three invalid contours. Thresholds for contour amplitude were measured adaptively across three levels of added external orientation noise. Using the LAM, we found that mTBI increased internal noise without affecting integration efficiency. mTBI also caused hemifield bias differences, and efficiency was related to a change of visual habits. Using a controlled task reflecting cortical integration within the equivalent noise framework empowered us to detect increased computational noise that may be at the heart of mTBI deficits. Our approach is highly sensitive and translatable to rehabilitative efforts for the mTBI population, while also implicating a novel hypothesis of mTBI effects on basic visual processing—namely that cortical integration is maintained at the cost of increased internal noise.

Neural mechanisms of contextual modulation in the retinal direction selective circuit

Contextual modulation of neuronal responses by surrounding environments is a fundamental attribute of sensory processing. In the mammalian retina, responses of On–Off direction selective ganglion cells (DSGCs) are modulated by motion contexts. However, the underlying mechanisms are unknown. Here, we show that posterior-preferring DSGCs (pDSGCs) are sensitive to discontinuities of moving contours owing to contextually modulated cholinergic excitation from starburst amacrine cells (SACs). Using a combination of synapse-specific genetic manipulations, patch clamp electrophysiology and connectomic analysis, we identified distinct circuit motifs upstream of On and Off SACs that are required for the contextual modulation of pDSGC activity for bright and dark contrasts. Furthermore, our results reveal a class of wide-field amacrine cells (WACs) with straight, unbranching dendrites that function as “continuity detectors” of moving contours. Therefore, divergent circuit motifs in the On and Off pathways extend the information encoding of On-Off DSGCs beyond their direction selectivity during complex stimuli.

The mechanisms of contextual modulation in direction selective ganglion cells in the retina remain unclear. Here, the authors find that that On-Off direction-selective ganglion cells are differentially sensitive to discontinuities of dark and bright moving edges in the visual environment and, using synapse-specific genetic manipulations with functional measurements, reveal the microcircuits underlying this contextual sensitivity.

Cortical suppression in human primary visual cortex predicts individual differences in illusory tilt perception

Neural responses to visual stimuli are modulated by spatial and temporal context. For example, in primary visual cortex (V1), responses to an oriented target stimulus will be suppressed when embedded within an oriented surround stimulus. This suppression is orientation-specific, with the largest suppression observed when stimuli in the neuron's classical receptive field and surround are of similar orientation. In human psychological experiments, the tilt illusion and tilt aftereffect demonstrate an effect of context on perceived orientation of a target stimulus. Similar to the neurophysiological data, the strength of these effects is modulated by the orientation difference between the target stimulus and context. It has been hypothesized that the neural mechanism underlying both the tilt illusion and tilt aftereffect involves orientation-tuned inhibition in V1. However, to date there is no direct evidence linking human perception of these illusions with measurements of inhibition from human visual cortex. Here, we measured context-induced suppression of neural responses in human visual cortex using functional magnetic resonance imaging (fMRI). In the same participants, we also measured magnitudes of their tilt illusion and tilt aftereffect. Our data revealed a significant relationship between the magnitude of neural suppression in V1 and size of the tilt illusion and tilt aftereffect. That is, participants who showed stronger blood oxygenation level dependent (BOLD) suppression in V1 also perceived stronger shifts in illusory tilt. This agreement between perception and neural responses in human V1 suggests a shared inhibitory mechanism that mediates both spatial and temporal effects of context in human perception.

Suppressive Traveling Waves Shape Representations of Illusory Motion in Primary Visual Cortex of Awake Primate

How does the brain link visual stimuli across space and time? Visual illusions provide an experimental paradigm to study these processes. When two stationary dots are flashed in close spatial and temporal succession, human observers experience a percept of apparent motion. Large spatiotemporal separation challenges the visual system to keep track of object identity along the apparent motion path, the so-called "correspondence problem." Here, we use voltage-sensitive dye imaging in primary visual cortex (V1) of awake monkeys to show that intracortical connections within V1 can solve this issue by shaping cortical dynamics to represent the illusory motion. We find that the appearance of the second stimulus in V1 creates a systematic suppressive wave traveling toward the retinotopic representation of the first. Using a computational model, we show that the suppressive wave is the emergent property of a recurrent gain control fed by the intracortical network. This suppressive wave acts to explain away ambiguous correspondence problems and contributes to precisely encode the expected motion velocity at the surface of V1. Together, these results demonstrate that the nonlinear dynamics within retinotopic maps can shape cortical representations of illusory motion. Understanding these dynamics will shed light on how the brain links sensory stimuli across space and time, by preformatting population responses for a straightforward read-out by downstream areas.SIGNIFICANCE STATEMENT Traveling waves have recently been observed in different animal species, brain areas, and behavioral states. However, it is still unclear what are their functional roles. In the case of cortical visual processing, waves propagate across retinotopic maps and can hereby generate interactions between spatially and temporally separated instances of feedforward driven activity. Such interactions could participate in processing long-range apparent motion stimuli, an illusion for which no clear neuronal mechanisms have yet been proposed. Using this paradigm in awake monkeys, we show that suppressive traveling waves produce a spatiotemporal normalization of apparent motion stimuli. Our study suggests that cortical waves shape the representation of illusory moving stimulus within retinotopic maps for a straightforward read-out by downstream areas.

Co-circularity opponency in visual texture

It is well known that the human visual system is sensitive to co-circularity among oriented edges, which are ubiquitous features of object contours. Here, we report a novel aftereffect in which the appearance of a texture is dramatically altered after adaptation to a texture composed of elements with co-circular structure. Following prolonged viewing of a texture made of pairs of adjacent Gabor elements arranged to form obtuse angle co-circular pairs, i.e. shallow curves, a subsequently viewed random texture appears to be composed of acute angle, i.e. near-parallel pairs. Conversely, adaptation to a texture made of parallel pairs causes a random texture to appear to be composed of shallow curves. This suggests that mechanisms sensitive to co-circularity are organized in an opponent manner, with one pole sensitive to shallow curves the other parallel shapes. This notion was tested further in a non-adaptation experiment in which co-circular and non-co-circular Gabor pairs were mixed within a single texture. Results revealed summation between pairs that fell on one side of the opponent continuum, and cancellation between pairs that fell on opposite sides of the continuum. Taken together these results support opponent interactions between mechanisms sensitive to pairwise co-circular texture features.

Layer 3 Dynamically Coordinates Columnar Activity According to Spatial Context

To reduce statistical redundancy of natural inputs and increase the sparseness of coding, neurons in primary visual cortex (V1) show tuning for stimulus size and surround suppression. This integration of spatial information is a fundamental, context-dependent neural operation involving extensive neural circuits that span across all cortical layers of a V1 column, and reflects both feedforward and feedback processing. However, how spatial integration is dynamically coordinated across cortical layers remains poorly understood. We recorded single- and multiunit activity and local field potentials across V1 layers of awake mice (both sexes) while they viewed stimuli of varying size and used dynamic Bayesian model comparisons to identify when laminar activity and interlaminar functional interactions showed surround suppression, the hallmark of spatial integration. We found that surround suppression is strongest in layer 3 (L3) and L4 activity, where suppression is established within ∼10 ms after response onset, and receptive fields dynamically sharpen while suppression strength increases. Importantly, we also found that specific directed functional connections were strongest for intermediate stimulus sizes and suppressed for larger ones, particularly for connections from L3 targeting L5 and L1. Together, the results shed light on the different functional roles of cortical layers in spatial integration and on how L3 dynamically coordinates activity across a cortical column depending on spatial context.SIGNIFICANCE STATEMENT Neurons in primary visual cortex (V1) show tuning for stimulus size, where responses to stimuli exceeding the receptive field can be suppressed (surround suppression). We demonstrate that functional connectivity between V1 layers can also have a surround-suppressed profile. A particularly prominent role seems to have layer 3, the functional connections to layers 5 and 1 of which are strongest for stimuli of optimal size and decreased for large stimuli. Our results therefore point toward a key role of layer 3 in coordinating activity across the cortical column according to spatial context.

V1-based modeling of discrimination between natural scenes within the luminance and isoluminant color planes

We have been developing a computational visual difference predictor model that can predict how human observers rate the perceived magnitude of suprathreshold differences between pairs of full-color naturalistic scenes (To, Lovell, Troscianko, & Tolhurst, 2010). The model is based closely on V1 neurophysiology and has recently been updated to more realistically implement sequential application of nonlinear inhibitions (contrast normalization followed by surround suppression; To, Chirimuuta, & Tolhurst, 2017). The model is based originally on a reliable luminance model (Watson & Solomon, 1997) which we have extended to the red/green and blue/yellow opponent planes, assuming that the three planes (luminance, red/green, and blue/yellow) can be modeled similarly to each other with narrow-band oriented filters. This paper examines whether this may be a false assumption, by decomposing our original full-color stimulus images into monochromatic and isoluminant variants, which observers rate separately and which we model separately. The ratings for the original full-color scenes correlate better with the new ratings for the monochromatic variants than for the isoluminant ones, suggesting that luminance cues carry more weight in observers' ratings to full-color images. The ratings for the original full-color stimuli can be predicted from the new monochromatic and isoluminant rating data by combining them by Minkowski summation with power m = 2.71, consistent with other studies involving feature summation. The model performed well at predicting ratings for monochromatic stimuli, but was weaker for isoluminant stimuli, indicating that mirroring the monochromatic models is not sufficient to model the color planes. We discuss several alternative strategies to improve the color modeling.

Multimodal Modeling of Neural Network Activity: Computing LFP, ECoG, EEG, and MEG Signals With LFPy 2.0

Recordings of extracellular electrical, and later also magnetic, brain signals have been the dominant technique for measuring brain activity for decades. The interpretation of such signals is however nontrivial, as the measured signals result from both local and distant neuronal activity. In volume-conductor theory the extracellular potentials can be calculated from a distance-weighted sum of contributions from transmembrane currents of neurons. Given the same transmembrane currents, the contributions to the magnetic field recorded both inside and outside the brain can also be computed. This allows for the development of computational tools implementing forward models grounded in the biophysics underlying electrical and magnetic measurement modalities. LFPy (LFPy.readthedocs.io) incorporated a well-established scheme for predicting extracellular potentials of individual neurons with arbitrary levels of biological detail. It relies on NEURON (neuron.yale.edu) to compute transmembrane currents of multicompartment neurons which is then used in combination with an electrostatic forward model. Its functionality is now extended to allow for modeling of networks of multicompartment neurons with concurrent calculations of extracellular potentials and current dipole moments. The current dipole moments are then, in combination with suitable volume-conductor head models, used to compute non-invasive measures of neuronal activity, like scalp potentials (electroencephalographic recordings; EEG) and magnetic fields outside the head (magnetoencephalographic recordings; MEG). One such built-in head model is the four-sphere head model incorporating the different electric conductivities of brain, cerebrospinal fluid, skull and scalp. We demonstrate the new functionality of the software by constructing a network of biophysically detailed multicompartment neuron models from the Neocortical Microcircuit Collaboration (NMC) Portal (bbp.epfl.ch/nmc-portal) with corresponding statistics of connections and synapses, and compute in vivo-like extracellular potentials (local field potentials, LFP; electrocorticographical signals, ECoG) and corresponding current dipole moments. From the current dipole moments we estimate corresponding EEG and MEG signals using the four-sphere head model. We also show strong scaling performance of LFPy with different numbers of message-passing interface (MPI) processes, and for different network sizes with different density of connections. The open-source software LFPy is equally suitable for execution on laptops and in parallel on high-performance computing (HPC) facilities and is publicly available on GitHub.com.

Bottom-up saliency and top-down learning in the primary visual cortex of monkeys

Early sensory cortex is better known for representing sensory inputs but less for the effect of its responses on behavior. Here we explore the behavioral correlates of neuronal responses in primary visual cortex (V1) in a task to detect a uniquely oriented bar-the orientation singleton-in a background of uniformly oriented bars. This singleton is salient or inconspicuous when the orientation contrast between the singleton and background bars is sufficiently large or small, respectively. Using implanted microelectrodes, we measured V1 activities while monkeys were trained to quickly saccade to the singleton. A neuron's responses to the singleton within its receptive field had an early and a late component, both increased with the orientation contrast. The early component started from the outset of neuronal responses; it remained unchanged before and after training on the singleton detection. The late component started ∼40 ms after the early one; it emerged and evolved with practicing the detection task. Training increased the behavioral accuracy and speed of singleton detection and increased the amount of information in the late response component about a singleton's presence or absence. Furthermore, for a given singleton, faster detection performance was associated with higher V1 responses; training increased this behavioral-neural correlate in the early V1 responses but decreased it in the late V1 responses. Therefore, V1's early responses are directly linked with behavior and represent the bottom-up saliency signals. Learning strengthens this link, likely serving as the basis for making the detection task more reflexive and less top-down driven.

Distinct Laminar Processing of Local and Global Context in Primate Primary Visual Cortex

Visual perception is affected by spatial context. In visual cortex, neuronal responses to stimuli inside the receptive field (RF) are suppressed by stimuli in the RF surround. To understand the circuits and cortical layers processing spatial context, we simultaneously recorded across all layers of macaque primary visual cortex while presenting stimuli at increasing distances from the recorded cells' RF. We find that near versus far-surround stimuli activate distinct layers, thus revealing unique laminar contributions to the processing of local and global spatial context. Stimuli in the near-surround evoke the earliest subthreshold responses in superficial and upper-deep layers, and earliest suppression of spiking responses in superficial layers. Conversely, far-surround stimuli evoke the earliest subthreshold responses in feedback-recipient layer 1 and lower-deep layers, and earliest suppression of spiking responses almost simultaneously in all layers, except 4C, where suppression emerges last. Our results suggest distinct circuits for local and global signal integration.

Effects of V1 surround modulation tuning on visual saliency and the tilt illusion

Neurons in the primary visual cortex respond to oriented stimuli placed in the center of their receptive field, yet their response is modulated by stimuli outside the receptive field (the surround). Classically, this surround modulation is assumed to be strongest if the orientation of the surround stimulus aligns with the neuron's preferred orientation, irrespective of the actual center stimulus. This neuron-dependent surround modulation has been used to explain a wide range of psychophysical phenomena, such as biased tilt perception and saliency of stimuli with contrasting orientation. However, several neurophysiological studies have shown that for most neurons surround modulation is instead center dependent: it is strongest if the surround orientation aligns with the center stimulus. As the impact of such center-dependent modulation on the population level is unknown, we examine this using computational models. We find that with neuron-dependent modulation the biases in orientation coding, commonly used to explain the tilt illusion, are larger than psychophysically reported, but disappear with center-dependent modulation. Therefore we suggest that a mixture of the two modulation types is necessary to quantitatively explain the psychophysically observed biases. Next, we find that under center-dependent modulation average population responses are more sensitive to orientation differences between stimuli, which in theory could improve saliency detection. However, this effect depends on the specific saliency model. Overall, our results thus show that center-dependent modulation reduces coding bias, while possibly increasing the sensitivity to salient features. NEW & NOTEWORTHY Neural responses in the primary visual cortex are modulated by stimuli surrounding the receptive field. Most earlier studies assume this modulation depends on the neuron's tuning properties, but experiments have shown that instead it depends mostly on the stimulus characteristics. We show that this simple change leads to neural coding that is less biased and under some conditions more sensitive to salient features.

Beyond Rehabilitation of Acuity, Ocular Alignment, and Binocularity in Infantile Strabismus

Infantile strabismus impairs the perception of all attributes of the visual scene. High spatial frequency components are no longer visible, leading to amblyopia. Binocularity is altered, leading to the loss of stereopsis. Spatial perception is impaired as well as detection of vertical orientation, the fastest movements, directions of movement, the highest contrasts and colors. Infantile strabismus also affects other vision-dependent processes such as control of postural stability. But presently, rehabilitative therapies for infantile strabismus by ophthalmologists, orthoptists and optometrists are restricted to preventing or curing amblyopia of the deviated eye, aligning the eyes and, whenever possible, preserving or restoring binocular vision during the critical period of development, i.e., before ~10 years of age. All the other impairments are thus ignored; whether they may recover after strabismus treatment even remains unknown. We argue here that medical and paramedical professionals may extend their present treatments of the perceptual losses associated with infantile strabismus. This hypothesis is based on findings from fundamental research on visual system organization of higher mammals in particular at the cortical level. In strabismic subjects (as in normal-seeing ones), information about all of the visual attributes converge, interact and are thus inter-dependent at multiple levels of encoding ranging from the single neuron to neuronal assemblies in visual cortex. Thus if the perception of one attribute is restored this may help to rehabilitate the perception of other attributes. Concomitantly, vision-dependent processes may also improve. This could occur spontaneously, but still should be assessed and validated. If not, medical and paramedical staff, in collaboration with neuroscientists, will have to break new ground in the field of therapies to help reorganize brain circuitry and promote more comprehensive functional recovery. Findings from fundamental research studies in both young and adult patients already support our hypothesis and are reviewed here. For example, presenting different contrasts to each eye of a strabismic patient during training sessions facilitates recovery of acuity in the amblyopic eye as well as of 3D perception. Recent data also demonstrate that visual recoveries in strabismic subjects improve postural stability. These findings form the basis for a roadmap for future research and clinical development to extend presently applied rehabilitative therapies for infantile strabismus.

Testing the link between visual suppression and intelligence

The impairment to discriminate the motion direction of a large high contrast stimulus or to detect a stimulus surrounded by another one is called visual suppression and is the result of the normal function of our visual inhibitory mechanisms. Recently, Melnick et al. (2013), using a motion discrimination task, showed that intelligence strongly correlates with visual suppression (r = 0.71). Cook et al. (2016) also showed a strong link between contrast surround suppression and IQ (r = 0.87), this time using a contrast matching task. Our aim is to test this link using two different visual suppression tasks: a motion discrimination task and a contrast detection task. Fifty volunteers took part in the experiments. Using Bayesian staircases, we measured duration thresholds in the motion experiment and contrast thresholds in the spatial experiment. Although we found a much weaker effect, our results from the motion experiment still replicate previous results supporting the link between motion surround suppression and IQ (r = 0.43). However, our results from the spatial experiment do not support the link between contrast surround suppression and IQ (r = -0.09). Methodological differences between this study and previous studies which could explain these discrepancies are discussed.

Visual Cortex Limits Pop-Out in the Superior Colliculus of Awake Mice

We detect objects more readily if they differ from their surroundings in motion, color, or texture. This increased saliency is thought to be related to increased responses in the visual cortex. The superior colliculus is another brain area involved in vision and especially in directing gaze and attention. In this study, we show that differences in texture orientation also increase responses in the superficial layers of the superior colliculus that receive retinal and cortical input. We found that gratings evoke more neural response when surrounded by orthogonal gratings than when surrounded by parallel gratings, particularly in the awake mouse. This pop-out is not originating from the visual cortex, and silencing visual cortex increased the relative difference in response. A model shows that this can result from retinotopically matched excitation from visual cortex to the superior colliculus. We suggest that the perceptual saliency of a stimulus differing from its surround in a low-level feature like grating orientation could depend on visual processing in the superior colliculus.

Extrafoveally applied flashing light affects contrast thresholds of achromatic and S-cone isolating, but not L-M cone modulated stimuli

Flashing light stimulation is often used to investigate the visual system. However, the magnitude of the effect of this stimulus on the various subcortical pathways is not well investigated. The signals of conscious vision are conveyed by the magnocellular, parvocellular and koniocellular pathways. Parvocellular and koniocellular pathways (or more precisely, the L-M opponent and S-cone isolating channels) can be accessed by isoluminant red-green (L-M) and S-cone isolating stimuli, respectively. The main goal of the present study was to explore how costimulation with strong white extrafoveal light flashes alters the perception of stimuli specific to these pathways. Eleven healthy volunteers with negative neurological and ophthalmological history were enrolled for the study. Isoluminance of L-M and S-cone isolating sine-wave gratings was set individually, using the minimum motion procedure. The contrast thresholds for these stimuli as well as for achromatic gratings were determined by an adaptive staircase procedure where subjects had to indicate the orientation (horizontal, oblique or vertical) of the gratings. Thresholds were then determined again while a strong white peripheral light flash was presented 50 ms before each trial. Peripheral light flashes significantly (p < 0.05) increased the contrast thresholds of the achromatic and S-cone isolating stimuli. The threshold elevation was especially marked in case of the achromatic stimuli. However, the contrast threshold for the L-M stimuli was not significantly influenced by the light flashes. We conclude that extrafoveally applied light flashes influence predominantly the perception of achromatic stimuli.

Top-down feedback controls spatial summation and response amplitude in primate visual cortex

Sensory information travels along feedforward connections through a hierarchy of cortical areas, which, in turn, send feedback connections to lower-order areas. Feedback has been implicated in attention, expectation, and sensory context, but the mechanisms underlying these diverse feedback functions are unknown. Using specific optogenetic inactivation of feedback connections from the secondary visual area (V2), we show how feedback affects neural responses in the primate primary visual cortex (V1). Reducing feedback activity increases V1 cells' receptive field (RF) size, decreases their responses to stimuli confined to the RF, and increases their responses to stimuli extending into the proximal surround, therefore reducing surround suppression. Moreover, stronger reduction of V2 feedback activity leads to progressive increase in RF size and decrease in response amplitude, an effect predicted by a recurrent network model. Our results indicate that feedback modulates RF size, surround suppression and response amplitude, similar to the modulatory effects of visual spatial attention.

Contextual modulation of sensitivity to naturalistic image structure in macaque V2

The stimulus selectivity of neurons in V1 is well known, as is the finding that their responses can be affected by visual input to areas outside of the classical receptive field. Less well understood are the ways selectivity is modified as signals propagate to visual areas beyond V1, such as V2. We recently proposed a role for V2 neurons in representing the higher order statistical dependencies found in images of naturally occurring visual texture. V2 neurons, but not V1 neurons, respond more vigorously to "naturalistic" images that contain these dependencies than to "noise" images that lack them. In this work, we examine the dependency of these effects on stimulus size. For most V2 neurons, the preference for naturalistic over noise stimuli was modest when presented in small patches and gradually strengthened with increasing size, suggesting that the mechanisms responsible for this enhanced sensitivity operate over regions of the visual field that are larger than the classical receptive field. Indeed, we found that surround suppression was stronger for noise than for naturalistic stimuli and that the preference for large naturalistic stimuli developed over a delayed time course consistent with lateral or feedback connections. These findings are compatible with a spatially broad facilitatory mechanism that is absent in V1 and suggest that a distinct role for the receptive field surround emerges in V2 along with sensitivity for more complex image structure. NEW & NOTEWORTHY The responses of neurons in visual cortex are often affected by visual input delivered to regions of the visual field outside of the conventionally defined receptive field, but the significance of such contextual modulations are not well understood outside of area V1. We studied the importance of regions beyond the receptive field in establishing a novel form of selectivity for the statistical dependencies contained in natural visual textures that first emerges in area V2.

Phase-specific Surround suppression in Mouse Primary Visual Cortex Correlates with Figure Detection Behavior Based on Phase Discontinuity

In the primary visual cortex (V1), neuronal responses to stimuli within the receptive field (RF) are modulated by stimuli in the RF surround. A common effect of surround modulation is surround suppression, which is dependent on the feature difference between stimuli within and surround the RF and is suggested to be involved in the perceptual phenomenon of figure-ground segregation. In this study, we examined the relationship between feature-specific surround suppression of V1 neurons and figure detection behavior based on figure-ground feature difference. We trained freely moving mice to perform a figure detection task using figure and ground gratings that differed in spatial phase. The performance of figure detection increased with the figure-ground phase difference, and was modulated by stimulus contrast. Electrophysiological recordings from V1 in head-fixed mice showed that the increase in phase difference between stimuli within and surround the RF caused a reduction in surround suppression, which was associated with an increase in V1 neural discrimination between stimuli with and without RF-surround phase difference. Consistent with the behavioral performance, the sensitivity of V1 neurons to RF-surround phase difference could be influenced by stimulus contrast. Furthermore, inhibiting V1 by optogenetically activating either parvalbumin (PV)- or somatostatin (SOM)-expressing inhibitory neurons both decreased the behavioral performance of figure detection. Thus, the phase-specific surround suppression in V1 represents a neural correlate of figure detection behavior based on figure-ground phase discontinuity.

Cortical travelling waves: mechanisms and computational principles

Multichannel recording technologies have revealed travelling waves of neural activity in multiple sensory, motor and cognitive systems. These waves can be spontaneously generated by recurrent circuits or evoked by external stimuli. They travel along brain networks at multiple scales, transiently modulating spiking and excitability as they pass. Here, we review recent experimental findings that have found evidence for travelling waves at single-area (mesoscopic) and whole-brain (macroscopic) scales. We place these findings in the context of the current theoretical understanding of wave generation and propagation in recurrent networks. During the large low-frequency rhythms of sleep or the relatively desynchronized state of the awake cortex, travelling waves may serve a variety of functions, from long-term memory consolidation to processing of dynamic visual stimuli. We explore new avenues for experimental and computational understanding of the role of spatiotemporal activity patterns in the cortex.