Excitatory-inhibitory network in the visual cortex: psychophysical evidence

Stimulus type shapes the topology of cellular functional networks in mouse visual cortex

On the timescale of sensory processing, neuronal networks have relatively fixed anatomical connectivity, while functional interactions between neurons can vary depending on the ongoing activity of the neurons within the network. We thus hypothesized that different types of stimuli could lead those networks to display stimulus-dependent functional connectivity patterns. To test this hypothesis, we analyzed single-cell resolution electrophysiological data from the Allen Institute, with simultaneous recordings of stimulus-evoked activity from neurons across 6 different regions of mouse visual cortex. Comparing the functional connectivity patterns during different stimulus types, we made several nontrivial observations: (1) while the frequencies of different functional motifs were preserved across stimuli, the identities of the neurons within those motifs changed; (2) the degree to which functional modules are contained within a single brain region increases with stimulus complexity. Altogether, our work reveals unexpected stimulus-dependence to the way groups of neurons interact to process incoming sensory information.

Space, time, and dynamics of binocular interactions

Binocular summation (BS), defined as the superiority of binocular over monocular visual performance, shows that thresholds are about 40% (a factor of 1.4) better in binocular than in monocular viewing. However, it was reported that different amounts of BS exist in a range from 1.4 to 2 values because BS is affected by the spatiotemporal parameters of the stimulus. Lateral interactions can be defined as the neuron's ability to affect the neighboring neurons by either inhibiting or exciting their activity. We investigated the effect of the spatial and temporal domains on binocular interactions and BS under the lateral masking paradigm and how BS would be affected by lateral interactions via a lateral masking experiment. The two temporal alternative forced-choice (2TAFC) method was used. The stimuli consisted of a central vertically oriented Gabor target and high-contrast Gabor flankers positioned in two configurations (orthogonal or collinear) with target-flanker separations of either 2 or 3 wavelengths (λ), presented at 4 different presentation times (40, 80, 120, and 200 ms) using a different order of measurements across the different experiments. Opaque lenses were used to control the monocular and binocular vision. BS is absent at close distances (2λ), depending on the presentation time's order, for the collinear but not for the orthogonal configuration. However, BS exists at more distant flankers (collinear and orthogonal, 3λ). BS is not uniform (1.4); it depends on the stimulus condition, the presentation times, the order, and the method that was used to control the monocular and binocular vision.

Abnormal basic visual processing functions in binocular fusion disorders

Heterophoria is a common type of binocular fusion disorder that consists of a latent eye misalignment with potential consequences on daily activities such as reading or working on a computer (with CVS). Crowding, a type of contextual modulation, can also impair reading. Our recent studies found an abnormal pattern of low-level visual processing with larger perceptive fields (PF) in heterophoria. The PF is the fundamental processing unit of human vision and both masking and crowding depend on its size. We investigated how heterophoria would impact the PF's size via a lateral masking experiment and consequently affect the foveal crowding at different letter-spacings (the crowding zone). More specifically, we explored the relationship between crowding, lateral masking, the PF's size, and the amount of heterophoria. The binocular horizontal PF's size was larger with heterophoric subjects, in agreement with our previous study. We found a stronger crowding and an extended crowding zone associated with slower response times; this shows that the processing of letter identification under both crowded and uncrowded conditions requires more processing effort in heterophoric individuals. In agreement with previous studies, we found a correlation between the crowding zone and the PF's size; each was strongly correlated with the amount of phoria. These findings resemble those involving the PF size and the extended crowding found at the fovea in amblyopia and young children. We suggest that these findings could help explain the inter-observers' variability found in the masking literature, and the reading difficulties often encountered in subjects with high heterophoria.

The stabilization of visibility for sequentially presented, low-contrast objects: Experiments and neural field model

In any environment, events transpire in temporal sequences. The general principle governing such sequences is that each instance of the event is influenced by its predecessors. It is shown here that this principle is true for a fundamental aspect of visual perception: visibility. A series of nine psychophysical experiments and associated neural dynamic simulations provide evidence that two non-stimulus factors, self-excitation and short-term memory, stabilize the visibility of a simple low-contrast object (a line segment) as it moves over a sequence of unpredictable locations. Stabilization was indicated by the very low probability of visible-to-invisible switches, and dependence on preceding visibility states was indicated by hysteresis as the contrast of the object was gradually decreased or increased. The contribution of self-excitation to stabilization was indicated by increased visible-to-invisible switching (decreased hysteresis) following adaptation of the visibility state, and the contribution of memory to stabilization was indicated by visibility "bridging" long blank intervals separating each relocation of the object. Because of the unpredictability of the relocations of the object, its visibility at one location pre-shapes visibility at its next location via persisting subthreshold activation of detectors surrounding the low-contrast object. All effects were modeled, including contributions from adaptation and recurrent inhibition, with a single set of parameter values.

Stimulus-dependent functional network topology in mouse visual cortex

Information is processed by networks of neurons in the brain. On the timescale of sensory processing, those neuronal networks have relatively fixed anatomical connectivity, while functional connectivity, which defines the interactions between neurons, can vary depending on the ongoing activity of the neurons within the network. We thus hypothesized that different types of stimuli, which drive different neuronal activities in the network, could lead those networks to display stimulus-dependent functional connectivity patterns. To test this hypothesis, we analyzed electrophysiological data from the Allen Brain Observatory, which utilized Neuropixels probes to simultaneously record stimulus-evoked activity from hundreds of neurons across 6 different regions of mouse visual cortex. The recordings had single-cell resolution and high temporal fidelity, enabling us to determine fine-scale functional connectivity. Comparing the functional connectivity patterns observed when different stimuli were presented to the mice, we made several nontrivial observations. First, while the frequencies of different connectivity motifs (i.e., the patterns of connectivity between triplets of neurons) were preserved across stimuli, the identities of the neurons within those motifs changed. This means that functional connectivity dynamically changes along with the input stimulus, but does so in a way that preserves the motif frequencies. Secondly, we found that the degree to which functional modules are contained within a single brain region (as opposed to being distributed between regions) increases with increasing stimulus complexity. This suggests a mechanism for how the brain could dynamically alter its computations based on its inputs. Altogether, our work reveals unexpected stimulus-dependence to the way groups of neurons interact to process incoming sensory information.

Extended perceptive field revealed in humans with binocular fusion disorders

Binocular vision disorders or dysfunctions have considerable impact on daily visual activities such as reading. Heterophoria (phoria) is a latent eye misalignment (with a prevalence of up to 35%) that appears in conditions that disrupt binocular vision and it may affect the quality of binocular fusion. Our recent study, which used lateral masking (LM), suggests that subjects with binocular fusion disorders (horizontal phoria) exhibit an asymmetry and an abnormal pattern of both binocular and monocular lateral interactions, but only for the horizontal meridian (HM). The perceptive field (PF) is the fundamental processing unit of human vision and both masking and crowding depend on its size. An increased PF size is found in amblyopic populations or in young children. We hypothesized that the PF's size would be asymmetric only for the phoric group (larger along the HM). We estimated the PF's size using two different methods (LM with equal-phase and opposite-phase flankers). Phoric subjects exhibited a larger binocular PF size, only for the HM, confirming our hypothesis of an asymmetric PF size. However, the monocular PF size of phoric and control subjects was similar. Phoria affects the PF's size similarly to meridional amblyopia but without being attributed to abnormal refraction. We suggest that these findings could help explain the inter-observer variability found in the masking literature and the reading difficulties often encountered in subjects with high heterophoria. Since perceptual learning can reduce the PF's size, further investigation of training may provide a novel therapy to reduce some symptoms related to heterophoria.

Binocular fusion disorders impair basic visual processing

In an era of increasing screen consumption, the requirement for binocular vision is demanding, leading to the emergence of syndromes such as the computer vision syndrome (CVS) or visual discomfort reported by virtual reality (VR) users. Heterophoria (phoria) is a latent eye misalignment (with a prevalence up to 35%) that appears in conditions that disrupt binocular vision and may affect the quality of binocular fusion. Collinear facilitation (CF), the mechanism for grouping contour elements, is a process that reveals lateral interactions by improving the visibility of a target by flankers placed collinearly. An abnormal pattern of CF has been observed in strabismic amblyopia. We hypothesize that phoria may affect CF in the horizontal meridian (HM) due to latent eye misalignment and its impact on binocular fusion. Fully corrected participants (phoria group and controls) completed a standard CF experiment for horizontal and vertical meridians during binocular and monocular viewing. Phoric observers exhibited (1) an asymmetry and an abnormal pattern of CF only for the HM, during both monocular and binocular viewing, (2) poor binocular summation between the monocular inputs, and (3) no binocular advantage of the CF. Phoria affects the CF in a way that is reminiscent of meridional amblyopia without being attributed to abnormal refraction. The abnormal pattern of CF in monocular viewing suggests that phoria could be a binocular developmental disorder that affects monocular spatial interactions. We suggest that the results could contribute to explain the visual discomfort experienced with VR users or symptoms when presenting CVS.

Classical-Contextual Interactions in V1 May Rely on Dendritic Computations

A signature feature of the neocortex is the dense network of horizontal connections (HCs) through which pyramidal neurons (PNs) exchange "contextual" information. In primary visual cortex (V1), HCs are thought to facilitate boundary detection, a crucial operation for object recognition, but how HCs modulate PN responses to boundary cues within their classical receptive fields (CRF) remains unknown. We began by "asking" natural images, through a structured data collection and ground truth labeling process, what function a V1 cell should use to compute boundary probability from aligned edge cues within and outside its CRF. The "answer" was an asymmetric 2-D sigmoidal function, whose nonlinear form provides the first normative account for the "multiplicative" center-flanker interactions previously reported in V1 neurons (Kapadia et al., 1995, 2000; Polat et al., 1998). Using a detailed compartmental model, we then show that this boundary-detecting classical-contextual interaction function can be computed by NMDAR-dependent spatial synaptic interactions within PN dendrites - the site where classical and contextual inputs first converge in the cortex. In additional simulations, we show that local interneuron circuitry activated by HCs can powerfully leverage the nonlinear spatial computing capabilities of PN dendrites, providing the cortex with a highly flexible substrate for integration of classical and contextual information.

Non-reciprocal phase transitions

Out of equilibrium, a lack of reciprocity is the rule rather than the exception. Non-reciprocity occurs, for instance, in active matter^1-6, non-equilibrium systems^7-9, networks of neurons^10,11, social groups with conformist and contrarian members¹², directional interface growth phenomena^13-15 and metamaterials^16-20. Although wave propagation in non-reciprocal media has recently been closely studied^1,16-20, less is known about the consequences of non-reciprocity on the collective behaviour of many-body systems. Here we show that non-reciprocity leads to time-dependent phases in which spontaneously broken continuous symmetries are dynamically restored. We illustrate this mechanism with simple robotic demonstrations. The resulting phase transitions are controlled by spectral singularities called exceptional points²¹. We describe the emergence of these phases using insights from bifurcation theory^22,23 and non-Hermitian quantum mechanics^24,25. Our approach captures non-reciprocal generalizations of three archetypal classes of self-organization out of equilibrium: synchronization, flocking and pattern formation. Collective phenomena in these systems range from active time-(quasi)crystals to exceptional-point-enforced pattern formation and hysteresis. Our work lays the foundation for a general theory of critical phenomena in systems whose dynamics is not governed by an optimization principle.

Perceptual learning improves visual functions in patients with albinistic bilateral amblyopia: A pilot study

BACKGROUND

Several visual functions are impaired in patients with oculocutaneous albinism (OCA) associated to albinistic bilateral amblyopia (ABA).

OBJECTIVE

In this study, we aimed at exploring whether perceptual learning (PL) can improve visual functions in albinism.

METHOD

Six patients and six normal sighted controls, were trained in a contrast detection task with lateral masking. Participants were asked to choose which of the two intervals contained a foveally presented low-contrast Gabor patch. Targets were presented between higher contrast collinear flankers with equal spatial frequency. When increasing target-to-flanker distance, lateral interactions effect normally switches from inhibition to facilitation, up to no effect.

RESULTS

Our findings showed that before PL, only controls showed facilitation. After PL, results suggest that facilitatory lateral interactions are found both in controls as well as in albino patients. These results suggest that PL could induce higher processing efficiency at early cortical level. Moreover, PL positive effect seems to transfer to higher-level visual functions, but results were not very consistent among tasks (visual acuity, contrast sensitivity function, hyperacuity and foveal crowding).

CONCLUSIONS

Although a small sample size was tested, our findings suggest a rehabilitative potential of PL in improving visual functions in albinism.

Discriminating Global Orientation of Two Element Sets

Perceived global organization of visual patterns is based upon the aggregate contribution of constituent components. Patterns constructed from multiple sources cooperate or compete for global organization. An investigation was made here of interactions between two interspersed element sets on global orientation. It was hypothesized that each set would operate as an integrated unit, and contribute independently to global orientation. Participants viewed a 10 × 10 array of Gabor patches, and indicated the predominant orientation of the array. In Experiment 1 all elements were rotated. Rotation up to 23° had little effect, whereas greater rotation produced a progressive shift on global orientation. In Experiment 2 a proportion of elements remained aligned while remaining elements were rotated. Embedding a proportion of aligned elements stabilized global orientation, which was dependent upon the proportion of aligned elements. Specifically, with 20% alignment, global orientation was similar to rotating all elements, whereas 80% alignment strongly biased perception towards aligned elements. The stabilizing effect varied with rotation of the second element set. Across levels of rotation, alignment effects rose to a peak then declined as element sets became orthogonal. In Experiment 3, each element set was rotated independently. Independent rotation of both sets altered global orientation, compressing the psychometric function for the single-element condition. Together, for interspersed element sets with explicit orientations, each set does not contribute independently to global orientation. Instead, element sets interact, where the contribution of one set, presented at a fixed rotation and fixed proportion, varies with the change to the second set.

Development of global visual processing: From the retina to the perceptive field

Young children exhibit poorer visual performance than adults due to immaturity of the fovea and of the fundamental processing of visual functions such as masking and crowding. Recent studies suggest that masking and crowding are closely related to the size of the fundamental processing unit-the perceptive field (PF). However, while it is known that the retina and basic visual functions develop throughout childhood, it is not clear whether and how changes in the size of the PF affect masking and crowding. Furthermore, no retinal and perceptual development data have been collected from the same cohort and time. Here we explored the developmental process of the PF and the basic visual functions. Psychophysical and imaging methods were used to test visual functions and foveal changes in participants ranging from 3-17 years old. Lateral masking, crowding and contrast sensitivity were tested using computerized tasks. Foveal measurements were obtained from spectral-domain optical coherence tomography (OCT). The children patterns below 6 years exhibited high crowding, while the expected facilitation was found only at a larger target-flanker distance than required for children above 6 years, who exhibited the typical adult. Foveal thickness and macular volume for the children below 6 years were significantly lower than for the older group. Significant correlation was found for contrast sensitivity, foveal thickness and macular volume with age and between contrast sensitivity and foveal thickness. Our data suggest that the developmental processes at the retina and visual cortex occur in the same age range. Thus, in parallel to maturation of the PF, which enables reduction in crowding, foveal development contributes to increasing contrast sensitivity.

Visual illusions via neural dynamics: Wilson-Cowan-type models and the efficient representation principle

We reproduce suprathreshold perception phenomena, specifically visual illusions, by Wilson-Cowan (WC)-type models of neuronal dynamics. Our findings show that the ability to replicate the illusions considered is related to how well the neural activity equations comply with the efficient representation principle. Our first contribution consists in showing that the WC equations can reproduce a number of brightness and orientation-dependent illusions. Then we formally prove that there cannot be an energy functional that the WC dynamics are minimizing. This leads us to consider an alternative, variational modeling, which has been previously employed for local histogram equalization (LHE) tasks. To adapt our model to the architecture of V1, we perform an extension that has an explicit dependence on local image orientation. Finally, we report several numerical experiments showing that LHE provides a better reproduction of visual illusions than the original WC formulation, and that its cortical extension is capable also to reproduce complex orientation-dependent illusions.NEW & NOTEWORTHY We show that the Wilson-Cowan equations can reproduce a number of brightness and orientation-dependent illusions. Then we formally prove that there cannot be an energy functional that the Wilson-Cowan equations are minimizing, making them suboptimal with respect to the efficient representation principle. We thus propose a slight modification that is consistent with such principle and show that this provides a better reproduction of visual illusions than the original Wilson-Cowan formulation. We also consider the cortical extension of both models to deal with more complex orientation-dependent illusions.

Excitatory and inhibitory lateral interactions effects on contrast detection are modulated by tRNS

Contrast sensitivity for a Gabor signal is affected by collinear high-contrast Gabor flankers. The flankers reduce (inhibitory effect) or increase (facilitatory effect) sensitivity, at short (2λ) and intermediate (6λ) target-to-flanker separation respectively. We investigated whether these inhibitory/facilitatory sensitivity effects are modulated by transcranial random noise stimulation (tRNS) applied to the occipital and frontal cortex of human observers during task performance. Signal detection theory was used to measure sensitivity (d’) and the Criterion (C) in a contrast detection task, performed with sham or tRNS applied over the occipital or the frontal cortex. After occipital stimulation results show a tRNS-dependent increased sensitivity for the single Gabor signal of low but not high contrast. Moreover, results suggest a dissociation of the tRNS effect when the Gabor signal is presented with the flankers, consisting in a general increased sensitivity at 2λ where the flankers had an inhibitory effect (reduction of inhibition) and a decreased sensitivity at 6λ where the flankers had a facilitatory effect on the Gabor signal (reduction of facilitation). After a frontal stimulation, no specific effect of the tRNS was found. We account for these complex interactions between tRNS and flankers by assuming that tRNS not only enhances feedforward input from the Gabor signal to the cortex, but also enhances the excitatory or inhibitory lateral intracortical input from the flankers. The boosted lateral input depends on the excitation-inhibition (E/I) ratio, namely when the lateral input is weak, it is boosted by tRNS with consequent modification of the contrast-dependent E/I ratio.

Lateral effects in pattern vision

There is a large literature on lateral effects in pattern vision but no consensus about them or comprehensive model of them. This paper reviews the literature with a focus on the effects of parallel context in the central fovea. It describes seven experiments that measure detection and discrimination thresholds in annular and Gabor-pattern contexts at different separations. It presents a model of these effects, which is an elaboration of Foley's (1994) model. The model describes the results well, and it shows that lateral context affects the response to the target by both multiplicative excitation and additive inhibition. Both lateral effects extend for several wavelengths beyond the target. They vary in relative strength, producing near suppression and far enhancement of the response to the target. The model describes the detection and discrimination results well, and it also describes the results of experiments on lateral effects on perceived contrast. The model is consistent with the physiology of V1 cells.

Contextual influences in the peripheral retina of patients with macular degeneration

Macular degeneration (MD) is the leading cause of low vision in the elderly population worldwide. In case of complete bilateral loss of central vision, MD patients start to show a preferred retinal region for fixation (PRL). Previous literature has reported functional changes that are connected with the emergence of the PRL. In this paper, we question whether the PRL undergoes a use-dependent cortical reorganization that alters the range of spatial lateral interactions between low-level filters. We asked whether there is a modulation of the excitatory/inhibitory lateral interactions or whether contextual influences are well accounted for by the same law that describes the integration response in normal viewers. In a group of 13 MD patients and 7 age-matched controls, we probed contextual influences by measuring the contrast threshold for a vertical target Gabor, flanked by two collinear high-contrast Gabors. Contextual influences of the collinear flankers were indicated by the changes in contrast threshold obtained at different target-to-flanker distances (λs) relative to the baseline orthogonal condition. Results showed that MDs had higher thresholds in the baseline condition and functional impairment in the identification tasks. Moreover, at the shortest λ, we found facilitatory rather than inhibitory contextual influence. No difference was found between the PRL and a symmetrical retinal position (non-PRL). By pulling together data from MD and controls we showed that in the periphery this inversion occurs when the target threshold approach the flankers’ contrast (about 1:3 ratio) and that for patients it does occur in both the PRL and a symmetrical retinal position (non-PRL). We conclude that contrary to previous interpretations, this modulation doesn’t seem to reflect use-dependent cortical reorganization but rather, it might result from a reduction of contrast gain for the target that promotes target-flankers grouping.

Increased gamma band activity for lateral interactions in humans

Collinear facilitation of contrast sensitivity supported by lateral interactions within primary visual cortex is implicated in contour and object perception, with neural correlates in several frequency bands. Although higher component of the ERP power spectrum, the gamma-band, is postulated to reflect object representation, attention and memory, its neuronal source has been questioned, suggesting it is an artifact reflecting saccadic eye movements. Here we explored the gamma-band activity during collinear facilitation with no saccade-related confounds. We used single-trial spectral analysis of ERP in occipital channels in a time-window of nearly complete saccadic suppression and discarded sporadic trials containing saccades, in order to avoid saccadic artifacts. Although converging evidence suggests that gamma-band oscillations emerge from local excitatory–inhibitory balance involving GABAergic inhibition, here we show activity amplification during facilitatory collinear interactions, presumably dominated by excitations, in the gamma-band 150–350 milliseconds following onset of low near-threshold contrast stimulus. This result highlights the potential role of gamma-band oscillations in neuronal encoding of basic processes in visual perception. Thus, our findings suggest that gamma-band ERP spectrum analysis may serve as a useful and reliable tool for exploring basic perception, both in normal adults and in special populations.

Lateral masking effects on contrast sensitivity in rats

Changes in target visibility may be produced by additional stimulus elements at adjacent locations. Such contextual effects may reflect lateral interactions of stimulus representations in early cortical areas. It has been reported that the organization of orientation preference found in primates and cats visual cortex differs from that found in rodents, suggesting functional distinctions across species. In order to examine effects of lateral interactions at a perceptual level, contrast sensitivity in rats was measured for Gabor patches masked by two additional patches. Rats responded to target onset, and perceptual indices were based upon reaction time distributions across levels of luminance contrast. It was found that contrast sensitivity of targets without lateral masks corresponded to levels previously reported. For all measurements, the presence of sustained lateral masks systematically reduced sensitivity to targets, demonstrating interference by adjacent elements across levels of contrast. Effects of mask orientation or separation were not observed. These results may reflect reported non-systematic topography of orientation tuning across the cortex in rodents. Results suggest that intrinsic lateral connections in early processing areas play a minimal role in stimulus integration for rats.

Approximate-master-equation approach for the Kinouchi-Copelli neural model on networks

In this work, we use the approximate-master-equation approach to study the dynamics of the Kinouchi-Copelli neural model on various networks. By categorizing each neuron in terms of its state and also the states of its neighbors, we are able to uncover how the coupled system evolves with respective to time by directly solving a set of ordinary differential equations. In particular, we can easily calculate the statistical properties of the time evolution of the network instantaneous response, the network response curve, the dynamic range, and the critical point in the framework of the approximate-master-equation approach. The possible usage of the proposed theoretical approach to other spreading phenomena is briefly discussed.

Contextual Interactions in Grating Plaid Configurations Are Explained by Natural Image Statistics and Neural Modeling

Processing natural scenes requires the visual system to integrate local features into global object descriptions. To achieve coherent representations, the human brain uses statistical dependencies to guide weighting of local feature conjunctions. Pairwise interactions among feature detectors in early visual areas may form the early substrate of these local feature bindings. To investigate local interaction structures in visual cortex, we combined psychophysical experiments with computational modeling and natural scene analysis. We first measured contrast thresholds for 2 × 2 grating patch arrangements (plaids), which differed in spatial frequency composition (low, high, or mixed), number of grating patch co-alignments (0, 1, or 2), and inter-patch distances (1° and 2° of visual angle). Contrast thresholds for the different configurations were compared to the prediction of probability summation (PS) among detector families tuned to the four retinal positions. For 1° distance the thresholds for all configurations were larger than predicted by PS, indicating inhibitory interactions. For 2° distance, thresholds were significantly lower compared to PS when the plaids were homogeneous in spatial frequency and orientation, but not when spatial frequencies were mixed or there was at least one misalignment. Next, we constructed a neural population model with horizontal laminar structure, which reproduced the detection thresholds after adaptation of connection weights. Consistent with prior work, contextual interactions were medium-range inhibition and long-range, orientation-specific excitation. However, inclusion of orientation-specific, inhibitory interactions between populations with different spatial frequency preferences were crucial for explaining detection thresholds. Finally, for all plaid configurations we computed their likelihood of occurrence in natural images. The likelihoods turned out to be inversely related to the detection thresholds obtained at larger inter-patch distances. However, likelihoods were almost independent of inter-patch distance, implying that natural image statistics could not explain the crowding-like results at short distances. This failure of natural image statistics to resolve the patch distance modulation of plaid visibility remains a challenge to the approach.

Temporal asynchrony and spatial perception

Collinear facilitation is an enhancement in the visibility of a target by laterally placed iso-oriented flankers in a collinear (COL) configuration. Iso-oriented flankers placed in a non-collinear configuration (side-by-side, SBS) produce less facilitation. Surprisingly, presentation of both configurations simultaneously (ISO-CROSS) abolishes the facilitation rather than increases it - a phenomenon that can’t be fully explained by the spatial properties of the target and flankers. Based on our preliminary data and recent studies, we hypothesized that there might be a novel explanation based on the temporal properties of the excitation and inhibition, resulting in asynchrony between the lateral inputs received from COL and SBS, leading to cancelation of the facilitatory component in ISO-CROSS. We explored this effect using a detection task in humans. The results replicated the previous results showing that the preferred facilitation for COL and SBS was abolished for the ISO-CROSS configuration. However, presenting the SBS flankers, but not the COL flankers 20 msec before ISO-CROSS restored the facilitatory effect. We propose a novel explanation that the perceptual advantage of collinear facilitation may be cancelled by the delayed input from the sides; thus, the final perception is determined by the overall spatial-temporal integration of the lateral interactions.

Noise and the Perceptual Filling-in effect

Nearby collinear flankers increase the false alarm rate (reports of the target being present when it is not) in a Yes-No experiment. This effect has been attributed to "filling-in" of the target location due to increased activity induced by the flankers. According to signal detection theory, false alarms are attributed to noise in the visual nervous system. Here we investigated the effect of external noise on the filling-in effect by adding white noise to a low contrast Gabor target presented between two collinear Gabor flankers at a range of target-flanker separations. External noise modulates the filling-in effect, reducing visual sensitivity (d') and increasing the filling-in effect (False Alarm rate). We estimated the amount of external noise at which the false alarm rate increases by the √2 (which we refer to as NFA). Across flank distances, both the false alarm rate and d' (with no external noise) are correlated with NFA. These results are consistent with the notion that nearby collinear flankers add both signal and noise to the target location. The increased signal results in higher d' values; the increased noise to higher false alarm rates (the filling effect).

Single additive mechanism predicts lateral interactions effects-computational model

The mechanism underlying the lateral interactions (LI) phenomenon is still an enigma. Over the years, several groups have tried to explain the phenomenon and suggested models to predict its psychophysical results. Most of these models comprise both inhibitory and facilitatory mechanisms for describing the LI phenomenon. Their studies' assumption that a significant inhibition mechanism exists is based on the classical interpretation of the threshold elevation perceived in psychophysical experiments. In this work, we suggest a different interpretation of the threshold elevation obtained experimentally. Our model proposes and demonstrates how a facilitatory additive mechanism can solely predict both the facilitation and "inhibition" aspects of the phenomenon, without the need for an additional inhibitory mechanism, at least for the two flankers' configurations. Though the model is simple it succeeds to predict the LI effect under a large variety of stimuli configurations and parameters. The model is in agreement with both classical and recent psychophysical and neurophysiological results. We suggest that the LI mechanism plays a role in creating an educated guess to form a continuation of gratings and textures based on the surrounding visual stimuli.

The stabilized supralinear network: a unifying circuit motif underlying multi-input integration in sensory cortex

Neurons in sensory cortex integrate multiple influences to parse objects and support perception. Across multiple cortical areas, integration is characterized by two neuronal response properties: (1) surround suppression--modulatory contextual stimuli suppress responses to driving stimuli; and (2) "normalization"--responses to multiple driving stimuli add sublinearly. These depend on input strength: for weak driving stimuli, contextual influences facilitate or more weakly suppress and summation becomes linear or supralinear. Understanding the circuit operations underlying integration is critical to understanding cortical function and disease. We present a simple, general theory. A wealth of integrative properties, including the above, emerge robustly from four cortical circuit properties: (1) supralinear neuronal input/output functions; (2) sufficiently strong recurrent excitation; (3) feedback inhibition; and (4) simple spatial properties of intracortical connections. Integrative properties emerge dynamically as circuit properties, with excitatory and inhibitory neurons showing similar behaviors. In new recordings in visual cortex, we confirm key model predictions.

Anisotropy in spatial summation properties of human Ocular-Following Response (OFR)

Using sinusoidal gratings we show that an increase in stimulus size confined to the dimension orthogonal to the axis of motion leads to stronger Ocular Following Responses (OFRs) up to a certain optimal size. An increase beyond this optimum produces smaller responses, indicating suppressive interactions. In sharp contrast, when the stimulus growth occurs parallel to the axis of motion OFR magnitudes increase monotonically both for horizontal and vertical directions of motion. Similar results are obtained with 1D white noise patterns. However, the OFR spatial anisotropy is minimal with 2D white noise patterns, revealing a pivotal role of orientation-selective (i.e., cortical) mechanisms in mediating this phenomenon. The lack of anisotropy for 2D patterns suggests that directional signals alone are not sufficient to elicit this suppression. The OFR spatial anisotropy is potentiated if a stationary grating is presented for 600-1000ms before its motion commences, further emphasizing the importance of static orientation signals. These results suggest that the strength of cortical spatial interactions is asymmetric-i.e., larger in the direction of the ends than the flanks of an orientation-selective receptive field-which corroborates the existing neurophysiological evidence.

Collinear facilitation and contour integration in autism: evidence for atypical visual integration

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by impaired social interaction, atypical communication and a restricted repertoire of interests and activities. Altered sensory and perceptual experiences are also common, and a notable perceptual difference between individuals with ASD and controls is their superior performance in visual tasks where it may be beneficial to ignore global context. This superiority may be the result of atypical integrative processing. To explore this claim we investigated visual integration in adults with ASD (diagnosed with Asperger's Syndrome) using two psychophysical tasks thought to rely on integrative processing-collinear facilitation and contour integration. We measured collinear facilitation at different flanker orientation offsets and contour integration for both open and closed contours. Our results indicate that compared to matched controls, ASD participants show (i) reduced collinear facilitation, despite equivalent performance without flankers; and (ii) less benefit from closed contours in contour integration. These results indicate weaker visuospatial integration in adults with ASD and suggest that further studies using these types of paradigms would provide knowledge on how contextual processing is altered in ASD.

A Neurocomputational account of the role of contour facilitation in brightness perception

A new filling-in model is proposed in order to account for challenging brightness illusions, where inducing background elements are spatially separated from the gray target such as dungeon, cube and grating illusions, bullseye display and ring patterns. This model implements the simple idea that neural response to low-contrast contour is enhanced (facilitated) by the presence of collinear or parallel high-contrast contours in its wider neighborhood. Contour facilitation is achieved via dendritic inhibition, which enables the computation of maximum function among inputs to the node. Recurrent application of maximum function leads to the propagation of the neural signal along collinear or parallel contour segments. When a strong global-contour signal is accompanied with a weak local-contour signal at the same location, conditions are met to produce brightness assimilation within the Filling-in Layer. Computer simulations showed that the model correctly predicts brightness appearance in all of the aforementioned illusions as well as in White's effect, Benary's cross, Todorović's illusion, checkerboard contrast, contrast-contrast illusion and various variations of the White's effect. The proposed model offers new insights on how geometric factors (contour colinearity or parallelism), together with contrast magnitude contribute to the brightness perception.

Training improves visual processing speed and generalizes to untrained functions

Studies show that manipulating certain training features in perceptual learning determines the specificity of the improvement. The improvement in abnormal visual processing following training and its generalization to visual acuity, as measured on static clinical charts, can be explained by improved sensitivity or processing speed. Crowding, the inability to recognize objects in a clutter, fundamentally limits conscious visual perception. Although it was largely considered absent in the fovea, earlier studies report foveal crowding upon very brief exposures or following spatial manipulations. Here we used GlassesOff's application for iDevices to train foveal vision of young participants. The training was performed at reading distance based on contrast detection tasks under different spatial and temporal constraints using Gabor patches aimed at testing improvement of processing speed. We found several significant improvements in spatio-temporal visual functions including near and also non-trained far distances. A remarkable transfer to visual acuity measured under crowded conditions resulted in reduced processing time of 81 ms, in order to achieve 6/6 acuity. Despite a subtle change in contrast sensitivity, a robust increase in processing speed was found. Thus, enhanced processing speed may lead to overcoming foveal crowding and might be the enabling factor for generalization to other visual functions.

Perceptual grouping across eccentricity

Across the visual field, progressive differences exist in neural processing as well as perceptual abilities. Expansion of stimulus scale across eccentricity compensates for some basic visual capacities, but not for high-order functions. It was hypothesized that as with many higher-order functions, perceptual grouping ability should decline across eccentricity. To test this prediction, psychophysical measurements of grouping were made across eccentricity. Participants indicated the dominant grouping of dot grids in which grouping was based upon luminance, motion, orientation, or proximity. Across trials, the organization of stimuli was systematically decreased until perceived grouping became ambiguous. For all stimulus features, grouping ability remained relatively stable until 40°, beyond which thresholds significantly elevated. The pattern of change across eccentricity varied across stimulus feature, in which stimulus scale, dot size, or stimulus size interacted with eccentricity effects. These results demonstrate that perceptual grouping of such stimuli is not reliant upon foveal viewing, and suggest that selection of dominant grouping patterns from ambiguous displays operates similarly across much of the visual field.

Early sensitivity for eyes within faces: a new neuronal account of holistic and featural processing

Eyes are central to face processing however their role in early face encoding as reflected by the N170 ERP component is unclear. Using eye tracking to enforce fixation on specific facial features, we found that the N170 was larger for fixation on the eyes compared to fixation on the forehead, nasion, nose or mouth, which all yielded similar amplitudes. This eye sensitivity was seen in both upright and inverted faces and was lost in eyeless faces, demonstrating it was due to the presence of eyes at fovea. Upright eyeless faces elicited largest N170 at nose fixation. Importantly, the N170 face inversion effect (FIE) was strongly attenuated in eyeless faces when fixation was on the eyes but was less attenuated for nose fixation and was normal when fixation was on the mouth. These results suggest the impact of eye removal on the N170 FIE is a function of the angular distance between the fixated feature and the eye location. We propose the Lateral Inhibition, Face Template and Eye Detector based (LIFTED) model which accounts for all the present N170 results including the FIE and its interaction with eye removal. Although eyes elicit the largest N170 response, reflecting the activity of an eye detector, the processing of upright faces is holistic and entails an inhibitory mechanism from neurons coding parafoveal information onto neurons coding foveal information. The LIFTED model provides a neuronal account of holistic and featural processing involved in upright and inverted faces and offers precise predictions for further testing.

Information-geometric measures estimate neural interactions during oscillatory brain states

The characterization of functional network structures among multiple neurons is essential to understanding neural information processing. Information geometry (IG), a theory developed for investigating a space of probability distributions has recently been applied to spike-train analysis and has provided robust estimations of neural interactions. Although neural firing in the equilibrium state is often assumed in these studies, in reality, neural activity is non-stationary. The brain exhibits various oscillations depending on cognitive demands or when an animal is asleep. Therefore, the investigation of the IG measures during oscillatory network states is important for testing how the IG method can be applied to real neural data. Using model networks of binary neurons or more realistic spiking neurons, we studied how the single- and pairwise-IG measures were influenced by oscillatory neural activity. Two general oscillatory mechanisms, externally driven oscillations and internally induced oscillations, were considered. In both mechanisms, we found that the single-IG measure was linearly related to the magnitude of the external input, and that the pairwise-IG measure was linearly related to the sum of connection strengths between two neurons. We also observed that the pairwise-IG measure was not dependent on the oscillation frequency. These results are consistent with the previous findings that were obtained under the equilibrium conditions. Therefore, we demonstrate that the IG method provides useful insights into neural interactions under the oscillatory condition that can often be observed in the real brain.

Computing local edge probability in natural scenes from a population of oriented simple cells

A key computation in visual cortex is the extraction of object contours, where the first stage of processing is commonly attributed to V1 simple cells. The standard model of a simple cell-an oriented linear filter followed by a divisive normalization-fits a wide variety of physiological data, but is a poor performing local edge detector when applied to natural images. The brain's ability to finely discriminate edges from nonedges therefore likely depends on information encoded by local simple cell populations. To gain insight into the corresponding decoding problem, we used Bayes's rule to calculate edge probability at a given location/orientation in an image based on a surrounding filter population. Beginning with a set of ∼ 100 filters, we culled out a subset that were maximally informative about edges, and minimally correlated to allow factorization of the joint on- and off-edge likelihood functions. Key features of our approach include a new, efficient method for ground-truth edge labeling, an emphasis on achieving filter independence, including a focus on filters in the region orthogonal rather than tangential to an edge, and the use of a customized parametric model to represent the individual filter likelihood functions. The resulting population-based edge detector has zero parameters, calculates edge probability based on a sum of surrounding filter influences, is much more sharply tuned than the underlying linear filters, and effectively captures fine-scale edge structure in natural scenes. Our findings predict nonmonotonic interactions between cells in visual cortex, wherein a cell may for certain stimuli excite and for other stimuli inhibit the same neighboring cell, depending on the two cells' relative offsets in position and orientation, and their relative activation levels.

Contextual influences in texture-segmentation: distinct effects from elements along the edge and in the texture-region

Both neurophysiological and psychophysical evidence suggest a strong influence of context on texture-segmentation. Here we extend and further analyse this issue, with a particular focus on the underlying mechanism. Specifically, we use a texture-edge discrimination task and separately investigate the effect of elements far from and along the edge. Consistent with previous studies, we report both an iso-near contextual effect - whereby performance is better if elements along the edge are iso-oriented compared to ortho-oriented to the edge - as well as an ortho-far effect - whereby discrimination is higher when elements far from the edge are orthogonal to the edge. We found that backward mask, which is known to interrupt re-entrant processing from extrastriate areas, only interferes with the iso-near effect whereas perturbing orientation, position or contrast polarity of elements far from the edge only abolishes the ortho-far effect. This suggests that feedback processes may be involved in the iso-near effect. Instead, the ortho-far effect may be accounted for by recurrent interactions among 1st order filters.

Superimposed hemifields in primary visual cortex of achiasmic individuals

In the rare condition of achiasma, the visual cortex in each hemisphere receives information from both halves of the visual field. How is this "doubling" of information accommodated in V1? In this issue of Neuron, Hoffmann et al. (2012) investigate the cortical consequences of this anomaly.

How to enhance the dynamic range of excitatory-inhibitory excitable networks

We investigate the collective dynamics of excitatory-inhibitory excitable networks in response to external stimuli. How to enhance the dynamic range, which represents the ability of networks to encode external stimuli, is crucial to many applications. We regard the system as a two-layer network (E layer and I layer) and explore the criticality and dynamic range on diverse networks. Interestingly, we find that phase transition occurs when the dominant eigenvalue of the E layer's weighted adjacency matrix is exactly 1, which is only determined by the topology of the E layer. Meanwhile, it is shown that the dynamic range is maximized at a critical state. Based on theoretical analysis, we propose an inhibitory factor for each excitatory node. We suggest that if nodes with high inhibitory factors are cut out from the I layer, the dynamic range could be further enhanced. However, because of the sparseness of networks and passive function of inhibitory nodes, the improvement is relatively small compared to the original dynamic range. Even so, this provides a strategy to enhance the dynamic range.

Learning to be fast: gain accuracy with speed

Our recent neurophysiological findings provided evidence for collinear facilitation in detecting low-contrast Gabor patches (GPs) and for the abolishment of these collinear interactions by backward masking (BM) (Sterkin et al., 2008; Sterkin, Yehezkel, Bonneh, et al., 2009). We suggested that the suppression induced by the BM eliminates the collinear facilitation. Moreover, our recent study showed that training on a BM task overcomes the BM effect, hence, improves the processing speed (Polat, 2009). Here we applied training on detecting a target that is followed by BM in order to study whether reinforced facilitatory interactions can overcome the suppressive effects induced by BM. Event-Related Potentials (ERPs) were recorded before and after ten training sessions performed on different days. Low-contrast, foveal target GP was simultaneously flanked by two collinear high-contrast GPs. In the BM task, another identical mask was presented at different time-intervals (ISIs). Before training, BM induced suppression of target detection, at the ISI of 50 ms, in agreement with earlier behavioral findings. This ISI coincides with the active time-window of lateral interactions. After training, our results show a remarkable improvement in all behavioral measurements, including percent of correct responses, sensitivity (d'), reaction time (RT) and the decision criterion for this ISI. The ERP results show that before training,BM attenuated the physiological markers of facilitation at the same ISI of 50 ms, measured as the amplitude of the negative N1 peak (latency of 260 ms). After the training, the sensory representation, reflected by P1 peak, has not changed, consistent with the unchanged physical parameters of the stimulus. Instead, the shorter latency (by 20 ms, latency of 240 ms) and the increased amplitude of N1 represent the development of faster and stronger facilitatory lateral interactions between the target and the collinear flankers. Thus, previously effective backward masking became ineffective in disrupting the collinear facilitation. Moreover, a high-amplitude late peak (P4, latency of 610-630 ms) was not affected by training, however its high correlation with RT (95%) before training was significantly decreased (to 76%), consistent with a lower-level representation of a trained skill. We suggest that perceptual learning that strengthens collinear facilitation results in a faster processing speed.

The effect of spatial orientation on detecting motion trajectories in noise

A series of experiments investigated the extent to which the spatial orientation of a signal line affects discrimination of its trajectory from the random trajectories of background noise lines. The orientation of the signal line was either parallel (iso-) or orthogonal (ortho-) to its motion direction and it was identical in all respects to the noise (orientation, length and speed) except for its motion direction, rendering the signal line indistinguishable from the noise on a frame-to-frame basis. We found that discrimination of ortho-trajectories was generally better than iso-trajectories. Discrimination of ortho-trajectories was largely immune to the effects of spatial jitter in the trajectory, and to variations in step size and line-length. Discrimination of iso-trajectories was reliable provided that step-size was not too short and did not exceed line length, and that the trajectory was straight. The new result that trajectory discrimination in moving line elements is modulated by line orientation suggests that ortho- and iso-trajectory discrimination rely upon two distinct mechanisms: iso-motion discrimination involves a 'motion-streak' process that combines motion information with information about orientation parallel to the motion trajectory, while ortho-motion discrimination involves extended trajectory facilitation in a network of receptive fields with orthogonal orientation tuning.

Psychometric functions for detection and discrimination with and without flankers

Recent studies have reported that flanking stimuli broaden the psychometric function and lower detection thresholds. In the present study, we measured psychometric functions for detection and discrimination with and without flankers to investigate whether these effects occur throughout the contrast continuum. Our results confirm that lower detection thresholds with flankers are accompanied by broader psychometric functions. Psychometric functions for discrimination reveal that discrimination thresholds with and without flankers are similar across standard levels, and that the broadening of psychometric functions with flankers disappears as standard contrast increases, to the point that psychometric functions at high standard levels are virtually identical with or without flankers. Threshold-versus-contrast (TvC) curves with flankers only differ from TvC curves without flankers in occasional shallower dippers and lower branches on the left of the dipper, but they run virtually superimposed at high standard levels. We discuss differences between our results and other results in the literature, and how they are likely attributed to the differential vulnerability of alternative psychophysical procedures to the effects of presentation order. We show that different models of flanker facilitation can fit the data equally well, which stresses that succeeding at fitting a model does not validate it in any sense.

The effects of aging on contour discrimination in clutter

The present study examined the effect of aging on the detection and discrimination of contours embedded in a dense field of distractors. The minimum stimulus duration required to correctly discriminate (Experiment 1) and detect (Experiment 2) three types of "C" shaped contours was measured. Overall, older subjects required longer stimulus durations than younger subjects in all conditions. Comparing performance for contours comprising elements oriented tangentially to the contour path (aligned) and those oriented orthogonally to the contour (radial) revealed that the effect of local orientation on contour discrimination is slightly greater in older than younger subjects. Control experiments showed that these age differences were not due to differences in retinal illuminance, or the detectability or discriminability of the elements comprising the contours. These findings suggest that ability to extract global contours embedded in clutter declines in older age.

Inhibitory stabilization of the cortical network underlies visual surround suppression

In what regime does the cortical circuit operate? Our intracellular studies of surround suppression in cat primary visual cortex (V1) provide strong evidence on this question. Although suppression has been thought to arise from an increase in lateral inhibition, we find that the inhibition that cells receive is reduced, not increased, by a surround stimulus. Instead, suppression is mediated by a withdrawal of excitation. Thalamic recordings and previous work show that these effects cannot be explained by a withdrawal of thalamic input. We find in theoretical work that this behavior can only arise if V1 operates as an inhibition-stabilized network (ISN), in which excitatory recurrence alone is strong enough to destabilize visual responses but feedback inhibition maintains stability. We confirm two strong tests of this scenario experimentally and show through simulation that observed cell-to-cell variability in surround effects, from facilitation to suppression, can arise naturally from variability in the ISN.

Spatio-temporal low-level neural networks account for visual masking

T emporal masking is a paradigm that is widely used to study visual information processing. When a mask is presented, typically within less than 100 msec before or after the target, the response to the target is reduced. The results of our psychophysical and visual evoked potential (VEP) experiments show that the masking effect critically depends on a combination of several factors: (1) the processing time of the target, (2) the order of presentation of the target and the mask, and (3) the spatial arrangement of the target and the mask. Thus, the masking effect depends on the spatial-temporal combination of these factors. Suppression was observed when the mask was positioned within a spatial range that was found to evoke inhibition, and when the temporal separation between the target and the mask was short. In contrast, lateral facilitation was observed when the mask was presented at a spatial separation that did not evoke inhibition from the target’s vicinity and with a temporal sequence that preceded the target, or when it was presented simultaneously with it, but not when the target preceded the mask. We propose that masking effects, either suppression or facilitation, reflect integration into the spatial and the temporal domains of the feedforward response to the target and the lateral inputs evoked by the mask (excitatory and/or inhibitory). Because the excitation evoked by the mask develops and propagates slowly from the mask’s location to the target’s location, it lags behind the response to the target. On the other hand, inhibition that is produced in the vicinity of the target evolves more rapidly and follows the onset and offset of the stimulus more closely. Thus, lateral excitation that overcomes the inhibition may facilitate the grouping of local elements into a global percept by increasing the survivability of the object and its accessibility for perceptual awareness.