Visual latencies in areas V1 and V2 of the macaque monkey

Investigating the hemiretinal asymmetry in emotion processing as a function of spatial frequency

The subcortical visual pathway to the amygdala has long been considered a rapid and crude stream for processing emotionally salient information that is reliant on low spatial frequency (LSF) information. Recently, research has called this LSF dependency into question. To resolve this debate, we take advantage of an anatomical hemiretinal asymmetry, whereby the nasal hemiretina sends a higher proportion of information through the subcortical pathway than the temporal hemiretina. We recorded brain activity using electroencephalography (EEG) in human participants (N = 40) while they completed a monocular viewing paradigm. Pairs of faces (one fearful and one neutral, or both neutral) were projected simultaneously to the nasal and temporal hemiretina in three contrast-equated blocks; faces filtered to display only (i) LSF, (ii) high spatial frequency (HSF), or (iii) unfiltered information (broadband spatial frequency; BSF). BSF fearful faces were found to produce a greater naso-temporal asymmetry, with greater N170 amplitudes evoked by BSF faces in the nasal field, compared to HSF faces. Conversely, the naso-temporal asymmetry for LSF fearful faces did not differ between BSF and HSF. Collectively, these findings provide crucial evidence that the subcortical pathway carries combined spatial frequency visual signals, with a potential bias against HSF content.

Grasping the Concept of an Object at a Glance: Category Information Accessed by Brief Dichoptic Presentation

What type of conceptual information about an object do we get at a brief glance? In two experiments, we investigated the nature of conceptual tokening-the moment at which conceptual information about an object is accessed. Using a masked picture-word congruency task with dichoptic presentations at "brief" (50-60 ms) and "long" (190-200 ms) durations, participants judged the relation between a picture (e.g., a banana) and a word representing one of four property types about the object: superordinate (fruit), basic level (banana), a high-salient (yellow), or low-salient feature (peel). In Experiment 1, stimuli were presented in black-and-white; in Experiment 2, they were presented in red and blue, with participants wearing red-blue anaglyph glasses. This manipulation allowed for the independent projection of stimuli to the left- and right-hemisphere visual areas, aiming to probe the early effects of these projections in conceptual tokening. Results showed that superordinate and basic-level properties elicited faster and more accurate responses than high- and low-salient features at both presentation times. This advantage persisted even when the objects were divided into categories (e.g., animals, vegetables, vehicles, tools), and when objects contained high-salient visual features. However, contrasts between categories show that animals, fruits, and vegetables tend to be categorized at the superordinate level, while vehicles tend to be categorized at the basic level. Also, for a restricted class of objects, high-salient features representing diagnostic color information (yellow for the picture of a banana) facilitated congruency judgments to the same extent as that of superordinate and basic-level labels. We suggest that early access to object concepts yields superordinate and basic-level information, with features only yielding effects at a later stage of processing, unless they represent diagnostic color information. We discuss these results advancing a unified theory of conceptual representation, integrating key postulates of atomism and feature-based theories.

Psychophysics of neon color spreading: Chromatic and temporal factors are not limiting

Neon color spreading (NCS) is an illusory color phenomenon that provides a dramatic example of surface completion and filling-in. Numerous studies have varied both spatial and temporal aspects of the neon-generating stimulus to explore variations in the strength of the effect. Here, we take a novel, parametric, low-level psychophysical approach to studying NCS in two experiments. In Experiment 1, we test the ability of both cone-isolating and equiluminant stimuli to generate neon color spreading for both increments and decrements in cone modulations. As expected, sensitivity was low to S(hort-wavelength) cone stimuli due to their poor spatial resolution, but sensitivity was similar for the other color directions. We show that when these differences in detection sensitivity are accounted for, the particular cone type, and the polarity (increment or decrement), make little difference in generating neon color spreading, with NCS visible at about twice detection threshold level in all cases. In Experiment 2, we use L-cone flicker modulations (reddish and greenish excursions around grey) to study sensitivity to NCS as a function of temporal frequency from 0.5 to 8 Hz. After accounting for detectability, the temporal contrast sensitivity functions for NCS are approximately constant or even increase over the studied frequency range. Therefore there is no evidence in this study that the processes underlying NCS are slower than the low-level processes of simple flicker detection. These results point to relatively fast mechanisms, not slow diffusion processes, as the substrate for NCS.

High-Resolution Laminar Identification in Macaque Primary Visual Cortex Using Neuropixels Probes

Laminar electrode arrays allow simultaneous recording of activity of many cortical neurons and assignment to layers using current source density (CSD) analyses. Electrode arrays with 100-micron contact spacing have been used to estimate borders between layer 4 versus superficial or deep layers, but in macaque primary visual cortex (V1) there are far more layers, such as 4A which is only 50-100 microns thick. Neuropixels electrode arrays have 20-micron spacing, and thus could potentially discern thinner layers and more precisely identify laminar borders. Here we show that laminar distributions of CSDs lack consistency and the spatial resolution required for thin layers and accurate layer boundaries. To take full advantage of high density Neuropixels arrays, we have developed approaches based on higher resolution electrical signals and analyses, including spike waveforms and spatial spread, unit density, high-frequency action potential (AP) power spectrum, temporal power change, and coherence spectrum, that afford far higher resolution of laminar distinctions, including the ability to precisely detect the borders of even the thinnest layers of V1.

Different Sensory Information Is Used for State Estimation when Stationary or Moving

The accurate estimation of limb state is necessary for movement planning and execution. While state estimation requires both feedforward and feedback information, we focus here on the latter. Prior literature has shown that integrating visual and proprioceptive feedback improves estimates of static limb position. However, differences in visual and proprioceptive feedback delays suggest that multisensory integration could be disadvantageous when the limb is moving. We formalized this hypothesis by modeling feedback-based state estimation using the long-standing maximum likelihood estimation model of multisensory integration, which we updated to account for sensory delays. Our model predicted that the benefit of multisensory integration was largely lost when the limb was passively moving. We tested this hypothesis in a series of experiments in human subjects that compared the degree of interference created by discrepant visual or proprioceptive feedback when estimating limb position either statically at the end of the movement or dynamically at movement midpoint. In the static case, we observed significant interference: discrepant feedback in one modality systematically biased sensory estimates based on the other modality. However, no interference was seen in the dynamic case: participants could ignore sensory feedback from one modality and accurately reproduce the motion indicated by the other modality. Together, these findings suggest that the sensory feedback used to compute a state estimate differs depending on whether the limb is stationary or moving. While the former may tend toward multimodal integration, the latter is more likely to be based on feedback from a single sensory modality.

Different sensory information is used for state estimation when stationary or moving

The accurate estimation of limb state is necessary for movement planning and execution. While state estimation requires both feedforward and feedback information, we focus here on the latter. Prior literature has shown that integrating visual and proprioceptive feedback improves estimates of static limb position. However, differences in visual and proprioceptive feedback delays suggest that multisensory integration could be disadvantageous when the limb is moving. We formalized this hypothesis by modeling feedback-based state estimation using the longstanding maximum likelihood estimation model of multisensory integration, which we updated to account for sensory delays. Our model predicted that the benefit of multisensory integration was largely lost when the limb was passively moving. We tested this hypothesis in a series of experiments in human subjects that compared the degree of interference created by discrepant visual or proprioceptive feedback when estimating limb position either statically at the end of the movement or dynamically at movement midpoint. In the static case, we observed significant interference: discrepant feedback in one modality systematically biased sensory estimates based on the other modality. However, no interference was seen in the dynamic case: participants could ignore sensory feedback from one modality and accurately reproduce the motion indicated by the other modality. Together, these findings suggest that the sensory feedback used to compute a state estimate differs depending on whether the limb is stationary or moving. While the former may tend toward multimodal integration, the latter is more likely to be based on feedback from a single sensory modality.

Characterizing Spatiotemporal Population Receptive Fields in Human Visual Cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time-varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants (both females and males). We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (1) from early to later areas within a visual stream, spatial and temporal windows of pRFs progressively increase in size and show greater compressive nonlinearities, (2) later visual areas show diverging spatial and temporal windows across streams, and (3) within early visual areas (V1-V3), both spatial and temporal windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses using fMRI.

Laminar compartmentalization of attention modulation in area V4 aligns with the demands of visual processing hierarchy in the cortex

Attention selectively enhances neural responses to low contrast stimuli in visual area V4, a critical hub that sends projections both up and down the visual hierarchy. Veridical encoding of contrast information is a key computation in early visual areas, while later stages encoding higher level features benefit from improved sensitivity to low contrast. How area V4 meets these distinct information processing demands in the attentive state is unknown. We found that attentional modulation in V4 is cortical layer and cell-class specific. Putative excitatory neurons in the superficial layers show enhanced boosting of low contrast information, while those of deep layers exhibit contrast-independent scaling. Computational modeling suggested the extent of spatial integration of inhibitory neurons as the mechanism behind such laminar differences. Considering that superficial neurons are known to project to higher areas and deep layers to early visual areas, our findings suggest that the interactions between attention and contrast in V4 are compartmentalized, in alignment with the demands of the visual processing hierarchy.

The influence of stereopsis on visual saliency in a proto-object based model of selective attention

Some animals including humans use stereoscopic vision which reconstructs spatial information about the environment from the disparity between images captured by eyes in two separate adjacent locations. Like other sensory information, such stereoscopic information is expected to influence attentional selection. We develop a biologically plausible model of binocular vision to study its effect on bottom-up visual attention, i.e., visual saliency. In our model, the scene is organized in terms of proto-objects on which attention acts, rather than on unbound sets of elementary features. We show that taking into account the stereoscopic information improves the performance of the model in the prediction of human eye movements with statistically significant differences.

Hierarchical temporal prediction captures motion processing along the visual pathway

Visual neurons respond selectively to features that become increasingly complex from the eyes to the cortex. Retinal neurons prefer flashing spots of light, primary visual cortical (V1) neurons prefer moving bars, and those in higher cortical areas favor complex features like moving textures. Previously, we showed that V1 simple cell tuning can be accounted for by a basic model implementing temporal prediction - representing features that predict future sensory input from past input (Singer et al., 2018). Here, we show that hierarchical application of temporal prediction can capture how tuning properties change across at least two levels of the visual system. This suggests that the brain does not efficiently represent all incoming information; instead, it selectively represents sensory inputs that help in predicting the future. When applied hierarchically, temporal prediction extracts time-varying features that depend on increasingly high-level statistics of the sensory input.

Oculomotor feature discrimination is cortically mediated

Eye movements are often directed toward stimuli with specific features. Decades of neurophysiological research has determined that this behavior is subserved by a feature-reweighting of the neural activation encoding potential eye movements. Despite the considerable body of research examining feature-based target selection, no comprehensive theoretical account of the feature-reweighting mechanism has yet been proposed. Given that such a theory is fundamental to our understanding of the nature of oculomotor processing, we propose an oculomotor feature-reweighting mechanism here. We first summarize the considerable anatomical and functional evidence suggesting that oculomotor substrates that encode potential eye movements rely on the visual cortices for feature information. Next, we highlight the results from our recent behavioral experiments demonstrating that feature information manifests in the oculomotor system in order of featural complexity, regardless of whether the feature information is task-relevant. Based on the available evidence, we propose an oculomotor feature-reweighting mechanism whereby (1) visual information is projected into the oculomotor system only after a visual representation manifests in the highest stage of the cortical visual processing hierarchy necessary to represent the relevant features and (2) these dynamically recruited cortical module(s) then perform feature discrimination via shifting neural feature representations, while also maintaining parity between the feature representations in cortical and oculomotor substrates by dynamically reweighting oculomotor vectors. Finally, we discuss how our behavioral experiments may extend to other areas in vision science and its possible clinical applications.

Characterizing spatiotemporal population receptive fields in human visual cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants. We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (i) from early to later areas within a visual stream, spatial and temporal integration windows of pRFs progressively increase in size and show greater compressive nonlinearities, (ii) later visual areas show diverging spatial and temporal integration windows across streams, and (iii) within early visual areas (V1-V3), both spatial and temporal integration windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses in the human brain using fMRI.

Backward masking reveals coarse-to-fine dynamics in human V1

Natural images exhibit luminance variations aligned across a broad spectrum of spatial frequencies (SFs). It has been proposed that, at early stages of processing, the coarse signals carried by the low SF (LSF) of the visual input are sent rapidly from primary visual cortex (V1) to ventral, dorsal and frontal regions to form a coarse representation of the input, which is later sent back to V1 to guide the processing of fine-grained high SFs (i.e., HSF). We used functional resonance imaging (fMRI) to investigate the role of human V1 in the coarse-to-fine integration of visual input. We disrupted the processing of the coarse and fine content of full-spectrum human face stimuli via backward masking of selective SF ranges (LSFs: <1.75cpd and HSFs: >1.75cpd) at specific times (50, 83, 100 or 150ms). In line with coarse-to-fine proposals, we found that (1) the selective masking of stimulus LSF disrupted V1 activity in the earliest time window, and progressively decreased in influence, while (2) an opposite trend was observed for the masking of stimulus' HSF. This pattern of activity was found in V1, as well as in ventral (i.e. the Fusiform Face area, FFA), dorsal and orbitofrontal regions. We additionally presented subjects with contrast negated stimuli. While contrast negation significantly reduced response amplitudes in the FFA, as well as coupling between FFA and V1, coarse-to-fine dynamics were not affected by this manipulation. The fact that V1 response dynamics to strictly identical stimulus sets differed depending on the masked scale adds to growing evidence that V1 role goes beyond the early and quasi-passive transmission of visual information to the rest of the brain. It instead indicates that V1 may yield a 'spatially registered common forum' or 'blackboard' that integrates top-down inferences with incoming visual signals through its recurrent interaction with high-level regions located in the inferotemporal, dorsal and frontal regions.

Impact of glaucoma on the spatial frequency processing of scenes in central vision

Glaucoma is an eye disease characterized by a progressive vision loss usually starting in peripheral vision. However, a deficit for scene categorization is observed even in the preserved central vision of patients with glaucoma. We assessed the processing and integration of spatial frequencies in the central vision of patients with glaucoma during scene categorization, considering the severity of the disease, in comparison to age-matched controls. In the first session, participants had to categorize scenes filtered in low-spatial frequencies (LSFs) and high-spatial frequencies (HSFs) as a natural or an artificial scene. Results showed that the processing of spatial frequencies was impaired only for patients with severe glaucoma, in particular for HFS scenes. In the light of proactive models of visual perception, we investigated how LSF could guide the processing of HSF in a second session. We presented hybrid scenes (combining LSF and HSF from two scenes belonging to the same or different semantic category). Participants had to categorize the scene filtered in HSF while ignoring the scene filtered in LSF. Surprisingly, results showed that the semantic influence of LSF on HSF was greater for patients with early glaucoma than controls, and then disappeared for the severe cases. This study shows that a progressive destruction of retinal ganglion cells affects the spatial frequency processing in central vision. This deficit may, however, be compensated by increased reliance on predictive mechanisms at early stages of the disease which would however decline in more severe cases.

Model-based characterization of the selectivity of neurons in primary visual cortex

Statistical models are increasingly being used to understand the complexity of stimulus selectivity in primary visual cortex (V1) in the context of complex time-varying stimuli, replacing averaging responses to simple parametric stimuli. Although such models often can more accurately reflect the computations performed by V1 neurons in more natural visual environments, they do not by themselves provide insight into V1 neural selectivity to basic stimulus features such as receptive field size, spatial frequency tuning, and phase invariance. Here, we present a battery of analyses that can be directly applied to encoding models to link complex encoding models to more interpretable aspects of stimulus selectivity. We apply this battery to nonlinear models of V1 neurons recorded in awake macaque during random bar stimuli. In linking model properties to more classical measurements, we demonstrate several novel aspects of V1 selectivity not available to simpler experimental measurements. For example, this approach reveals that individual spatiotemporal elements of the V1 models often have a smaller spatial scale than the neuron as a whole, resulting in nontrivial tuning to spatial frequencies. In addition, we propose measures of nonlinear integration that suggest that classical classifications of V1 neurons into simple versus complex cells will be spatial-frequency dependent. In total, rather than obfuscate classical characterizations of V1 neurons, model-based characterizations offer a means to more fully understand their selectivity, and link their classical tuning properties to their roles in more complex, natural, visual processing.NEW & NOTEWORTHY Visual neurons are increasingly being studied with more complex, natural visual stimuli, and increasingly complex models are necessary to characterize their response properties. Here, we describe a battery of analyses that relate these more complex models to classical characterizations. Using such model-based characterizations of V1 neurons furthermore yields several new insights into V1 processing not possible to capture in more classical means to measure their visual selectivity.

Adaptive erasure of spurious sequences in sensory cortical circuits

Sequential activity reflecting previously experienced temporal sequences is considered a hallmark of learning across cortical areas. However, it is unknown how cortical circuits avoid the converse problem: producing spurious sequences that are not reflecting sequences in their inputs. We develop methods to quantify and study sequentiality in neural responses. We show that recurrent circuit responses generally include spurious sequences, which are specifically prevented in circuits that obey two widely known features of cortical microcircuit organization: Dale’s law and Hebbian connectivity. In particular, spike-timing-dependent plasticity in excitation-inhibition networks leads to an adaptive erasure of spurious sequences. We tested our theory in multielectrode recordings from the visual cortex of awake ferrets. Although responses to natural stimuli were largely non-sequential, responses to artificial stimuli initially included spurious sequences, which diminished over extended exposure. These results reveal an unexpected role for Hebbian experience-dependent plasticity and Dale’s law in sensory cortical circuits.

•

Recurrent circuits generate spurious sequences without sequential inputs

•

A principled measure of total sequentiality in population responses is developed

•

Theory predicts that Hebbian plasticity should abolish spurious sequences

•

Spurious sequences in the visual cortex diminish with experience

Decoding rapidly presented visual stimuli from prefrontal ensembles without report nor post-perceptual processing

The role of the primate prefrontal cortex (PFC) in conscious perception is debated. The global neuronal workspace theory of consciousness predicts that PFC neurons should contain a detailed code of the current conscious contents. Previous research showed that PFC is indeed activated in paradigms of conscious visual perception, including no-report paradigms where no voluntary behavioral report of the percept is given, thus avoiding a conflation of signals related to visual consciousness with signals related to the report. Still, it has been argued that prefrontal modulation could reflect post-perceptual processes that may be present even in the absence of report, such as thinking about the perceived stimulus, therefore reflecting a consequence rather than a direct correlate of conscious experience. Here, we investigate these issues by recording neuronal ensemble activity from the macaque ventrolateral PFC during briefly presented visual stimuli, either in isolated trials in which stimuli were clearly perceived or in sequences of rapid serial visual presentation (RSVP) in which perception and post-perceptual processing were challenged. We report that the identity of each stimulus could be decoded from PFC population activity even in the RSVP condition. The first visual signals could be detected at 60 ms after stimulus onset and information was maximal at 150 ms. However, in the RSVP condition, 200 ms after the onset of a stimulus, the decoding accuracy quickly dropped to chance level and the next stimulus started to be decodable. Interestingly, decoding in the ventrolateral PFC was stronger compared to posterior parietal cortex for both isolated and RSVP stimuli. These results indicate that neuronal populations in the macaque PFC reliably encode visual stimuli even under conditions that have been shown to challenge conscious perception and/or substantially reduce the probability of post-perceptual processing in humans. We discuss whether the observed activation reflects conscious access, phenomenal consciousness, or merely a preconscious bottom-up wave.

Transient neuronal suppression for exploitation of new sensory evidence

In noisy but stationary environments, decisions should be based on the temporal integration of sequentially sampled evidence. This strategy has been supported by many behavioral studies and is qualitatively consistent with neural activity in multiple brain areas. By contrast, decision-making in the face of non-stationary sensory evidence remains poorly understood. Here, we trained monkeys to identify and respond via saccade to the dominant color of a dynamically refreshed bicolor patch that becomes informative after a variable delay. Animals’ behavioral responses were briefly suppressed after evidence changes, and many neurons in the frontal eye field displayed a corresponding dip in activity at this time, similar to that frequently observed after stimulus onset but sensitive to stimulus strength. Generalized drift-diffusion models revealed consistency of behavior and neural activity with brief suppression of motor output, but not with pausing or resetting of evidence accumulation. These results suggest that momentary arrest of motor preparation is important for dynamic perceptual decision making.

While evidence is constantly changing during real-world decisions, little is known about how the brain deals with such changes. Here, the authors show that the brain strategically suppresses motor output via the frontal eye fields in response to stimulus changes.

Stimulus dependence of directed information exchange between cortical layers in macaque V1

Perception and cognition require the integration of feedforward sensory information with feedback signals. Using different sized stimuli, we isolate spectral signatures of feedforward and feedback signals, and their effect on communication between layers in primary visual cortex of male macaque monkeys. Small stimuli elicited gamma frequency oscillations predominantly in the superficial layers. These Granger-causally originated in upper layer 4 and lower supragranular layers. Unexpectedly, large stimuli generated strong narrow band gamma oscillatory activity across cortical layers. They Granger-causally arose in layer 5, were conveyed through layer six to superficial layers, and violated existing models of feedback spectral signatures. Equally surprising, with large stimuli, alpha band oscillatory activity arose predominantly in granular and supragranular layers and communicated in a feedforward direction. Thus, oscillations in specific frequency bands are dynamically modulated to serve feedback and feedforward communication and are not restricted to specific cortical layers in V1.

Information redundancy across spatial scales modulates early visual cortical processing

Visual images contain redundant information across spatial scales where low spatial frequency contrast is informative towards the location and likely content of high spatial frequency detail. Previous research suggests that the visual system makes use of those redundancies to facilitate efficient processing. In this framework, a fast, initial analysis of low-spatial frequency (LSF) information guides the slower and later processing of high spatial frequency (HSF) detail. Here, we used multivariate classification as well as time-frequency analysis of MEG responses to the viewing of intact and phase scrambled images of human faces to demonstrate that the availability of redundant LSF information, as found in broadband intact images, correlates with a reduction in HSF representational dominance in both early and higher-level visual areas as well as a reduction of gamma-band power in early visual cortex. Our results indicate that the cross spatial frequency information redundancy that can be found in all natural images might be a driving factor in the efficient integration of fine image details.

Columnar processing of border ownership in primate visual cortex

To understand a visual scene, the brain segregates figures from background by assigning borders to foreground objects. Neurons in primate visual cortex encode which object owns a border (border ownership), but the underlying circuitry is not understood. Here, we used multielectrode probes to record from border ownership-selective units in different layers in macaque visual area V4 to study the laminar organization and timing of border ownership selectivity. We find that border ownership selectivity occurs first in deep layer units, in contrast to spike latency for small stimuli in the classical receptive field. Units on the same penetration typically share the preferred side of border ownership, also across layers, similar to orientation preference. Units are often border ownership-selective for a range of border orientations, where the preferred sides of border ownership are systematically organized in visual space. Together our data reveal a columnar organization of border ownership in V4 where the earliest border ownership signals are not simply inherited from upstream areas, but computed by neurons in deep layers, and may thus be part of signals fed back to upstream cortical areas or the oculomotor system early after stimulus onset. The finding that preferred border ownership is clustered and can cover a wide range of spatially contiguous locations suggests that the asymmetric context integrated by these neurons is provided in a systematically clustered manner, possibly through corticocortical feedback and horizontal connections.

To understand a visual scene, the brain needs to identify objects and distinguish them from background. A border marks the transition from object to background, but to differentiate which side of the border belongs to the object and which to background, the brain must integrate information across space. An early signature of this computation is that brain cells signal which side of a border is ‘owned’ by an object, also known as border ownership. But how the brain computes border ownership remains unknown.

The optic nerve is a cable-like group of nerve cells that transmits information from the eye to the brain’s visual processing areas and into the visual cortex. This flow of information is often described as traveling in a feedforward direction, away from the eyes to progressively more specialized areas in the visual cortex. However, there are also numerous feedback connections in the brain, running backward from more specialized to less specialized cortical areas.

To better understand the role of these feedforward and feedback circuits in the visual processing of object borders, Franken and Reynolds made use of their stereotyped projection patterns across the cortex layers. Feedforward connections terminate in the middle layers of a cortical area, whereas feedback connections terminate in upper and lower layers. Since time is required for information to traverse the cortical layers, dissecting the timing of border ownership signals may reveal if border ownership is computed in a feedforward or feedback manner. To find out more, electrodes were used to record neural activity in the upper, middle and lower layers of the visual cortex of two rhesus monkeys as they were presented with a set of abstract scenes composed of simple shapes on a background.

This revealed that cells signaling border ownership in deep layers of the cortex did so before the signals appeared in the middle layer. This suggests that feedback rather than feedforward is required to compute border ownership. Moreover, Franken and Reynolds found evidence that cells that prefer the same side of border ownership are clustered in columns, showing how these neural circuits are organized within the visual cortex.

In summary, Franken and Reynolds found that the circuits of the primate brain that compute border ownership occur as columns, in which cells in deep layers signal border ownership first, suggesting that border ownership relies on feedback from more specialized areas. A better understanding of how feedback in the brain works to process visual information helps us appreciate what happens when these systems are impaired.

Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex

Horizontal disparities between the two eyes' retinal images are the primary cue for depth. Commonly used random ot tereograms (RDS) intentionally camouflage the disparity cue, breaking the correlations between monocular image structure and the depth map that are present in natural images. Because of the nonlinear nature of visual processing, it is unlikely that simple computational rules derived from RDS will be sufficient to explain binocular vision in natural environments. In order to understand the interplay between natural scene structure and disparity encoding, we used a depth-image-based-rendering technique and a library of natural 3D stereo pairs to synthesize two novel stereogram types in which monocular scene content was manipulated independent of scene depth information. The half-images of the novel stereograms comprised either random-dots or scrambled natural scenes, each with the same depth maps as the corresponding natural scene stereograms. Using these stereograms in a simultaneous Event-Related Potential and behavioral discrimination task, we identified multiple disparity-contingent encoding stages between 100 ~ 500 msec. The first disparity sensitive evoked potential was observed at ~100 msec after an earlier evoked potential (between ~50-100 msec) that was sensitive to the structure of the monocular half-images but blind to disparity. Starting at ~150 msec, disparity responses were stereogram-specific and predictive of perceptual depth. Complex features associated with natural scene content are thus at least partially coded prior to disparity information, but these features and possibly others associated with natural scene content interact with disparity information only after an intermediate, 2D scene-independent disparity processing stage.

Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials

The primate visual system analyzes statistical information in natural images and uses it for the immediate perception of scenes, objects, and surface materials. To investigate the dynamical encoding of image statistics in the human brain, we measured visual evoked potentials (VEPs) for 166 natural textures and their synthetic versions, and performed a reverse-correlation analysis of the VEPs and representative texture statistics of the image. The analysis revealed occipital VEP components strongly correlated with particular texture statistics. VEPs correlated with low-level statistics, such as subband SDs, emerged rapidly from 100 to 250 ms in a spatial frequency dependent manner. VEPs correlated with higher-order statistics, such as subband kurtosis and cross-band correlations, were observed at slightly later times. Moreover, these robust correlations enabled us to inversely estimate texture statistics from VEP signals via linear regression and to reconstruct texture images that appear similar to those synthesized with the original statistics. Additionally, we found significant differences in VEPs at 200-300 ms between some natural textures and their Portilla-Simoncelli (PS) synthesized versions, even though they shared almost identical texture statistics. This differential VEP was related to the perceptual "unnaturalness" of PS-synthesized textures. These results suggest that the visual cortex rapidly encodes image statistics hidden in natural textures specifically enough to predict the visual appearance of a texture, while it also represents high-level information beyond image statistics, and that electroencephalography can be used to decode these cortical signals.

Neuronal heterogeneity modulates phase synchronization between unidirectionally coupled populations with excitation-inhibition balance

Several experiments and models have highlighted the importance of neuronal heterogeneity in brain dynamics and function. However, how such a cell-to-cell diversity can affect cortical computation, synchronization, and neuronal communication is still under debate. Previous studies have focused on the effect of neuronal heterogeneity in one neuronal population. Here we are specifically interested in the effect of neuronal variability on the phase relations between two populations, which can be related to different cortical communication hypotheses. It has been recently shown that two spiking neuron populations unidirectionally connected in a sender-receiver configuration can exhibit anticipated synchronization (AS), which is characterized by a negative phase lag. This phenomenon has been reported in electrophysiological data of nonhuman primates and human EEG during a visual discrimination cognitive task. In experiments, the unidirectional coupling could be accessed by Granger causality and can be accompanied by either positive or negative phase difference between cortical areas. Here we propose a model of two coupled populations in which the neuronal heterogeneity can determine the dynamical relation between the sender and the receiver and can reproduce phase relations reported in experiments. Depending on the distribution of parameters characterizing the neuronal firing patterns, the system can exhibit both AS and the usual delayed synchronization regime (DS, with positive phase) as well as a zero-lag synchronization regime and phase bistability between AS and DS. Furthermore, we show that our network can present diversity in their phase relations maintaining the excitation-inhibition balance.

Semantic and Physical Properties of Peripheral Vision Are Used for Scene Categorization in Central Vision

Theories of visual recognition postulate that our ability to understand our visual environment at a glance is based on the extraction of the gist of the visual scene, a first global and rudimentary visual representation. Gist perception would be based on the rapid analysis of low spatial frequencies in the visual signal and would allow a coarse categorization of the scene. We aimed to study whether the low spatial resolution information available in peripheral vision could modulate the processing of visual information presented in central vision. We combined behavioral measures (Experiments 1 and 2) and fMRI measures (Experiment 2). Participants categorized a scene presented in central vision (artificial vs. natural categories) while ignoring another scene, either semantically congruent or incongruent, presented in peripheral vision. The two scenes could either share the same physical properties (similar amplitude spectrum and spatial configuration) or not. Categorization of the central scene was impaired by a semantically incongruent peripheral scene, in particular when the two scenes were physically similar. This semantic interference effect was associated with increased activation of the inferior frontal gyrus. When the two scenes were semantically congruent, the dissimilarity of their physical properties impaired the categorization of the central scene. This effect was associated with increased activation in occipito-temporal areas. In line with the hypothesis of predictive mechanisms involved in visual recognition, results suggest that semantic and physical properties of the information coming from peripheral vision would be automatically used to generate predictions that guide the processing of signal in central vision.

Neural Selectivity for Visual Motion in Macaque Area V3A

The processing of visual motion is conducted by dedicated pathways in the primate brain. These pathways originate with populations of direction-selective neurons in the primary visual cortex, which projects to dorsal structures like the middle temporal (MT) and medial superior temporal (MST) areas. Anatomical and imaging studies have suggested that area V3A might also be specialized for motion processing, but there have been very few studies of single-neuron direction selectivity in this area. We have therefore performed electrophysiological recordings from V3A neurons in two macaque monkeys (one male and one female) and measured responses to a large battery of motion stimuli that includes translation motion, as well as more complex optic flow patterns. For comparison, we simultaneously recorded the responses of MT neurons to the same stimuli. Surprisingly, we find that overall levels of direction selectivity are similar in V3A and MT and moreover that the population of V3A neurons exhibits somewhat greater selectivity for optic flow patterns. These results suggest that V3A should be considered as part of the motion processing machinery of the visual cortex, in both human and non-human primates.

Systematic modelling of the development of laminar projection origins in the cerebral cortex: Interactions of spatio-temporal patterns of neurogenesis and cellular heterogeneity

The architectonic type principle conceptualizes structural connections between brain areas in terms of the relative architectonic differentiation of connected areas. It has previously been shown that spatio-temporal interactions between the time and place of neurogenesis could underlie multiple features of empirical mammalian connectomes, such as projection existence and the distribution of projection strengths. However, so far no mechanistic explanation for the emergence of typically observed laminar patterns of projection origins and terminations has been tested. Here, we expand an in silico model of the developing cortical sheet to explore which factors could potentially constrain the development of laminar projection patterns. We show that manipulations which rely solely on spatio-temporal interactions, namely the relative density of laminar compartments, a delay in the neurogenesis of infragranular layers relative to layer 1, and a delay in the neurogenesis of supragranular layers relative to infragranular layers, do not result in the striking correlation between supragranular contribution to projections and the relative differentiation of areas that is typically observed in the mammalian cortex. In contrast, we find that if we introduce systematic variation in cell-intrinsic properties, coupling them with architectonic differentiation, the resulting laminar projection patterns closely mirror the empirically observed patterns. We also find that the spatio-temporal interactions posited to occur during neurogenesis are necessary for the formation of the characteristic laminar patterns. Hence, our results indicate that the specification of the laminar patterns of projection origins may result from systematic variation in a number of cell-intrinsic properties, superimposed on the previously identified spatio-temporal interactions which are sufficient for the emergence of the architectonic type principle on the level of inter-areal connectivity in silico.

Phase bistability between anticipated and delayed synchronization in neuronal populations

Two dynamical systems unidirectionally coupled in a sender-receiver configuration can synchronize with a nonzero phase lag. In particular, the system can exhibit anticipated synchronization (AS), which is characterized by a negative phase lag, if the receiver also receives a delayed negative self-feedback. Recently, AS was shown to occur between cortical-like neuronal populations in which the self-feedback is mediated by inhibitory synapses. In this biologically plausible scenario, a transition from the usual delayed synchronization (with positive phase lag) to AS can be mediated by the inhibitory conductances in the receiver population. Here we show that depending on the relation between excitatory and inhibitory synaptic conductances the system can also exhibit phase bistability between anticipated and delayed synchronization. Furthermore, we show that the amount of noise at the receiver and the synaptic conductances can mediate the transition from stable phase locking to a bistable regime and eventually to a phase drift. We suggest that our spiking neuronal populations model could be potentially useful to study phase bistability in cortical regions related to bistable perception.

Desflurane Anesthesia Alters Cortical Layer-specific Hierarchical Interactions in Rat Cerebral Cortex

BACKGROUND

Neurocognitive investigations suggest that conscious sensory perception depends on recurrent neuronal interactions among sensory, parietal, and frontal cortical regions, which are suppressed by general anesthetics. The purpose of this work was to investigate if local interactions in sensory cortex are also altered by anesthetics. The authors hypothesized that desflurane would reduce recurrent neuronal interactions in cortical layer-specific manner consistent with the anatomical disposition of feedforward and feedback pathways.

METHODS

Single-unit neuronal activity was measured in freely moving adult male rats (268 units; 10 animals) using microelectrode arrays chronically implanted in primary and secondary visual cortex. Layer-specific directional interactions were estimated by mutual information and transfer entropy of multineuron spike patterns within and between cortical layers three and five. The effect of incrementally increasing and decreasing steady-state concentrations of desflurane (0 to 8% to 0%) was tested for statistically significant quadratic trend across the successive anesthetic states.

RESULTS

Desflurane produced robust, state-dependent reduction (P = 0.001) of neuronal interactions between primary and secondary visual areas and between layers three and five, as indicated by mutual information (37 and 41% decrease at 8% desflurane from wakeful baseline at [mean ± SD] 0.52 ± 0.51 and 0.53 ± 0.51 a.u., respectively) and transfer entropy (77 and 78% decrease at 8% desflurane from wakeful baseline at 1.86 ± 1.56 a.u. and 1.87 ± 1.67 a.u., respectively). In addition, a preferential suppression of feedback between secondary and primary visual cortex was suggested by the reduction of directional index of transfer entropy overall (P = 0.001; 89% decrease at 8% desflurane from 0.11 ± 0.18 a.u. at baseline) and specifically, in layer five (P = 0.001; 108% decrease at 8% desflurane from 0.12 ± 0.19 a.u. at baseline).

CONCLUSIONS

Desflurane anesthesia reduces neuronal interactions in visual cortex with a preferential effect on feedback. The findings suggest that neuronal disconnection occurs locally, among hierarchical sensory regions, which may contribute to global functional disconnection underlying anesthetic-induced unconsciousness.

Distinct spatiotemporal mechanisms underlie extra-classical receptive field modulation in macaque V1 microcircuits

Complex scene perception depends upon the interaction between signals from the classical receptive field (CRF) and the extra-classical receptive field (eCRF) in primary visual cortex (V1) neurons. Although much is known about V1 eCRF properties, we do not yet know how the underlying mechanisms map onto the cortical microcircuit. We probed the spatio-temporal dynamics of eCRF modulation using a reverse correlation paradigm, and found three principal eCRF mechanisms: tuned-facilitation, untuned-suppression, and tuned-suppression. Each mechanism had a distinct timing and spatial profile. Laminar analysis showed that the timing, orientation-tuning, and strength of eCRF mechanisms had distinct signatures within magnocellular and parvocellular processing streams in the V1 microcircuit. The existence of multiple eCRF mechanisms provides new insights into how V1 responds to spatial context. Modeling revealed that the differences in timing and scale of these mechanisms predicted distinct patterns of net modulation, reconciling many previous disparate physiological and psychophysical findings.

Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models

The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.

Changes in Local Network Activity Approximated by Reverse Spike-Triggered Local Field Potentials Predict the Focus of Attention

The effects of visual spatial attention on neuronal firing rates have been well characterized for neurons throughout the visual processing hierarchy. Interestingly, the mechanisms by which attention generates more or fewer spikes in response to a visual stimulus remain unknown. One possibility is that attention boosts the likelihood that synaptic inputs to a neuron result in spikes. We performed a novel analysis to measure local field potentials (LFPs) just prior to spikes, or reverse spike-triggered LFP “wavelets,” for neurons recorded in primary visual cortex (V1) of monkeys performing a contrast change detection task requiring covert shifts in visual spatial attention. We used dimensionality reduction to define LFP wavelet shapes with single numerical values, and we found that LFP wavelet shape changes correlated with changes in neuronal firing rate. We then tested whether a simple classifier could predict monkeys’ focus of attention from LFP wavelet shape. LFP wavelet shapes sampled in discrete windows were predictive of the locus of attention for some neuronal types. These findings suggest that LFP wavelets are a useful proxy for local network activity influencing spike generation, and changes in LFP wavelet shape are predictive of the focus of attention.

Visual Motion Processing in Macaque V2

In the primate visual system, direction-selective (DS) neurons are critical for visual motion perception. While DS neurons in the dorsal visual pathway have been well characterized, the response properties of DS neurons in other major visual areas are largely unexplored. Recent optical imaging studies in monkey visual cortex area 2 (V2) revealed clusters of DS neurons. This imaging method facilitates targeted recordings from these neurons. Using optical imaging and single-cell recording, we characterized detailed response properties of DS neurons in macaque V2. Compared with DS neurons in the dorsal areas (e.g., middle temporal area [MT]), V2 DS neurons have a smaller receptive field and a stronger antagonistic surround. They do not code speed or plaid motion but are sensitive to motion contrast. Our results suggest that V2 DS neurons play an important role in figure-ground segregation. The clusters of V2 DS neurons are likely specialized functional systems for detecting motion contrast.

Human visual steady-state responses to amplitude-modulated flicker: Latency measurement

The response latency of steady-state visually evoked potentials (SSVEPs) is a sensitive measurement for investigating visual functioning of the human brain, specifically in visual development and for clinical evaluation. This latency can be measured from the slope of phase versus frequency of responses by using multiple frequencies of stimuli. In an attempt to provide an alternative measurement of this latency, this study utilized an envelope response of SSVEPs elicited by amplitude-modulated visual stimulation and then compared with the envelope of the generating signal, which was recorded simultaneously with the electroencephalography recordings. The advantage of this measurement is that it successfully estimates the response latency based on the physiological envelope in the entire waveform. Results showed the response latency at the occipital lobe (Oz channel) was approximately 104.55 ms for binocular stimulation, 97.14 ms for the dominant eye, and 104.75 ms for the nondominant eye with no significant difference between these stimulations. Importantly, the response latency at frontal channels (125.84 ms) was significantly longer than that at occipital channels (104.11 ms) during binocular stimulation. Together with strong activation of the source envelope at occipital cortex, these findings support the idea of a feedforward process, with the visual stimuli propagating originally from occipital cortex to anterior cortex. In sum, these findings offer a novel method for future studies in measuring visual response latencies and also potentially shed a new light on understanding of how long collective neural activities take to travel in the human brain.

Laminar Differences in Responses to Naturalistic Texture in Macaque V1 and V2

Most single units recorded from macaque secondary visual cortex (V2) respond with higher firing rates to synthetic texture images containing "naturalistic" higher-order statistics than to spectrally matched "noise" images lacking these statistics. In contrast, few single units in V1 show this property. We explored how the strength and dynamics of response vary across the different layers of visual cortex by recording multiunit (defined as high-frequency power in the local field potential) and gamma-band activity evoked by brief presentations of naturalistic and noise images in V1 and V2 of anesthetized macaque monkeys of both sexes. As previously reported, recordings in V2 showed consistently stronger responses to naturalistic texture than to spectrally matched noise. In contrast to single-unit recordings, V1 multiunit activity showed a preference for images with naturalistic statistics, and in gamma-band activity this preference was comparable across V1 and V2. Sensitivity to naturalistic image structure was strongest in the supragranular and infragranular layers of V1, but weak in granular layers, suggesting that it might reflect feedback from V2. Response timing was consistent with this idea. Visual responses appeared first in V1, followed by V2. Sensitivity to naturalistic texture emerged first in V2, followed by the supragranular and infragranular layers of V1, and finally in the granular layers of V1. Our results demonstrate laminar differences in the encoding of higher-order statistics of natural texture, and suggest that this sensitivity first arises in V2 and is fed back to modulate activity in V1.SIGNIFICANCE STATEMENT The circuit mechanisms responsible for visual representations of intermediate complexity are largely unknown. We used a well validated set of synthetic texture stimuli to probe the temporal and laminar profile of sensitivity to the higher-order statistical structure of natural images. We found that this sensitivity emerges first and most strongly in V2 but soon after in V1. However, sensitivity in V1 is higher in the laminae (extragranular) and recording modalities (local field potential) most likely affected by V2 connections, suggesting a feedback origin. Our results show how sensitivity to naturalistic image structure emerges across time and circuitry in the early visual cortex.

Control of synaptic plasticity in deep cortical networks

Humans and many other animals have an enormous capacity to learn about sensory stimuli and to master new skills. However, many of the mechanisms that enable us to learn remain to be understood. One of the greatest challenges of systems neuroscience is to explain how synaptic connections change to support maximally adaptive behaviour. Here, we provide an overview of factors that determine the change in the strength of synapses, with a focus on synaptic plasticity in sensory cortices. We review the influence of neuromodulators and feedback connections in synaptic plasticity and suggest a specific framework in which these factors can interact to improve the functioning of the entire network.

Exploring the Phase-Locking Mechanisms Yielding Delayed and Anticipated Synchronization in Neuronal Circuits

Synchronization is one of the brain mechanisms allowing the coordination of neuronal activity required in many cognitive tasks. Anticipated Synchronization (AS) is a specific type of out-of-phase synchronization that occurs when two systems are unidirectionally coupled and, consequently, the information is transmitted from the sender to the receiver, but the receiver leads the sender in time. It has been shown that the primate cortex could operate in a regime of AS as part of normal neurocognitive function. However it is still unclear what is the mechanism that gives rise to anticipated synchronization in neuronal motifs. Here, we investigate the synchronization properties of cortical motifs on multiple scales and show that the internal dynamics of the receiver, which is related to its free running frequency in the uncoupled situation, is the main ingredient for AS to occur. For biologically plausible parameters, including excitation/inhibition balance, we found that the phase difference between the sender and the receiver decreases when the free running frequency of the receiver increases. As a consequence, the system switches from the usual delayed synchronization (DS) regime to an AS regime. We show that at three different scales, neuronal microcircuits, spiking neuronal populations and neural mass models, both the inhibitory loop and the external current acting on the receiver mediate the DS-AS transition for the sender-receiver configuration by changing the free running frequency of the receiver. Therefore, we propose that a faster internal dynamics of the receiver system is the main mechanism underlying anticipated synchronization in brain circuits.

Time course of spatial frequency integration in face perception: An ERP study

Face perception is based on the processing and integration of multiple spatial frequency (SF) ranges. However, the temporal dynamics of SF integration to form an early face representation in the human brain is still a matter of debate. To address this issue, we recorded event-related potentials (ERPs) during the presentation of spatial frequency-manipulated facial images. Twenty-six participants performed a gender discrimination task on non-filtered, low-, high-, and band-pass filtered face images, corresponding, respectively, to the full range, spatial frequencies up to 8 cycles/image, above 32 cycles/image, and from 8 to 16 cycles/image. Behaviorally, the task related-performance was more accurate and faster for non-filtered (NF) and mid-range SF (MSF) than for low SF (LSF) and high SF (HSF) stimuli. At both behavioral and electrophysiological levels, response to MSF contained in faces did not differ from the responses to full spectrum non-filtered (NF) facial images. In ERPs, LSF facial images evoked the largest P1 amplitude while HSF facial images evoked the largest N170 amplitude compared with the other three conditions. Since LSFs and HSFs would transmit global and local information respectively, our observations lend further support to the "coarse-to-fine" processing theory of faces. Furthermore, they offer original evidence of the effectiveness and adequacy of the mid-range spatial frequency in face perception. Possible theoretical interpretations of our findings are discussed.

Inhibitory autapse mediates anticipated synchronization between coupled neurons

Two identical autonomous dynamical systems unidirectionally coupled in a sender-receiver configuration can exhibit anticipated synchronization (AS) if the receiver neuron also receives a delayed negative self-feedback. Recently, AS was shown to occur in a three-neuron motif with standard chemical synapses where the delayed inhibition was provided by an interneuron. Here, we show that a two-neuron model in the presence of an inhibitory autapse, which is a massive self-innervation present in the cortical architecture, may present AS. The GABAergic autapse regulates the internal dynamics of the receiver neuron and acts as the negative delayed self-feedback required by dynamical systems in order to exhibit AS. In this biologically plausible scenario, a smooth transition from the usual delayed synchronization (DS) to AS typically occurs when the inhibitory conductance is increased. The phenomenon is shown to be robust when model parameters are varied within a physiological range. For extremely large values of the inhibitory autapse the system undergoes to a phase-drift regime in which the receiver is faster than the sender. Furthermore, we show that the inhibitory autapse promotes a faster internal dynamics of the free-running Receiver when the two neurons are uncoupled, which could be the mechanism underlying anticipated synchronization and the DS-AS transition.

Neuron density fundamentally relates to architecture and connectivity of the primate cerebral cortex

Studies of structural brain connectivity have revealed many intriguing features of complex cortical networks. To advance integrative theories of cortical organization, an understanding is required of how connectivity interrelates with other aspects of brain structure. Recent studies have suggested that interareal connectivity may be related to a variety of macroscopic as well as microscopic architectonic features of cortical areas. However, it is unclear how these features are inter-dependent and which of them most strongly and fundamentally relate to structural corticocortical connectivity. Here, we systematically investigated the relation of a range of microscopic and macroscopic architectonic features of cortical organization, namely layer III pyramidal cell soma cross section, dendritic synapse count, dendritic synapse density and dendritic tree size as well as area neuron density, to multiple properties of cortical connectivity, using a comprehensive, up-to-date structural connectome of the primate brain. Importantly, relationships were investigated by multi-variate analyses to account for the interrelations of features. Of all considered factors, the classical architectonic parameter of neuron density most strongly and consistently related to essential features of cortical connectivity (existence and laminar patterns of projections, area degree), and in conjoint analyses largely abolished effects of cellular morphological features. These results confirm neuron density as a central architectonic indicator of the primate cerebral cortex that is closely related to essential aspects of brain connectivity and is also highly indicative of further features of the architectonic organization of cortical areas, such as the considered cellular morphological measures. Our findings integrate several aspects of cortical micro- and macroscopic organization, with implications for cortical development and function.

Human posterior parietal cortex responds to visual stimuli as early as peristriate occipital cortex

Much of what is known about the timing of visual processing in the brain is inferred from intracranial studies in monkeys, with human data limited to mainly noninvasive methods with lower spatial resolution. Here, we estimated visual onset latencies from electrocorticographic (ECoG) recordings in a patient who was implanted with 112 subdural electrodes, distributed across the posterior cortex of the right hemisphere, for presurgical evaluation of intractable epilepsy. Functional MRI prior to surgery was used to determine boundaries of visual areas. The patient was presented with images of objects from several categories. Event-related potentials (ERPs) were calculated across all categories excluding targets, and statistically reliable onset latencies were determined, using a bootstrapping procedure over the single trial baseline activity in individual electrodes. The distribution of onset latencies broadly reflected the known hierarchy of visual areas, with the earliest cortical responses in primary visual cortex, and higher areas showing later responses. A clear exception to this pattern was a robust, statistically reliable and spatially localized, very early response, on the bank of the posterior intraparietal sulcus (IPS). The response in the IPS started nearly simultaneously with responses detected in peristriate visual areas, around 60 ms poststimulus onset. Our results support the notion of early visual processing in the posterior parietal lobe, not respecting traditional hierarchies, and give direct evidence for onset times of visual responses across the human cortex.

Neuronal response properties across cytochrome oxidase stripes in primate V2

Cytochrome oxidase histochemistry reveals large-scale cortical modules in area V2 of primates known as thick, thin, and interstripes. Anatomical, electrophysiological, and tracing studies suggest that V2 cytochrome oxidase stripes participate in functionally distinct streams of visual information processing. However, there is controversy whether the different V2 compartments indeed correlate with specialized neuronal response properties. We used multiple-electrode arrays (16 × 2, 8 × 4 and 4 × 4 matrices) to simultaneously record the spiking activity (N = 190 single units) across distinct V2 stripes in anesthetized and paralyzed capuchin monkeys (N = 3 animals, 6 hemispheres). Visual stimulation consisted of moving bars and full-field gratings with different contrasts, orientations, directions of motion, spatial frequencies, velocities, and color contrasts. Interstripe neurons exhibited the strongest orientation and direction selectivities compared to the thick and thin stripes, with relatively stronger coding for orientation. Additionally, they responded best to higher spatial frequencies and to lower stimulus velocities. Thin stripes showed the highest proportion (80%) of neurons selective to color contrast (compared to 47% and 21% for thick and interstripes, respectively). The great majority of the color selective cells (86%) were also orientation selective. Additionally, thin stripe neurons continued to increase their firing rate for stimulus contrasts above 50%, while thick and interstripe neurons already exhibited some degree of response saturation at this point. Thick stripes best coded for lower spatial frequencies and higher stimulus velocities. In conclusion, V2 CytOx stripes exhibit a mixed degree of segregation and integration of information processing, shedding light into the early mechanisms of vision.

Time course of the use of chromatic and achromatic facial information for sex categorization

The most useful facial features for sex categorization are the eyes, the eyebrows, and the mouth. Dupuis-Roy et al. reported a large positive correlation between the use of the mouth region and rapid correct answers [Journal of Vision 9 (2009) 1-8]. Given the chromatic information in this region, they hypothesized that the extraction of chromatic and achromatic cues may have different time courses. Here, we tested this hypothesis directly: 110 participants categorized the sex of 300 face images whose chromatic and achromatic content was partially revealed through time (200 ms) and space using randomly located spatio-temporal Gaussian apertures (i.e. the Bubbles technique). This also allowed us to directly compare, for the first time, the relative importance of chromatic and achromatic facial cues for sex categorization. Results showed that face-sex categorization relies mostly on achromatic (luminance) information concentrated in the eye and eyebrow regions, especially the left eye and eyebrow. Additional analyses indicated that chromatic information located in the mouth/philtrum region was used earlier-peaking as early as 35 ms after stimulus onset-than achromatic information in the eye regions-peaking between 165 and 176 ms after stimulus onset-as was speculated by Dupuis-Roy et al. A non-linear analysis failed to support Yip and Sinha's proposal that processing of chromatic variations can improve subsequent processing of achromatic spatial cues, possibly via surface segmentation [Perception 31 (2002) 995-1003]. Instead, we argue that the brain prioritizes chromatic information to compensate for the sluggishness of chromatic processing in early visual areas, and allow chromatic and achromatic information to reach higher-level visual areas simultaneously.

Long-term all-optical interrogation of cortical neurons in awake-behaving nonhuman primates

Whereas optogenetic techniques have proven successful in their ability to manipulate neuronal populations-with high spatial and temporal fidelity-in species ranging from insects to rodents, significant obstacles remain in their application to nonhuman primates (NHPs). Robust optogenetics-activated behavior and long-term monitoring of target neurons have been challenging in NHPs. Here, we present a method for all-optical interrogation (AOI), integrating optical stimulation and simultaneous two-photon (2P) imaging of neuronal populations in the primary visual cortex (V1) of awake rhesus macaques. A red-shifted channel-rhodopsin transgene (ChR1/VChR1 [C1V1]) and genetically encoded calcium indicators (genetically encoded calmodulin protein [GCaMP]5 or GCaMP6s) were delivered by adeno-associated viruses (AAVs) and subsequently expressed in V1 neuronal populations for months. We achieved optogenetic stimulation using both single-photon (1P) activation of neuronal populations and 2P activation of single cells, while simultaneously recording 2P calcium imaging in awake NHPs. Optogenetic manipulations of V1 neuronal populations produced reliable artificial visual percepts. Together, our advances show the feasibility of precise and stable AOI of cortical neurons in awake NHPs, which may lead to broad applications in high-level cognition and preclinical testing studies.

Extrafoveally applied flashing light affects contrast thresholds of achromatic and S-cone isolating, but not L-M cone modulated stimuli

Flashing light stimulation is often used to investigate the visual system. However, the magnitude of the effect of this stimulus on the various subcortical pathways is not well investigated. The signals of conscious vision are conveyed by the magnocellular, parvocellular and koniocellular pathways. Parvocellular and koniocellular pathways (or more precisely, the L-M opponent and S-cone isolating channels) can be accessed by isoluminant red-green (L-M) and S-cone isolating stimuli, respectively. The main goal of the present study was to explore how costimulation with strong white extrafoveal light flashes alters the perception of stimuli specific to these pathways. Eleven healthy volunteers with negative neurological and ophthalmological history were enrolled for the study. Isoluminance of L-M and S-cone isolating sine-wave gratings was set individually, using the minimum motion procedure. The contrast thresholds for these stimuli as well as for achromatic gratings were determined by an adaptive staircase procedure where subjects had to indicate the orientation (horizontal, oblique or vertical) of the gratings. Thresholds were then determined again while a strong white peripheral light flash was presented 50 ms before each trial. Peripheral light flashes significantly (p < 0.05) increased the contrast thresholds of the achromatic and S-cone isolating stimuli. The threshold elevation was especially marked in case of the achromatic stimuli. However, the contrast threshold for the L-M stimuli was not significantly influenced by the light flashes. We conclude that extrafoveally applied light flashes influence predominantly the perception of achromatic stimuli.

A parsimonious model of brightness induction

We present a parsimonious model of brightness induction which can account for various brightness illusions of both brightness-contrast and brightness-assimilation types. Our model is based on a difference of difference-of-Gaussian filter and a two-pass model of attentive vision based on the parallel channels in the central visual pathway. It overcomes some of the problems that could not be addressed by the well-known oriented difference of Gaussian model like those associated with Mach band and checkerboard illusions. This model attempts to provide insight to the mechanism of attention in brightness perception through the two major complimentary visual channels, viz. the magnocellular and the parvocellular.