More Gamma More Predictions: Gamma-Synchronization as a Key Mechanism for Efficient Integration of Classical Receptive Field Inputs with Surround Predictions

Emotional text messages affect the early processing of emoticons depending on their emotional congruence: evidence from the N170 and EPN event related potentials

Emoticons have been considered pragmatic cues that enhance emotional expressivity during computer-mediated communication. Yet, it is unclear how emoticons are processed in ambiguous text-based communication due to incongruences between the emoticon's emotional valence and its context. In this study, we investigated the electrophysiological correlates of contextual influence on the early emotional processing of emoticons, during an emotional congruence judgment task. Participants were instructed to judge the congruence between a text message expressing an emotional situation (positive or negative), and a subsequent emoticon expressing positive or negative emotions. We analyzed early event-related potentials elicited by emoticons related to face processing (N170) and emotional salience in visual perception processing (Early Posterior Negativity, EPN). Our results show that accuracy and Reaction Times depend on the interaction between the emotional valence of the context and the emoticon. Negative emoticons elicited a larger N170, suggesting that the emotional information of the emoticon is integrated at the early stages of the perceptual process. During emoticon processing, a valence effect was observed with enhanced EPN amplitudes in occipital areas for emoticons representing negative valences. Moreover, we observed a congruence effect in parieto-temporal sites within the same time-window, with larger amplitudes for the congruent condition. We conclude that, similar to face processing, emoticons are processed differently according to their emotional content and the context in which they are embedded. A congruent context might enhance the emotional salience of the emoticon (and therefore, its emotional expression) during the early stages of their processing.

Binding of cortical functional modules by synchronous high-frequency oscillations

Whether high-frequency phase-locked oscillations facilitate integration ('binding') of information across widespread cortical areas is controversial. Here we show with intracranial electroencephalography that cortico-cortical co-ripples (~100-ms-long ~90 Hz oscillations) increase during reading and semantic decisions, at the times and co-locations when and where binding should occur. Fusiform wordform areas co-ripple with virtually all language areas, maximally from 200 to 400 ms post-word-onset. Semantically specified target words evoke strong co-rippling between wordform, semantic, executive and response areas from 400 to 800 ms, with increased co-rippling between semantic, executive and response areas prior to correct responses. Co-ripples were phase-locked at zero lag over long distances (>12 cm), especially when many areas were co-rippling. General co-activation, indexed by non-oscillatory high gamma, was mainly confined to early latencies in fusiform and earlier visual areas, preceding co-ripples. These findings suggest that widespread synchronous co-ripples may assist the integration of multiple cortical areas for sustained periods during cognition.

Adaptation of the inferior temporal neurons and efficient visual processing

Numerous studies examining the responses of individual neurons in the inferior temporal (IT) cortex have revealed their characteristics such as two-dimensional or three-dimensional shape tuning, objects, or category selectivity. While these basic selectivities have been studied assuming that their response to stimuli is relatively stable, physiological experiments have revealed that the responsiveness of IT neurons also depends on visual experience. The activity changes of IT neurons occur over various time ranges; among these, repetition suppression (RS), in particular, is robustly observed in IT neurons without any behavioral or task constraints. I observed a similar phenomenon in the ventral visual neurons in macaque monkeys while they engaged in free viewing and actively fixated on one consistent object multiple times. This observation indicates that the phenomenon also occurs in natural situations during which the subject actively views stimuli without forced fixation, suggesting that this phenomenon is an everyday occurrence and widespread across regions of the visual system, making it a default process for visual neurons. Such short-term activity modulation may be a key to understanding the visual system; however, the circuit mechanism and the biological significance of RS remain unclear. Thus, in this review, I summarize the observed modulation types in IT neurons and the known properties of RS. Subsequently, I discuss adaptation in vision, including concepts such as efficient and predictive coding, as well as the relationship between adaptation and psychophysical aftereffects. Finally, I discuss some conceptual implications of this phenomenon as well as the circuit mechanisms and the models that may explain adaptation as a fundamental aspect of visual processing.

Dynamic fading memory and expectancy effects in the monkey primary visual cortex

In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.

Normalization by orientation-tuned surround in human V1-V3

An influential account of neuronal responses in primary visual cortex is the normalized energy model. This model is often implemented as a multi-stage computation. The first stage is linear filtering. The second stage is the extraction of contrast energy, whereby a complex cell computes the squared and summed outputs of a pair of the linear filters in quadrature phase. The third stage is normalization, in which a local population of complex cells mutually inhibit one another. Because the population includes cells tuned to a range of orientations and spatial frequencies, the result is that the responses are effectively normalized by the local stimulus contrast. Here, using evidence from human functional MRI, we show that the classical model fails to account for the relative responses to two classes of stimuli: straight, parallel, band-passed contours (gratings), and curved, band-passed contours (snakes). The snakes elicit fMRI responses that are about twice as large as the gratings, yet a traditional divisive normalization model predicts responses that are about the same. Motivated by these observations and others from the literature, we implement a divisive normalization model in which cells matched in orientation tuning ("tuned normalization") preferentially inhibit each other. We first show that this model accounts for differential responses to these two classes of stimuli. We then show that the model successfully generalizes to other band-pass textures, both in V1 and in extrastriate cortex (V2 and V3). We conclude that even in primary visual cortex, complex features of images such as the degree of heterogeneity, can have large effects on neural responses.

Cell-type-specific propagation of visual flicker

Rhythmic flicker stimulation has gained interest as a treatment for neurodegenerative diseases and as a method for frequency tagging neural activity. Yet, little is known about the way in which flicker-induced synchronization propagates across cortical levels and impacts different cell types. Here, we use Neuropixels to record from the lateral geniculate nucleus (LGN), the primary visual cortex (V1), and CA1 in mice while presenting visual flicker stimuli. LGN neurons show strong phase locking up to 40 Hz, whereas phase locking is substantially weaker in V1 and is absent in CA1. Laminar analyses reveal an attenuation of phase locking at 40 Hz for each processing stage. Gamma-rhythmic flicker predominantly entrains fast-spiking interneurons. Optotagging experiments show that these neurons correspond to either parvalbumin (PV+) or narrow-waveform somatostatin (Sst+) neurons. A computational model can explain the observed differences based on the neurons' capacitative low-pass filtering properties. In summary, the propagation of synchronized activity and its effect on distinct cell types strongly depend on its frequency.

Principles of large-scale neural interactions

What mechanisms underlie flexible inter-areal communication in the cortex? We consider four mechanisms for temporal coordination and their contributions to communication: (1) Oscillatory synchronization (communication-through-coherence); (2) communication-through-resonance; (3) non-linear integration; and (4) linear signal transmission (coherence-through-communication). We discuss major challenges for communication-through-coherence based on layer- and cell-type-specific analyses of spike phase-locking, heterogeneity of dynamics across networks and states, and computational models for selective communication. We argue that resonance and non-linear integration are viable alternative mechanisms that facilitate computation and selective communication in recurrent networks. Finally, we consider communication in relation to cortical hierarchy and critically examine the hypothesis that feedforward and feedback communication use fast (gamma) and slow (alpha/beta) frequencies, respectively. Instead, we propose that feedforward propagation of prediction errors relies on the non-linear amplification of aperiodic transients, whereas gamma and beta rhythms represent rhythmic equilibrium states that facilitate sustained and efficient information encoding and amplification of short-range feedback via resonance.

Gamma oscillations point to the role of primary visual cortex in atypical motion processing in autism

Neurophysiological studies suggest that abnormal neural inhibition may explain a range of sensory processing differences in autism spectrum disorders (ASD). In particular, the impaired ability of people with ASD to visually discriminate the motion direction of small-size objects and their reduced perceptual suppression of background-like visual motion may stem from deficient surround inhibition within the primary visual cortex (V1) and/or its atypical top-down modulation by higher-tier cortical areas. In this study, we estimate the contribution of abnormal surround inhibition to the motion-processing deficit in ASD. For this purpose, we used a putative correlate of surround inhibition-suppression of the magnetoencephalographic (MEG) gamma response (GR) caused by an increase in the drift rate of a large annular high-contrast grating. The motion direction discrimination thresholds for the gratings of different angular sizes (1° and 12°) were assessed in a separate psychophysical paradigm. The MEG data were collected in 42 boys with ASD and 37 typically developing (TD) boys aged 7-15 years. Psychophysical data were available in 33 and 34 of these participants, respectively. The results showed that the GR suppression in V1 was reduced in boys with ASD, while their ability to detect the direction of motion was compromised only in the case of small stimuli. In TD boys, the GR suppression directly correlated with perceptual suppression caused by increasing stimulus size, thus suggesting the role of the top-down modulations of V1 in surround inhibition. In ASD, weaker GR suppression was associated with the poor directional sensitivity to small stimuli, but not with perceptual suppression. These results strongly suggest that a local inhibitory deficit in V1 plays an important role in the reduction of directional sensitivity in ASD and that this perceptual deficit cannot be explained exclusively by atypical top-down modulation of V1 by higher-tier cortical areas.

Putting the brakes on synchrony: VIP interneurons tune visually evoked rhythmic activity

Visually evoked synchrony in the primary visual cortex has proven to be a robust model for examining circuit interactions. In this issue of Neuron, Veit et al.¹ highlight a previously unappreciated role for VIP interneurons in regulating local and long-range patterns of coordinated neural activity.

Human visual gamma for color stimuli

Strong gamma-band oscillations in primate early visual cortex can be induced by homogeneous color surfaces (Peter et al., 2019; Shirhatti and Ray, 2018). Compared to other hues, particularly strong gamma oscillations have been reported for red stimuli. However, precortical color processing and the resultant strength of input to V1 have often not been fully controlled for. Therefore, stronger responses to red might be due to differences in V1 input strength. We presented stimuli that had equal luminance and cone contrast levels in a color coordinate system based on responses of the lateral geniculate nucleus, the main input source for area V1. With these stimuli, we recorded magnetoencephalography in 30 human participants. We found gamma oscillations in early visual cortex which, contrary to previous reports, did not differ between red and green stimuli of equal L-M cone contrast. Notably, blue stimuli with contrast exclusively on the S-cone axis induced very weak gamma responses, as well as smaller event-related fields and poorer change-detection performance. The strength of human color gamma responses for stimuli on the L-M axis could be well explained by L-M cone contrast and did not show a clear red bias when L-M cone contrast was properly equalized.

Spontaneous variability in gamma dynamics described by a damped harmonic oscillator driven by noise

Circuits of excitatory and inhibitory neurons generate gamma-rhythmic activity (30-80 Hz). Gamma-cycles show spontaneous variability in amplitude and duration. To investigate the mechanisms underlying this variability, we recorded local-field-potentials (LFPs) and spikes from awake macaque V1. We developed a noise-robust method to detect gamma-cycle amplitudes and durations, which showed a weak but positive correlation. This correlation, and the joint amplitude-duration distribution, is well reproduced by a noise-driven damped harmonic oscillator. This model accurately fits LFP power-spectra, is equivalent to a linear, noise-driven E-I circuit, and recapitulates two additional features of gamma: (1) Amplitude-duration correlations decrease with oscillation strength; (2) amplitudes and durations exhibit strong and weak autocorrelations, respectively, depending on oscillation strength. Finally, longer gamma-cycles are associated with stronger spike-synchrony, but lower spike-rates in both (putative) excitatory and inhibitory neurons. In sum, V1 gamma-dynamics are well described by the simplest possible model of gamma: A damped harmonic oscillator driven by noise.

Predictive coding of natural images by V1 firing rates and rhythmic synchronization

Predictive coding is an important candidate theory of self-supervised learning in the brain. Its central idea is that sensory responses result from comparisons between bottom-up inputs and contextual predictions, a process in which rates and synchronization may play distinct roles. We recorded from awake macaque V1 and developed a technique to quantify stimulus predictability for natural images based on self-supervised, generative neural networks. We find that neuronal firing rates were mainly modulated by the contextual predictability of higher-order image features, which correlated strongly with human perceptual similarity judgments. By contrast, V1 gamma (γ)-synchronization increased monotonically with the contextual predictability of low-level image features and emerged exclusively for larger stimuli. Consequently, γ-synchronization was induced by natural images that are highly compressible and low-dimensional. Natural stimuli with low predictability induced prominent, late-onset beta (β)-synchronization, likely reflecting cortical feedback. Our findings reveal distinct roles of synchronization and firing rates in the predictive coding of natural images.

Biased Orientation and Color Tuning of the Human Visual Gamma Rhythm

Narrowband γ oscillations (NBG: ∼20-60 Hz) in visual cortex reflect rhythmic fluctuations in population activity generated by underlying circuits tuned for stimulus location, orientation, and color. A variety of theories posit a specific role for NBG in encoding and communicating this information within visual cortex. However, recent findings suggest a more nuanced role for NBG, given its dependence on certain stimulus feature configurations, such as coherent-oriented edges and specific hues. Motivated by these factors, we sought to quantify the independent and joint tuning properties of NBG to oriented and color stimuli using intracranial recordings from the human visual cortex (male and female). NBG was shown to display a cardinal orientation bias (horizontal) and also an end- and mid-spectral color bias (red/blue and green). When jointly probed, the cardinal bias for orientation was attenuated and an end-spectral preference for red and blue predominated. This loss of mid-spectral tuning occurred even for recording sites showing large responses to uniform green stimuli. Our results demonstrate the close, yet complex, link between the population dynamics driving NBG oscillations and known feature selectivity biases for orientation and color within visual cortex. Such a bias in stimulus tuning imposes new constraints on the functional significance of the visual γ rhythm. More generally, these biases in population electrophysiology will need to be considered in experiments using orientation or color features to examine the role of visual cortex in other domains, such as working memory and decision-making.SIGNIFICANCE STATEMENT Oscillations in electrophysiological activity occur in visual cortex in response to stimuli that strongly drive the orientation or color selectivity of visual neurons. The significance of this induced "γ rhythm" to brain function remains unclear. Answering this question requires understanding how and why some stimuli can reliably generate oscillatory γ activity while others do not. We examined how different orientations and colors independently and jointly modulate γ oscillations in the human brain. Our data show that γ oscillations are greatest for certain orientations and colors that reflect known response biases in visual cortex. Such findings complicate the functional significance of γ oscillations but open new avenues for linking circuits to population dynamics in visual cortex.

Classic Psychedelic Drugs: Update on Biological Mechanisms

Renewed interest in the effects of psychedelics in the treatment of psychiatric disorders warrants a better understanding of the neurobiological mechanisms underlying the effects of these substances. During the past two decades, state-of-the-art studies of animals and humans have yielded new important insights into the molecular, cellular, and systems-level actions of psychedelic drugs. These efforts have revealed that psychedelics affect primarily serotonergic receptor subtypes located in cortico-thalamic and cortico-cortical feedback circuits of information processing. Psychedelic drugs modulate excitatory-inhibitory balance in these circuits and can participate in neuroplasticity within brain structures critical for the integration of information relevant to sensation, cognition, emotions, and the narrative of self. Neuroimaging studies showed that characteristic dimensions of the psychedelic experience obtained through subjective questionnaires as well as alterations in self-referential processing and emotion regulation obtained through neuropsychological tasks are associated with distinct changes in brain activity and connectivity patterns at multiple-system levels. These recent results suggest that changes in self-experience, emotional processing, and social cognition may contribute to the potential therapeutic effects of psychedelics.

A mechanism for inter-areal coherence through communication based on connectivity and oscillatory power

Inter-areal coherence between field potentials is a widespread phenomenon in cortex. Coherence has been hypothesized to reflect phase-synchronization between oscillators and flexibly gate communication according to behavioral and cognitive demands. We reveal an alternative mechanism where coherence is not the cause but the consequence of communication and naturally emerges because spiking activity in a sending area causes post-synaptic potentials both in the same and in other areas. Consequently, coherence depends in a lawful manner on power and phase-locking in the sender and connectivity. Changes in oscillatory power explained prominent changes in fronto-parietal and LGN-V1 coherence across behavioral conditions. Optogenetic experiments and excitatory-inhibitory network simulations identified afferent synaptic inputs rather than spiking entrainment as the principal determinant of coherence. These findings suggest that unique spectral profiles of different brain areas automatically give rise to large-scale coherence patterns that follow anatomical connectivity and continuously reconfigure as a function of behavior and cognition.

Stimulus-specific plasticity of macaque V1 spike rates and gamma

When a visual stimulus is repeated, average neuronal responses typically decrease, yet they might maintain or even increase their impact through increased synchronization. Previous work has found that many repetitions of a grating lead to increasing gamma-band synchronization. Here, we show in awake macaque area V1 that both repetition-related reductions in firing rate and increases in gamma are specific to the repeated stimulus. These effects show some persistence on the timescale of minutes. Gamma increases are specific to the presented stimulus location. Further, repetition effects on gamma and on firing rates generalize to images of natural objects. These findings support the notion that gamma-band synchronization subserves the adaptive processing of repeated stimulus encounters.

Recurrent dynamics in the cerebral cortex: Integration of sensory evidence with stored knowledge

Current concepts of sensory processing in the cerebral cortex emphasize serial extraction and recombination of features in hierarchically structured feed-forward networks in order to capture the relations among the components of perceptual objects. These concepts are implemented in convolutional deep learning networks and have been validated by the astounding similarities between the functional properties of artificial systems and their natural counterparts. However, cortical architectures also display an abundance of recurrent coupling within and between the layers of the processing hierarchy. This massive recurrence gives rise to highly complex dynamics whose putative function is poorly understood. Here a concept is proposed that assigns specific functions to the dynamics of cortical networks and combines, in a unifying approach, the respective advantages of recurrent and feed-forward processing. It is proposed that the priors about regularities of the world are stored in the weight distributions of feed-forward and recurrent connections and that the high-dimensional, dynamic space provided by recurrent interactions is exploited for computations. These comprise the ultrafast matching of sensory evidence with the priors covertly represented in the correlation structure of spontaneous activity and the context-dependent grouping of feature constellations characterizing natural objects. The concept posits that information is encoded not only in the discharge frequency of neurons but also in the precise timing relations among the discharges. Results of experiments designed to test the predictions derived from this concept support the hypothesis that cerebral cortex exploits the high-dimensional recurrent dynamics for computations serving predictive coding.

The Hierarchical Evolution in Human Vision Modeling

Computational models of primate vision took a significant advance with David Marr's tripartite separation of the vision enterprise into the problem formulation, algorithm, and neural implementation; however, many subsequent parallel developments in robotics and modeling greatly refined the algorithm descriptions into very distinct levels that complement each other. This review traces the time course of these developments and shows how the current perspective evolved to have its alternative internal hierarchical organization.

Motion Coherence and Luminance Contrast Interact in Driving Visual Gamma-Band Activity

Synchronized neuronal population activity in the gamma-frequency range (>30 Hz) correlates with the bottom-up drive of various visual features. It has been hypothesized that gamma-band synchronization enhances the gain of neuronal representations, yet evidence remains sparse. We tested a critical prediction of the gain hypothesis, which is that features that drive synchronized gamma-band activity interact super-linearly. To test this prediction, we employed whole-head magnetencephalography in human subjects and investigated if the strength of visual motion (motion coherence) and luminance contrast interact in driving gamma-band activity in visual cortex. We found that gamma-band activity (64-128 Hz) monotonically increased with coherence and contrast, while lower frequency activity (8-32 Hz) decreased with both features. Furthermore, as predicted for a gain mechanism, we found a multiplicative interaction between motion coherence and contrast in their joint drive of gamma-band activity. The lower frequency activity did not show such an interaction. Our findings provide evidence that gamma-band activity acts as a cortical gain mechanism that nonlinearly combines the bottom-up drive of different visual features.

Cortical hierarchy, dual counterstream architecture and the importance of top-down generative networks

Hierarchy is a major organizational principle of the cortex and underscores modern computational theories of cortical function. The local microcircuit amplifies long-distance inter-areal input, which show distance-dependent changes in their laminar profiles. Statistical modeling of these changes in laminar profiles demonstrates that inputs from multiple hierarchical levels to their target areas show remarkable consistency, allowing the construction of a cortical hierarchy based on a principle of hierarchical distance. The statistical modeling that is applied to structure can also be applied to laminar differences in the oscillatory coherence between areas thereby determining a functional hierarchy of the cortex. Close examination of the anatomy of inter-areal connectivity reveals a dual counterstream architecture with well-defined distance-dependent feedback and feedforward pathways in both the supra- and infragranular layers, suggesting a multiplicity of feedback pathways with well-defined functional properties. These findings are consistent with feedback connections providing a generative network involved in a wide range of cognitive functions. A dynamical model constrained by connectivity data sheds insight into the experimentally observed signatures of frequency-dependent Granger causality for feedforward versus feedback signaling. Concerted experiments capitalizing on recent technical advances and combining tract-tracing, high-resolution fMRI, optogenetics and mathematical modeling hold the promise of a much improved understanding of lamina-constrained mechanisms of neural computation and cognition. However, because inter-areal interactions involve cortical layers that have been the target of important evolutionary changes in the primate lineage, these investigations will need to include human and non-human primate comparisons.

Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference

Sensory cortices display a suite of ubiquitous dynamical features, such as ongoing noise variability, transient overshoots and oscillations, that have so far escaped a common, principled theoretical account. We developed a unifying model for these phenomena by training a recurrent excitatory-inhibitory neural circuit model of a visual cortical hypercolumn to perform sampling-based probabilistic inference. The optimized network displayed several key biological properties, including divisive normalization and stimulus-modulated noise variability, inhibition-dominated transients at stimulus onset and strong gamma oscillations. These dynamical features had distinct functional roles in speeding up inferences and made predictions that we confirmed in novel analyses of recordings from awake monkeys. Our results suggest that the basic motifs of cortical dynamics emerge as a consequence of the efficient implementation of the same computational function-fast sampling-based inference-and predict further properties of these motifs that can be tested in future experiments.

Parallel Neural Multiprocessing with Gamma Frequency Latencies

The Poisson variability in cortical neural responses has been typically modeled using spike averaging techniques, such as trial averaging and rate coding, since such methods can produce reliable correlates of behavior. However, mechanisms that rely on counting spikes could be slow and inefficient and thus might not be useful in the brain for computations at timescales in the 10 millisecond range. This issue has motivated a search for alternative spike codes that take advantage of spike timing and has resulted in many studies that use synchronized neural networks for communication. Here we focus on recent studies that suggest that the gamma frequency may provide a reference that allows local spike phase representations that could result in much faster information transmission. We have developed a unified model (gamma spike multiplexing) that takes advantage of a single cycle of a cell's somatic gamma frequency to modulate the generation of its action potentials. An important consequence of this coding mechanism is that it allows multiple independent neural processes to run in parallel, thereby greatly increasing the processing capability of the cortex. System-level simulations and preliminary analysis of mouse cortical cell data are presented as support for the proposed theoretical model.

Propagation of BOLD Activity Reveals Task-dependent Directed Interactions Across Human Visual Cortex

It has recently been shown that large-scale propagation of blood-oxygen-level-dependent (BOLD) activity is constrained by anatomical connections and reflects transitions between behavioral states. It remains to be seen, however, if the propagation of BOLD activity can also relate to the brain's anatomical structure at a more local scale. Here, we hypothesized that BOLD propagation reflects structured neuronal activity across early visual field maps. To explore this hypothesis, we characterize the propagation of BOLD activity across V1, V2, and V3 using a modeling approach that aims to disentangle the contributions of local activity and directed interactions in shaping BOLD propagation. It does so by estimating the effective connectivity (EC) and the excitability of a noise-diffusion network to reproduce the spatiotemporal covariance structure of the data. We apply our approach to 7T fMRI recordings acquired during resting state (RS) and visual field mapping (VFM). Our results reveal different EC interactions and changes in cortical excitability in RS and VFM, and point to a reconfiguration of feedforward and feedback interactions across the visual system. We conclude that the propagation of BOLD activity has functional relevance, as it reveals directed interactions and changes in cortical excitability in a task-dependent manner.

A Distinct Class of Bursting Neurons with Strong Gamma Synchronization and Stimulus Selectivity in Monkey V1

Cortical computation depends on interactions between excitatory and inhibitory neurons. The contributions of distinct neuron types to sensory processing and network synchronization in primate visual cortex remain largely undetermined. We show that in awake monkey V1, there exists a distinct cell type (››30% of neurons) that has narrow-waveform (NW) action potentials and high spontaneous discharge rates and fires in high-frequency bursts. These neurons are more stimulus selective and phase locked to 30- to 80-Hz gamma oscillations than other neuron types. Unlike other neuron types, their gamma-phase locking is highly predictive of orientation tuning. We find evidence for strong rhythmic inhibition in these neurons, suggesting that they interact with interneurons to act as excitatory pacemakers for the V1 gamma rhythm. We did not find a similar class of NW bursting neurons in L2-L4 of mouse V1. Given its properties, this class of NW bursting neurons should be pivotal for the encoding and transmission of stimulus information.

An image-computable model for the stimulus selectivity of gamma oscillations

Gamma oscillations in visual cortex have been hypothesized to be critical for perception, cognition, and information transfer. However, observations of these oscillations in visual cortex vary widely; some studies report little to no stimulus-induced narrowband gamma oscillations, others report oscillations for only some stimuli, and yet others report large oscillations for most stimuli. To better understand this signal, we developed a model that predicts gamma responses for arbitrary images and validated this model on electrocorticography (ECoG) data from human visual cortex. The model computes variance across the outputs of spatially pooled orientation channels, and accurately predicts gamma amplitude across 86 images. Gamma responses were large for a small subset of stimuli, differing dramatically from fMRI and ECoG broadband (non-oscillatory) responses. We propose that gamma oscillations in visual cortex serve as a biomarker of gain control rather than being a fundamental mechanism for communicating visual information.

Relation between gamma oscillations and neuronal plasticity in the visual cortex

Learning is thought to be mediated by activity-dependent modification of neuronal interactions. To avoid maladaptive modifications of synaptic transmission by spurious activity, synaptic plasticity has to be gated. In the case of supervised learning, these gating functions are accomplished by reinforcement through value-assigning systems. Here we show that the dynamic state of local circuits correlates with the occurrence of activity-dependent long-term changes in neuronal response properties. We find that repeated visual stimuli induce long-term changes of orientation preference of neuronal populations in visual cortex if stimuli induce synchronized population responses oscillating at ɣ-frequencies. This suggests that neuronal plasticity is controlled by a hierarchy of gating systems and assigns critical gating functions to resonance properties of local circuits.

Use-dependent long-term changes of neuronal response properties must be gated to prevent irrelevant activity from inducing inappropriate modifications. Here we test the hypothesis that local network dynamics contribute to such gating. As synaptic modifications depend on temporal contiguity between presynaptic and postsynaptic activity, we examined the effect of synchronized gamma (ɣ) oscillations on stimulation-dependent modifications of orientation selectivity in adult cat visual cortex. Changes of orientation maps were induced by pairing visual stimulation with electrical activation of the mesencephalic reticular formation. Changes in orientation selectivity were assessed with optical recording of intrinsic signals and multiunit recordings. When conditioning stimuli were associated with strong ɣ-oscillations, orientation domains matching the orientation of the conditioning grating stimulus became more responsive and expanded, because neurons with preferences differing by less than 30° from the orientation of the conditioning grating shifted their orientation preference toward the conditioned orientation. When conditioning stimuli induced no or only weak ɣ-oscillations, responsiveness of neurons driven by the conditioning stimulus decreased. These differential effects depended on the power of oscillations in the low ɣ-band (20 Hz to 48 Hz) and not on differences in discharge rate of cortical neurons, because there was no correlation between the discharge rates during conditioning and the occurrence of changes in orientation preference. Thus, occurrence and polarity of use-dependent long-term changes of cortical response properties appear to depend on the occurrence of ɣ-oscillations during induction and hence on the degree of temporal coherence of the change-inducing network activity.

Functionally Distinct Gamma Range Activity Revealed by Stimulus Tuning in Human Visual Cortex

Neocortical gamma activity has long been hypothesized as a mechanism for synchronizing brain regions to support visual perception and cognition more broadly. Although early studies focused on narrowband gamma oscillations (∼20-60 Hz), recent work has emphasized a more broadband "high-gamma" response (∼70-150+ Hz). These responses are often conceptually or analytically treated as synonymous markers of gamma activity. Using high-density intracranial recordings from the human visual cortex, we challenge this view by showing distinct spectral, temporal, and functional properties of narrow and broadband gamma. Across four experiments, narrowband gamma was strongly selective for gratings and long-wavelength colors, displaying a delayed response onset, sustained temporal profile, and contrast-dependent peak frequency. In addition, induced narrowband gamma oscillations lacked phase consistency across stimulus repetitions and displayed highly focal inter-site synchronization. In contrast, broadband gamma was consistently observed for all presented stimuli, displaying a rapid response onset, transient temporal profile, and invariant spectral properties. We exploited stimulus tuning to highlight the functional dissociation of these distinct signals, reconciling prior inconsistencies across species and stimuli regarding the ubiquity of visual gamma oscillations during natural vision. The occurrence of visual narrowband gamma oscillations, unlike broadband high gamma, appears contingent on specific structural and chromatic stimulus attributes intersecting with the receptive field. Together, these findings have important implications for the study, analysis, and functional interpretation of neocortical gamma-range activity.

Layers of Rhythms - from Cortical Anatomy to Dynamics

The activity of the cerebral cortex patterns into recurring dynamic motifs. In the present issue of Neuron, Senzai et al. (2019) elucidate how these motifs recruit excitatory and inhibitory neurons across cortical layers and how brain state modulates laminar interactions.

Distinct Inhibitory Circuits Orchestrate Cortical beta and gamma Band Oscillations

Distinct subtypes of inhibitory interneuron are known to shape diverse rhythmic activities in the cortex, but how they interact to orchestrate specific band activity remains largely unknown. By recording optogenetically tagged interneurons of specific subtypes in the primary visual cortex of behaving mice, we show that spiking of somatostatin (SOM)- and parvalbumin (PV)-expressing interneurons preferentially correlates with cortical beta and gamma band oscillations, respectively. Suppression of SOM cell spiking reduces the spontaneous low-frequency band (<30-Hz) oscillations and selectively reduces visually induced enhancement of beta oscillation. In comparison, suppressing PV cell activity elevates the synchronization of spontaneous activity across a broad frequency range and further precludes visually induced changes in beta and gamma oscillations. Rhythmic activation of SOM and PV cells in the local circuit entrains resonant activity in the narrow 5- to 30-Hz band and the wide 20- to 80-Hz band, respectively. Together, these findings reveal differential and cooperative roles of SOM and PV inhibitory neurons in orchestrating specific cortical oscillations.

Human visual cortical gamma reflects natural image structure

Many studies have reported visual cortical gamma-band activity related to stimulus processing and cognition. Most respective studies used artificial stimuli, and the few studies that used natural stimuli disagree. Electrocorticographic (ECoG) recordings from awake macaque areas V1 and V4 found gamma to be abundant during free viewing of natural images. In contrast, a study using ECoG recordings from V1 of human patients reported that many natural images induce no gamma and concluded that it is not necessary for seeing. To reconcile these apparently disparate findings, we reanalyzed those same human ECoG data recorded during presentation of natural images. We find that the strength of gamma is positively correlated with different image-computable metrics of image structure. This holds independently of the precise metric used to quantify gamma. In fact, an average of previously used gamma metrics reflects image structure most robustly. Gamma was sufficiently diagnostic of image structure to differentiate between any possible pair of images with >70% accuracy. Thus, while gamma might be weak for some natural images, the graded strength of gamma reflects the graded degree of image structure, and thereby conveys functionally relevant stimulus properties.

Surface color and predictability determine contextual modulation of V1 firing and gamma oscillations

The integration of direct bottom-up inputs with contextual information is a core feature of neocortical circuits. In area V1, neurons may reduce their firing rates when their receptive field input can be predicted by spatial context. Gamma-synchronized (30–80 Hz) firing may provide a complementary signal to rates, reflecting stronger synchronization between neuronal populations receiving mutually predictable inputs. We show that large uniform surfaces, which have high spatial predictability, strongly suppressed firing yet induced prominent gamma synchronization in macaque V1, particularly when they were colored. Yet, chromatic mismatches between center and surround, breaking predictability, strongly reduced gamma synchronization while increasing firing rates. Differences between responses to different colors, including strong gamma-responses to red, arose from stimulus adaptation to a full-screen background, suggesting prominent differences in adaptation between M- and L-cone signaling pathways. Thus, synchrony signaled whether RF inputs were predicted from spatial context, while firing rates increased when stimuli were unpredicted from context.

Attention Configures Synchronization Within Local Neuronal Networks for Processing of the Behaviorally Relevant Stimulus

The need for fast and dynamic processing of relevant information imposes high demands onto the flexibility and efficiency of the nervous system. A good example for such flexibility is the attention-dependent selection of relevant sensory information. Studies investigating attentional modulations of neuronal responses to simultaneously arriving input showed that neurons respond, as if only the attended stimulus would be present within their receptive fields (RF). However, attention also improves neuronal representation and behavioral performance, when only one stimulus is present. Thus, attention serves for selecting relevant input and changes the neuronal processing of signals representing selected stimuli, ultimately leading to a more efficient behavioral performance. Here, we tested the hypothesis that attention configures the strength of functional coupling between a local neuronal network's neurons specifically for effective processing of signals representing attended stimuli. This coupling is measured as the strength of γ-synchronization between these neurons. The hypothesis predicts that the pattern of synchronization in local networks should depend on which stimulus is attended. Furthermore, we expect this pattern to be similar for the attended stimulus presented alone or together with irrelevant stimuli in the RF. To test these predictions, we recorded spiking-activity and local field potentials (LFP) with closely spaced electrodes in area V4 of monkeys performing a demanding attention task. Our results show that the γ-band phase coherence (γ-PhC) between spiking-activity and the LFP, as well as the spiking-activity of two groups of neurons, strongly depended on which of the two stimuli in the RF was attended. The γ-PhC was almost identical for the attended stimulus presented either alone or together with a distractor. The functional relevance of dynamic γ-band synchronization is further supported by the observation of strongly degraded γ-PhC before behavioral errors, while firing rates were barely affected. These qualitatively different results point toward a failure of attention-dependent top-down mechanisms to correctly synchronize the local neuronal network in V4, even though this network receives the correctly selected input. These findings support the idea of a flexible, demand-dependent dynamic configuration of local neuronal networks, for performing different functions, even on the same sensory input.

Microsaccade-rhythmic modulation of neural synchronization and coding within and across cortical areas V1 and V2

Primates sample their visual environment actively through saccades and microsaccades (MSs). Saccadic eye movements not only modulate neural spike rates but might also affect temporal correlations (synchrony) among neurons. Neural synchrony plays a role in neural coding and modulates information transfer between cortical areas. The question arises of how eye movements shape neural synchrony within and across cortical areas and how it affects visual processing. Through local field recordings in macaque early visual cortex while monitoring eye position and through neural network simulations, we find 2 distinct synchrony regimes in early visual cortex that are embedded in a 3- to 4-Hz MS-related rhythm during visual fixation. In the period shortly after an MS (“transient period”), synchrony was high within and between cortical areas. In the subsequent period (“sustained period”), overall synchrony dropped and became selective to stimulus properties. Only mutually connected neurons with similar stimulus responses exhibited sustained narrow-band gamma synchrony (25–80 Hz), both within and across cortical areas. Recordings in macaque V1 and V2 matched the model predictions. Furthermore, our modeling provides predictions on how (micro)saccade-modulated gamma synchrony in V1 shapes V2 receptive fields (RFs). We suggest that the rhythmic alternation between synchronization regimes represents a basic repeating sampling strategy of the visual system.

During visual exploration, we continuously move our eyes in a quick, coordinated manner several times a second to scan our environment. These movements are called saccades. Even while we fixate on a visual object, we unconsciously execute small saccades that are termed microsaccades (MSs). Despite MSs being relatively small, they are suggested to be critical to maintain and support accurate perception during visual fixation. Here, we studied in macaques the influence of MSs on the synchronization of neural rhythms—which are important to regulate information flow in the brain—in areas of the cerebral cortex that are important for early processing of visual information, and we complemented the analysis with computational modeling. We found that synchronization properties shortly after an MS were distinct from synchronization in the later phase. Specifically, we found an early and spectrally broadband synchronization within and between visual cortices that was broadly tuned over the cortical space and stimulus properties. This was followed by narrow-band synchronization in the gamma range (25–80 Hz) that was spatially and stimulus specific. This suggests that the manner in which information is transmitted and integrated between early visual cortices depends on the timing relative to MSs. We illustrate this in a computational model showing that the receptive field (RF) of neurons in the secondary visual cortex are expected to be different depending on MS timing. Our results highlight the significance of MS timing for understanding cortical dynamics and suggest that the regulation of synchronization might be one mechanism by which MSs support visual perception.

Motion contrast in primary visual cortex: a direct comparison of single neuron and population encoding

Features from outside the classical receptive field (CRF) can modulate the stimulus-driven activity of single cells in the primary visual cortex. This modulation, mediated by horizontal and feedback networks, has been extensively described as a variation of firing rate and is considered the basis of processing features as, for example, motion contrast. However, surround influences have also been identified in pairwise spiking or local field coherence. Yet, evidence about co-existence and integration of different neural signatures remains elusive. To compare multiple signatures, we recorded spiking and LFP activity evoked by stimuli exhibiting a motion contrast in the CRFs surround in anesthetized cat primary visual cortex. We chose natural-like scenes over gratings to avoid predominance of simple visual features, which could be easily represented by a rate code. We analyzed firing rates and phase-locking to low-gamma frequency in single cells and neuronal assemblies. Motion contrast was reflected in all measures but in semi-independent populations. Whereas activation of assemblies accompanied single neuron rates, their phase relations were modulated differently. Interestingly, only assembly phase relations mirrored the direction of movement of the surround and were selectively affected by thermal deactivation of visual interhemispheric connections. We argue that motion contrast can be reflected in complementary and superimposed neuronal signatures that can represent different surround features in independent neuronal populations.

Phase-synchronization-based parcellation of resting state fMRI signals reveals topographically organized clusters in early visual cortex

Resting-state fMRI is widely used to study brain function and connectivity. However, interpreting patterns of resting state (RS) fMRI activity remains challenging as they may arise from different neuronal mechanisms than those triggered by exogenous events. Currently, this limits the use of RS-fMRI for understanding cortical function in health and disease. Here, we examine the phase synchronization (PS) properties of blood-oxygen level dependent (BOLD) signals obtained during visual field mapping (VFM) and RS with 7T fMRI. This data-driven approach exploits spatiotemporal covariations in the phase of BOLD recordings to establish the presence of clusters of synchronized activity. We find that, in both VFM and RS data, selecting the most synchronized neighboring recording sites identifies spatially localized PS clusters that follow the topographic organization of the visual cortex. However, in activity obtained during VFM, PS is spatially more extensive than in RS activity, likely reflecting stimulus-driven interactions between local responses. Nevertheless, the similarity of the PS clusters obtained for RS and stimulus-driven fMRI suggest that they share a common neuroanatomical origin. Our finding justifies and facilitates direct comparison of RS and stimulus-evoked activity.

A quantitative theory of gamma synchronization in macaque V1

Gamma-band synchronization coordinates brief periods of excitability in oscillating neuronal populations to optimize information transmission during sensation and cognition. Commonly, a stable, shared frequency over time is considered a condition for functional neural synchronization. Here, we demonstrate the opposite: instantaneous frequency modulations are critical to regulate phase relations and synchronization. In monkey visual area V1, nearby local populations driven by different visual stimulation showed different gamma frequencies. When similar enough, these frequencies continually attracted and repulsed each other, which enabled preferred phase relations to be maintained in periods of minimized frequency difference. Crucially, the precise dynamics of frequencies and phases across a wide range of stimulus conditions was predicted from a physics theory that describes how weakly coupled oscillators influence each other's phase relations. Hence, the fundamental mathematical principle of synchronization through instantaneous frequency modulations applies to gamma in V1 and is likely generalizable to other brain regions and rhythms.

Cortical Spike Synchrony as a Measure of Input Familiarity

Spike synchrony, which occurs in various cortical areas in response to specific perception, action, and memory tasks, has sparked a long-standing debate on the nature of temporal organization in cortex. One prominent view is that this type of synchrony facilitates the binding or grouping of separate stimulus components. We argue instead for a more general function: a measure of the prior probability of incoming stimuli, implemented by long-range, horizontal, intracortical connections. We show that networks of this kind-pulse-coupled excitatory spiking networks in a noisy environment-can provide a sufficient substrate for stimulus-dependent spike synchrony. This allows for a quick (few spikes) estimate of the match between inputs and the input history as encoded in the network structure. Given the ubiquity of small, strongly excitatory subnetworks in cortex, we thus propose that many experimental observations of spike synchrony can be viewed as signs of input patterns that resemble long-term experience-that is, of patterns with high prior probability.

Phase Difference between Model Cortical Areas Determines Level of Information Transfer

Communication between cortical sites is mediated by long-range synaptic connections. However, these connections are relatively static, while everyday cognitive tasks demand a fast and flexible routing of information in the brain. Synchronization of activity between distant cortical sites has been proposed as the mechanism underlying such a dynamic communication structure. Here, we study how oscillatory activity affects the excitability and input-output relation of local cortical circuits and how it alters the transmission of information between cortical circuits. To this end, we develop model circuits showing fast oscillations by the PING mechanism, of which the oscillatory characteristics can be altered. We identify conditions for synchronization between two brain circuits and show that the level of intercircuit coherence and the phase difference is set by the frequency difference between the intrinsic oscillations. We show that the susceptibility of the circuits to inputs, i.e., the degree of change in circuit output following input pulses, is not uniform throughout the oscillation period and that both firing rate, frequency and power are differentially modulated by inputs arriving at different phases. As a result, an appropriate phase difference between the circuits is critical for the susceptibility windows of the circuits in the network to align and for information to be efficiently transferred. We demonstrate that changes in synchrony and phase difference can be used to set up or abolish information transfer in a network of cortical circuits.