Synchrony unbound: a critical evaluation of the temporal binding hypothesis

A spatial map: a propitious choice for constraining the binding problem

Many studies have shown that the human visual system has two major functionally distinct cortical visual pathways: a ventral pathway, thought to be important for object recognition, and a dorsal pathway, thought to be important for spatial cognition. According to our and others previous studies, artificial neural networks with two segregated pathways can determine objects' identities and locations more accurately and efficiently than one-pathway artificial neural networks. In addition, we showed that these two segregated artificial cortical visual pathways can each process identity and spatial information of visual objects independently and differently. However, when using such networks to process multiple objects' identities and locations, a binding problem arises because the networks may not associate each object's identity with its location correctly. In a previous study, we constrained the binding problem by training the artificial identity pathway to retain relative location information of objects. This design uses a location map to constrain the binding problem. One limitation of that study was that we only considered two attributes of our objects (identity and location) and only one possible map (location) for binding. However, typically the brain needs to process and bind many attributes of an object, and any of these attributes could be used to constrain the binding problem. In our current study, using visual objects with multiple attributes (identity, luminance, orientation, and location) that need to be recognized, we tried to find the best map (among an identity map, a luminance map, an orientation map, or a location map) to constrain the binding problem. We found that in our experimental simulations, when visual attributes are independent of each other, a location map is always a better choice than the other kinds of maps examined for constraining the binding problem. Our findings agree with previous neurophysiological findings that show that the organization or map in many visual cortical areas is primarily retinotopic or spatial.

Auditory Competition and Coding of Relative Stimulus Strength across Midbrain Space Maps of Barn Owls

The natural environment challenges the brain to prioritize the processing of salient stimuli. The barn owl, a sound localization specialist, exhibits a circuit called the midbrain stimulus selection network, dedicated to representing locations of the most salient stimulus in circumstances of concurrent stimuli. Previous competition studies using unimodal (visual) and bimodal (visual and auditory) stimuli have shown that relative strength is encoded in spike response rates. However, open questions remain concerning auditory-auditory competition on coding. To this end, we present diverse auditory competitors (concurrent flat noise and amplitude-modulated noise) and record neural responses of awake barn owls of both sexes in subsequent midbrain space maps, the external nucleus of the inferior colliculus (ICx) and optic tectum (OT). While both ICx and OT exhibit a topographic map of auditory space, OT also integrates visual input and is part of the global-inhibitory midbrain stimulus selection network. Through comparative investigation of these regions, we show that while increasing strength of a competitor sound decreases spike response rates of spatially distant neurons in both regions, relative strength determines spike train synchrony of nearby units only in the OT. Furthermore, changes in synchrony by sound competition in the OT are correlated to gamma range oscillations of local field potentials associated with input from the midbrain stimulus selection network. The results of this investigation suggest that modulations in spiking synchrony between units by gamma oscillations are an emergent coding scheme representing relative strength of concurrent stimuli, which may have relevant implications for downstream readout.

Alpha phase-coding supports feature binding during working memory maintenance

The ability to successfully retain and manipulate information in working memory (WM) requires that objects' individual features are bound into cohesive representations; yet, the mechanisms supporting feature binding remain unclear. Binding (or swap) errors, where memorized features are erroneously associated with the wrong object, can provide a window into the intrinsic limits in capacity of WM that represent a key bottleneck in our cognitive ability. We tested the hypothesis that binding in WM is accomplished via neural phase synchrony and that swap errors result from perturbations in this synchrony. Using magnetoencephalography data collected from human subjects in a task designed to induce swap errors, we showed that swaps are characterized by reduced phase-locked oscillatory activity during memory retention, as predicted by an attractor model of spiking neural networks. Further, we found that this reduction arises from increased phase-coding variability in the alpha-band over a distributed network of sensorimotor areas. Our findings demonstrate that feature binding in WM is accomplished through phase-coding dynamics that emerge from the competition between different memories.

TMS provokes target-dependent intracranial rhythms across human cortical and subcortical sites

BACKGROUND

Transcranial magnetic stimulation (TMS) is believed to alter ongoing neural activity and cause circuit-level changes in brain function. While the electrophysiological effects of TMS have been extensively studied with scalp electroencephalography (EEG), this approach generally evaluates low-frequency neural activity at the cortical surface. However, TMS can be safely used in patients with intracranial electrodes (iEEG), allowing for direct assessment of deeper and more localized oscillatory responses across the frequency spectrum.

OBJECTIVE/HYPOTHESIS

Our study used iEEG to understand the effects of TMS on human neural activity in the spectral domain. We asked (1) which brain regions respond to cortically-targeted TMS, and in what frequency bands, (2) whether deeper brain structures exhibit oscillatory responses, and (3) whether the neural responses to TMS reflect evoked versus induced oscillations.

METHODS

We recruited 17 neurosurgical patients with indwelling electrodes and recorded neural activity while patients underwent repeated trials of single-pulse TMS at either the dorsolateral prefrontal cortex (DLPFC) or parietal cortex. iEEG signals were analyzed using spectral methods to understand the oscillatory responses to TMS.

RESULTS

Stimulation to DLPFC drove widespread low-frequency increases (3-8 Hz) in frontolimbic cortices and high-frequency decreases (30-110 Hz) in frontotemporal areas, including the hippocampus. Stimulation to parietal cortex specifically provoked low-frequency responses in the medial temporal lobe. While most low-frequency activity was consistent with phase-locked evoked responses, anterior frontal regions exhibited induced theta oscillations following DLPFC stimulation.

CONCLUSIONS

By combining TMS with intracranial EEG recordings, our results suggest that TMS is an effective means to perturb oscillatory neural activity in brain-wide networks, including deeper structures not directly accessed by stimulation itself.

Spike synchrony as a measure of Gestalt structure

The function of spike synchrony is debatable: some researchers view it as a mechanism for binding perceptual features, others - as a byproduct of brain activity. We argue for an alternative computational role: synchrony can estimate the prior probability of incoming stimuli. In V1, this can be achieved by comparing input with previously acquired visual experience, which is encoded in plastic horizontal intracortical connections. V1 connectivity structure can encode the acquired visual experience in the form of its aggregate statistics. Since the aggregate statistics of natural images tend to follow the Gestalt principles, we can assume that V1 is more often exposed to Gestalt-like stimuli, and this is manifested in its connectivity structure. At the same time, the connectivity structure has an impact on spike synchrony in V1. We used a spiking model with V1-like connectivity to demonstrate that spike synchrony reflects the Gestalt structure of the stimulus. We conducted simulation experiments with three Gestalt laws: proximity, similarity, and continuity, and found substantial differences in firing synchrony for stimuli with varying degrees of Gestalt-likeness. This allows us to conclude that spike synchrony indeed reflects the Gestalt structure of the stimulus, which can be interpreted as a mechanism for prior probability estimation.

Enhancement of low gamma oscillations by volitional conditioning of local field potential in the primary motor and visual cortex of mice

Volitional control of local field potential oscillations in low gamma band via brain machine interface can not only uncover the relationship between low gamma oscillation and neural synchrony but also suggest a therapeutic potential to reverse abnormal local field potential oscillation in neurocognitive disorders. In nonhuman primates, the volitional control of low gamma oscillations has been demonstrated by brain machine interface techniques in the primary motor and visual cortex. However, it is not clear whether this holds in other brain regions and other species, for which gamma rhythms might involve in highly different neural processes. Here, we established a closed-loop brain-machine interface and succeeded in training mice to volitionally elevate low gamma power of local field potential in the primary motor and visual cortex. We found that the mice accomplished the task in a goal-directed manner and spiking activity exhibited phase-locking to the oscillation in local field potential in both areas. Moreover, long-term training made the power enhancement specific to direct and adjacent channel, and increased the transcriptional levels of NMDA receptors as well as that of hypoxia-inducible factor relevant to metabolism. Our results suggest that volitionally generated low gamma rhythms in different brain regions share similar mechanisms and pave the way for employing brain machine interface in therapy of neurocognitive disorders.

TMS provokes target-dependent intracranial rhythms across human cortical and subcortical sites

Transcranial magnetic stimulation (TMS) is increasingly deployed in the treatment of neuropsychiatric illness, under the presumption that stimulation of specific cortical targets can alter ongoing neural activity and cause circuit-level changes in brain function. While the electrophysiological effects of TMS have been extensively studied with scalp electroencephalography (EEG), this approach is most useful for evaluating low-frequency neural activity at the cortical surface. As such, little is known about how TMS perturbs rhythmic activity among deeper structures - such as the hippocampus and amygdala - and whether stimulation can alter higher-frequency oscillations. Recent work has established that TMS can be safely used in patients with intracranial electrodes (iEEG), allowing for direct neural recordings at sufficient spatiotemporal resolution to examine localized oscillatory responses across the frequency spectrum. To that end, we recruited 17 neurosurgical patients with indwelling electrodes and recorded neural activity while patients underwent repeated trials of single-pulse TMS at several cortical sites. Stimulation to the dorsolateral prefrontal cortex (DLPFC) drove widespread low-frequency increases (3-8Hz) in frontolimbic cortices, as well as high-frequency decreases (30-110Hz) in frontotemporal areas, including the hippocampus. Stimulation to parietal cortex specifically provoked low-frequency responses in the medial temporal lobe. While most low-frequency activity was consistent with brief evoked responses, anterior frontal regions exhibited induced theta oscillations following DLPFC stimulation. Taken together, we established that non-invasive stimulation can (1) provoke a mixture of low-frequency evoked power and induced theta oscillations and (2) suppress high-frequency activity in deeper brain structures not directly accessed by stimulation itself.

Immediate neural impact and incomplete compensation after semantic hub disconnection

The human brain extracts meaning using an extensive neural system for semantic knowledge. Whether broadly distributed systems depend on or can compensate after losing a highly interconnected hub is controversial. We report intracranial recordings from two patients during a speech prediction task, obtained minutes before and after neurosurgical treatment requiring disconnection of the left anterior temporal lobe (ATL), a candidate semantic knowledge hub. Informed by modern diaschisis and predictive coding frameworks, we tested hypotheses ranging from solely neural network disruption to complete compensation by the indirectly affected language-related and speech-processing sites. Immediately after ATL disconnection, we observed neurophysiological alterations in the recorded frontal and auditory sites, providing direct evidence for the importance of the ATL as a semantic hub. We also obtained evidence for rapid, albeit incomplete, attempts at neural network compensation, with neural impact largely in the forms stipulated by the predictive coding framework, in specificity, and the modern diaschisis framework, more generally. The overall results validate these frameworks and reveal an immediate impact and capability of the human brain to adjust after losing a brain hub.

Interoceptive rhythms in the brain

Sensing internal bodily signals, or interoception, is fundamental to maintain life. However, interoception should not be viewed as an isolated domain, as it interacts with exteroception, cognition and action to ensure the integrity of the organism. Focusing on cardiac, respiratory and gastric rhythms, we review evidence that interoception is anatomically and functionally intertwined with the processing of signals from the external environment. Interactions arise at all stages, from the peripheral transduction of interoceptive signals to sensory processing and cortical integration, in a network that extends beyond core interoceptive regions. Interoceptive rhythms contribute to functions ranging from perceptual detection up to sense of self, or conversely compete with external inputs. Renewed interest in interoception revives long-standing issues on how the brain integrates and coordinates information in distributed regions, by means of oscillatory synchrony, predictive coding or multisensory integration. Considering interoception and exteroception in the same framework paves the way for biological modes of information processing specific to living organisms.

Exploring retinal ganglion cells encoding to multi-modal stimulation using 3D microelectrodes arrays

Microelectrode arrays (MEA) are extensively utilized in encoding studies of retinal ganglion cells (RGCs) due to their capacity for simultaneous recording of neural activity across multiple channels. However, conventional planar MEAs face limitations in studying RGCs due to poor coupling between electrodes and RGCs, resulting in low signal-to-noise ratio (SNR) and limited recording sensitivity. To overcome these challenges, we employed photolithography, electroplating, and other processes to fabricate a 3D MEA based on the planar MEA platform. The 3D MEA exhibited several improvements compared to planar MEA, including lower impedance (8.73 ± 1.66 kΩ) and phase delay (-15.11° ± 1.27°), as well as higher charge storage capacity (CSC = 10.16 ± 0.81 mC/cm2), cathodic charge storage capacity (CSCc = 7.10 ± 0.55 mC/cm2), and SNR (SNR = 8.91 ± 0.57). Leveraging the advanced 3D MEA, we investigated the encoding characteristics of RGCs under multi-modal stimulation. Optical, electrical, and chemical stimulation were applied as sensory inputs, and distinct response patterns and response times of RGCs were detected, as well as variations in rate encoding and temporal encoding. Specifically, electrical stimulation elicited more effective RGC firing, while optical stimulation enhanced RGC synchrony. These findings hold promise for advancing the field of neural encoding.

Solving the binding problem: Assemblies form when neurons enhance their firing rate-they don't need to oscillate or synchronize

When we look at an image, its features are represented in our visual system in a highly distributed manner, calling for a mechanism that binds them into coherent object representations. There have been different proposals for the neuronal mechanisms that can mediate binding. One hypothesis is that binding is achieved by oscillations that synchronize neurons representing features of the same perceptual object. This view allows separate communication channels between different brain areas. Another hypothesis is that binding of features that are represented in different brain regions occurs when the neurons in these areas that respond to the same object simultaneously enhance their firing rate, which would correspond to directing object-based attention to these features. This review summarizes evidence in favor of and against these two hypotheses, examining the neuronal correlates of binding and assessing the time course of perceptual grouping. I conclude that enhanced neuronal firing rates bind features into coherent object representations, whereas oscillations and synchrony are unrelated to binding.

Narrowband gamma oscillations propagate and synchronize throughout the mouse thalamocortical visual system

Oscillations of neural activity permeate sensory systems. In the visual system, broadband gamma oscillations (30-80 Hz) are thought to act as a communication mechanism underlying perception. However, these oscillations show widely varying frequency and phase, providing constraints for coordinating spike timing across areas. Here, we examined Allen Brain Observatory data and performed causal experiments to show that narrowband gamma (NBG) oscillations (50-70 Hz) propagate and synchronize throughout the awake mouse visual system. Lateral geniculate nucleus (LGN) neurons fired precisely relative to NBG phase in primary visual cortex (V1) and multiple higher visual areas (HVAs). NBG neurons across areas showed a higher likelihood of functional connectivity and stronger visual responses; remarkably, NBG neurons in LGN, preferring bright (ON) versus dark (OFF), fired at distinct NBG phases aligned across the cortical hierarchy. NBG oscillations may thus serve to coordinate spike timing across brain areas and facilitate communication of distinct visual features during perception.

Time marking in perception

Several authors have proposed that perceptual information carries labels that identify temporal features, including time of occurrence, ordinal temporal relations, and brief durations. These labels serve to locate and organise perceptual objects, features, and events in time. In some proposals time marking has local, specific functions such as synchronisation of different features in perceptual processing. In other proposals time marking has general significance and is responsible for rendering perceptual experience temporally coherent, just as various forms of spatial information render the visual environment spatially coherent. These proposals, which all concern time marking on the millisecond time scale, are reviewed. It is concluded that time marking is vital to the construction of a multisensory perceptual world in which things are orderly with respect to both space and time, but that much more research is needed to ascertain its functions in perception and its neurophysiological foundations.

Cortical VIP neurons locally control the gain but globally control the coherence of gamma band rhythms

Gamma band synchronization can facilitate local and long-range neural communication. In the primary visual cortex, visual stimulus properties within a specific location determine local synchronization strength, while the match of stimulus properties between distant locations controls long-range synchronization. The neural basis for the differential control of local and global gamma band synchronization is unknown. Combining electrophysiology, optogenetics, and computational modeling, we found that VIP disinhibitory interneurons in mouse cortex linearly scale gamma power locally without changing its stimulus tuning. Conversely, they suppress long-range synchronization when two regions process non-matched stimuli, tuning gamma coherence globally. Modeling shows that like-to-like connectivity across space and specific VIP→SST inhibition capture these opposing effects. VIP neurons thus differentially impact local and global properties of gamma rhythms depending on visual stimulus statistics. They may thereby construct gamma-band filters for spatially extended but continuous image features, such as contours, facilitating the downstream generation of coherent visual percepts.

Evaluating interhemispheric connectivity during midline object recognition using EEG

Functional integration between two hemispheres is crucial for perceptual binding to occur when visual stimuli are presented in the midline of the visual field. Mima and colleagues (2001) showed using EEG that midline object recognition was associated with task-related decrease in alpha band power (alpha desynchronisation) and a transient increase in interhemispheric coherence. Our objective in the current study was to replicate the results of Mima et al. and to further evaluate interhemispheric effective connectivity during midline object recognition in source space. We recruited 11 healthy adult volunteers and recorded EEG from 64 channels while they performed a midline object recognition task. Task-related power and coherence were estimated in sensor and source spaces. Further, effective connectivity was evaluated using Granger causality. While we were able to replicate the alpha desynchronisation associated with midline object recognition, we could not replicate the coherence results of Mima et al. The data-driven approach that we employed in our study localised the source of alpha desynchronisation over the left occipito-temporal region. In the alpha band, we further observed significant increase in imaginary part of coherency between bilateral occipito-temporal regions during object recognition. Finally, Granger causality analysis between the left and right occipito-temporal regions provided an insight that even though there is bidirectional interaction, the left occipito-temporal region may be crucial for integrating the information necessary for object recognition. The significance of the current study lies in using high-density EEG and applying more appropriate and robust measures of connectivity as well as statistical analysis to validate and enhance our current knowledge on the neural basis of midline object recognition.

Widespread ripples synchronize human cortical activity during sleep, waking, and memory recall

Declarative memory encoding, consolidation, and retrieval require the integration of elements encoded in widespread cortical locations. The mechanism whereby such "binding" of different components of mental events into unified representations occurs is unknown. The "binding-by-synchrony" theory proposes that distributed encoding areas are bound by synchronous oscillations enabling enhanced communication. However, evidence for such oscillations is sparse. Brief high-frequency oscillations ("ripples") occur in the hippocampus and cortex and help organize memory recall and consolidation. Here, using intracranial recordings in humans, we report that these ∼70-ms-duration, 90-Hz ripples often couple (within ±500 ms), co-occur (≥ 25-ms overlap), and, crucially, phase-lock (have consistent phase lags) between widely distributed focal cortical locations during both sleep and waking, even between hemispheres. Cortical ripple co-occurrence is facilitated through activation across multiple sites, and phase locking increases with more cortical sites corippling. Ripples in all cortical areas co-occur with hippocampal ripples but do not phase-lock with them, further suggesting that cortico-cortical synchrony is mediated by cortico-cortical connections. Ripple phase lags vary across sleep nights, consistent with participation in different networks. During waking, we show that hippocampo-cortical and cortico-cortical coripples increase preceding successful delayed memory recall, when binding between the cue and response is essential. Ripples increase and phase-modulate unit firing, and coripples increase high-frequency correlations between areas, suggesting synchronized unit spiking facilitating information exchange. co-occurrence, phase synchrony, and high-frequency correlation are maintained with little decrement over very long distances (25 cm). Hippocampo-cortico-cortical coripples appear to possess the essential properties necessary to support binding by synchrony during memory retrieval and perhaps generally in cognition.

Spike-Gamma Phase Relationship in the Visual Cortex

Gamma oscillations (30-70 Hz) have been hypothesized to play a role in cortical function. Most of the proposed mechanisms involve rhythmic modulation of neuronal excitability at gamma frequencies, leading to modulation of spike timing relative to the rhythm. I first show that the gamma band could be more privileged than other frequencies in observing spike-field interactions even in the absence of genuine gamma rhythmicity and discuss several biases in spike-gamma phase estimation. I then discuss the expected spike-gamma phase according to several hypotheses. Inconsistent with the phase-coding hypothesis (but not with others), the spike-gamma phase does not change with changes in stimulus intensity or attentional state, with spikes preferentially occurring 2-4 ms before the trough, but with substantial variability. However, this phase relationship is expected even when gamma is a byproduct of excitatory-inhibitory interactions. Given that gamma occurs in short bursts, I argue that the debate over the role of gamma is a matter of semantics. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A Dynamic Mechanistic Model of Perceptual Binding

The brain’s ability to create a unified conscious representation of an object by integrating information from multiple perception pathways is called perceptual binding. Binding is crucial for normal cognitive function. Some perceptual binding errors and disorders have been linked to certain neurological conditions, brain lesions, and conditions that give rise to illusory conjunctions. However, the mechanism of perceptual binding remains elusive. Here, I present a computational model of binding using two sets of coupled oscillatory processes that are assumed to occur in response to two different percepts. I use the model to study the dynamic behavior of coupled processes to characterize how these processes can modulate each other and reach a temporal synchrony. I identify different oscillatory dynamic regimes that depend on coupling mechanisms and parameter values. The model can also discriminate different combinations of initial inputs that are set by initial states of coupled processes. Decoding brain signals that are formed through perceptual binding is a challenging task, but my modeling results demonstrate how crosstalk between two systems of processes can possibly modulate their outputs. Therefore, my mechanistic model can help one gain a better understanding of how crosstalk between perception pathways can affect the dynamic behavior of the systems that involve perceptual binding.

Transforming Discoveries About Cortical Microcircuits and Gamma Oscillations Into New Treatments for Cognitive Deficits in Schizophrenia

The major cause of disability in schizophrenia is cognitive impairment, which remains largely refractory to existing treatments. This reflects the fact that antipsychotics and other therapies have not been designed to address specific brain abnormalities that cause cognitive impairment. This overview proposes that understanding how specific cellular and synaptic loci within cortical microcircuits contribute to cortical gamma oscillations may reveal treatments for cognitive impairment. Gamma oscillations are rhythmic patterns of high frequency (∼30-100 Hz) neuronal activity that are synchronized within and across brain regions, generated by a class of inhibitory interneurons that express parvalbumin, and recruited during a variety of cognitive tasks. In schizophrenia, both parvalbumin interneuron function and task-evoked gamma oscillations are deficient. While it has long been controversial whether gamma oscillations are merely a biomarker of circuit function or actually contribute to information processing by neuronal networks, recent neurobiological studies in mice have shown that disrupting or enhancing synchronized gamma oscillations can reproduce or ameliorate cognitive deficits resembling those seen in schizophrenia. In fact, transiently enhancing the synchrony of parvalbumin interneuron-generated gamma oscillations can lead to long-lasting improvements in cognition in mice that model aspects of schizophrenia. Gamma oscillations emerge from specific patterns of connections between a variety of cell types within cortical microcircuits. Thus, a critical next step is to understand how specific cell types and synapses generate gamma oscillations, mediate the effects of gamma oscillations on information processing, and/or undergo plasticity following the induction of gamma oscillations. Modulating these circuit loci, potentially in combination with other approaches such as cognitive training and brain stimulation, may yield potent and selective interventions for enhancing cognition in schizophrenia.

Acquiring new memories in neocortex of hippocampal-lesioned mice

The hippocampus interacts with the neocortical network for memory retrieval and consolidation. Here, we found the lateral entorhinal cortex (LEC) modulates learning-induced cortical long-range gamma synchrony (20–40 Hz) in a hippocampal-dependent manner. The long-range gamma synchrony, which was coupled to the theta (7–10 Hz) rhythm and enhanced upon learning and recall, was mediated by inter-cortical projections from layer 5 neurons of the LEC to layer 2 neurons of the sensory and association cortices. Artificially induced cortical gamma synchrony across cortical areas improved memory encoding in hippocampal lesioned mice for originally hippocampal-dependent tasks. Mechanistically, we found that activities of cortical c-Fos labeled neurons, which showed egocentric map properties, were modulated by LEC-mediated gamma synchrony during memory recall, implicating a role of cortical synchrony to generate an integrative memory representation from disperse features. Our findings reveal the hippocampal mediated organization of cortical memories and suggest brain-machine interface approaches to improve cognitive function.

Hippocampal lesioned mice form new memories. Here, the authors show the lateral entorhinal cortex modulates learning-induced cortical long-range gamma synchrony in a hippocampal-dependent manner and artificially induced cortical gamma synchrony across cortical areas improved memory encoding in hippocampal lesioned mice.

Meta-criteria to formulate criteria of consciousness

Any neurobiological model claiming explanation of a complex human phenomenon should start with an explicit definition of the explanandum. If a classical intensional definition is impossible, we can use a descriptive definition by listing necessary criteria (e.g., of consciousness). This commentary suggests four meta-criteria that different proposed criteria of consciousness should fulfill: phenomenological consensus, empirical evidence, domain specificity, and non-circularity.

Representation of Color, Form, and their Conjunction across the Human Ventral Visual Pathway

Despite decades of research, our understanding of the relationship between color and form processing in the primate ventral visual pathway remains incomplete. Using fMRI multivoxel pattern analysis, we examined coding of color and form, using a simple form feature (orientation) and a mid-level form feature (curvature), in human ventral visual processing regions. We found that both color and form could be decoded from activity in early visual areas V1 to V4, as well as in the posterior color-selective region and shape-selective regions in ventral and lateral occipitotemporal cortex defined based on their univariate selectivity to color or shape, respectively (the central color region only showed color but not form decoding). Meanwhile, decoding biases towards one feature or the other existed in the color- and shape-selective regions, consistent with their univariate feature selectivity reported in past studies. Additional extensive analyses show that while all these regions contain independent (linearly additive) coding for both features, several early visual regions also encode the conjunction of color and the simple, but not the complex, form feature in a nonlinear, interactive manner. Taken together, the results show that color and form are encoded in a biased distributed and largely independent manner across ventral visual regions in the human brain.

Gamma rhythms in the visual cortex: functions and mechanisms

Gamma-band activity, peaking around 30–100 Hz in the local field potential's power spectrum, has been found and intensively studied in many brain regions. Although gamma is thought to play a critical role in processing neural information in the brain, its cognitive functions and neural mechanisms remain unclear or debatable. Experimental studies showed that gamma rhythms are stochastic in time and vary with visual stimuli. Recent studies further showed that multiple rhythms coexist in V1 with distinct origins in different species. While all these experimental facts are a challenge for understanding the functions of gamma in the visual cortex, there are many signs of progress in computational studies. This review summarizes and discusses studies on gamma in the visual cortex from multiple perspectives and concludes that gamma rhythms are still a mystery. Combining experimental and computational studies seems the best way forward in the future.

Can the causal role of brain oscillations be studied through rhythmic brain stimulation?

Many studies have investigated the causal relevance of brain oscillations using rhythmic stimulation, either through direct-brain or sensory stimulation. Yet, how intrinsic rhythms interact with the externally generated rhythm is largely unknown. We presented a flickered (60 Hz) visual grating or its correspondent unflickered stimulus in a psychophysical change detection task during simultaneous magnetoencephalography recordings to humans to test the effect of visual entrainment on induced gamma oscillations. Notably, we generally observed the coexistence of the broadband induced gamma rhythm with the entrained flicker rhythm (reliably measured in each participant), with the peak frequency of the induced response remaining unaltered in approximately half of participants—relatively independently of their native frequency. However, flicker increased broadband induced gamma power, and this was stronger in participants with a native frequency closer to the flicker frequency (resonance) and led to strong phase entrainment. Presence of flicker did not change behavior itself but profoundly altered brain behavior correlates across the sample: While broadband induced gamma oscillations correlated with reaction times for unflickered stimuli (as known previously), for the flicker, the amplitude of the entrained flicker rhythm (but no more the induced oscillation) correlated with reaction times. This, however, strongly depended on whether a participant's peak frequency shifted to the entrained rhythm. Our results suggests that rhythmic brain stimulation leads to a coexistence of two partially independent oscillations with heterogeneous effects across participants on the downstream relevance of these rhythms for behavior. This may explain the inconsistency of findings related to external entrainment of brain oscillations and poses further questions toward causal manipulations of brain oscillations in general.

Toward understanding the neural code of the brain

More and more, the neurosciences and the sciences concerned with mind and cognition are burying fundamental questions under layers of professional methodology. I therefore welcome Biological Cybernetics' invitation to comment on two of my papers, (von der Malsburg 1973) and (von der Malsburg and Schneider 1986) (henceforth referred to as (I) and (II)) as an opportunity to address two fundamental questions about brain and mind: How is the brain's structure generated? and How is mental content expressed by the brain's physical states? Those two questions are deeply entangled with each other and play a kind of gateway role on the way to making progress with the issues of perception, intelligence, creativity and consciousness.

Across-Area Synchronization Supports Feature Integration in a Biophysical Network Model of Working Memory

Working memory function is severely limited. One key limitation that constrains the ability to maintain multiple items in working memory simultaneously is so-called swap errors. These errors occur when an inaccurate response is in fact accurate relative to a non-target stimulus, reflecting the failure to maintain the appropriate association or "binding" between the features that define one object (e.g., color and location). The mechanisms underlying feature binding in working memory remain unknown. Here, we tested the hypothesis that features are bound in memory through synchrony across feature-specific neural assemblies. We built a biophysical neural network model composed of two one-dimensional attractor networks - one for color and one for location - simulating feature storage in different cortical areas. Within each area, gamma oscillations were induced during bump attractor activity through the interplay of fast recurrent excitation and slower feedback inhibition. As a result, different memorized items were held at different phases of the network's oscillation. These two areas were then reciprocally connected via weak cortico-cortical excitation, accomplishing binding between color and location through the synchronization of pairs of bumps across the two areas. Encoding and decoding of color-location associations was accomplished through rate coding, overcoming a long-standing limitation of binding through synchrony. In some simulations, swap errors arose: "color bumps" abruptly changed their phase relationship with "location bumps." This model, which leverages the explanatory power of similar attractor models, specifies a plausible mechanism for feature binding and makes specific predictions about swap errors that are testable at behavioral and neurophysiological levels.

Capturing the objects of vision with neural networks

Human visual perception carves a scene at its physical joints, decomposing the world into objects, which are selectively attended, tracked and predicted as we engage our surroundings. Object representations emancipate perception from the sensory input, enabling us to keep in mind that which is out of sight and to use perceptual content as a basis for action and symbolic cognition. Human behavioural studies have documented how object representations emerge through grouping, amodal completion, proto-objects and object files. By contrast, deep neural network models of visual object recognition remain largely tethered to sensory input, despite achieving human-level performance at labelling objects. Here, we review related work in both fields and examine how these fields can help each other. The cognitive literature provides a starting point for the development of new experimental tasks that reveal mechanisms of human object perception and serve as benchmarks driving the development of deep neural network models that will put the object into object recognition.

Recurrent dynamics in the cerebral cortex: Integration of sensory evidence with stored knowledge

Current concepts of sensory processing in the cerebral cortex emphasize serial extraction and recombination of features in hierarchically structured feed-forward networks in order to capture the relations among the components of perceptual objects. These concepts are implemented in convolutional deep learning networks and have been validated by the astounding similarities between the functional properties of artificial systems and their natural counterparts. However, cortical architectures also display an abundance of recurrent coupling within and between the layers of the processing hierarchy. This massive recurrence gives rise to highly complex dynamics whose putative function is poorly understood. Here a concept is proposed that assigns specific functions to the dynamics of cortical networks and combines, in a unifying approach, the respective advantages of recurrent and feed-forward processing. It is proposed that the priors about regularities of the world are stored in the weight distributions of feed-forward and recurrent connections and that the high-dimensional, dynamic space provided by recurrent interactions is exploited for computations. These comprise the ultrafast matching of sensory evidence with the priors covertly represented in the correlation structure of spontaneous activity and the context-dependent grouping of feature constellations characterizing natural objects. The concept posits that information is encoded not only in the discharge frequency of neurons but also in the precise timing relations among the discharges. Results of experiments designed to test the predictions derived from this concept support the hypothesis that cerebral cortex exploits the high-dimensional recurrent dynamics for computations serving predictive coding.

No Evidence for Entrainment: Endogenous Gamma Oscillations and Rhythmic Flicker Responses Coexist in Visual Cortex

Over the past decades, numerous studies have linked cortical gamma oscillations (∼30-100 Hz) to neurocomputational mechanisms. Their functional relevance, however, is still passionately debated. Here, we asked whether endogenous gamma oscillations in the human brain can be entrained by a rhythmic photic drive >50 Hz. Such a noninvasive modulation of endogenous brain rhythms would allow conclusions about their causal involvement in neurocognition. To this end, we systematically investigated oscillatory responses to a rapid sinusoidal flicker in the absence and presence of endogenous gamma oscillations using magnetoencephalography (MEG) in combination with a high-frequency projector. The photic drive produced a robust response over visual cortex to stimulation frequencies of up to 80 Hz. Strong, endogenous gamma oscillations were induced using moving grating stimuli as repeatedly done in previous research. When superimposing the flicker and the gratings, there was no evidence for phase or frequency entrainment of the endogenous gamma oscillations by the photic drive. Unexpectedly, we did not observe an amplification of the flicker response around participants' individual gamma frequencies (IGFs); rather, the magnitude of the response decreased monotonically with increasing frequency. Source reconstruction suggests that the flicker response and the gamma oscillations were produced by separate, coexistent generators in visual cortex. The presented findings challenge the notion that cortical gamma oscillations can be entrained by rhythmic visual stimulation. Instead, the mechanism generating endogenous gamma oscillations seems to be resilient to external perturbation.SIGNIFICANCE STATEMENT We aimed to investigate to what extent ongoing, high-frequency oscillations in the gamma-band (30-100 Hz) in the human brain can be entrained by a visual flicker. Gamma oscillations have long been suggested to coordinate neuronal firing and enable interregional communication. Our results demonstrate that rhythmic visual stimulation cannot hijack the dynamics of ongoing gamma oscillations; rather, the flicker response and the endogenous gamma oscillations coexist in different visual areas. Therefore, while a visual flicker evokes a strong neuronal response even at high frequencies in the gamma-band, it does not entrain endogenous gamma oscillations in visual cortex. This has important implications for interpreting studies investigating the causal and neuroprotective effects of rhythmic sensory stimulation in the gamma-band.

Joint representation of color and form in convolutional neural networks: A stimulus-rich network perspective

To interact with real-world objects, any effective visual system must jointly code the unique features defining each object. Despite decades of neuroscience research, we still lack a firm grasp on how the primate brain binds visual features. Here we apply a novel network-based stimulus-rich representational similarity approach to study color and form binding in five convolutional neural networks (CNNs) with varying architecture, depth, and presence/absence of recurrent processing. All CNNs showed near-orthogonal color and form processing in early layers, but increasingly interactive feature coding in higher layers, with this effect being much stronger for networks trained for object classification than untrained networks. These results characterize for the first time how multiple basic visual features are coded together in CNNs. The approach developed here can be easily implemented to characterize whether a similar coding scheme may serve as a viable solution to the binding problem in the primate brain.

Olfactory encoding within the insect antennal lobe: The emergence and role of higher order temporal correlations in the dynamics of antennal lobe spiking activity

In this review, we focus on the antennal lobe (AL) of three insect species - the fruit fly, sphinx moth, and locust. We first review the experimentally elucidated anatomy and physiology of the early olfactory system of each species; empirical studies of AL activity, however, often focus on assessing firing rates (averaged over time scales of about 100 ms), and hence the AL odor code is often analyzed in terms of a temporally evolving vector of firing rates. However, such a perspective necessarily misses the possibility of higher order temporal correlations in spiking activity within a single cell and across multiple cells over shorter time scales (of about 10 ms). Hence, we then review our prior theoretical work, where we constructed biophysically detailed, species-specific AL models within the fly, moth, and locust, finding that in each case higher order temporal correlations in spiking naturally emerge from model dynamics (i.e., without a prioriincorporation of elements designed to produce correlated activity). We therefore use our theoretical work to argue the perspective that temporal correlations in spiking over short time scales, which have received little experimental attention to-date, may provide valuable coding dimensions (complementing the coding dimensions provided by the vector of firing rates) that nature has exploited in the encoding of odors within the AL. We further argue that, if the AL does indeed utilize temporally correlated activity to represent odor information, such an odor code could be naturally and easily deciphered within the Mushroom Body.

Unique scales preserve self-similar integrate-and-fire functionality of neuronal clusters

Brains demonstrate varying spatial scales of nested hierarchical clustering. Identifying the brain's neuronal cluster size to be presented as nodes in a network computation is critical to both neuroscience and artificial intelligence, as these define the cognitive blocks capable of building intelligent computation. Experiments support various forms and sizes of neural clustering, from handfuls of dendrites to thousands of neurons, and hint at their behavior. Here, we use computational simulations with a brain-derived fMRI network to show that not only do brain networks remain structurally self-similar across scales but also neuron-like signal integration functionality ("integrate and fire") is preserved at particular clustering scales. As such, we propose a coarse-graining of neuronal networks to ensemble-nodes, with multiple spikes making up its ensemble-spike and time re-scaling factor defining its ensemble-time step. This fractal-like spatiotemporal property, observed in both structure and function, permits strategic choice in bridging across experimental scales for computational modeling while also suggesting regulatory constraints on developmental and evolutionary "growth spurts" in brain size, as per punctuated equilibrium theories in evolutionary biology.

Prefrontal lesions disrupt oscillatory signatures of spatiotemporal integration in working memory

How does the human brain integrate spatial and temporal information into unified mnemonic representations? Building on classic theories of feature binding, we first define the oscillatory signatures of integrating 'where' and 'when' information in working memory (WM) and then investigate the role of prefrontal cortex (PFC) in spatiotemporal integration. Fourteen individuals with lateral PFC damage and 20 healthy controls completed a visuospatial WM task while electroencephalography (EEG) was recorded. On each trial, two shapes were presented sequentially in a top/bottom spatial orientation. We defined EEG signatures of spatiotemporal integration by comparing the maintenance of two possible where-when configurations: the first shape presented on top and the reverse. Frontal delta-theta (δθ; 2-7 Hz) activity, frontal-posterior δθ functional connectivity, lateral posterior event-related potentials, and mesial posterior alpha phase-to-gamma amplitude coupling dissociated the two configurations in controls. WM performance and frontal and mesial posterior signatures of spatiotemporal integration were diminished in PFC lesion patients, whereas lateral posterior signatures were intact. These findings reveal both PFC-dependent and independent substrates of spatiotemporal integration and link optimal performance to PFC.

A neural correlate of visual feature binding in primate lateral prefrontal cortex

We effortlessly perceive visual objects as unified entities, despite the preferential encoding of their various visual features in separate cortical areas. A 'binding' process is assumed to be required for creating this unified percept, but the underlying neural mechanism and specific brain areas are poorly understood. We investigated 'feature-binding' across two feature dimensions, using a novel stimulus configuration, designed to disambiguate whether a given combination of color and motion direction is perceived as bound or unbound. In the "bound" condition, two behaviorally relevant features (color and motion) belong to the same object, while in the "unbound" condition they belong to different objects. We recorded local field potentials from the lateral prefrontal cortex (lPFC) in macaque monkeys that actively monitored the different stimulus configurations. Our data show a neural representation of visual feature binding especially in the 4-12 Hz frequency band and a transmission of binding information between different lPFC neural subpopulations. This information is linked to the animal's reaction time, suggesting a behavioral relevance of the binding information. Together, our results document the involvement of the prefrontal cortex, targeted by the dorsal and ventral visual streams, in binding visual features from different dimensions, in a process that includes a dynamic modulation of low frequency inter-regional communication.

Neurofeedback Training of Gamma Oscillations in Monkey Primary Visual Cortex

In humans, neurofeedback (NFB) training has been used extensively and successfully to manipulate brain activity. Feedback signals were derived from EEG, fMRI, MEG, and intracranial recordings and modifications were obtained of the BOLD signal, of the power of oscillatory activity in distinct frequency bands and of single unit activity. The purpose of the present study was to examine whether neuronal activity could also be controlled by NFB in early sensory cortices whose activity is thought to be influenced mainly by sensory input rather than volitional control. We trained 2 macaque monkeys to enhance narrow band gamma oscillations in the primary visual cortex by providing them with an acoustic signal that reflected the power of gamma oscillations in a preselected band and rewarding increases of the feedback signal. Oscillations were assessed from local field potentials recorded with chronically implanted microelectrodes. Both monkeys succeeded to raise gamma activity in the absence of visual stimulation in the selected frequency band and at the site from which the NFB signal was derived. This suggests that top-down signals are not confined to just modulate stimulus induced responses but can actually drive or facilitate the gamma generating microcircuits even in a primary sensory area.

Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference

Sensory cortices display a suite of ubiquitous dynamical features, such as ongoing noise variability, transient overshoots and oscillations, that have so far escaped a common, principled theoretical account. We developed a unifying model for these phenomena by training a recurrent excitatory-inhibitory neural circuit model of a visual cortical hypercolumn to perform sampling-based probabilistic inference. The optimized network displayed several key biological properties, including divisive normalization and stimulus-modulated noise variability, inhibition-dominated transients at stimulus onset and strong gamma oscillations. These dynamical features had distinct functional roles in speeding up inferences and made predictions that we confirmed in novel analyses of recordings from awake monkeys. Our results suggest that the basic motifs of cortical dynamics emerge as a consequence of the efficient implementation of the same computational function-fast sampling-based inference-and predict further properties of these motifs that can be tested in future experiments.

Progress in Brain-Compatible Interfaces with Soft Nanomaterials

Neural interfaces facilitating communication between the brain and machines must be compatible with the soft, curvilinear, and elastic tissues of the brain and yet yield enough power to read and write information across a wide range of brain areas through high-throughput recordings or optogenetics. Biocompatible-material engineering has facilitated the development of brain-compatible neural interfaces to support built-in modulation of neural circuits and neurological disorders. Recent developments in brain-compatible neural interfaces that use soft nanomaterials more suitable for complex neural circuit analysis and modulation are reviewed. Preclinical tests of the compatibility and specificity of these interfaces in animal models are also discussed.

Astrocytes modulate sensory-evoked neuronal network activity

While neurons principally mediate brain function, astrocytes are emerging as cells with important neuromodulatory actions in brain physiology. In addition to homeostatic roles, astrocytes respond to neurotransmitters with calcium transients stimulating the release of gliotransmitters that regulate synaptic and neuronal functions. We investigated astrocyte-neuronal network interactions in vivo by combining two-photon microscopy to monitor astrocyte calcium and electrocorticogram to record neuronal network activity in the somatosensory cortex during sensory stimulation. We found astrocytes respond to sensory stimuli in a stimulus-dependent manner. Sensory stimuli elicit a surge of neuronal network activity in the gamma range (30-50 Hz) followed by a delayed astrocyte activity that dampens the steady-state gamma activity. This sensory-evoked gamma activity increase is enhanced in transgenic mice with impaired astrocyte calcium signaling and is decreased by pharmacogenetic stimulation of astrocytes. Therefore, cortical astrocytes respond to sensory inputs and regulate sensory-evoked neuronal network activity maximizing its dynamic range.

Cross-hemispheric gamma synchrony between prefrontal parvalbumin interneurons supports behavioral adaptation during rule shift learning

Organisms must learn new strategies to adapt to changing environments. Activity in different neurons often exhibits synchronization that can dynamically enhance their communication and might create flexible brain states that facilitate changes in behavior. We studied the role of gamma-frequency (~40 Hz) synchrony between prefrontal parvalbumin (PV) interneurons in mice learning multiple new cue-reward associations. Voltage indicators revealed cell-type-specific increases of cross-hemispheric gamma synchrony between PV interneurons when mice received feedback that previously learned associations were no longer valid. Disrupting this synchronization by delivering out-of-phase optogenetic stimulation caused mice to perseverate on outdated associations, an effect not reproduced by in-phase stimulation or out-of-phase stimulation at other frequencies. Gamma synchrony was specifically required when new associations used familiar cues that were previously irrelevant to behavioral outcomes, not when associations involved new cues or for reversing previously learned associations. Thus, gamma synchrony is indispensable for reappraising the behavioral salience of external cues.

Information filtering by coincidence detection of synchronous population output: analytical approaches to the coherence function of a two-stage neural system

Information about time-dependent sensory stimuli is encoded in the activity of neural populations; distinct aspects of the stimulus are read out by different types of neurons: while overall information is perceived by integrator cells, so-called coincidence detector cells are driven mainly by the synchronous activity in the population that encodes predominantly high-frequency content of the input signal (high-pass information filtering). Previously, an analytically accessible statistic called the partial synchronous output was introduced as a proxy for the coincidence detector cell's output in order to approximate its information transmission. In the first part of the current paper, we compare the information filtering properties (specifically, the coherence function) of this proxy to those of a simple coincidence detector neuron. We show that the latter's coherence function can indeed be well-approximated by the partial synchronous output with a time scale and threshold criterion that are related approximately linearly to the membrane time constant and firing threshold of the coincidence detector cell. In the second part of the paper, we propose an alternative theory for the spectral measures (including the coherence) of the coincidence detector cell that combines linear-response theory for shot-noise driven integrate-and-fire neurons with a novel perturbation ansatz for the spectra of spike-trains driven by colored noise. We demonstrate how the variability of the synaptic weights for connections from the population to the coincidence detector can shape the information transmission of the entire two-stage system.

Rhythmic Network Modulation to Thalamocortical Couplings in Epilepsy

Thalamus interacts with cortical areas, generating oscillations characterized by their rhythm and levels of synchrony. However, little is known of what function the rhythmic dynamic may serve in thalamocortical couplings. This work introduced a general approach to investigate the modulatory contribution of rhythmic scalp network to the thalamo-frontal couplings in juvenile myoclonic epilepsy (JME) and frontal lobe epilepsy (FLE). Here, time-varying rhythmic network was constructed using the adapted directed transfer function between EEG electrodes, and then was applied as a modulator in fMRI-based thalamocortical functional couplings. Furthermore, the relationship between corticocortical connectivity and rhythm-dependent thalamocortical coupling was examined. The results revealed thalamocortical couplings modulated by EEG scalp network have frequency-dependent characteristics. Increased thalamus- sensorimotor network (SMN) and thalamus-default mode network (DMN) couplings in JME were strongly modulated by alpha band. These thalamus-SMN couplings demonstrated enhanced association with SMN-related corticocortical connectivity. In addition, altered theta-dependent and beta-dependent thalamus-frontoparietal network (FPN) couplings were found in FLE. The reduced theta-dependent thalamus-FPN couplings were associated with the decreased FPN-related corticocortical connectivity. This study proposed interactive links between the rhythmic modulation and thalamocortical coupling. The crucial role of SMN and FPN in subcortical-cortical circuit may have implications for intervention in generalized and focal epilepsy.

Concepts and Compositionality: In Search of the Brain's Language of Thought

Imagine Genghis Khan, Aretha Franklin, and the Cleveland Cavaliers performing an opera on Maui. This silly sentence makes a serious point: As humans, we can flexibly generate and comprehend an unbounded number of complex ideas. Little is known, however, about how our brains accomplish this. Here we assemble clues from disparate areas of cognitive neuroscience, integrating recent research on language, memory, episodic simulation, and computational models of high-level cognition. Our review is framed by Fodor's classic language of thought hypothesis, according to which our minds employ an amodal, language-like system for combining and recombining simple concepts to form more complex thoughts. Here, we highlight emerging work on combinatorial processes in the brain and consider this work's relation to the language of thought. We review evidence for distinct, but complementary, contributions of map-like representations in subregions of the default mode network and sentence-like representations of conceptual relations in regions of the temporal and prefrontal cortex.

Expanding our horizons: central pattern generation in the context of complex activity sequences

Central pattern generators (CPGs) are central nervous system (CNS) networks that can generate coordinated output in the absence of patterned sensory input. For decades, this concept was applied almost exclusively to simple, innate, rhythmic movements with essentially identical cycles that repeat continually (e.g. respiration) or episodically (e.g. locomotion). But many natural movement sequences are not simple rhythms, as they include different elements in a complex order, and some involve learning. The concepts and experimental approaches of CPG research have also been applied to the neural control of complex movement sequences, such as birdsong, though this is not widely appreciated. Experimental approaches to the investigation of CPG networks, both for simple rhythms and for complex activity sequences, have shown that: (1) brief activation of the CPG elicits a long-lasting naturalistic activity sequence; (2) electrical stimulation of CPG elements alters the timing of subsequent cycles or sequence elements; and (3) warming or cooling CPG elements respectively speeds up or slows down the rhythm or sequence rate. The CPG concept has also been applied to the activity rhythms of populations of mammalian cortical neurons. CPG concepts and methods might further be applied to a variety of fixed action patterns typically used in courtship, rivalry, nest building and prey capture. These complex movements could be generated by CPGs within CPGs (‘nested’ CPGs). Stereotypical, non-motor, non-rhythmic neuronal activity sequences may also be generated by CPGs. My goal here is to highlight previous applications of the CPG concept to complex but stereotypical activity sequences and to suggest additional possible applications, which might provoke new hypotheses and experiments.

Feedforward Thalamocortical Connectivity Preserves Stimulus Timing Information in Sensory Pathways

Reliable timing of cortical spikes in response to visual events is crucial in representing visual inputs to the brain. Spikes in the primary visual cortex (V1) need to occur at the same time within a repeated visual stimulus. Two classical mechanisms are employed by the cortex to enhance reliable timing. First, cortical neurons respond reliably to a restricted set of stimuli through their preference for certain patterns of membrane potential due to their intrinsic properties. Second, intracortical networking of excitatory and inhibitory neurons induces lateral inhibition that, through the timing and strength of IPSCs and EPSCs, produces sparse and reliably timed cortical neuron spike trains to be transmitted downstream. Here, we describe a third mechanism that, through preferential thalamocortical synaptic connectivity, enhances the trial-to-trial timing precision of cortical spikes in the presence of spike train variability within each trial that is introduced between LGN neurons in the retino-thalamic pathway. Applying experimentally recorded LGN spike trains from the anesthetized cat to a detailed model of a spiny stellate V1 neuron, we found that output spike timing precision improved with increasing numbers of convergent LGN inputs. The improvement was consistent with the predicted proportionality of [Formula: see text] for n LGN source neurons. We also found connectivity configurations that maximize reliability and that generate V1 cell output spike trains quantitatively similar to the experimental recordings. Our findings suggest a general principle, namely intra-trial variability among converging inputs, that increases stimulus response precision and is widely applicable to synaptically connected spiking neurons.SIGNIFICANCE STATEMENT The early visual pathway of the cat is favorable for studying the effects of trial-to-trial variability of synaptic inputs and intra-trial variability of thalamocortical connectivity on information transmission into the visual cortex. We have used a detailed model to show that there are preferred combinations of the number of thalamic afferents and the number of synapses per afferent that maximize the output reliability and spike-timing precision of cortical neurons. This provides additional insights into how synchrony in thalamic spike trains can reduce trial-to-trial variability to produce highly reliable reporting of sensory events to the cortex. The same principles may apply to other converging pathways where temporally jittered spike trains can reliably drive the downstream neuron and improve temporal precision.

Persistent Gamma Spiking in SI Nonsensory Fast Spiking Cells Predicts Perceptual Success

Gamma oscillations (30-55 Hz) are hypothesized to temporally coordinate sensory encoding, enabling perception. However, fast spiking interneurons (FS), key gamma generators, can be highly sensory responsive, as is the gamma band local field potential (LFP). How can FS-mediated gamma act as an impartial temporal reference for sensory encoding, when the sensory drive itself presumably perturbs the pre-established rhythm? Combining tetrode recording in SI barrel cortex with controlled psychophysics, we found a unique FS subtype that was not sensory responsive and spiked regularly at gamma range intervals (gamma regular nonsensory FS [grnsFS]). Successful detection was predicted by a further increase in gamma regular spiking of grnsFS, persisting from before to after sensory onset. In contrast, broadband LFP power, including gamma, negatively predicted detection and did not cohere with gamma band spiking by grnsFS. These results suggest that a distinct FS subtype mediates perceptually relevant oscillations, independent of the LFP and sensory drive.

Cellular and Network Mechanisms for Temporal Signal Propagation in a Cortical Network Model

The mechanisms underlying an effective propagation of high intensity information over a background of irregular firing and response latency in cognitive processes remain unclear. Here we propose a SSCCPI circuit to address this issue. We hypothesize that when a high-intensity thalamic input triggers synchronous spike events (SSEs), dense spikes are scattered to many receiving neurons within a cortical column in layer IV, many sparse spike trains are propagated in parallel along minicolumns at a substantially high speed and finally integrated into an output spike train toward or in layer Va. We derive the sufficient conditions for an effective (fast, reliable, and precise) SSCCPI circuit: (i) SSEs are asynchronous (near synchronous); (ii) cortical columns prevent both repeatedly triggering SSEs and incorrectly synaptic connections between adjacent columns; and (iii) the propagator in interneurons is temporally complete fidelity and reliable. We encode the membrane potential responses to stimuli using the non-linear autoregressive integrated process derived by applying Newton's second law to stochastic resilience systems. We introduce a multithreshold decoder to correct encoding errors. Evidence supporting an effective SSCCPI circuit includes that for the condition, (i) time delay enhances SSEs, suggesting that response latency induces SSEs in high-intensity stimuli; irregular firing causes asynchronous SSEs; asynchronous SSEs relate to healthy neurons; and rigorous SSEs relate to brain disorders. For the condition (ii) neurons within a given minicolumn are stereotypically interconnected in the vertical dimension, which prevents repeated triggering SSEs and ensures signal parallel propagation; columnar segregation avoids incorrect synaptic connections between adjacent columns; and signal propagation across layers overwhelmingly prefers columnar direction. For the condition (iii), accumulating experimental evidence supports temporal transfer precision with millisecond fidelity and reliability in interneurons; homeostasis supports a stable fixed-point encoder by regulating changes to synaptic size, synaptic strength, and ion channel function in the membrane; together all-or-none modulation, active backpropagation, additive effects of graded potentials, and response variability functionally support the multithreshold decoder; our simulations demonstrate that the encoder-decoder is temporally complete fidelity and reliable in special intervals contained within the stable fixed-point range. Hence, the SSCCPI circuit provides a possible mechanism of effective signal propagation in cortical networks.

Robust computation with rhythmic spike patterns

This work makes 2 contributions. First, we present a neural network model of associative memory that stores and retrieves sparse patterns of complex variables. This network can store analog information as fixed-point attractors in the complex domain; it is governed by an energy function and has increased memory capacity compared to early models. Second, we translate complex attractor networks into spiking networks, where the timing of the spike indicates the phase of a complex number. We show that complex fixed points correspond to stable periodic spike patterns. It is demonstrated that such networks can be constructed with resonate-and-fire or integrate-and-fire neurons with biologically plausible mechanisms and be used for robust computations, such as image retrieval.

Information coding by precise timing of spikes can be faster and more energy efficient than traditional rate coding. However, spike-timing codes are often brittle, which has limited their use in theoretical neuroscience and computing applications. Here, we propose a type of attractor neural network in complex state space and show how it can be leveraged to construct spiking neural networks with robust computational properties through a phase-to-timing mapping. Building on Hebbian neural associative memories, like Hopfield networks, we first propose threshold phasor associative memory (TPAM) networks. Complex phasor patterns whose components can assume continuous-valued phase angles and binary magnitudes can be stored and retrieved as stable fixed points in the network dynamics. TPAM achieves high memory capacity when storing sparse phasor patterns, and we derive the energy function that governs its fixed-point attractor dynamics. Second, we construct 2 spiking neural networks to approximate the complex algebraic computations in TPAM, a reductionist model with resonate-and-fire neurons and a biologically plausible network of integrate-and-fire neurons with synaptic delays and recurrently connected inhibitory interneurons. The fixed points of TPAM correspond to stable periodic states of precisely timed spiking activity that are robust to perturbation. The link established between rhythmic firing patterns and complex attractor dynamics has implications for the interpretation of spike patterns seen in neuroscience and can serve as a framework for computation in emerging neuromorphic devices.

Neural dynamics of spreading attentional labels in mental contour tracing

Behavioral and neural data suggest that visual attention spreads along contour segments to bind them into a unified object representation. Such attentional labeling segregates the target contour from distractors in a process known as mental contour tracing. A recurrent competitive map is developed to simulate the dynamics of mental contour tracing. In the model, local excitation opposes global inhibition and enables enhanced activity to propagate on the path offered by the contour. The extent of local excitatory interactions is modulated by the output of the multi-scale contour detection network, which constrains the speed of activity spreading in a scale-dependent manner. Furthermore, an L-junction detection network enables tracing to switch direction at the L-junctions, but not at the X- or T-junctions, thereby preventing spillover to a distractor contour. Computer simulations reveal that the model exhibits a monotonic increase in tracing time as a function of the distance to be traced. Also, the speed of tracing increases with decreasing proximity to the distractor contour and with the reduced curvature of the contours. The proposed model demonstrated how an elaborated version of the winner-takes-all network can implement a complex cognitive operation such as contour tracing.