Spike-Phase Coding Boosts and Stabilizes Information Carried by Spatial and Temporal Spike Patterns

EEG phase patterns reflect the representation of semantic categories of objects

Oscillations of electroencephalographic signals represent the cognitive processes arose from the behavioral task and sensory representations across the mental state activity. Previous studies have shown the relation between event-related EEG and sensory-cognitive representation and revealed that categorization of presented object can be successfully recognized using recorded EEG signals when subjects view objects. Here, EEG signals in conjunction with a multivariate pattern recognition technique were used for investigating the possibility to identify conceptual representation based on the presentation of 12 semantic categories of objects (5 exemplars per category). Using multivariate stimulus decoding methods, surprisingly, we demonstrate that how objects are discriminated from phase pattern of EEG signals across the time in low-frequency band (1-4 Hz), but not from power of oscillatory brain signals in the same frequency band. In contrast, discrimination accuracy from the power of EEG signals has significantly higher than the performance from phase of EEG signal in the high-frequency band (20-30 Hz). Moreover, our results indicate that how the accuracy of prediction changes between various areas of brain continuously across the time. In particular, we find that, during the object categorization task, the inter-trial phase coherence in low-frequency band is significantly higher than other frequency in various regions of interests. This measure is associated with decoding pattern across the time. These results suggest that the mechanism underlying conceptual representation can be mediated by the phase of oscillatory neural activity.

Shifts of Gamma Phase across Primary Visual Cortical Sites Reflect Dynamic Stimulus-Modulated Information Transfer

Distributed neural processing likely entails the capability of networks to reconfigure dynamically the directionality and strength of their functional connections. Yet, the neural mechanisms that may allow such dynamic routing of the information flow are not yet fully understood. We investigated the role of gamma band (50-80 Hz) oscillations in transient modulations of communication among neural populations by using measures of direction-specific causal information transfer. We found that the local phase of gamma-band rhythmic activity exerted a stimulus-modulated and spatially-asymmetric directed effect on the firing rate of spatially separated populations within the primary visual cortex. The relationships between gamma phases at different sites (phase shifts) could be described as a stimulus-modulated gamma-band wave propagating along the spatial directions with the largest information transfer. We observed transient stimulus-related changes in the spatial configuration of phases (compatible with changes in direction of gamma wave propagation) accompanied by a relative increase of the amount of information flowing along the instantaneous direction of the gamma wave. These effects were specific to the gamma-band and suggest that the time-varying relationships between gamma phases at different locations mark, and possibly causally mediate, the dynamic reconfiguration of functional connections.

Phase-amplitude coupling supports phase coding in human ECoG

Prior studies have shown that high-frequency activity (HFA) is modulated by the phase of low-frequency activity. This phenomenon of phase-amplitude coupling (PAC) is often interpreted as reflecting phase coding of neural representations, although evidence for this link is still lacking in humans. Here, we show that PAC indeed supports phase-dependent stimulus representations for categories. Six patients with medication-resistant epilepsy viewed images of faces, tools, houses, and scenes during simultaneous acquisition of intracranial recordings. Analyzing 167 electrodes, we observed PAC at 43% of electrodes. Further inspection of PAC revealed that category specific HFA modulations occurred at different phases and frequencies of the underlying low-frequency rhythm, permitting decoding of categorical information using the phase at which HFA events occurred. These results provide evidence for categorical phase-coded neural representations and are the first to show that PAC coincides with phase-dependent coding in the human brain.

Phase-locking of bursting neuronal firing to dominant LFP frequency components

Neuronal firing in the hippocampal formation relative to the phase of local field potentials (LFP) has a key role in memory processing and spatial navigation. Firing can be in either tonic or burst mode. Although bursting neurons are common in the hippocampal formation, the characteristics of their locking to LFP phase are not completely understood. We investigated phase-locking properties of bursting neurons using simulations generated by a dual compartmental model of a pyramidal neuron adapted to match the bursting activity in the subiculum of a rat. The model was driven with stochastic input signals containing a power spectral profile consistent with physiologically relevant frequencies observed in LFP. The single spikes and spike bursts fired by the model were locked to a preferred phase of the predominant frequency band where there was a peak in the power of the driving signal. Moreover, the preferred phase of locking shifted with increasing burst size, providing evidence that LFP phase can be encoded by burst size. We also provide initial support for the model results by analysing example data of spontaneous LFP and spiking activity recorded from the subiculum of a single urethane-anaesthetised rat. Subicular neurons fired single spikes, two-spike bursts and larger bursts that locked to a preferred phase of either dominant slow oscillations or theta rhythms within the LFP, according to the model prediction. Both power-modulated phase-locking and gradual shift in the preferred phase of locking as a function of burst size suggest that neurons can use bursts to encode timing information contained in LFP phase into a spike-count code.

Rhythmic auditory cortex activity at multiple timescales shapes stimulus-response gain and background firing

The phase of low-frequency network activity in the auditory cortex captures changes in neural excitability, entrains to the temporal structure of natural sounds, and correlates with the perceptual performance in acoustic tasks. Although these observations suggest a causal link between network rhythms and perception, it remains unknown how precisely they affect the processes by which neural populations encode sounds. We addressed this question by analyzing neural responses in the auditory cortex of anesthetized rats using stimulus-response models. These models included a parametric dependence on the phase of local field potential rhythms in both stimulus-unrelated background activity and the stimulus-response transfer function. We found that phase-dependent models better reproduced the observed responses than static models, during both stimulation with a series of natural sounds and epochs of silence. This was attributable to two factors: (1) phase-dependent variations in background firing (most prominent for delta; 1-4 Hz); and (2) modulations of response gain that rhythmically amplify and attenuate the responses at specific phases of the rhythm (prominent for frequencies between 2 and 12 Hz). These results provide a quantitative characterization of how slow auditory cortical rhythms shape sound encoding and suggest a differential contribution of network activity at different timescales. In addition, they highlight a putative mechanism that may implement the selective amplification of appropriately timed sound tokens relative to the phase of rhythmic auditory cortex activity.

Oscillatory dynamics coordinating human frontal networks in support of goal maintenance

Humans have a capacity for hierarchical cognitive control—the ability to simultaneously control immediate actions while holding more abstract goals in mind. Neuropsychological and neuroimaging evidence suggests that hierarchical cognitive control emerges from a frontal architecture whereby prefrontal cortex coordinates neural activity in the motor cortices when abstract rules are needed to govern motor outcomes. Here we utilize the improved temporal resolution of human intracranial electrocorticography to investigate the mechanisms by which frontal cortical oscillatory networks communicate in support of hierarchical cognitive control. Responding according to progressively more abstract rules results in greater frontal network theta phase encoding (4-8 Hz) and increased prefrontal local neuronal population activity (high gamma amplitude, 80-150 Hz), which predicts trial-by-trial response times. Theta phase encoding couples with high gamma amplitude during interregional information encoding, suggesting that interregional phase encoding is a mechanism for the dynamic instantiation of complex cognitive functions by frontal cortical subnetworks.

Listening to another sense: somatosensory integration in the auditory system

Conventionally, sensory systems are viewed as separate entities, each with its own physiological process serving a different purpose. However, many functions require integrative inputs from multiple sensory systems and sensory intersection and convergence occur throughout the central nervous system. The neural processes for hearing perception undergo significant modulation by the two other major sensory systems, vision and somatosensation. This synthesis occurs at every level of the ascending auditory pathway: the cochlear nucleus, inferior colliculus, medial geniculate body and the auditory cortex. In this review, we explore the process of multisensory integration from (1) anatomical (inputs and connections), (2) physiological (cellular responses), (3) functional and (4) pathological aspects. We focus on the convergence between auditory and somatosensory inputs in each ascending auditory station. This review highlights the intricacy of sensory processing and offers a multisensory perspective regarding the understanding of sensory disorders.

Contribution of LFP dynamics to single-neuron spiking variability in motor cortex during movement execution

Understanding the sources of variability in single-neuron spiking responses is an important open problem for the theory of neural coding. This variability is thought to result primarily from spontaneous collective dynamics in neuronal networks. Here, we investigate how well collective dynamics reflected in motor cortex local field potentials (LFPs) can account for spiking variability during motor behavior. Neural activity was recorded via microelectrode arrays implanted in ventral and dorsal premotor and primary motor cortices of non-human primates performing naturalistic 3-D reaching and grasping actions. Point process models were used to quantify how well LFP features accounted for spiking variability not explained by the measured 3-D reach and grasp kinematics. LFP features included the instantaneous magnitude, phase and analytic-signal components of narrow band-pass filtered (δ,θ,α,β) LFPs, and analytic signal and amplitude envelope features in higher-frequency bands. Multiband LFP features predicted single-neuron spiking (1ms resolution) with substantial accuracy as assessed via ROC analysis. Notably, however, models including both LFP and kinematics features displayed marginal improvement over kinematics-only models. Furthermore, the small predictive information added by LFP features to kinematic models was redundant to information available in fast-timescale (<100 ms) spiking history. Overall, information in multiband LFP features, although predictive of single-neuron spiking during movement execution, was redundant to information available in movement parameters and spiking history. Our findings suggest that, during movement execution, collective dynamics reflected in motor cortex LFPs primarily relate to sensorimotor processes directly controlling movement output, adding little explanatory power to variability not accounted by movement parameters.

Competitive STDP Learning of Overlapping Spatial Patterns

Spike-timing-dependent plasticity (STDP) is a set of Hebbian learning rules firmly based on biological evidence. It has been demonstrated that one of the STDP learning rules is suited for learning spatiotemporal patterns. When multiple neurons are organized in a simple competitive spiking neural network, this network is capable of learning multiple distinct patterns. If patterns overlap significantly (i.e., patterns are mutually inclusive), however, competition would not preclude trained neuron's responding to a new pattern and adjusting synaptic weights accordingly. This letter presents a simple neural network that combines vertical inhibition and Euclidean distance-dependent synaptic strength factor. This approach helps to solve the problem of pattern size-dependent parameter optimality and significantly reduces the probability of a neuron's forgetting an already learned pattern. For demonstration purposes, the network was trained for the first ten letters of the Braille alphabet.

Brain rhythms connect impaired inhibition to altered cognition in schizophrenia

In recent years, schizophrenia research has focused on inhibitory interneuron dysfunction at the level of neurobiology and on cognitive impairments at the psychological level. Reviewing both experimental and computational findings, we show how the temporal structure of the activity of neuronal populations, exemplified by brain rhythms, can begin to bridge these levels of complexity. Oscillations in neuronal activity tie the pathophysiology of schizophrenia to alterations in local processing and large-scale coordination, and these alterations in turn can lead to the cognitive and perceptual disturbances observed in schizophrenia.

Speech encoding by coupled cortical theta and gamma oscillations

Many environmental stimuli present a quasi-rhythmic structure at different timescales that the brain needs to decompose and integrate. Cortical oscillations have been proposed as instruments of sensory de-multiplexing, i.e., the parallel processing of different frequency streams in sensory signals. Yet their causal role in such a process has never been demonstrated. Here, we used a neural microcircuit model to address whether coupled theta–gamma oscillations, as observed in human auditory cortex, could underpin the multiscale sensory analysis of speech. We show that, in continuous speech, theta oscillations can flexibly track the syllabic rhythm and temporally organize the phoneme-level response of gamma neurons into a code that enables syllable identification. The tracking of slow speech fluctuations by theta oscillations, and its coupling to gamma-spiking activity both appeared as critical features for accurate speech encoding. These results demonstrate that cortical oscillations can be a key instrument of speech de-multiplexing, parsing, and encoding.

DOI:http://dx.doi.org/10.7554/eLife.06213.001

Some people speak twice as fast as others, while people with different accents pronounce the same words in different ways. However, despite these differences between speakers, humans can usually follow spoken language with remarkable ease.

The different elements of speech have different frequencies: the typical frequency for syllables, for example, is about four syllables per second in speech. Phonemes, which are the smallest elements of speech, appear at a higher frequency. However, these elements are all transmitted at the same time, so the brain needs to be able to process them simultaneously.

The auditory cortex, the part of the brain that processes sound, produces various ‘waves’ of electrical activity, and these waves also have a characteristic frequency (which is the number of bursts of neural activity per second). One type of brain wave, called the theta rhythm, has a frequency of three to eight bursts per second, which is similar to the typical frequency of syllables in speech, and the frequency of another brain wave, the gamma rhythm, is similar to the frequency of phonemes. It has been suggested that these two brain waves may have a central role in our ability to follow speech, but to date there has been no direct evidence to support this theory.

Hyafil et al. have now used computer models of neural oscillations to explore this theory. Their simulations show that, as predicted, the theta rhythm tracks the syllables in spoken language, while the gamma rhythm encodes the specific features of each phoneme. Moreover, the two rhythms work together to establish the sequence of phonemes that makes up each syllable. These findings will support the development of improved speech recognition technologies.

DOI:http://dx.doi.org/10.7554/eLife.06213.002

Decoding speech perception from single cell activity in humans

Deciphering the content of continuous speech is a challenging task performed daily by the human brain. Here, we tested whether activity of single cells in auditory cortex could be used to support such a task. We recorded neural activity from auditory cortex of two neurosurgical patients while presented with a short video segment containing speech. Population spiking activity (~20 cells per patient) allowed detection of word onset and decoding the identity of perceived words with significantly high accuracy levels. Oscillation phase of local field potentials (8-12Hz) also allowed decoding word identity although with lower accuracy levels. Our results provide evidence that the spiking activity of a relatively small population of cells in human primary auditory cortex contains significant information for classification of words in ongoing speech. Given previous evidence for overlapping neural representation during speech perception and production, this may have implications for developing brain-machine interfaces for patients with deficits in speech production.

State-dependent population coding in primary auditory cortex

Sensory function is mediated by interactions between external stimuli and intrinsic cortical dynamics that are evident in the modulation of evoked responses by cortical state. A number of recent studies across different modalities have demonstrated that the patterns of activity in neuronal populations can vary strongly between synchronized and desynchronized cortical states, i.e., in the presence or absence of intrinsically generated up and down states. Here we investigated the impact of cortical state on the population coding of tones and speech in the primary auditory cortex (A1) of gerbils, and found that responses were qualitatively different in synchronized and desynchronized cortical states. Activity in synchronized A1 was only weakly modulated by sensory input, and the spike patterns evoked by tones and speech were unreliable and constrained to a small range of patterns. In contrast, responses to tones and speech in desynchronized A1 were temporally precise and reliable across trials, and different speech tokens evoked diverse spike patterns with extremely weak noise correlations, allowing responses to be decoded with nearly perfect accuracy. Restricting the analysis of synchronized A1 to activity within up states yielded similar results, suggesting that up states are not equivalent to brief periods of desynchronization. These findings demonstrate that the representational capacity of A1 depends strongly on cortical state, and suggest that cortical state should be considered as an explicit variable in all studies of sensory processing.

HCN channels enhance spike phase coherence and regulate the phase of spikes and LFPs in the theta-frequency range

What are the implications for the existence of subthreshold ion channels, their localization profiles, and plasticity on local field potentials (LFPs)? Here, we assessed the role of hyperpolarization-activated cyclic-nucleotide-gated (HCN) channels in altering hippocampal theta-frequency LFPs and the associated spike phase. We presented spatiotemporally randomized, balanced theta-modulated excitatory and inhibitory inputs to somatically aligned, morphologically realistic pyramidal neuron models spread across a cylindrical neuropil. We computed LFPs from seven electrode sites and found that the insertion of an experimentally constrained HCN-conductance gradient into these neurons introduced a location-dependent lead in the LFP phase without significantly altering its amplitude. Further, neurons fired action potentials at a specific theta phase of the LFP, and the insertion of HCN channels introduced large lags in this spike phase and a striking enhancement in neuronal spike-phase coherence. Importantly, graded changes in either HCN conductance or its half-maximal activation voltage resulted in graded changes in LFP and spike phases. Our conclusions on the impact of HCN channels on LFPs and spike phase were invariant to changes in neuropil size, to morphological heterogeneity, to excitatory or inhibitory synaptic scaling, and to shifts in the onset phase of inhibitory inputs. Finally, we selectively abolished the inductive lead in the impedance phase introduced by HCN channels without altering neuronal excitability and found that this inductive phase lead contributed significantly to changes in LFP and spike phase. Our results uncover specific roles for HCN channels and their plasticity in phase-coding schemas and in the formation and dynamic reconfiguration of neuronal cell assemblies.

Predictive motor control of sensory dynamics in auditory active sensing

Neuronal oscillations present potential physiological substrates for brain operations that require temporal prediction. We review this idea in the context of auditory perception. Using speech as an exemplar, we illustrate how hierarchically organized oscillations can be used to parse and encode complex input streams. We then consider the motor system as a major source of rhythms (temporal priors) in auditory processing, that act in concert with attention to sharpen sensory representations and link them across areas. We discuss the circuits that could mediate this audio-motor interaction, notably the potential role of the somatosensory system. Finally, we reposition temporal predictions in the context of internal models, discussing how they interact with feature-based or spatial predictions. We argue that complementary predictions interact synergistically according to the organizational principles of each sensory system, forming multidimensional filters crucial to perception.

Improved discriminability of spatiotemporal neural patterns in rat motor cortical areas as directional choice learning progresses

Animals learn to choose a proper action among alternatives to improve their odds of success in food foraging and other activities critical for survival. Through trial-and-error, they learn correct associations between their choices and external stimuli. While a neural network that underlies such learning process has been identified at a high level, it is still unclear how individual neurons and a neural ensemble adapt as learning progresses. In this study, we monitored the activity of single units in the rat medial and lateral agranular (AGm and AGl, respectively) areas as rats learned to make a left or right side lever press in response to a left or right side light cue. We noticed that rat movement parameters during the performance of the directional choice task quickly became stereotyped during the first 2–3 days or sessions. But learning the directional choice problem took weeks to occur. Accompanying rats' behavioral performance adaptation, we observed neural modulation by directional choice in recorded single units. Our analysis shows that ensemble mean firing rates in the cue-on period did not change significantly as learning progressed, and the ensemble mean rate difference between left and right side choices did not show a clear trend of change either. However, the spatiotemporal firing patterns of the neural ensemble exhibited improved discriminability between the two directional choices through learning. These results suggest a spatiotemporal neural coding scheme in a motor cortical neural ensemble that may be responsible for and contributing to learning the directional choice task.

Neural population coding: combining insights from microscopic and mass signals

Behavior relies on the distributed and coordinated activity of neural populations. Population activity can be measured using multi-neuron recordings and neuroimaging. Neural recordings reveal how the heterogeneity, sparseness, timing, and correlation of population activity shape information processing in local networks, whereas neuroimaging shows how long-range coupling and brain states impact on local activity and perception. To obtain an integrated perspective on neural information processing we need to combine knowledge from both levels of investigation. We review recent progress of how neural recordings, neuroimaging, and computational approaches begin to elucidate how interactions between local neural population activity and large-scale dynamics shape the structure and coding capacity of local information representations, make them state-dependent, and control distributed populations that collectively shape behavior.

Incoordination between spikes and LFPs in Aβ1-42-mediated memory deficits in rats

Alzheimer's disease (AD) is a neurodegenerative disease that gradually induces cognitive deficits. Impairments of working memory have been typically observed in AD. It is well known that spikes and local field potentials (LFPs) as well as the coordination between them encode information in normal brain function. However, the abnormal coordination between spikes and LFPs in the cognitive deficits of AD has remained largely unexplored. As amyloid-β peptide (Aβ) is a causative factor for the cognitive impairments of AD, developing a mechanistic understanding of the contribution of Aβ to cognitive impairments may yield important insights into the pathophysiology of AD. In the present study, we simultaneously recorded spikes and LFPs from multiple electrodes implanted in the prefrontal cortex of rats (control and intra-hippocampal Aβ injection group) that performed a Y-maze working memory task. The information changes in spikes and LFPs during the task were assessed by calculation of entropy. Then the coordination between spikes and LFPs was estimated by the correlation of LFP entropy and spike entropy. Compared with the control group, the Aβ group showed significantly weaker coordination between spikes and LFPs. Our results indicate that the incoordination between spikes and LFPs may provide a potential mechanism for the cognitive deficits in working memory of AD.

Encoding of fear learning and memory in distributed neuronal circuits

How sensory information is transformed by learning into adaptive behaviors is a fundamental question in neuroscience. Studies of auditory fear conditioning have revealed much about the formation and expression of emotional memories and have provided important insights into this question. Classical work focused on the amygdala as a central structure for fear conditioning. Recent advances, however, have identified new circuits and neural coding strategies mediating fear learning and the expression of fear behaviors. One area of research has identified key brain regions and neuronal coding mechanisms that regulate the formation, specificity and strength of fear memories. Other work has discovered critical circuits and neuronal dynamics by which fear memories are expressed through a medial prefrontal cortex pathway and coordinated activity across interconnected brain regions. Here we review these recent advances alongside prior work to provide a working model of the extended circuits and neuronal coding mechanisms mediating fear learning and memory.

Extracting information in spike time patterns with wavelets and information theory

We present a new method to assess the information carried by temporal patterns in spike trains. The method first performs a wavelet decomposition of the spike trains, then uses Shannon information to select a subset of coefficients carrying information, and finally assesses timing information in terms of decoding performance: the ability to identify the presented stimuli from spike train patterns. We show that the method allows: 1) a robust assessment of the information carried by spike time patterns even when this is distributed across multiple time scales and time points; 2) an effective denoising of the raster plots that improves the estimate of stimulus tuning of spike trains; and 3) an assessment of the information carried by temporally coordinated spikes across neurons. Using simulated data, we demonstrate that the Wavelet-Information (WI) method performs better and is more robust to spike time-jitter, background noise, and sample size than well-established approaches, such as principal component analysis, direct estimates of information from digitized spike trains, or a metric-based method. Furthermore, when applied to real spike trains from monkey auditory cortex and from rat barrel cortex, the WI method allows extracting larger amounts of spike timing information. Importantly, the fact that the WI method incorporates multiple time scales makes it robust to the choice of partly arbitrary parameters such as temporal resolution, response window length, number of response features considered, and the number of available trials. These results highlight the potential of the proposed method for accurate and objective assessments of how spike timing encodes information.

Alpha- and beta-band oscillations subserve different processes in reactive control of limb movements

The capacity to rapidly suppress a behavioral act in response to sudden instruction to stop is a key cognitive function. This function, called reactive control, is tested in experimental settings using the stop signal task, which requires subjects to generate a movement in response to a go signal or suppress it when a stop signal appears. The ability to inhibit this movement fluctuates over time: sometimes, subjects can stop their response, and at other times, they can not. To determine the neural basis of this fluctuation, we recorded local field potentials (LFPs) in the alpha (6–12 Hz) and beta (13–35 Hz) bands from the dorsal premotor cortex of two nonhuman primates that were performing the task. The ability to countermand a movement after a stop signal was predicted by the activity of both bands, each purportedly representing a distinct neural process. The beta band represents the level of movement preparation; higher beta power corresponds to a lower level of movement preparation, whereas the alpha band supports a proper phasic, reactive inhibitory response: movements are inhibited when alpha band power increases immediately after a stop signal. Our findings support the function of LFP bands in generating the signatures of various neural computations that are multiplexed in the brain.

Understanding Neural Population Coding: Information Theoretic Insights from the Auditory System

In recent years, our research in computational neuroscience has focused on understanding how populations of neurons encode naturalistic stimuli. In particular, we focused on how populations of neurons use the time domain to encode sensory information. In this focused review, we summarize this recent work from our laboratory. We focus in particular on the mathematical methods that we developed for the quantification of how information is encoded by populations of neurons and on how we used these methods to investigate the encoding of complex naturalistic sounds in auditory cortex. We review how these methods revealed a complementary role of low frequency oscillations and millisecond precise spike patterns in encoding complex sounds and in making these representations robust to imprecise knowledge about the timing of the external stimulus. Further, we discuss challenges in extending this work to understand how large populations of neurons encode sensory information. Overall, this previous work provides analytical tools and conceptual understanding necessary to study the principles of how neural populations reflect sensory inputs and achieve a stable representation despite many uncertainties in the environment.

Information theoretic analysis of proprioceptive encoding during finger flexion in the monkey sensorimotor system

There is considerable debate over whether the brain codes information using neural firing rate or the fine-grained structure of spike timing. We investigated this issue in spike discharge recorded from single units in the sensorimotor cortex, deep cerebellar nuclei, and dorsal root ganglia in macaque monkeys trained to perform a finger flexion task. The task required flexion to four different displacements against two opposing torques; the eight possible conditions were randomly interleaved. We used information theory to assess coding of task condition in spike rate, discharge irregularity, and spectral power in the 15- to 25-Hz band during the period of steady holding. All three measures coded task information in all areas tested. Information coding was most often independent between irregularity and 15-25 Hz power (60% of units), moderately redundant between spike rate and irregularity (56% of units redundant), and highly redundant between spike rate and power (93%). Most simultaneously recorded unit pairs coded using the same measure independently (86%). Knowledge of two measures often provided extra information about task, compared with knowledge of only one alone. We conclude that sensorimotor systems use both rate and temporal codes to represent information about a finger movement task. As well as offering insights into neural coding, this work suggests that incorporating spike irregularity into algorithms used for brain-machine interfaces could improve decoding accuracy.

Entrained neural oscillations in multiple frequency bands comodulate behavior

Our sensory environment is teeming with complex rhythmic structure, to which neural oscillations can become synchronized. Neural synchronization to environmental rhythms (entrainment) is hypothesized to shape human perception, as rhythmic structure acts to temporally organize cortical excitability. In the current human electroencephalography study, we investigated how behavior is influenced by neural oscillatory dynamics when the rhythmic fluctuations in the sensory environment take on a naturalistic degree of complexity. Listeners detected near-threshold gaps in auditory stimuli that were simultaneously modulated in frequency (frequency modulation, 3.1 Hz) and amplitude (amplitude modulation, 5.075 Hz); modulation rates and types were chosen to mimic the complex rhythmic structure of natural speech. Neural oscillations were entrained by both the frequency modulation and amplitude modulation in the stimulation. Critically, listeners' target-detection accuracy depended on the specific phase-phase relationship between entrained neural oscillations in both the 3.1-Hz and 5.075-Hz frequency bands, with the best performance occurring when the respective troughs in both neural oscillations coincided. Neural-phase effects were specific to the frequency bands entrained by the rhythmic stimulation. Moreover, the degree of behavioral comodulation by neural phase in both frequency bands exceeded the degree of behavioral modulation by either frequency band alone. Our results elucidate how fluctuating excitability, within and across multiple entrained frequency bands, shapes the effective neural processing of environmental stimuli. More generally, the frequency-specific nature of behavioral comodulation effects suggests that environmental rhythms act to reduce the complexity of high-dimensional neural states.

Spatial computation with gamma oscillations

Gamma oscillations in cortex have been extensively studied with relation to behavior in both humans and animal models; however, their computational role in the processing of behaviorally relevant signals is still not clear. One oft-overlooked characteristic of gamma oscillations is their spatial distribution over the cortical space and the computational consequences of such an organization. Here, we advance the proposal that the spatial organization of gamma oscillations is of major importance for their function. The interaction of specific spatial distributions of oscillations with the functional topography of cortex enables select amplification of neuronal signals, which supports perceptual and cognitive processing.

The temporal window of individuation limits visual capacity

One of the main tasks of vision is to individuate and recognize specific objects. Unlike the detection of basic features, object individuation is strictly limited in capacity. Previous studies of capacity, in terms of subitizing ranges or visual working memory, have emphasized spatial limits in the number of objects that can be apprehended simultaneously. Here, we present psychophysical and electrophysiological evidence that capacity limits depend instead on time. Contrary to what is commonly assumed, subitizing, the reading-out a small set of individual objects, is not an instantaneous process. Instead, individuation capacity increases in steps within the lifetime of visual persistence of the stimulus, suggesting that visual capacity limitations arise as a result of the narrow window of feedforward processing. We characterize this temporal window as coordinating individuation and integration of sensory information over a brief interval of around 100 ms. Neural signatures of integration windows are revealed in reset alpha oscillations shortly after stimulus onset within generators in parietal areas. Our findings suggest that short-lived alpha phase synchronization (≈1 cycle) is key for individuation and integration of visual transients on rapid time scales (<100 ms). Within this time frame intermediate-level vision provides an equilibrium between the competing needs to individuate invariant objects, integrate information about those objects over time, and remain sensitive to dynamic changes in sensory input. We discuss theoretical and practical implications of temporal windows in visual processing, how they create a fundamental capacity limit, and their role in constraining the real-time dynamics of visual processing.

Local field potentials in the gustatory cortex carry taste information

It has been recently shown that local field potentials (LFPs) from the auditory and visual cortices carry information about sensory stimuli, but whether this is a universal property of sensory cortices remains to be determined. Moreover, little is known about the temporal dynamics of sensory information contained in LFPs following stimulus onset. Here we investigated the time course of the amount of stimulus information in LFPs and spikes from the gustatory cortex of awake rats subjected to tastants and water delivery on the tongue. We found that the phase and amplitude of multiple LFP frequencies carry information about stimuli, which have specific time courses after stimulus delivery. The information carried by LFP phase and amplitude was independent within frequency bands, since the joint information exhibited neither synergy nor redundancy. Tastant information in LFPs was also independent and had a different time course from the information carried by spikes. These findings support the hypothesis that the brain uses different frequency channels to dynamically code for multiple features of a stimulus.

More than spikes: common oscillatory mechanisms for content specific neural representations during perception and memory

Although previous research into the mechanisms underlying sensory and episodic representations has primarily focused on changes in neural firing rate, more recent evidence suggests that neural oscillations also contribute to these representations. Here, we argue that multiplexed oscillatory power and phase contribute to neural representations at the mesoscopic scale, complementary to neuronal firing. Reviewing recent studies which used oscillatory activity to decipher content-specific neural representations, we identify oscillatory mechanisms common to both sensory and episodic memory representations and incorporate these into a model of episodic encoding and retrieval. This model advances the idea that oscillations provide a reference frame for phase-coded item representations during memory encoding and that shifts in oscillatory frequency and phase coordinate ensemble activity during memory retrieval.

Spatial consistency of neural firing regulates long-range local field potential synchronization: a computational study

Local field potentials (LFPs) are thought to integrate neuronal processes within the range of a few millimeters of radius, which corresponds to the scale of multiple columns. In this study, the model of LFP in the visual cortex proposed by Mazzoni et al. (2008) was adapted to organize a network of two cortical areas, in which pyramidal neurons were divided into two sub-population modeling columns with spatially organized connections to neurons in other areas. Using the model enabled the relationship between neural firing and LFP to be evaluated, in addition to the LFP coherence between the two areas. Results showed that: (1) neurons in a particular sub-population generated the LFP in the area; (2) the spatial consistency of neural firing in the two areas was strongly correlated with LFP coherence; and (3) this consistency was capable of regulating LFP coherence in a lower frequency band, which was originally introduced to neurons in a particular sub-population. These results were derived from a winner-take-all operation in the columnar structure; thus, they are expected to be common in the cortex. It is suggested that the spatial consistency of neural firing is essential for regulating long-range LFP synchronization, which would facilitate neuronal integration processes over multiple cortical areas.

Movement dependence and layer specificity of entorhinal phase precession in two-dimensional environments

As a rat moves, grid cells in its entorhinal cortex (EC) discharge at multiple locations of the external world, and the firing fields of each grid cell span a hexagonal lattice. For movements on linear tracks, spikes tend to occur at successively earlier phases of the theta-band filtered local field potential during the traversal of a firing field - a phenomenon termed phase precession. The complex movement patterns observed in two-dimensional (2D) open-field environments may fundamentally alter phase precession. To study this question at the behaviorally relevant single-run level, we analyzed EC spike patterns as a function of the distance traveled by the rat along each trajectory. This analysis revealed that cells across all EC layers fire spikes that phase-precess; indeed, the rate and extent of phase precession were the same, only the correlation between spike phase and path length was weaker in EC layer III. Both slope and correlation of phase precession were surprisingly similar on linear tracks and in 2D open-field environments despite strong differences in the movement statistics, including running speed. While the phase-precession slope did not correlate with the average running speed, it did depend on specific properties of the animal's path. The longer a curving path through a grid-field in a 2D environment, the shallower was the rate of phase precession, while runs that grazed a grid field tangentially led to a steeper phase-precession slope than runs through the field center. Oscillatory interference models for grid cells do not reproduce the observed phenomena.

Functions of gamma-band synchronization in cognition: from single circuits to functional diversity across cortical and subcortical systems

Gamma-band activity (30-90 Hz) and the synchronization of neural activity in the gamma-frequency range have been observed in different cortical and subcortical structures and have been associated with different cognitive functions. However, it is still unknown whether gamma-band synchronization subserves a single universal function or a diversity of functions across the full spectrum of cognitive processes. Here, we address this question reviewing the mechanisms of gamma-band oscillation generation and the functions associated with gamma-band activity across several cortical and subcortical structures. Additionally, we raise a plausible explanation of why gamma rhythms are found so ubiquitously across brain structures. Gamma band activity originates from the interplay between inhibition and excitation. We stress that gamma oscillations, associated with this interplay, originate from basic functional motifs that conferred advantages for low-level system processing and multiple cognitive functions throughout evolution. We illustrate the multifunctionality of gamma-band activity by considering its role in neural systems for perception, selective attention, memory, motivation and behavioral control. We conclude that gamma-band oscillations support multiple cognitive processes, rather than a single one, which, however, can be traced back to a limited set of circuit motifs which are found universally across species and brain structures.

Learning precisely timed spikes

To signal the onset of salient sensory features or execute well-timed motor sequences, neuronal circuits must transform streams of incoming spike trains into precisely timed firing. To address the efficiency and fidelity with which neurons can perform such computations, we developed a theory to characterize the capacity of feedforward networks to generate desired spike sequences. We find the maximum number of desired output spikes a neuron can implement to be 0.1-0.3 per synapse. We further present a biologically plausible learning rule that allows feedforward and recurrent networks to learn multiple mappings between inputs and desired spike sequences. We apply this framework to reconstruct synaptic weights from spiking activity and study the precision with which the temporal structure of ongoing behavior can be inferred from the spiking of premotor neurons. This work provides a powerful approach for characterizing the computational and learning capacities of single neurons and neuronal circuits.

The role of alpha-rhythm states in perceptual learning: insights from experiments and computational models

During the past two decades growing evidence indicates that brain oscillations in the alpha band (~10 Hz) not only reflect an "idle" state of cortical activity, but also take a more active role in the generation of complex cognitive functions. A recent study shows that more than 60% of the observed inter-subject variability in perceptual learning can be ascribed to ongoing alpha activity. This evidence indicates a significant role of alpha oscillations for perceptual learning and hence motivates to explore the potential underlying mechanisms. Hence, it is the purpose of this review to highlight existent evidence that ascribes intrinsic alpha oscillations a role in shaping our ability to learn. In the review, we disentangle the alpha rhythm into different neural signatures that control information processing within individual functional building blocks of perceptual learning. We further highlight computational studies that shed light on potential mechanisms regarding how alpha oscillations may modulate information transfer and connectivity changes relevant for learning. To enable testing of those model based hypotheses, we emphasize the need for multidisciplinary approaches combining assessment of behavior and multi-scale neuronal activity, active modulation of ongoing brain states and computational modeling to reveal the mathematical principles of the complex neuronal interactions. In particular we highlight the relevance of multi-scale modeling frameworks such as the one currently being developed by "The Virtual Brain" project.

Oscillations can reconcile slowly changing stimuli with short neuronal integration and STDP timescales

Oscillatory brain activity has been widely reported experimentally, yet its functional roles, if any, are still under debate. In this review we argue two things: firstly, thanks to oscillations, even slowly changing stimuli can be encoded in precise relative spike times, decodable by downstream "coincidence detector" neurons in a feedforward manner. Secondly, the required connectivity to do so can spontaneously emerge with spike timing-dependent plasticity (STDP), in an unsupervised manner. The key here is that a common oscillatory drive enables neurons to remain under a fluctuation-driven regime. In this regime spike time jitter does not accumulate and can thus be lower than the intrinsic timescales of stimulus fluctuations, which leads to so-called "temporal encoding". Furthermore, the oscillatory drive formats the spikes in discrete oversampling volleys, and the relative spike times between neurons indicate the eventual differences in their activation levels. The oversampling accelerates the STDP-based learning for downstream neurons. After learning, readout only takes one oscillatory cycle. Finally, we also discuss experimental evidence, and the question of how the theory is complementary to the so-called "communication through coherence" theory.

Noise-Robust Speech Recognition Through Auditory Feature Detection and Spike Sequence Decoding

Speech recognition in noisy conditions is a major challenge for computer systems, but the human brain performs it routinely and accurately. Automatic speech recognition (ASR) systems that are inspired by neuroscience can potentially bridge the performance gap between humans and machines. We present a system for noise-robust isolated word recognition that works by decoding sequences of spikes from a population of simulated auditory feature-detecting neurons. Each neuron is trained to respond selectively to a brief spectrotemporal pattern, or feature, drawn from the simulated auditory nerve response to speech. The neural population conveys the time-dependent structure of a sound by its sequence of spikes. We compare two methods for decoding the spike sequences—one using a hidden Markov model–based recognizer, the other using a novel template-based recognition scheme. In the latter case, words are recognized by comparing their spike sequences to template sequences obtained from clean training data, using a similarity measure based on the length of the longest common sub-sequence. Using isolated spoken digits from the AURORA-2 database, we show that our combined system outperforms a state-of-the-art robust speech recognizer at low signal-to-noise ratios. Both the spike-based encoding scheme and the template-based decoding offer gains in noise robustness over traditional speech recognition methods. Our system highlights potential advantages of spike-based acoustic coding and provides a biologically motivated framework for robust ASR development.

Assessment of rhythmic entrainment at multiple timescales in dyslexia: evidence for disruption to syllable timing

Developmental dyslexia is associated with rhythmic difficulties, including impaired perception of beat patterns in music and prosodic stress patterns in speech. Spoken prosodic rhythm is cued by slow (<10 Hz) fluctuations in speech signal amplitude. Impaired neural oscillatory tracking of these slow amplitude modulation (AM) patterns is one plausible source of impaired rhythm tracking in dyslexia. Here, we characterise the temporal profile of the dyslexic rhythm deficit by examining rhythmic entrainment at multiple speech timescales. Adult dyslexic participants completed two experiments aimed at testing the perception and production of speech rhythm. In the perception task, participants tapped along to the beat of 4 metrically-regular nursery rhyme sentences. In the production task, participants produced the same 4 sentences in time to a metronome beat. Rhythmic entrainment was assessed using both traditional rhythmic indices and a novel AM-based measure, which utilised 3 dominant AM timescales in the speech signal each associated with a different phonological grain-sized unit (0.9-2.5 Hz, prosodic stress; 2.5-12 Hz, syllables; 12-40 Hz, phonemes). The AM-based measure revealed atypical rhythmic entrainment by dyslexic participants to syllable patterns in speech, in perception and production. In the perception task, both groups showed equally strong phase-locking to Syllable AM patterns, but dyslexic responses were entrained to a significantly earlier oscillatory phase angle than controls. In the production task, dyslexic utterances showed shorter syllable intervals, and differences in Syllable:Phoneme AM cross-frequency synchronisation. Our data support the view that rhythmic entrainment at slow (∼5 Hz, Syllable) rates is atypical in dyslexia, suggesting that neural mechanisms for syllable perception and production may also be atypical. These syllable timing deficits could contribute to the atypical development of phonological representations for spoken words, the central cognitive characteristic of developmental dyslexia across languages.

Timing of single-neuron and local field potential responses in the human medial temporal lobe

The relationship between the firing of single cells and local field potentials (LFPs) has received increasing attention, with studies in animals [1–11] and humans [12–14]. Recordings in the human medial temporal lobe (MTL) have demonstrated the existence of neurons with selective and invariant responses [15], with a relatively late but precise response onset around 300 ms after stimulus presentation [16–18] and firing only upon conscious recognition of the stimulus [19]. This represents a much later onset than expected from direct projections from inferotemporal cortex [16, 18]. The neural mechanisms underlying this onset remain unclear. To address this issue, we performed a joint analysis of single-cell and LFP responses during a visual recognition task. Single-neuron responses were preceded by a global LFP deflection in the theta range. In addition, there was a local and stimulus-specific increase in the single-trial gamma power. These LFP responses correlated with conscious recognition. The timing of the neurons’ firing was phase locked to these LFP responses. We propose that whereas the gamma phase locking reflects the activation of local networks encoding particular recognized stimuli, the theta phase locking reflects a global activation that provides a temporal window for processing consciously perceived stimuli in the MTL.

•

Global theta LFP increases immediately precede MTL single-cell responses

•

Gamma power reflects activations of local networks encoding specific stimuli

•

The timing of the neurons’ firing is phase locked to LFP responses

•

LFP responses give a temporal window for processing consciously perceived stimuli

Reading spike timing without a clock: intrinsic decoding of spike trains

The precise timing of action potentials of sensory neurons relative to the time of stimulus presentation carries substantial sensory information that is lost or degraded when these responses are summed over longer time windows. However, it is unclear whether and how downstream networks can access information in precise time-varying neural responses. Here, we review approaches to test the hypothesis that the activity of neural populations provides the temporal reference frames needed to decode temporal spike patterns. These approaches are based on comparing the single-trial stimulus discriminability obtained from neural codes defined with respect to network-intrinsic reference frames to the discriminability obtained from codes defined relative to the experimenter's computer clock. Application of this formalism to auditory, visual and somatosensory data shows that information carried by millisecond-scale spike times can be decoded robustly even with little or no independent external knowledge of stimulus time. In cortex, key components of such intrinsic temporal reference frames include dedicated neural populations that signal stimulus onset with reliable and precise latencies, and low-frequency oscillations that can serve as reference for partitioning extended neuronal responses into informative spike patterns.

Neural codes formed by small and temporally precise populations in auditory cortex

The encoding of sensory information by populations of cortical neurons forms the basis for perception but remains poorly understood. To understand the constraints of cortical population coding we analyzed neural responses to natural sounds recorded in auditory cortex of primates (Macaca mulatta). We estimated stimulus information while varying the composition and size of the considered population. Consistent with previous reports we found that when choosing subpopulations randomly from the recorded ensemble, the average population information increases steadily with population size. This scaling was explained by a model assuming that each neuron carried equal amounts of information, and that any overlap between the information carried by each neuron arises purely from random sampling within the stimulus space. However, when studying subpopulations selected to optimize information for each given population size, the scaling of information was strikingly different: a small fraction of temporally precise cells carried the vast majority of information. This scaling could be explained by an extended model, assuming that the amount of information carried by individual neurons was highly nonuniform, with few neurons carrying large amounts of information. Importantly, these optimal populations can be determined by a single biophysical marker-the neuron's encoding time scale-allowing their detection and readout within biologically realistic circuits. These results show that extrapolations of population information based on random ensembles may overestimate the population size required for stimulus encoding, and that sensory cortical circuits may process information using small but highly informative ensembles.

Speech rhythms and multiplexed oscillatory sensory coding in the human brain

A neuroimaging study reveals how coupled brain oscillations at different frequencies align with quasi-rhythmic features of continuous speech such as prosody, syllables, and phonemes.

Cortical oscillations are likely candidates for segmentation and coding of continuous speech. Here, we monitored continuous speech processing with magnetoencephalography (MEG) to unravel the principles of speech segmentation and coding. We demonstrate that speech entrains the phase of low-frequency (delta, theta) and the amplitude of high-frequency (gamma) oscillations in the auditory cortex. Phase entrainment is stronger in the right and amplitude entrainment is stronger in the left auditory cortex. Furthermore, edges in the speech envelope phase reset auditory cortex oscillations thereby enhancing their entrainment to speech. This mechanism adapts to the changing physical features of the speech envelope and enables efficient, stimulus-specific speech sampling. Finally, we show that within the auditory cortex, coupling between delta, theta, and gamma oscillations increases following speech edges. Importantly, all couplings (i.e., brain-speech and also within the cortex) attenuate for backward-presented speech, suggesting top-down control. We conclude that segmentation and coding of speech relies on a nested hierarchy of entrained cortical oscillations.

Continuous speech is organized into a nested hierarchy of quasi-rhythmic components (prosody, syllables, phonemes) with different time scales. Interestingly, neural activity in the human auditory cortex shows rhythmic modulations with frequencies that match these speech rhythms. Here, we use magnetoencephalography and information theory to study brain oscillations in participants as they process continuous speech. We show that auditory brain oscillations at different frequencies align with the rhythmic structure of speech. This alignment is more precise when participants listen to intelligible rather than unintelligible speech. The onset of speech resets brain oscillations and improves their alignment to speech rhythms; it also improves the alignment between the different frequencies of nested brain oscillations in the auditory cortex. Since these brain oscillations reflect rhythmic changes in neural excitability, they are strong candidates for mediating the segmentation of continuous speech at different time scales corresponding to key speech components such as syllables and phonemes.

In vivo assessment of human brain oscillations during application of transcranial electric currents

Brain oscillations reflect pattern formation of cell assemblies’ activity, which is often disturbed in neurological and psychiatric diseases like depression, schizophrenia and stroke. In the neurobiological analysis and treatment of these conditions, transcranial electric currents applied to the brain proved beneficial. However, the direct effects of these currents on brain oscillations have remained an enigma because of the inability to record them simultaneously. Here we report a novel strategy that resolves this problem. We describe accurate reconstructed localization of dipolar sources and changes of brain oscillatory activity associated with motor actions in primary cortical brain regions undergoing transcranial electric stimulation. This new method allows for the first time direct measurement of the effects of non-invasive electrical brain stimulation on brain oscillatory activity and behavior.

Modeling the formation process of grouping stimuli sets through cortical columns and microcircuits to feature neurons

A computational model of a self-structuring neuronal net is presented in which repetitively applied pattern sets induce the formation of cortical columns and microcircuits which decode distinct patterns after a learning phase. In a case study, it is demonstrated how specific neurons in a feature classifier layer become orientation selective if they receive bar patterns of different slopes from an input layer. The input layer is mapped and intertwined by self-evolving neuronal microcircuits to the feature classifier layer. In this topical overview, several models are discussed which indicate that the net formation converges in its functionality to a mathematical transform which maps the input pattern space to a feature representing output space. The self-learning of the mathematical transform is discussed and its implications are interpreted. Model assumptions are deduced which serve as a guide to apply model derived repetitive stimuli pattern sets to in vitro cultures of neuron ensembles to condition them to learn and execute a mathematical transform.

Modelling and analysis of local field potentials for studying the function of cortical circuits

The past decade has witnessed a renewed interest in cortical local field potentials (LFPs)--that is, extracellularly recorded potentials with frequencies of up to ~500 Hz. This is due to both the advent of multielectrodes, which has enabled recording of LFPs at tens to hundreds of sites simultaneously, and the insight that LFPs offer a unique window into key integrative synaptic processes in cortical populations. However, owing to its numerous potential neural sources, the LFP is more difficult to interpret than are spikes. Careful mathematical modelling and analysis are needed to take full advantage of the opportunities that this signal offers in understanding signal processing in cortical circuits and, ultimately, the neural basis of perception and cognition.

Rhythmic sampling within and between objects despite sustained attention at a cued location

The brain directs its limited processing resources through various selection mechanisms, broadly referred to as attention. The present study investigated the temporal dynamics of two such selection mechanisms: space- and object-based selection. Previous evidence has demonstrated that preferential processing resulting from a spatial cue (i.e., space-based selection) spreads to uncued locations if those locations are part of the same object (i.e., resulting in object-based selection), but little is known about the relationship between these fundamental selection mechanisms. Here, we used human behavioral data to determine how space- and object-based selection simultaneously evolve under conditions that promote sustained attention at a cued location, varying the cue-to-target interval from 300 to 1100 ms. We tracked visual-target detection at a cued location (i.e., space-based selection), at an uncued location that was part of the same object (i.e., object-based selection), and at an uncued location that was part of a different object (i.e., in the absence of space- and object-based selection). The data demonstrate that even under static conditions, there is a moment-to-moment reweighting of attentional priorities based on object properties. This reweighting is revealed through rhythmic patterns of visual-target detection both within (at 8 Hz) and between (at 4 Hz) objects.