Spike-Phase Coding Boosts and Stabilizes Information Carried by Spatial and Temporal Spike Patterns

Signal switching may enhance processing power of the brain

Our ability to perceive multiple objects is mysterious. Sensory neurons are broadly tuned, producing potential overlap in the populations of neurons activated by each object in a scene. This overlap raises questions about how distinct information is retained about each item. We present a novel signal switching theory of neural representation, which posits that neural signals may interleave representations of individual items across time. Evidence for this theory comes from new statistical tools that overcome the limitations inherent to standard time-and-trial-pooled assessments of neural signals. Our theory has implications for diverse domains of neuroscience, including attention, figure binding/scene segregation, oscillations, and divisive normalization. The general concept of switching between functions could also lend explanatory power to theories of grounded cognition.

A Hybrid Neural Coding Approach for Pattern Recognition With Spiking Neural Networks

Recently, brain-inspired spiking neural networks (SNNs) have demonstrated promising capabilities in solving pattern recognition tasks. However, these SNNs are grounded on homogeneous neurons that utilize a uniform neural coding for information representation. Given that each neural coding scheme possesses its own merits and drawbacks, these SNNs encounter challenges in achieving optimal performance such as accuracy, response time, efficiency, and robustness, all of which are crucial for practical applications. In this study, we argue that SNN architectures should be holistically designed to incorporate heterogeneous coding schemes. As an initial exploration in this direction, we propose a hybrid neural coding and learning framework, which encompasses a neural coding zoo with diverse neural coding schemes discovered in neuroscience. Additionally, it incorporates a flexible neural coding assignment strategy to accommodate task-specific requirements, along with novel layer-wise learning methods to effectively implement hybrid coding SNNs. We demonstrate the superiority of the proposed framework on image classification and sound localization tasks. Specifically, the proposed hybrid coding SNNs achieve comparable accuracy to state-of-the-art SNNs, while exhibiting significantly reduced inference latency and energy consumption, as well as high noise robustness. This study yields valuable insights into hybrid neural coding designs, paving the way for developing high-performance neuromorphic systems.

Hippocampal-parietal cortex causal directed connectivity during human episodic memory formation: Replication across three experiments

Hippocampus-parietal cortex circuits are thought to play a crucial role in memory and attention, but their neural basis remains poorly understood. We employed intracranial EEG from 96 participants (51 females) to investigate the neurophysiological underpinning of these circuits across three memory tasks spanning verbal and spatial domains. We uncovered a consistent pattern of higher causal directed connectivity from the hippocampus to both lateral parietal cortex (supramarginal and angular gyrus) and medial parietal cortex (posterior cingulate cortex) in the delta-theta band during memory encoding and recall. This connectivity was independent of activation or suppression states in the hippocampus or parietal cortex. Crucially, directed connectivity from the supramarginal gyrus to the hippocampus was enhanced in participants with higher memory recall, highlighting its behavioral significance. Our findings align with the attention-to-memory model, which posits that attention directs cognitive resources toward pertinent information during memory formation. The robustness of these results was demonstrated through Bayesian replication analysis of the memory encoding and recall periods across the three tasks. Our study sheds light on the neural basis of casual signaling within hippocampus-parietal circuits, broadening our understanding of their critical roles in human cognition.

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.

Phase of neural oscillations as a reference frame for attention-based routing in visual cortex

Selective attention allows the brain to efficiently process the image projected onto the retina, selectively focusing neural processing resources on behaviorally relevant visual information. While previous studies have documented the crucial role of the action potential rate of single neurons in relaying such information, little is known about how the activity of single neurons relative to their neighboring network contributes to the efficient representation of attended stimuli and transmission of this information to downstream areas. Here, we show in the dorsal visual pathway of monkeys (medial superior temporal area) that neurons fire spikes preferentially at a specific phase of the ongoing population beta (∼20 Hz) oscillations of the surrounding local network. This preferred spiking phase shifts towards a later phase when monkeys selectively attend towards (rather than away from) the receptive field of the neuron. This shift of the locking phase is positively correlated with the speed at which animals report a visual change. Furthermore, our computational modeling suggests that neural networks can manipulate the preferred phase of coupling by imposing differential synaptic delays on postsynaptic potentials. This distinction between the locking phase of neurons activated by the spatially attended stimulus vs. that of neurons activated by the unattended stimulus, may enable the neural system to discriminate relevant from irrelevant sensory inputs and consequently filter out distracting stimuli information by aligning the spikes which convey relevant/irrelevant information to distinct phases linked to periods of better/worse perceptual sensitivity for higher cortices. This strategy may be used to reserve the narrow windows of highest perceptual efficacy to the processing of the most behaviorally relevant information, ensuring highly efficient responses to attended sensory events.

Enhancement of low gamma oscillations by volitional conditioning of local field potential in the primary motor and visual cortex of mice

Volitional control of local field potential oscillations in low gamma band via brain machine interface can not only uncover the relationship between low gamma oscillation and neural synchrony but also suggest a therapeutic potential to reverse abnormal local field potential oscillation in neurocognitive disorders. In nonhuman primates, the volitional control of low gamma oscillations has been demonstrated by brain machine interface techniques in the primary motor and visual cortex. However, it is not clear whether this holds in other brain regions and other species, for which gamma rhythms might involve in highly different neural processes. Here, we established a closed-loop brain-machine interface and succeeded in training mice to volitionally elevate low gamma power of local field potential in the primary motor and visual cortex. We found that the mice accomplished the task in a goal-directed manner and spiking activity exhibited phase-locking to the oscillation in local field potential in both areas. Moreover, long-term training made the power enhancement specific to direct and adjacent channel, and increased the transcriptional levels of NMDA receptors as well as that of hypoxia-inducible factor relevant to metabolism. Our results suggest that volitionally generated low gamma rhythms in different brain regions share similar mechanisms and pave the way for employing brain machine interface in therapy of neurocognitive disorders.

Silences, spikes and bursts: Three-part knot of the neural code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.

A recruitment through coherence theory of working memory

The interactions between prefrontal cortex and other areas during working memory have been studied for decades. Here we outline a conceptual framework describing interactions between these areas during working memory, and review evidence for key elements of this model. We specifically suggest that a top-down signal sent from prefrontal to sensory areas drives oscillations in these areas. Spike timing within sensory areas becomes locked to these working-memory-driven oscillations, and the phase of spiking conveys information about the representation available within these areas. Downstream areas receiving these phase-locked spikes from sensory areas can recover this information via a combination of coherent oscillations and gating of input efficacy based on the phase of their local oscillations. Although the conceptual framework is based on prefrontal interactions with sensory areas during working memory, we also discuss the broader implications of this framework for flexible communication between brain areas in general.

Backbone spiking sequence as a basis for preplay, replay, and default states in human cortex

Sequences of spiking activity have been heavily implicated as potential substrates of memory formation and retrieval across many species. A parallel line of recent evidence also asserts that sequential activity may arise from and be constrained by pre-existing network structure. Here we reconcile these two lines of research in the human brain by measuring single unit spiking sequences in the temporal lobe cortex as participants perform an episodic memory task. We find the presence of an average backbone spiking sequence identified during pre-task rest that is stable over time and different cognitive states. We further demonstrate that these backbone sequences are composed of both rigid and flexible sequence elements, and that flexible elements within these sequences serve to promote memory specificity when forming and retrieving new memories. These results support the hypothesis that pre-existing network dynamics serve as a scaffold for ongoing neural activity in the human cortex.

Near-field potentials index local neural computations more accurately than population spiking

Local field potentials (LFP) are low-frequency extracellular voltage fluctuations thought to primarily arise from synaptic activity. However, unlike highly localized neuronal spiking, LFP is spatially less specific. LFP measured at one location is not entirely generated there due to far-field contributions that are passively conducted across volumes of neural tissue. We sought to quantify how much information within the locally generated, near-field low-frequency activity (nfLFP) is masked by volume-conducted far-field signals. To do so, we measured laminar neural activity in primary visual cortex (V1) of monkeys viewing sequences of multifeatured stimuli. We compared information content of regular LFP and nfLFP that was mathematically stripped of volume-conducted far-field contributions. Information content was estimated by decoding stimulus properties from neural responses via spatiotemporal multivariate pattern analysis. Volume-conducted information differed from locally generated information in two important ways: (1) for stimulus features relevant to V1 processing (orientation and eye-of-origin), nfLFP contained more information. (2) in contrast, the volume-conducted signal was more informative regarding temporal context (relative stimulus position in a sequence), a signal likely to be coming from elsewhere. Moreover, LFP and nfLFP differed both spectrally as well as spatially, urging caution regarding the interpretations of individual frequency bands and/or laminar patterns of LFP. Most importantly, we found that population spiking of local neurons was less informative than either the LFP or nfLFP, with nfLFP containing most of the relevant information regarding local stimulus processing. These findings suggest that the optimal way to read out local computational processing from neural activity is to decode the local contributions to LFP, with significant information loss hampering both regular LFP and local spiking.

Author’s Contributions

Conceptualization, D.A.T., J.A.W, and A.M.; Data Collection, J.A.W., M.A.C., K.D.; Formal Analysis, D.A.T. and J.A.W.; Data Visualization, D.A.T. and J.A.W.; Original Draft, D.A.T., J.A.W., and A.M.; Revisions and Final Draft, D.A.T., J.A.W., M.A.C., K.D., M.T.W., A.M.B., and A.M.

Competing Interests

The authors declare no conflicts of interest.

Doppler Frequency-Shift Information Processing in WOx -Based Memristive Synapse for Auditory Motion Perception

Auditory motion perception is one crucial capability to decode and discriminate the spatiotemporal information for neuromorphic auditory systems. Doppler frequency-shift feature and interaural time difference (ITD) are two fundamental cues of auditory information processing. In this work, the functions of azimuth detection and velocity detection, as the typical auditory motion perception, are demonstrated in a WO_x -based memristive synapse. The WO_x memristor presents both the volatile mode (M1) and semi-nonvolatile mode (M2), which are capable of implementing the high-pass filtering and processing the spike trains with a relative timing and frequency shift. In particular, the Doppler frequency-shift information processing for velocity detection is emulated in the WO_x memristor based auditory system for the first time, which relies on a scheme of triplet spike-timing-dependent-plasticity in the memristor. These results provide new opportunities for the mimicry of auditory motion perception and enable the auditory sensory system to be applied in future neuromorphic sensing.

Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task

Spiking Neural Networks (SNNs), known for their potential to enable low energy consumption and computational cost, can bring significant advantages to the realm of embedded machine learning for edge applications. However, input coming from standard digital sensors must be encoded into spike trains before it can be elaborated with neuromorphic computing technologies. We present here a detailed comparison of available spike encoding techniques for the translation of time-varying signals into the event-based signal domain, tested on two different datasets both acquired through commercially available digital devices: the Free Spoken Digit dataset (FSD), consisting of 8-kHz audio files, and the WISDM dataset, composed of 20-Hz recordings of human activity through mobile and wearable inertial sensors. We propose a complete pipeline to benchmark these encoding techniques by performing time-dependent signal classification through a Spiking Convolutional Neural Network (sCNN), including a signal preprocessing step consisting of a bank of filters inspired by the human cochlea, feature extraction by production of a sonogram, transfer learning via an equivalent ANN, and model compression schemes aimed at resource optimization. The resulting performance comparison and analysis provides a powerful practical tool, empowering developers to select the most suitable coding method based on the type of data and the desired processing algorithms, and further expands the applicability of neuromorphic computational paradigms to embedded sensor systems widely employed in the IoT and industrial domains.

Replicable patterns of causal information flow between hippocampus and prefrontal cortex during spatial navigation and spatial-verbal memory formation

Interactions between the hippocampus and prefrontal cortex (PFC) play an essential role in both human spatial navigation and episodic memory, but the underlying causal flow of information between these regions across task domains is poorly understood. Here we use intracranial EEG recordings and spectrally resolved phase transfer entropy to investigate information flow during two different virtual spatial navigation and memory encoding/recall tasks and examine replicability of information flow patterns across spatial and verbal memory domains. Information theoretic analysis revealed a higher causal information flow from hippocampus to lateral PFC than in the reverse direction. Crucially, an asymmetric pattern of information flow was observed during memory encoding and recall periods of both spatial navigation tasks. Further analyses revealed frequency specificity of interactions characterized by greater bottom-up information flow from hippocampus to PFC in delta-theta band (0.5-8 Hz); in contrast, top-down information flow from PFC to hippocampus was stronger in beta band (12-30 Hz). Bayesian analysis revealed a high degree of replicability between the two spatial navigation tasks (Bayes factor > 5.46e+3) and across tasks spanning the spatial and verbal memory domains (Bayes factor > 7.32e+8). Our findings identify a domain-independent and replicable frequency-dependent feedback loop engaged during memory formation in the human brain.

Coexisting neuronal coding strategies in the barrel cortex

During tactile sensation by rodents, whisker movements across surfaces generate complex whisker motions, including discrete, transient stick-slip events, which carry information about surface properties. The characteristics of these events and how the brain encodes this tactile information remain enigmatic. We found that cortical neurons show a mixture of synchronized and nontemporally correlated spikes in their tactile responses. Synchronous spikes convey the magnitude of stick-slip events by numerous aspects of temporal coding. These spikes show preferential selectivity for kinetic and kinematic whisker motion. By contrast, asynchronous spikes in each neuron convey the magnitude of stick-slip events by their discharge rates, response probability, and interspike intervals. We further show that the differentiation between these two types of activity is highly dependent on the magnitude of stick-slip events and stimulus and response history. These results suggest that cortical neurons transmit multiple components of tactile information through numerous coding strategies.

Neural synchrony in cortical networks: mechanisms and implications for neural information processing and coding

Synchronization of neuronal discharges on the millisecond scale has long been recognized as a prevalent and functionally important attribute of neural activity. In this article, I review classical concepts and corresponding evidence of the mechanisms that govern the synchronization of distributed discharges in cortical networks and relate those mechanisms to their possible roles in coding and cognitive functions. To accommodate the need for a selective, directed synchronization of cells, I propose that synchronous firing of distributed neurons is a natural consequence of spike-timing-dependent plasticity (STDP) that associates cells repetitively receiving temporally coherent input: the “synchrony through synaptic plasticity” hypothesis. Neurons that are excited by a repeated sequence of synaptic inputs may learn to selectively respond to the onset of this sequence through synaptic plasticity. Multiple neurons receiving coherent input could thus actively synchronize their firing by learning to selectively respond at corresponding temporal positions. The hypothesis makes several predictions: first, the position of the cells in the network, as well as the source of their input signals, would be irrelevant as long as their input signals arrive simultaneously; second, repeating discharge patterns should get compressed until all or some part of the signals are synchronized; and third, this compression should be accompanied by a sparsening of signals. In this way, selective groups of cells could emerge that would respond to some recurring event with synchronous firing. Such a learned response pattern could further be modulated by synchronous network oscillations that provide a dynamic, flexible context for the synaptic integration of distributed signals. I conclude by suggesting experimental approaches to further test this new hypothesis.

Direct Training via Backpropagation for Ultra-Low-Latency Spiking Neural Networks with Multi-Threshold

Spiking neural networks (SNNs) can utilize spatio-temporal information and have the characteristic of energy efficiency, being a good alternative to deep neural networks (DNNs). The event-driven information processing means that SNNs can reduce the expensive computation of DNNs and save a great deal of energy consumption. However, high training and inference latency is a limitation of the development of deeper SNNs. SNNs usually need tens or even hundreds of time steps during the training and inference process, which causes not only an increase in latency but also excessive energy consumption. To overcome this problem, we propose a novel training method based on backpropagation (BP) for ultra-low-latency (1–2 time steps) SNNs with multi-threshold. In order to increase the information capacity of each spike, we introduce the multi-threshold Leaky Integrate and Fired (LIF) model. The experimental results show that our proposed method achieves average accuracy of 99.56%, 93.08%, and 87.90% on MNIST, FashionMNIST, and CIFAR10, respectively, with only two time steps. For the CIFAR10 dataset, our proposed method achieves 1.12% accuracy improvement over the previously reported directly trained SNNs with fewer time steps.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

EnforceSNN: Enabling resilient and energy-efficient spiking neural network inference considering approximate DRAMs for embedded systems

Spiking Neural Networks (SNNs) have shown capabilities of achieving high accuracy under unsupervised settings and low operational power/energy due to their bio-plausible computations. Previous studies identified that DRAM-based off-chip memory accesses dominate the energy consumption of SNN processing. However, state-of-the-art works do not optimize the DRAM energy-per-access, thereby hindering the SNN-based systems from achieving further energy efficiency gains. To substantially reduce the DRAM energy-per-access, an effective solution is to decrease the DRAM supply voltage, but it may lead to errors in DRAM cells (i.e., so-called approximate DRAM). Toward this, we propose EnforceSNN, a novel design framework that provides a solution for resilient and energy-efficient SNN inference using reduced-voltage DRAM for embedded systems. The key mechanisms of our EnforceSNN are: (1) employing quantized weights to reduce the DRAM access energy; (2) devising an efficient DRAM mapping policy to minimize the DRAM energy-per-access; (3) analyzing the SNN error tolerance to understand its accuracy profile considering different bit error rate (BER) values; (4) leveraging the information for developing an efficient fault-aware training (FAT) that considers different BER values and bit error locations in DRAM to improve the SNN error tolerance; and (5) developing an algorithm to select the SNN model that offers good trade-offs among accuracy, memory, and energy consumption. The experimental results show that our EnforceSNN maintains the accuracy (i.e., no accuracy loss for BER ≤ 10−3) as compared to the baseline SNN with accurate DRAM while achieving up to 84.9% of DRAM energy saving and up to 4.1x speed-up of DRAM data throughput across different network sizes.

Adaptive Spike-Like Representation of EEG Signals for Sleep Stages Scoring

Recently there has seen promising results on auto-matic stage scoring by extracting spatio-temporal features from electroencephalogram (EEG). Such methods entail laborious manual feature engineering and domain knowledge. In this study, we propose an adaptive scheme to probabilistically encode, filter and accumulate the input signals and weight the resultant features by the half-Gaussian probabilities of signal intensities. The adaptive representations are subsequently fed into a transformer model to automatically mine the relevance between features and corresponding stages. Extensive exper-iments on the largest public dataset against state-of-the-art methods validate the effectiveness of our proposed method and reveal promising future directions.

Advancements in Algorithms and Neuromorphic Hardware for Spiking Neural Networks

Artificial neural networks (ANNs) have experienced a rapid advancement for their success in various application domains, including autonomous driving and drone vision. Researchers have been improving the performance efficiency and computational requirement of ANNs inspired by the mechanisms of the biological brain. Spiking neural networks (SNNs) provide a power-efficient and brain-inspired computing paradigm for machine learning applications. However, evaluating large-scale SNNs on classical von Neumann architectures (central processing units/graphics processing units) demands a high amount of power and time. Therefore, hardware designers have developed neuromorphic platforms to execute SNNs in and approach that combines fast processing and low power consumption. Recently, field-programmable gate arrays (FPGAs) have been considered promising candidates for implementing neuromorphic solutions due to their varied advantages, such as higher flexibility, shorter design, and excellent stability. This review aims to describe recent advances in SNNs and the neuromorphic hardware platforms (digital, analog, hybrid, and FPGA based) suitable for their implementation. We present that biological background of SNN learning, such as neuron models and information encoding techniques, followed by a categorization of SNN training. In addition, we describe state-of-the-art SNN simulators. Furthermore, we review and present FPGA-based hardware implementation of SNNs. Finally, we discuss some future directions for research in this field.

Electrophysiological foundations of the human default-mode network revealed by intracranial-EEG recordings during resting-state and cognition

Investigations using noninvasive functional magnetic resonance imaging (fMRI) have provided significant insights into the unique functional organization and profound importance of the human default mode network (DMN), yet these methods are limited in their ability to resolve network dynamics across multiple timescales. Electrophysiological techniques are critical to address these challenges, yet few studies have explored the neurophysiological underpinnings of the DMN. Here we investigate the electrophysiological organization of the DMN in a common large-scale network framework consistent with prior fMRI studies. We used intracranial EEG (iEEG) recordings, and evaluated intra- and cross-network interactions during resting-state and its modulation during a cognitive task involving episodic memory formation. Our analysis revealed significantly greater intra-DMN phase iEEG synchronization in the slow-wave (< 4 Hz), while DMN interactions with other brain networks was higher in the beta (12-30 Hz) and gamma (30-80 Hz) bands. Crucially, slow-wave intra-DMN synchronization was observed in the task-free resting-state and during both verbal memory encoding and recall. Compared to resting-state, slow-wave intra-DMN phase synchronization was significantly higher during both memory encoding and recall. Slow-wave intra-DMN phase synchronization increased during successful memory retrieval, highlighting its behavioral relevance. Finally, analysis of nonlinear dynamic causal interactions revealed that the DMN is a causal outflow network during both memory encoding and recall. Our findings identify frequency specific neurophysiological signatures of the DMN which allow it to maintain stability and flexibility, intrinsically and during task-based cognition, provide novel insights into the electrophysiological foundations of the human DMN, and elucidate network mechanisms by which it supports cognition.

When the Whole Is Less Than the Sum of Its Parts: Maximum Object Category Information and Behavioral Prediction in Multiscale Activation Patterns

Neural codes are reflected in complex neural activation patterns. Conventional electroencephalography (EEG) decoding analyses summarize activations by averaging/down-sampling signals within the analysis window. This diminishes informative fine-grained patterns. While previous studies have proposed distinct statistical features capable of capturing variability-dependent neural codes, it has been suggested that the brain could use a combination of encoding protocols not reflected in any one mathematical feature alone. To check, we combined 30 features using state-of-the-art supervised and unsupervised feature selection procedures (n = 17). Across three datasets, we compared decoding of visual object category between these 17 sets of combined features, and between combined and individual features. Object category could be robustly decoded using the combined features from all of the 17 algorithms. However, the combination of features, which were equalized in dimension to the individual features, were outperformed across most of the time points by the multiscale feature of Wavelet coefficients. Moreover, the Wavelet coefficients also explained the behavioral performance more accurately than the combined features. These results suggest that a single but multiscale encoding protocol may capture the EEG neural codes better than any combination of protocols. Our findings put new constraints on the models of neural information encoding in EEG.

Representing the dynamics of high-dimensional data with non-redundant wavelets

A crucial question in data science is to extract meaningful information embedded in high-dimensional data into a low-dimensional set of features that can represent the original data at different levels. Wavelet analysis is a pervasive method for decomposing time-series signals into a few levels with detailed temporal resolution. However, obtained wavelets are intertwined and over-represented across levels for each sample and across different samples within one population. Here, using neuroscience data of simulated spikes, experimental spikes, calcium imaging signals, and human electrocorticography signals, we leveraged conditional mutual information between wavelets for feature selection. The meaningfulness of selected features was verified to decode stimulus or condition with high accuracy yet using only a small set of features. These results provide a new way of wavelet analysis for extracting essential features of the dynamics of spatiotemporal neural data, which then enables to support novel model design of machine learning with representative features.

•

WCMI can extract meaningful information from high-dimensional data

•

Extracted features from neural signals are non-redundant

•

Simple decoders can read out these features with superb accuracy

One of the essential questions in data science is to extract meaningful information from high-dimensional data. A useful approach is to represent data using a few features that maintain the crucial information. The leading property of spatiotemporal data is foremost ever-changing dynamics in time. Wavelet analysis, as a classical method for disentangling time series, can capture temporal dynamics with detail. Here, we leveraged conditional mutual information between wavelets to select a small subset of non-redundant features. We demonstrated the efficiency and effectiveness of features using various types of neuroscience data with different sampling frequencies at the level of the single cell, cell population, and coarse-scale brain activity. Our results shed new insights into representing the dynamics of spatiotemporal data using a few fundamental features extracted by wavelet analysis, which may have wide implications to other types of data with rich temporal dynamics.

Neurons as will and representation

Memory recollections and voluntary actions are often perceived as spontaneously generated irrespective of external stimuli. Although products of our neurons, they are only rarely accessible in humans at the neuronal level. Here I review insights gleaned from unique neurosurgical opportunities to record and stimulate single-neuron activity in people who can declare their thoughts, memories and wishes. I discuss evidence that the subjective experience of human recollection and that of voluntary action arise from the activity of two internal neuronal generators, the former from medial temporal lobe reactivation and the latter from frontoparietal preactivation. I characterize properties of these generators and their interaction, enabling flexible recruitment of memory-based choices for action as well as recruitment of action-based plans for the representation of conceptual knowledge in memories. Both internal generators operate on surprisingly explicit but different neuronal codes, which appear to arise with distinct single-neuron activity, often observed before participants' reports of conscious awareness. I discuss prediction of behaviour based on these codes, and the potential for their modulation. The prospects of editing human memories and volitions by enhancement, inception or deletion of specific, selected content raise therapeutic possibilities and ethical concerns.

Causal dynamics and information flow in parietal-temporal-hippocampal circuits during mental arithmetic revealed by high-temporal resolution human intracranial EEG

Mental arithmetic involves distributed brain regions spanning parietal and temporal cortices, yet little is known about the neural dynamics of causal functional circuits that link them. Here we use high-temporal resolution (1000 Hz sampling rate) intracranial EEG from 35 participants, 362 electrodes, and 1727 electrode pairs, to investigate dynamic causal circuits linking posterior parietal cortex (PPC) with ventral temporal-occipital cortex and hippocampal regions which constitute the perceptual, visuospatial, and mnemonic building blocks of mental arithmetic. Nonlinear phase transfer entropy measures capable of capturing information flow identified dorsal PPC as a causal inflow hub during mental arithmetic, with strong causal influences from fusiform gyrus in ventral temporal-occipital cortex as well as the hippocampus. Net causal inflow into dorsal PPC was significantly higher during mental arithmetic, compared to both resting-state and verbal memory recall. Our analysis also revealed functional heterogeneity of casual signaling in the PPC, with greater net causal inflow into the dorsal PCC, compared to ventral PPC. Additionally, the strength of causal influences was significantly higher on dorsal, compared to ventral, PPC from the hippocampus, and ventral temporal-occipital cortex during mental arithmetic, when compared to both resting-state and verbal memory recall. Our findings provide novel insights into dynamic neural circuits and hubs underlying numerical problem solving and reveal neurophysiological circuit mechanisms by which both the visual number form processing and declarative memory systems dynamically engage the PPC during mental arithmetic.

Skin-Inspired Flexible and Stretchable Electrospun Carbon Nanofiber Sensors for Neuromorphic Sensing

During the past few decades, a significant amount of research effort has been dedicated toward developing skin-inspired sensors for real-time human motion monitoring and next-generation robotic devices. Although several flexible and wearable sensors have been developed in the past, the need of the hour is developing accurate, reliable, sophisticated, facile yet inexpensive flexible sensors coupled with neuromorphic systems or spiking neural networks to encode tactile information without the need for complex digital architectures, thus achieving true skin-like sensing with limited resources. In this work, we propose an approach entailing carbon nanofiber-polydimethylsiloxane composite-based piezoresistive sensors, coupled with spiking neural networks, to mimic skin-like sensing. The strain and pressure sensors have been combined with appropriately designed neural networks to encode analog voltages to spikes to recreate bioinspired tactile sensing and proprioception. To further validate the proprioceptive capability of the system, a gesture tracking smart glove, combined with a spiking neural network, was demonstrated. Wearable and flexible sensors with accompanying neural networks such as the ones proposed in this work will pave the way for a future generation of skin-mimetic sensors for advanced prosthetic devices, apparel integrable smart sensors for human motion monitoring, and human-machine interfaces.

Cerebellar nuclei neurons display aberrant oscillations during harmaline-induced tremor

Essential tremor, a common, debilitating motor disorder, is thought to be caused by cerebellar malfunction. It has been shown that rhythmic Purkinje cell firing is both necessary and sufficient to induce body tremor. During tremor, cerebellar nuclei (CN) cells also display oscillatory activity. This study examined whether rhythmic activity in the CN characterizes the occurrence of body tremor, or alternatively, whether aberrant bursting activity underlies body tremor. Cerebellar nuclei activity was chronically recorded and analyzed in freely moving and in harmaline treated rats. CN neurons displayed rhythmic activity in both conditions, but the number of oscillatory neurons and the relative oscillation time were significantly higher under harmaline. The dominant frequencies of the oscillations were broadly distributed under harmaline and the likelihood that two simultaneously recorded neurons would co-oscillate and their oscillation coherence were significantly lower. It is argued that these alterations rather than neuronal rhythmicity per se underlie harmaline-induced body tremor.

Asymmetric Frequency-Specific Feedforward and Feedback Information Flow between Hippocampus and Prefrontal Cortex during Verbal Memory Encoding and Recall

Hippocampus and prefrontal cortex (PFC) circuits are thought to play a prominent role in human episodic memory, but the precise nature, and electrophysiological basis, of directed information flow between these regions and their role in verbal memory formation has remained elusive. Here we investigate nonlinear causal interactions between hippocampus and lateral PFC using intracranial EEG recordings (26 participants, 16 females) during verbal memory encoding and recall tasks. Direction-specific information theoretic analysis revealed higher causal information flow from the hippocampus to PFC than in the reverse direction. Crucially, this pattern was observed during both memory encoding and recall, and the strength of causal interactions was significantly greater during memory task performance than resting baseline. Further analyses revealed frequency specificity of interactions with greater causal information flow from hippocampus to the PFC in the delta-theta frequency band (0.5-8 Hz); in contrast, PFC to hippocampus causal information flow were stronger in the beta band (12-30 Hz). Across all hippocampus-PFC electrode pairs, propagation delay between the source and target signals was estimated to be 17.7 ms, which is physiologically meaningful and corresponds to directional signal interactions on a timescale consistent with monosynaptic influence. Our findings identify distinct asymmetric feedforward and feedback signaling mechanisms between the hippocampus and PFC and their dissociable roles in memory recall, demonstrate that these regions preferentially use different frequency channels, and provide novel insights into the electrophysiological basis of directed information flow during episodic memory formation in the human brain.SIGNIFICANCE STATEMENT Hippocampal-PFC circuits play a critical role in episodic memory in rodents, nonhuman primates, and humans. Investigations using noninvasive fMRI techniques have provided insights into coactivation of the hippocampus and PFC during memory formation; however, the electrophysiological basis of dynamic causal hippocampal-PFC interactions in the human brain is poorly understood. Here, we use data from a large cohort of intracranial EEG recordings to investigate the neurophysiological underpinnings of asymmetric feedforward and feedback hippocampal-PFC interactions and their nonlinear causal dynamics during both episodic memory encoding and recall. Our findings provide novel insights into the electrophysiological basis of directed bottom-up and top-down information flow during episodic memory formation in the human brain.

An oscillating computational model can track pseudo-rhythmic speech by using linguistic predictions

Neuronal oscillations putatively track speech in order to optimize sensory processing. However, it is unclear how isochronous brain oscillations can track pseudo-rhythmic speech input. Here we propose that oscillations can track pseudo-rhythmic speech when considering that speech time is dependent on content-based predictions flowing from internal language models. We show that temporal dynamics of speech are dependent on the predictability of words in a sentence. A computational model including oscillations, feedback, and inhibition is able to track pseudo-rhythmic speech input. As the model processes, it generates temporal phase codes, which are a candidate mechanism for carrying information forward in time. The model is optimally sensitive to the natural temporal speech dynamics and can explain empirical data on temporal speech illusions. Our results suggest that speech tracking does not have to rely only on the acoustics but could also exploit ongoing interactions between oscillations and constraints flowing from internal language models.

A Survey of Encoding Techniques for Signal Processing in Spiking Neural Networks

Biologically inspired spiking neural networks are increasingly popular in the field of artificial intelligence due to their ability to solve complex problems while being power efficient. They do so by leveraging the timing of discrete spikes as main information carrier. Though, industrial applications are still lacking, partially because the question of how to encode incoming data into discrete spike events cannot be uniformly answered. In this paper, we summarise the signal encoding schemes presented in the literature and propose a uniform nomenclature to prevent the vague usage of ambiguous definitions. Therefore we survey both, the theoretical foundations as well as applications of the encoding schemes. This work provides a foundation in spiking signal encoding and gives an overview over different application-oriented implementations which utilise the schemes.

The impact of phase entrainment on auditory detection is highly variable: Revisiting a key finding

Ample evidence shows that the human brain carefully tracks acoustic temporal regularities in the input, perhaps by entraining cortical neural oscillations to the rate of the stimulation. To what extent the entrained oscillatory activity influences processing of upcoming auditory events remains debated. Here, we revisit a critical finding from Hickok et al. (2015) that demonstrated a clear impact of auditory entrainment on subsequent auditory detection. Participants were asked to detect tones embedded in stationary noise, following a noise that was amplitude modulated at 3 Hz. Tonal targets occurred at various phases relative to the preceding noise modulation. The original study (N = 5) showed that the detectability of the tones (presented at near-threshold intensity) fluctuated cyclically at the same rate as the preceding noise modulation. We conducted an exact replication of the original paradigm (N = 23) and a conceptual replication using a shorter experimental procedure (N = 24). Neither experiment revealed significant entrainment effects at the group level. A restricted analysis on the subset of participants (36%) who did show the entrainment effect revealed no consistent phase alignment between detection facilitation and the preceding rhythmic modulation. Interestingly, both experiments showed group-wide presence of a non-cyclic behavioural pattern, wherein participants' detection of the tonal targets was lower at early and late time points of the target period. The two experiments highlight both the sensitivity of the task to elicit oscillatory entrainment and the striking individual variability in performance.

State-dependent entrainment of cerebellar nuclear neurons to the local field potential during voluntary movements

Understanding the relationship between the local field potential (LFP) and single neurons is essential if we are to understand network dynamics and the entrainment of neuronal activity. Here, we investigated the interaction between the LFP and single neurons recorded in the rat cerebellar nuclei (CN), which are part of the sensorimotor network, in freely moving rats. During movement, the LFP displayed persistent oscillations in the theta band frequency, whereas CN neurons displayed intermittent oscillations in the same frequency band contingent on the instantaneous LFP power; the neurons oscillated primarily when the concurrent LFP power was either high or low. Quantification of the relative instantaneous frequency and phase locking showed that CN neurons exhibited phase locked rhythmic activity at a frequency similar to that of the LFP or at a shifted frequency during high and low LFP power, respectively. We suggest that this nonlinear interaction between cerebellar neurons and the LFP power, which occurs solely during movement, contributes to the shaping of cerebellar output patterns.NEW & NOTEWORTHY We studied the interaction between single neurons and the LFP in the cerebellar nuclei of freely moving rats. We show that during movement, the neurons oscillated in the theta frequency band contingent on the concurrent LFP oscillation power in the same band; the neurons oscillated primarily when the LFP power was either high or low. We are the first to demonstrate a nonlinear, state-dependent entrainment of single neurons to the LFP.

Burst-dependent synaptic plasticity can coordinate learning in hierarchical circuits

Synaptic plasticity is believed to be a key physiological mechanism for learning. It is well established that it depends on pre- and postsynaptic activity. However, models that rely solely on pre- and postsynaptic activity for synaptic changes have, so far, not been able to account for learning complex tasks that demand credit assignment in hierarchical networks. Here we show that if synaptic plasticity is regulated by high-frequency bursts of spikes, then pyramidal neurons higher in a hierarchical circuit can coordinate the plasticity of lower-level connections. Using simulations and mathematical analyses, we demonstrate that, when paired with short-term synaptic dynamics, regenerative activity in the apical dendrites and synaptic plasticity in feedback pathways, a burst-dependent learning rule can solve challenging tasks that require deep network architectures. Our results demonstrate that well-known properties of dendrites, synapses and synaptic plasticity are sufficient to enable sophisticated learning in hierarchical circuits.

Linear-nonlinear cascades capture synaptic dynamics

Short-term synaptic dynamics differ markedly across connections and strongly regulate how action potentials communicate information. To model the range of synaptic dynamics observed in experiments, we have developed a flexible mathematical framework based on a linear-nonlinear operation. This model can capture various experimentally observed features of synaptic dynamics and different types of heteroskedasticity. Despite its conceptual simplicity, we show that it is more adaptable than previous models. Combined with a standard maximum likelihood approach, synaptic dynamics can be accurately and efficiently characterized using naturalistic stimulation patterns. These results make explicit that synaptic processing bears algorithmic similarities with information processing in convolutional neural networks.

Information diversity in individual auditory cortical neurons is associated with functionally distinct coordinated neuronal ensembles

Neuronal activity in auditory cortex is often highly synchronous between neighboring neurons. Such coordinated activity is thought to be crucial for information processing. We determined the functional properties of coordinated neuronal ensembles (cNEs) within primary auditory cortical (AI) columns relative to the contributing neurons. Nearly half of AI cNEs showed robust spectro-temporal receptive fields whereas the remaining cNEs showed little or no acoustic feature selectivity. cNEs can therefore capture either specific, time-locked information of spectro-temporal stimulus features or reflect stimulus-unspecific, less-time specific processing aspects. By contrast, we show that individual neurons can represent both of those aspects through membership in multiple cNEs with either high or absent feature selectivity. These associations produce functionally heterogeneous spikes identifiable by instantaneous association with different cNEs. This demonstrates that single neuron spike trains can sequentially convey multiple aspects that contribute to cortical processing, including stimulus-specific and unspecific information.

Oscillations as a window into neuronal mechanisms underlying dorsal anterior cingulate cortex function

The function of dorsal Anterior Cingulate Cortex (dACC) remains poorly understood. While many methods, spanning bottom-up and top-down approaches, have been deployed, the view they offer is often conflicting. Integrating bottom-up and top-down approaches requires an intermediary with sufficient explanatory power, theoretical development, and empirical support. Oscillations in the local field potential (LFP) provide such a link. LFP oscillations arise from empirically well-characterized neuronal circuit motifs. Synchronizing the firing of individual units has appealing properties to bind disparate brain regions and propagate information, including gating, routing, and coding. Moreover, the LFP, rather than single unit activity, more closely relates to macro-scale recordings, such as the electroencephalogram and functional magnetic resonance imaging. Thus, LFP oscillations are a critical link that allow for the inference of neuronal micro-circuitry underlying macroscopic brain recordings.

Enhanced representation of natural sound sequences in the ventral auditory midbrain

The auditory midbrain (inferior colliculus, IC) plays an important role in sound processing, acting as hub for acoustic information extraction and for the implementation of fast audio-motor behaviors. IC neurons are topographically organized according to their sound frequency preference: dorsal IC regions encode low frequencies while ventral areas respond best to high frequencies, a type of sensory map defined as tonotopy. Tonotopic maps have been studied extensively using artificial stimuli (pure tones) but our knowledge of how these maps represent information about sequences of natural, spectro-temporally rich sounds is sparse. We studied this question by conducting simultaneous extracellular recordings across IC depths in awake bats (Carollia perspicillata) that listened to sequences of natural communication and echolocation sounds. The hypothesis was that information about these two types of sound streams is represented at different IC depths since they exhibit large differences in spectral composition, i.e., echolocation covers the high-frequency portion of the bat soundscape (> 45 kHz), while communication sounds are broadband and carry most power at low frequencies (20–25 kHz). Our results showed that mutual information between neuronal responses and acoustic stimuli, as well as response redundancy in pairs of neurons recorded simultaneously, increase exponentially with IC depth. The latter occurs regardless of the sound type presented to the bats (echolocation or communication). Taken together, our results indicate the existence of mutual information and redundancy maps at the midbrain level whose response cannot be predicted based on the frequency composition of natural sounds and classic neuronal tuning curves.

Factors influencing classification of frequency following responses to speech and music stimuli

Successful mapping of meaningful labels to sound input requires accurate representation of that sound's acoustic variances in time and spectrum. For some individuals, such as children or those with hearing loss, having an objective measure of the integrity of this representation could be useful. Classification is a promising machine learning approach which can be used to objectively predict a stimulus label from the brain response. This approach has been previously used with auditory evoked potentials (AEP) such as the frequency following response (FFR), but a number of key issues remain unresolved before classification can be translated into clinical practice. Specifically, past efforts at FFR classification have used data from a given subject for both training and testing the classifier. It is also unclear which components of the FFR elicit optimal classification accuracy. To address these issues, we recorded FFRs from 13 adults with normal hearing in response to speech and music stimuli. We compared labeling accuracy of two cross-validation classification approaches using FFR data: (1) a more traditional method combining subject data in both the training and testing set, and (2) a "leave-one-out" approach, in which subject data is classified based on a model built exclusively from the data of other individuals. We also examined classification accuracy on decomposed and time-segmented FFRs. Our results indicate that the accuracy of leave-one-subject-out cross validation approaches that obtained in the more conventional cross-validation classifications while allowing a subject's results to be analysed with respect to normative data pooled from a separate population. In addition, we demonstrate that classification accuracy is highest when the entire FFR is used to train the classifier. Taken together, these efforts contribute key steps toward translation of classification-based machine learning approaches into clinical practice.

Crossmodal Phase Reset and Evoked Responses Provide Complementary Mechanisms for the Influence of Visual Speech in Auditory Cortex

Natural conversation is multisensory: when we can see the speaker's face, visual speech cues improve our comprehension. The neuronal mechanisms underlying this phenomenon remain unclear. The two main alternatives are visually mediated phase modulation of neuronal oscillations (excitability fluctuations) in auditory neurons and visual input-evoked responses in auditory neurons. Investigating this question using naturalistic audiovisual speech with intracranial recordings in humans of both sexes, we find evidence for both mechanisms. Remarkably, auditory cortical neurons track the temporal dynamics of purely visual speech using the phase of their slow oscillations and phase-related modulations in broadband high-frequency activity. Consistent with known perceptual enhancement effects, the visual phase reset amplifies the cortical representation of concomitant auditory speech. In contrast to this, and in line with earlier reports, visual input reduces the amplitude of evoked responses to concomitant auditory input. We interpret the combination of improved phase tracking and reduced response amplitude as evidence for more efficient and reliable stimulus processing in the presence of congruent auditory and visual speech inputs.SIGNIFICANCE STATEMENT Watching the speaker can facilitate our understanding of what is being said. The mechanisms responsible for this influence of visual cues on the processing of speech remain incompletely understood. We studied these mechanisms by recording the electrical activity of the human brain through electrodes implanted surgically inside the brain. We found that visual inputs can operate by directly activating auditory cortical areas, and also indirectly by modulating the strength of cortical responses to auditory input. Our results help to understand the mechanisms by which the brain merges auditory and visual speech into a unitary perception.

Spike Timing in the Attention Network Predicts Behavioral Outcome Prior to Target Selection

There has been little evidence linking changes in spiking activity that occur prior to a spatially predictable target (i.e., prior to target selection) to behavioral outcomes, despite such preparatory changes being widely assumed to enhance the sensitivity of sensory processing. We simultaneously recorded from frontal and parietal nodes of the attention network while macaques performed a spatial cueing task. When anticipating a spatially predictable target, different patterns of coupling between spike timing and the oscillatory phase in local field potentials-but not changes in spike rate-were predictive of different behavioral outcomes. These behaviorally relevant differences in local and between-region synchronization occurred among specific cell types that were defined based on their sensory and motor properties, providing insight into the mechanisms underlying enhanced sensory processing prior to target selection. We propose that these changes in neural synchronization reflect differential anticipatory engagement of the network nodes and functional units that shape attention-related sampling.

Local field potential phase modulates neural responses to intracortical electrical stimulation

Cortical visual prostheses could one day help restore sight to the blind by targeting the visual cortex with electrical stimulation. However, power consumption and limited spatial resolution impose limits on performance, while large amounts of electrical charge sometimes necessary to evoke phosphenes can cause seizures. Here, we propose the use of the local field potential as a control signal for the timing of stimulation to reduce charge requirements. In Sprague-Dawley rats, visual cortex was electrically stimulated at random times, and neural responses recorded. Electrical stimulation at specific phases of the local field potential required smaller amounts of charge to elicit spikes than naïve stimulation. Incorporating this into prosthesis design could improve their safety and efficacy.

Spontaneous travelling cortical waves gate perception in behaving primates

Perceptual sensitivity varies from moment to moment. One potential source of variability is spontaneous fluctuations in cortical activity that can travel as a wave¹. Spontaneous traveling waves have been reported during anesthesia^2–7, but it is not known whether spontaneous traveling waves play a role during waking perception. Using newly developed analytic techniques to characterize the moment-to-moment dynamics of noisy multielectrode data, we find spontaneous waves of activity in extrastriate visual cortex of awake, behaving marmosets (Callithrix jacchus). In monkeys trained to detect faint visual targets, the timing and position of spontaneous traveling waves, prior to target onset, predict the magnitude of target-evoked activity and the likelihood of target detection. In contrast, spatially disorganized fluctuations of neural activity are much less predictive. These results reveal an important role for spontaneous traveling waves in sensory processing through modulating neural and perceptual sensitivity.

Phase-amplitude coupling profiles differ in frontal and auditory cortices of bats

Neural oscillations are at the core of important computations in the mammalian brain. Interactions between oscillatory activities in different frequency bands, such as delta (1-4 Hz), theta (4-8 Hz) or gamma (>30 Hz), are a powerful mechanism for binding fundamentally distinct spatiotemporal scales of neural processing. Phase-amplitude coupling (PAC) is one such plausible and well-described interaction, but much is yet to be uncovered regarding how PAC dynamics contribute to sensory representations. In particular, although PAC appears to have a major role in audition, the characteristics of coupling profiles in sensory and integration (i.e. frontal) cortical areas remain obscure. Here, we address this question by studying PAC dynamics in the frontal-auditory field (FAF; an auditory area in the bat frontal cortex) and the auditory cortex (AC) of the bat Carollia perspicillata. By means of simultaneous electrophysiological recordings in frontal and auditory cortices examining local-field potentials (LFPs), we show that the amplitude of gamma-band activity couples with the phase of low-frequency LFPs in both structures. Our results demonstrate that the coupling in FAF occurs most prominently in delta/high-gamma frequencies (1-4/75-100 Hz), whereas in the AC the coupling is strongest in the delta-theta/low-gamma (2-8/25-55 Hz) range. We argue that distinct PAC profiles may represent different mechanisms for neuronal processing in frontal and auditory cortices, and might complement oscillatory interactions for sensory processing in the frontal-auditory cortex network.

Phase of firing coding of learning variables across the fronto-striatal network during feature-based learning

The prefrontal cortex and striatum form a recurrent network whose spiking activity encodes multiple types of learning-relevant information. This spike-encoded information is evident in average firing rates, but finer temporal coding might allow multiplexing and enhanced readout across the connected network. We tested this hypothesis in the fronto-striatal network of nonhuman primates during reversal learning of feature values. We found that populations of neurons encoding choice outcomes, outcome prediction errors, and outcome history in their firing rates also carry significant information in their phase-of-firing at a 10–25 Hz band-limited beta frequency at which they synchronize across lateral prefrontal cortex, anterior cingulate cortex and anterior striatum when outcomes were processed. The phase-of-firing code exceeds information that can be obtained from firing rates alone and is evident for inter-areal connections between anterior cingulate cortex, lateral prefrontal cortex and anterior striatum. For the majority of connections, the phase-of-firing information gain is maximal at phases of the beta cycle that were offset from the preferred spiking phase of neurons. Taken together, these findings document enhanced information of three important learning variables at specific phases of firing in the beta cycle at an inter-areally shared beta oscillation frequency during goal-directed behavior.

The average spiking frequency in the fronto-striatal network encodes multiple types of learning-relevant information. Here, the authors show that populations of neurons in non-human primates also carry significant information in their phase-of-firing when learning-relevant outcomes are processed.

Oscillatory Bursting as a Mechanism for Temporal Coupling and Information Coding

Even the simplest cognitive processes involve interactions between cortical regions. To study these processes, we usually rely on averaging across several repetitions of a task or across long segments of data to reach a statistically valid conclusion. Neuronal oscillations reflect synchronized excitability fluctuations in ensembles of neurons and can be observed in electrophysiological recordings in the presence or absence of an external stimulus. Oscillatory brain activity has been viewed as sustained increase in power at specific frequency bands. However, this perspective has been challenged in recent years by the notion that oscillations may occur as transient burst-like events that occur in individual trials and may only appear as sustained activity when multiple trials are averaged together. In this review, we examine the idea that oscillatory activity can manifest as a transient burst as well as a sustained increase in power. We discuss the technical challenges involved in the detection and characterization of transient events at the single trial level, the mechanisms that might generate them and the features that can be extracted from these events to study single-trial dynamics of neuronal ensemble activity.

Spike Phase Shift Relative to Beta Oscillations Mediates Modality Selection

How does the brain selectively process signals from stimuli of different modalities? Coherent oscillations may function in coordinating communication between neuronal populations simultaneously involved in such cognitive behavior. Beta power (12-30 Hz) is implicated in top-down cognitive processes. Here we test the hypothesis that the brain increases encoding and behavioral influence of a target modality by shifting the relationship of neuronal spike phases relative to beta oscillations between primary sensory cortices and higher cortices. We simultaneously recorded neuronal spike and local field potentials in the posterior parietal cortex (PPC) and the primary auditory cortex (A1) when male rats made choices to either auditory or visual stimuli. Neuronal spikes exhibited modality-related phase locking to beta oscillations during stimulus sampling, and the phase shift between neuronal subpopulations demonstrated faster top-down signaling from PPC to A1 neurons when animals attended to auditory rather than visual stimuli. Importantly, complementary to spike timing, spike phase predicted rats' attended-to target in single trials, which was related to the animals' performance. Our findings support a candidate mechanism that cortices encode targets from different modalities by shifting neuronal spike phase. This work may extend our understanding of the importance of spike phase as a coding and readout mechanism.

Adaptation Modulates Spike-Phase Coupling Tuning Curve in the Rat Primary Auditory Cortex

Adaptation is an important mechanism that causes a decrease in the neural response both in terms of local field potentials (LFP) and spiking activity. We previously showed this reduction effect in the tuning curve of the primary auditory cortex. Moreover, we revealed that a repeated stimulus reduces the neural response in terms of spike-phase coupling (SPC). In the current study, we examined the effect of adaptation on the SPC tuning curve. To this end, employing the phase-locking value (PLV) method, we estimated the spike-LFP coupling. The data was obtained by a simultaneous recording from four single-electrodes in the primary auditory cortex of 15 rats. We first investigated whether the neural system may use spike-LFP phase coupling in the primary auditory cortex to encode sensory information. Secondly, we investigated the effect of adaptation on this potential SPC tuning. Our data showed that the coupling between spikes’ times and the LFP phase in beta oscillations represents sensory information (different stimulus frequencies), with an inverted bell-shaped tuning curve. Furthermore, we showed that adaptation to a specific frequency modulates SPC tuning curve of the adapter and its neighboring frequencies. These findings could be useful for interpretation of feature representation in terms of SPC and the underlying neural mechanism of adaptation.

Multicoding in neural information transfer suggested by mathematical analysis of the frequency-dependent synaptic plasticity in vivo

Two elements of neural information processing have primarily been proposed: firing rate and spike timing of neurons. In the case of synaptic plasticity, although spike-timing-dependent plasticity (STDP) depending on presynaptic and postsynaptic spike times had been considered the most common rule, recent studies have shown the inhibitory nature of the brain in vivo for precise spike timing, which is key to the STDP. Thus, the importance of the firing frequency in synaptic plasticity in vivo has been recognized again. However, little is understood about how the frequency-dependent synaptic plasticity (FDP) is regulated in vivo. Here, we focused on the presynaptic input pattern, the intracellular calcium decay time constants, and the background synaptic activity, which vary depending on neuron types and the anatomical and physiological environment in the brain. By analyzing a calcium-based model, we found that the synaptic weight differs depending on these factors characteristic in vivo, even if neurons receive the same input rate. This finding suggests the involvement of multifaceted factors other than input frequency in FDP and even neural coding in vivo.

Pitch, Timbre and Intensity Interdependently Modulate Neural Responses to Salient Sounds

As we listen to everyday sounds, auditory perception is heavily shaped by interactions between acoustic attributes such as pitch, timbre and intensity; though it is not clear how such interactions affect judgments of acoustic salience in dynamic soundscapes. Salience perception is believed to rely on an internal brain model that tracks the evolution of acoustic characteristics of a scene and flags events that do not fit this model as salient. The current study explores how the interdependency between attributes of dynamic scenes affects the neural representation of this internal model and shapes encoding of salient events. Specifically, the study examines how deviations along combinations of acoustic attributes interact to modulate brain responses, and subsequently guide perception of certain sound events as salient given their context. Human volunteers have their attention focused on a visual task and ignore acoustic melodies playing in the background while their brain activity using electroencephalography is recorded. Ambient sounds consist of musical melodies with probabilistically-varying acoustic attributes. Salient notes embedded in these scenes deviate from the melody's statistical distribution along pitch, timbre and/or intensity. Recordings of brain responses to salient notes reveal that neural power in response to the melodic rhythm as well as cross-trial phase alignment in the theta band are modulated by degree of salience of the notes, estimated across all acoustic attributes given their probabilistic context. These neural nonlinear effects across attributes strongly parallel behavioral nonlinear interactions observed in perceptual judgments of auditory salience using similar dynamic melodies; suggesting a neural underpinning of nonlinear interactions that underlie salience perception.