Long-term modifications in motor cortical dynamics induced by intensive practice

A theory of the skill-performance relationship

The skill-performance relationship is a cornerstone of a meritocratic society. People are selected for schools, colleges and jobs based on the premise that more skillful individuals perform better. Scientific understanding of the skill-performance relationship demands that the effect of skill on performance is objectively assessed without subjective, social, and political considerations. One of the best areas for this analysis is sports. In many sports settings, the skill-performance relationship can objectively be examined at the technical, behavioral, psychological, and neurological levels. This examination reveals that skill and performance are inextricably intertwined. While skill affects performance, performance in turn defines and affects skill. To disentangle the previously confusing and interchangeable use of these key constructs, the paper presents a theoretical model specifying that ability and effort have their own direct effects on performance, as well as indirect effects on performance through skill possession and skill execution in cognitive and physical domains of human performance. Thus, ability and skill are not the same. Although skill is a key determinant of performance, recent theory and research suggests that successful performers are successful not just because of their skills per se, but because they take advantage of their skills by creating more occurrences of momentum, making them last longer, and using them to bounce back faster from streaks of unsuccessful performance. Thus, momentum is an important mediator of the effects of skill on performance.

The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception

Timing and motor function share neural circuits and dynamics, which underpin their close and synergistic relationship. For instance, the temporal predictability of a sensory event optimizes motor responses to that event. Knowing when an event is likely to occur lowers response thresholds, leading to faster and more efficient motor behavior though in situations of response conflict can induce impulsive and inappropriate responding. In turn, through a process of active sensing, coupling action to temporally predictable sensory input enhances perceptual processing. Action not only hones perception of the event's onset or duration, but also boosts sensory processing of its non-temporal features such as pitch or shape. The effects of temporal predictability on motor behavior and sensory processing involve motor and left parietal cortices and are mediated by changes in delta and beta oscillations in motor areas of the brain.

Precise Spiking Motifs in Neurobiological and Neuromorphic Data

Why do neurons communicate through spikes? By definition, spikes are all-or-none neural events which occur at continuous times. In other words, spikes are on one side binary, existing or not without further details, and on the other, can occur at any asynchronous time, without the need for a centralized clock. This stands in stark contrast to the analog representation of values and the discretized timing classically used in digital processing and at the base of modern-day neural networks. As neural systems almost systematically use this so-called event-based representation in the living world, a better understanding of this phenomenon remains a fundamental challenge in neurobiology in order to better interpret the profusion of recorded data. With the growing need for intelligent embedded systems, it also emerges as a new computing paradigm to enable the efficient operation of a new class of sensors and event-based computers, called neuromorphic, which could enable significant gains in computation time and energy consumption-a major societal issue in the era of the digital economy and global warming. In this review paper, we provide evidence from biology, theory and engineering that the precise timing of spikes plays a crucial role in our understanding of the efficiency of neural networks.

The covariance perceptron: A new paradigm for classification and processing of time series in recurrent neuronal networks

Learning in neuronal networks has developed in many directions, in particular to reproduce cognitive tasks like image recognition and speech processing. Implementations have been inspired by stereotypical neuronal responses like tuning curves in the visual system, where, for example, ON/OFF cells fire or not depending on the contrast in their receptive fields. Classical models of neuronal networks therefore map a set of input signals to a set of activity levels in the output of the network. Each category of inputs is thereby predominantly characterized by its mean. In the case of time series, fluctuations around this mean constitute noise in this view. For this paradigm, the high variability exhibited by the cortical activity may thus imply limitations or constraints, which have been discussed for many years. For example, the need for averaging neuronal activity over long periods or large groups of cells to assess a robust mean and to diminish the effect of noise correlations. To reconcile robust computations with variable neuronal activity, we here propose a conceptual change of perspective by employing variability of activity as the basis for stimulus-related information to be learned by neurons, rather than merely being the noise that corrupts the mean signal. In this new paradigm both afferent and recurrent weights in a network are tuned to shape the input-output mapping for covariances, the second-order statistics of the fluctuating activity. When including time lags, covariance patterns define a natural metric for time series that capture their propagating nature. We develop the theory for classification of time series based on their spatio-temporal covariances, which reflect dynamical properties. We demonstrate that recurrent connectivity is able to transform information contained in the temporal structure of the signal into spatial covariances. Finally, we use the MNIST database to show how the covariance perceptron can capture specific second-order statistical patterns generated by moving digits.

The dynamics in cortex is characterized by highly fluctuating activity: Even under the very same experimental conditions the activity typically does not reproduce on the level of individual spikes. Given this variability, how then does the brain realize its quasi-deterministic function? One obvious solution is to compute averages over many cells, assuming that the mean activity, or rate, is actually the decisive signal. Variability across trials of an experiment is thus considered noise. We here explore the opposite view: Can fluctuations be used to actually represent information? And if yes, is there a benefit over a representation using the mean rate? We find that a fluctuation-based scheme is not only powerful in distinguishing signals into several classes, but also that networks can efficiently be trained in the new paradigm. Moreover, we argue why such a scheme of representation is more consistent with known forms of synaptic plasticity than rate-based network dynamics.

Self-consistent formulations for stochastic nonlinear neuronal dynamics

Neural dynamics is often investigated with tools from bifurcation theory. However, many neuron models are stochastic, mimicking fluctuations in the input from unknown parts of the brain or the spiking nature of signals. Noise changes the dynamics with respect to the deterministic model; in particular classical bifurcation theory cannot be applied. We formulate the stochastic neuron dynamics in the Martin-Siggia-Rose de Dominicis-Janssen (MSRDJ) formalism and present the fluctuation expansion of the effective action and the functional renormalization group (fRG) as two systematic ways to incorporate corrections to the mean dynamics and time-dependent statistics due to fluctuations in the presence of nonlinear neuronal gain. To formulate self-consistency equations, we derive a fundamental link between the effective action in the Onsager-Machlup (OM) formalism, which allows the study of phase transitions, and the MSRDJ effective action, which is computationally advantageous. These results in particular allow the derivation of an OM effective action for systems with non-Gaussian noise. This approach naturally leads to effective deterministic equations for the first moment of the stochastic system; they explain how nonlinearities and noise cooperate to produce memory effects. Moreover, the MSRDJ formulation yields an effective linear system that has identical power spectra and linear response. Starting from the better known loopwise approximation, we then discuss the use of the fRG as a method to obtain self-consistency beyond the mean. We present a new efficient truncation scheme for the hierarchy of flow equations for the vertex functions by adapting the Blaizot, Méndez, and Wschebor approximation from the derivative expansion to the vertex expansion. The methods are presented by means of the simplest possible example of a stochastic differential equation that has generic features of neuronal dynamics.

3d-SPADE: Significance evaluation of spatio-temporal patterns of various temporal extents

The Spike Pattern Detection and Evaluation (SPADE) analysis is a method to find reoccurring spike patterns in parallel spike train data, and to determine their statistical significance. Here we introduce an extension of the original statistical testing procedure which explicitly accounts for the temporal duration of the patterns. The extension improves the performance in the presence of patterns with different durations, as here demonstrated by application to various synthetic data. We further introduce an implementation of SPADE in form of a sub-module of the Python library Elephant (ELEctroPHysiological ANalysis Toolkit). The code is made publicly available on GitHub, together with detailed documentation, tutorials, and the results presented here.

Surrogate Data Methods Based on a Shuffling of the Trials for Synchrony Detection: The Centering Issue

We investigate several distribution-free dependence detection procedures, all based on a shuffling of the trials, from a statistical point of view. The mathematical justification of such procedures lies in the bootstrap principle and its approximation properties. In particular, we show that such a shuffling has mainly to be done on centered quantities-that is, quantities with zero mean under independence-to construct correct p-values, meaning that the corresponding tests control their false positive (FP) rate. Thanks to this study, we introduce a method, named permutation UE, which consists of a multiple testing procedure based on permutation of experimental trials and delayed coincidence count. Each involved single test of this procedure achieves the prescribed level, so that the corresponding multiple testing procedure controls the false discovery rate (FDR), and this with as few assumptions as possible on the underneath distribution, except independence and identical distribution across trials. The mathematical meaning of this assumption is discussed, and it is in particular argued that it does not mean what is commonly referred in neuroscience to as cross-trials stationarity. Some simulations show, moreover, that permutation UE outperforms the trial-shuffling of Pipa and Grün ( 2003 ) and the MTGAUE method of Tuleau-Malot et al. ( 2014 ) in terms of single levels and FDR, for a comparable amount of false negatives. Application to real data is also provided.

Methods for identification of spike patterns in massively parallel spike trains

Temporally, precise correlations between simultaneously recorded neurons have been interpreted as signatures of cell assemblies, i.e., groups of neurons that form processing units. Evidence for this hypothesis was found on the level of pairwise correlations in simultaneous recordings of few neurons. Increasing the number of simultaneously recorded neurons increases the chances to detect cell assembly activity due to the larger sample size. Recent technological advances have enabled the recording of 100 or more neurons in parallel. However, these massively parallel spike train data require novel statistical tools to be analyzed for correlations, because they raise considerable combinatorial and multiple testing issues. Recently, various of such methods have started to develop. First approaches were based on population or pairwise measures of synchronization, and later led to methods for the detection of various types of higher-order synchronization and of spatio-temporal patterns. The latest techniques combine data mining with analysis of statistical significance. Here, we give a comparative overview of these methods, of their assumptions and of the types of correlations they can detect.

Bistability, non-ergodicity, and inhibition in pairwise maximum-entropy models

Pairwise maximum-entropy models have been used in neuroscience to predict the activity of neuronal populations, given only the time-averaged correlations of the neuron activities. This paper provides evidence that the pairwise model, applied to experimental recordings, would produce a bimodal distribution for the population-averaged activity, and for some population sizes the second mode would peak at high activities, that experimentally would be equivalent to 90% of the neuron population active within time-windows of few milliseconds. Several problems are connected with this bimodality: 1. The presence of the high-activity mode is unrealistic in view of observed neuronal activity and on neurobiological grounds. 2. Boltzmann learning becomes non-ergodic, hence the pairwise maximum-entropy distribution cannot be found: in fact, Boltzmann learning would produce an incorrect distribution; similarly, common variants of mean-field approximations also produce an incorrect distribution. 3. The Glauber dynamics associated with the model is unrealistically bistable and cannot be used to generate realistic surrogate data. This bimodality problem is first demonstrated for an experimental dataset from 159 neurons in the motor cortex of macaque monkey. Evidence is then provided that this problem affects typical neural recordings of population sizes of a couple of hundreds or more neurons. The cause of the bimodality problem is identified as the inability of standard maximum-entropy distributions with a uniform reference measure to model neuronal inhibition. To eliminate this problem a modified maximum-entropy model is presented, which reflects a basic effect of inhibition in the form of a simple but non-uniform reference measure. This model does not lead to unrealistic bimodalities, can be found with Boltzmann learning, and has an associated Glauber dynamics which incorporates a minimal asymmetric inhibition.

Networks of interacting units are ubiquitous in various fields of biology; e.g. gene regulatory networks, neuronal networks, social structures. If a limited set of observables is accessible, maximum-entropy models provide a way to construct a statistical model for such networks, under particular assumptions. The pairwise maximum-entropy model only uses the first two moments among those observables, and can be interpreted as a network with only pairwise interactions. If correlations are on average positive, we here show that the maximum entropy distribution tends to become bimodal. In the application to neuronal activity this is a problem, because the bimodality is an artefact of the statistical model and not observed in real data. This problem could also affect other fields in biology. We here explain under which conditions bimodality arises and present a solution to the problem by introducing a collective negative feedback, corresponding to a modified maximum-entropy model. This result may point to the existence of a homeostatic mechanism active in the system that is not part of our set of observable units.

Synchronous Spike Patterns in Macaque Motor Cortex during an Instructed-Delay Reach-to-Grasp Task

The computational role of spike time synchronization at millisecond precision among neurons in the cerebral cortex is hotly debated. Studies performed on data of limited size provided experimental evidence that low-order correlations occur in relation to behavior. Advances in electrophysiological technology to record from hundreds of neurons simultaneously provide the opportunity to observe coordinated spiking activity of larger populations of cells. We recently published a method that combines data mining and statistical evaluation to search for significant patterns of synchronous spikes in massively parallel spike trains (Torre et al., 2013). The method solves the computational and multiple testing problems raised by the high dimensionality of the data. In the current study, we used our method on simultaneous recordings from two macaque monkeys engaged in an instructed-delay reach-to-grasp task to determine the emergence of spike synchronization in relation to behavior. We found a multitude of synchronous spike patterns aligned in both monkeys along a preferential mediolateral orientation in brain space. The occurrence of the patterns is highly specific to behavior, indicating that different behaviors are associated with the synchronization of different groups of neurons ("cell assemblies"). However, pooled patterns that overlap in neuronal composition exhibit no specificity, suggesting that exclusive cell assemblies become active during different behaviors, but can recruit partly identical neurons. These findings are consistent across multiple recording sessions analyzed across the two monkeys.

SIGNIFICANCE STATEMENT

Neurons in the brain communicate via electrical impulses called spikes. How spikes are coordinated to process information is still largely unknown. Synchronous spikes are effective in triggering a spike emission in receiving neurons and have been shown to occur in relation to behavior in a number of studies on simultaneous recordings of few neurons. We recently published a method to extend this type of investigation to larger data. Here, we apply it to simultaneous recordings of hundreds of neurons from the motor cortex of macaque monkeys performing a motor task. Our analysis reveals groups of neurons selectively synchronizing their activity in relation to behavior, which sheds new light on the role of synchrony in information processing in the cerebral cortex.

Locking of correlated neural activity to ongoing oscillations

Population-wide oscillations are ubiquitously observed in mesoscopic signals of cortical activity. In these network states a global oscillatory cycle modulates the propensity of neurons to fire. Synchronous activation of neurons has been hypothesized to be a separate channel of signal processing information in the brain. A salient question is therefore if and how oscillations interact with spike synchrony and in how far these channels can be considered separate. Experiments indeed showed that correlated spiking co-modulates with the static firing rate and is also tightly locked to the phase of beta-oscillations. While the dependence of correlations on the mean rate is well understood in feed-forward networks, it remains unclear why and by which mechanisms correlations tightly lock to an oscillatory cycle. We here demonstrate that such correlated activation of pairs of neurons is qualitatively explained by periodically-driven random networks. We identify the mechanisms by which covariances depend on a driving periodic stimulus. Mean-field theory combined with linear response theory yields closed-form expressions for the cyclostationary mean activities and pairwise zero-time-lag covariances of binary recurrent random networks. Two distinct mechanisms cause time-dependent covariances: the modulation of the susceptibility of single neurons (via the external input and network feedback) and the time-varying variances of single unit activities. For some parameters, the effectively inhibitory recurrent feedback leads to resonant covariances even if mean activities show non-resonant behavior. Our analytical results open the question of time-modulated synchronous activity to a quantitative analysis.

Psychological Momentum-A Key to Continued Success

One of the most fundamental characteristics about humans is their desire for success, especially in highly competitive societies. What does it take to be successful? Is success simply a matter of better performance, and if so, what specifically is it about performance that determines success? A long research tradition suggests that psychological momentum (PM) plays a critical role in goal pursuit and achievement. Accordingly, sequential runs of success are an essential feature of high levels of performance, meaning that better performers perceive and experience momentum of success more frequently, ride it as long as they can, and as a result, become more successful in the end. Theoretically, momentum is a principle vehicle of performance that will significantly augment future success and facilitate goal achievement. Consequently, an overall performance consists of occurrences of momentum that vary in frequency and duration. The higher the frequency and the higher the duration, the more likely is success. Research suggests that the main psychological processes that underpin momentum effects are confidence, perceived competence, and internal (ability-skill) attributions. Based upon related research, it is hypothesized that PM starts as a conscious process but subsequently becomes a major facilitator of nonconscious automatic execution of human behavior and performance.

Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations

Network models are routinely downscaled compared to nature in terms of numbers of nodes or edges because of a lack of computational resources, often without explicit mention of the limitations this entails. While reliable methods have long existed to adjust parameters such that the first-order statistics of network dynamics are conserved, here we show that limitations already arise if also second-order statistics are to be maintained. The temporal structure of pairwise averaged correlations in the activity of recurrent networks is determined by the effective population-level connectivity. We first show that in general the converse is also true and explicitly mention degenerate cases when this one-to-one relationship does not hold. The one-to-one correspondence between effective connectivity and the temporal structure of pairwise averaged correlations implies that network scalings should preserve the effective connectivity if pairwise averaged correlations are to be held constant. Changes in effective connectivity can even push a network from a linearly stable to an unstable, oscillatory regime and vice versa. On this basis, we derive conditions for the preservation of both mean population-averaged activities and pairwise averaged correlations under a change in numbers of neurons or synapses in the asynchronous regime typical of cortical networks. We find that mean activities and correlation structure can be maintained by an appropriate scaling of the synaptic weights, but only over a range of numbers of synapses that is limited by the variance of external inputs to the network. Our results therefore show that the reducibility of asynchronous networks is fundamentally limited.

Investigating Neuroanatomical Features in Top Athletes at the Single Subject Level

In sport events like Olympic Games or World Championships competitive athletes keep pushing the boundaries of human performance. Compared to team sports, high achievements in many athletic disciplines depend solely on the individual's performance. Contrasting previous research looking for expertise-related differences in brain anatomy at the group level, we aim to demonstrate changes in individual top athlete's brain, which would be averaged out in a group analysis. We compared structural magnetic resonance images (MRI) of three professional track-and-field athletes to age-, gender- and education-matched control subjects. To determine brain features specific to these top athletes, we tested for significant deviations in structural grey matter density between each of the three top athletes and a carefully matched control sample. While total brain volumes were comparable between athletes and controls, we show regional grey matter differences in striatum and thalamus. The demonstrated brain anatomy patterns remained stable and were detected after 2 years with Olympic Games in between. We also found differences in the fusiform gyrus in two top long jumpers. We interpret our findings in reward-related areas as correlates of top athletes' persistency to reach top-level skill performance over years.

Signs of timing in motor cortex during movement preparation and cue anticipation

The capacity to accurately anticipate the timing of predictable events is essential for sensorimotor behavior. Motor cortex holds an established role in movement preparation and execution. In this chapter we review the different ways in which motor cortical activity is modulated by event timing in sensorimotor delay tasks. During movement preparation, both single neuron and population responses reflect the temporal constraints of the task. Anticipatory modulations prior to sensory cues are also observed in motor cortex when the cue timing is predictable. We propose that the motor cortical activity during cue anticipation and movement preparation is embedded in a timing network that facilitates sensorimotor processing. In this context, the pre-cue and post-cue activity may reflect a presetting mechanism, complementing processing during movement execution, while prohibiting premature responses in situations requiring delayed motor output.

Electrifying the motor engram: effects of tDCS on motor learning and control

Learning to control our movements is accompanied by neuroplasticity of motor areas of the brain. The mechanisms of neuroplasticity are diverse and produce what is referred to as the motor engram, i.e., the neural trace of the motor memory. Transcranial direct current stimulation (tDCS) alters the neural and behavioral correlates of motor learning, but its precise influence on the motor engram is unknown. In this review, we summarize the effects of tDCS on neural activity and suggest a few key principles: (1) Firing rates are increased by anodal polarization and decreased by cathodal polarization, (2) anodal polarization strengthens newly formed associations, and (3) polarization modulates the memory of new/preferred firing patterns. With these principles in mind, we review the effects of tDCS on motor control, motor learning, and clinical applications. The increased spontaneous and evoked firing rates may account for the modulation of dexterity in non-learning tasks by tDCS. The facilitation of new association may account for the effect of tDCS on learning in sequence tasks while the ability of tDCS to strengthen memories of new firing patterns may underlie the effect of tDCS on consolidation of skills. We then describe the mechanisms of neuroplasticity of motor cortical areas and how they might be influenced by tDCS. We end with current challenges for the fields of brain stimulation and motor learning.

Multiple Tests Based on a Gaussian Approximation of the Unitary Events Method with Delayed Coincidence Count

The unitary events (UE) method is one of the most popular and efficient methods used over the past decade to detect patterns of coincident joint spike activity among simultaneously recorded neurons. The detection of coincidences is usually based on binned coincidence count (Grün, 1996 ), which is known to be subject to loss in synchrony detection (Grün, Diesmann, Grammont, Riehle, & Aertsen, 1999 ). This defect has been corrected by the multiple shift coincidence count (Grün et al., 1999 ). The statistical properties of this count have not been further investigated until this work, the formula being more difficult to deal with than the original binned count. First, we propose a new notion of coincidence count, the delayed coincidence count, which is equal to the multiple shift coincidence count when discretized point processes are involved as models for the spike trains. Moreover, it generalizes this notion to nondiscretized point processes, allowing us to propose a new gaussian approximation of the count. Since unknown parameters are involved in the approximation, we perform a plug-in step, where unknown parameters are replaced by estimated ones, leading to a modification of the approximating distribution. Finally the method takes the multiplicity of the tests into account via a Benjamini and Hochberg approach (Benjamini & Hochberg, 1995 ), to guarantee a prescribed control of the false discovery rate. We compare our new method, MTGAUE (multiple tests based on a gaussian approximation of the unitary events) and the UE method proposed in Grün et al. ( 1999 ) over various simulations, showing that MTGAUE extends the validity of the previous method. In particular, MTGAUE is able to detect both profusion and lack of coincidences with respect to the independence case and is robust to changes in the underlying model. Furthermore MTGAUE is applied on real data.

Modulation dynamics in the orofacial sensorimotor cortex during motor skill acquisition

The orofacial sensorimotor cortex is known to play a role in motor learning. However, how motor learning changes the dynamics of neuronal activity and whether these changes differ between orofacial primary motor (MIo) and somatosensory (SIo) cortices remain unknown. To address these questions, we used chronically implanted microelectrode arrays to track learning-induced changes in the activity of simultaneously recorded neurons in MIo and SIo as two naive monkeys (Macaca mulatta) were trained in a novel tongue-protrusion task. Over a period of 8-12 d, the monkeys showed behavioral improvements in task performance that were accompanied by rapid and long-lasting changes in neuronal responses in MIo and SIo occurring in parallel: (1) increases in the proportion of task-modulated neurons, (2) increases in the mutual information between tongue-protrusive force and spiking activity, (3) reductions in the across-trial firing rate variability, and (4) transient increases in coherent firing of neuronal pairs. More importantly, the time-resolved mutual information in MIo and SIo exhibited temporal alignment. While showing parallel changes, MIo neurons exhibited a bimodal distribution of peak correlation lag times between spiking activity and force, whereas SIo neurons showed a unimodal distribution. Moreover, coherent activity between pairs of MIo neurons was higher and centered around force onset compared with pairwise coherence of SIo neurons. Overall, the results suggest that the neuroplasticity in MIo and SIo occurring in parallel serves as a substrate for linking sensation and movement during sensorimotor learning, whereas the differing dynamic organizations reflect specific ways to control movement parameters as learning progresses.

Excitatory and inhibitory STDP jointly tune feedforward neural circuits to selectively propagate correlated spiking activity

Spike-timing-dependent plasticity (STDP) has been well established between excitatory neurons and several computational functions have been proposed in various neural systems. Despite some recent efforts, however, there is a significant lack of functional understanding of inhibitory STDP (iSTDP) and its interplay with excitatory STDP (eSTDP). Here, we demonstrate by analytical and numerical methods that iSTDP contributes crucially to the balance of excitatory and inhibitory weights for the selection of a specific signaling pathway among other pathways in a feedforward circuit. This pathway selection is based on the high sensitivity of STDP to correlations in spike times, which complements a recent proposal for the role of iSTDP in firing-rate based selection. Our model predicts that asymmetric anti-Hebbian iSTDP exceeds asymmetric Hebbian iSTDP for supporting pathway-specific balance, which we show is useful for propagating transient neuronal responses. Furthermore, we demonstrate how STDPs at excitatory-excitatory, excitatory-inhibitory, and inhibitory-excitatory synapses cooperate to improve the pathway selection. We propose that iSTDP is crucial for shaping the network structure that achieves efficient processing of synchronous spikes.

The correlation structure of local neuronal networks intrinsically results from recurrent dynamics

Correlated neuronal activity is a natural consequence of network connectivity and shared inputs to pairs of neurons, but the task-dependent modulation of correlations in relation to behavior also hints at a functional role. Correlations influence the gain of postsynaptic neurons, the amount of information encoded in the population activity and decoded by readout neurons, and synaptic plasticity. Further, it affects the power and spatial reach of extracellular signals like the local-field potential. A theory of correlated neuronal activity accounting for recurrent connectivity as well as fluctuating external sources is currently lacking. In particular, it is unclear how the recently found mechanism of active decorrelation by negative feedback on the population level affects the network response to externally applied correlated stimuli. Here, we present such an extension of the theory of correlations in stochastic binary networks. We show that (1) for homogeneous external input, the structure of correlations is mainly determined by the local recurrent connectivity, (2) homogeneous external inputs provide an additive, unspecific contribution to the correlations, (3) inhibitory feedback effectively decorrelates neuronal activity, even if neurons receive identical external inputs, and (4) identical synaptic input statistics to excitatory and to inhibitory cells increases intrinsically generated fluctuations and pairwise correlations. We further demonstrate how the accuracy of mean-field predictions can be improved by self-consistently including correlations. As a byproduct, we show that the cancellation of correlations between the summed inputs to pairs of neurons does not originate from the fast tracking of external input, but from the suppression of fluctuations on the population level by the local network. This suppression is a necessary constraint, but not sufficient to determine the structure of correlations; specifically, the structure observed at finite network size differs from the prediction based on perfect tracking, even though perfect tracking implies suppression of population fluctuations.

The co-occurrence of action potentials of pairs of neurons within short time intervals has been known for a long time. Such synchronous events can appear time-locked to the behavior of an animal, and also theoretical considerations argue for a functional role of synchrony. Early theoretical work tried to explain correlated activity by neurons transmitting common fluctuations due to shared inputs. This, however, overestimates correlations. Recently, the recurrent connectivity of cortical networks was shown responsible for the observed low baseline correlations. Two different explanations were given: One argues that excitatory and inhibitory population activities closely follow the external inputs to the network, so that their effects on a pair of cells mutually cancel. Another explanation relies on negative recurrent feedback to suppress fluctuations in the population activity, equivalent to small correlations. In a biological neuronal network one expects both, external inputs and recurrence, to affect correlated activity. The present work extends the theoretical framework of correlations to include both contributions and explains their qualitative differences. Moreover, the study shows that the arguments of fast tracking and recurrent feedback are not equivalent, only the latter correctly predicts the cell-type specific correlations.

Computer simulations of synchrony and oscillations evoked by two coherent inputs

Coherent oscillations have been reported in multiple cortical areas. This study examines the characteristics of output spikes through computer simulations when the neural network model receives periodic/aperiodic spatiotemporal spikes with modulated/constant populational activity from two pathways. Synchronous oscillations which have the same period as the input are observed in response to periodic input patterns regardless of populational activity. The results confirm that the output frequency of synchrony is essentially determined by the period of the repeated input patterns. On the other hand, weak periodic outputs are observed when aperiodic spikes are input with modulated populational activity. In this case, higher firing rates are necessary to input for higher frequency oscillations. The spike-timing-dependent plasticity suppresses the spikes which do not contribute to the synchrony for periodic inputs. This effect corresponds to the experimental reports that learning sharpens the synchrony in the motor cortex. These results suggest that spatiotemporal spike patterns should be entrained on modulated populational activity to transmit oscillatory information effectively in the convergent pathway.

Propagating synchrony in feed-forward networks

Coordinated patterns of precisely timed action potentials (spikes) emerge in a variety of neural circuits but their dynamical origin is still not well understood. One hypothesis states that synchronous activity propagating through feed-forward chains of groups of neurons (synfire chains) may dynamically generate such spike patterns. Additionally, synfire chains offer the possibility to enable reliable signal transmission. So far, mostly densely connected chains, often with all-to-all connectivity between groups, have been theoretically and computationally studied. Yet, such prominent feed-forward structures have not been observed experimentally. Here we analytically and numerically investigate under which conditions diluted feed-forward chains may exhibit synchrony propagation. In addition to conventional linear input summation, we study the impact of non-linear, non-additive summation accounting for the effect of fast dendritic spikes. The non-linearities promote synchronous inputs to generate precisely timed spikes. We identify how non-additive coupling relaxes the conditions on connectivity such that it enables synchrony propagation at connectivities substantially lower than required for linearly coupled chains. Although the analytical treatment is based on a simple leaky integrate-and-fire neuron model, we show how to generalize our methods to biologically more detailed neuron models and verify our results by numerical simulations with, e.g., Hodgkin Huxley type neurons.

A unified view on weakly correlated recurrent networks

The diversity of neuron models used in contemporary theoretical neuroscience to investigate specific properties of covariances in the spiking activity raises the question how these models relate to each other. In particular it is hard to distinguish between generic properties of covariances and peculiarities due to the abstracted model. Here we present a unified view on pairwise covariances in recurrent networks in the irregular regime. We consider the binary neuron model, the leaky integrate-and-fire (LIF) model, and the Hawkes process. We show that linear approximation maps each of these models to either of two classes of linear rate models (LRM), including the Ornstein-Uhlenbeck process (OUP) as a special case. The distinction between both classes is the location of additive noise in the rate dynamics, which is located on the output side for spiking models and on the input side for the binary model. Both classes allow closed form solutions for the covariance. For output noise it separates into an echo term and a term due to correlated input. The unified framework enables us to transfer results between models. For example, we generalize the binary model and the Hawkes process to the situation with synaptic conduction delays and simplify derivations for established results. Our approach is applicable to general network structures and suitable for the calculation of population averages. The derived averages are exact for fixed out-degree network architectures and approximate for fixed in-degree. We demonstrate how taking into account fluctuations in the linearization procedure increases the accuracy of the effective theory and we explain the class dependent differences between covariances in the time and the frequency domain. Finally we show that the oscillatory instability emerging in networks of LIF models with delayed inhibitory feedback is a model-invariant feature: the same structure of poles in the complex frequency plane determines the population power spectra.

Extended practice of a motor skill is associated with reduced metabolic activity in M1

How does long-term training and the development of motor skill modify the activity of the primary motor cortex (M1)? To address this issue we trained monkeys for ~1–6 years to perform visually-guided and internally-generated sequences of reaching movements. Then, we used ¹⁴C-2-deoxyglucose (2DG) uptake and single neuron recording to measure metabolic and neuron activity in M1. After extended practice, we observed a profound reduction of metabolic activity in M1 for the performance of internally-generated compared to visually-guided tasks. In contrast, measures of neuron firing displayed little difference during the two tasks. These findings suggest that the development of skill through extended practice results in a reduction in the synaptic activity required to produce internally-generated, but not visually-guided sequences of movements. Thus, practice leading to skilled performance results in more efficient generation of neuronal activity in M1.

Noise suppression and surplus synchrony by coincidence detection

The functional significance of correlations between action potentials of neurons is still a matter of vivid debate. In particular, it is presently unclear how much synchrony is caused by afferent synchronized events and how much is intrinsic due to the connectivity structure of cortex. The available analytical approaches based on the diffusion approximation do not allow to model spike synchrony, preventing a thorough analysis. Here we theoretically investigate to what extent common synaptic afferents and synchronized inputs each contribute to correlated spiking on a fine temporal scale between pairs of neurons. We employ direct simulation and extend earlier analytical methods based on the diffusion approximation to pulse-coupling, allowing us to introduce precisely timed correlations in the spiking activity of the synaptic afferents. We investigate the transmission of correlated synaptic input currents by pairs of integrate-and-fire model neurons, so that the same input covariance can be realized by common inputs or by spiking synchrony. We identify two distinct regimes: In the limit of low correlation linear perturbation theory accurately determines the correlation transmission coefficient, which is typically smaller than unity, but increases sensitively even for weakly synchronous inputs. In the limit of high input correlation, in the presence of synchrony, a qualitatively new picture arises. As the non-linear neuronal response becomes dominant, the output correlation becomes higher than the total correlation in the input. This transmission coefficient larger unity is a direct consequence of non-linear neural processing in the presence of noise, elucidating how synchrony-coded signals benefit from these generic properties present in cortical networks.

Whether spike timing conveys information in cortical networks or whether the firing rate alone is sufficient is a matter of controversial debate, touching the fundamental question of how the brain processes, stores, and conveys information. If the firing rate alone is the decisive signal used in the brain, correlations between action potentials are just an epiphenomenon of cortical connectivity, where pairs of neurons share a considerable fraction of common afferents. Due to membrane leakage, small synaptic amplitudes and the non-linear threshold, nerve cells exhibit lossy transmission of correlation originating from shared synaptic inputs. However, the membrane potential of cortical neurons often displays non-Gaussian fluctuations, caused by synchronized synaptic inputs. Moreover, synchronously active neurons have been found to reflect behavior in primates. In this work we therefore contrast the transmission of correlation due to shared afferents and due to synchronously arriving synaptic impulses for leaky neuron models. We not only find that neurons are highly sensitive to synchronous afferents, but that they can suppress noise on signals transmitted by synchrony, a computational advantage over rate signals.

Impact of spike train autostructure on probability distribution of joint spike events

The discussion whether temporally coordinated spiking activity really exists and whether it is relevant has been heated over the past few years. To investigate this issue, several approaches have been taken to determine whether synchronized events occur significantly above chance, that is, whether they occur more often than expected if the neurons fire independently. Most investigations ignore or destroy the autostructure of the spiking activity of individual cells or assume Poissonian spiking as a model. Such methods that ignore the autostructure can significantly bias the coincidence statistics. Here, we study the influence of the autostructure on the probability distribution of coincident spiking events between tuples of mutually independent non-Poisson renewal processes. In particular, we consider two types of renewal processes that were suggested as appropriate models of experimental spike trains: a gamma and a log-normal process. For a gamma process, we characterize the shape of the distribution analytically with the Fano factor (FFc). In addition, we perform Monte Carlo estimations to derive the full shape of the distribution and the probability for false positives if a different process type is assumed as was actually present. We also determine how manipulations of such spike trains, here dithering, used for the generation of surrogate data change the distribution of coincident events and influence the significance estimation. We find, first, that the width of the coincidence count distribution and its FFc depend critically and in a nontrivial way on the detailed properties of the structure of the spike trains as characterized by the coefficient of variation CV. Second, the dependence of the FFc on the CV is complex and mostly nonmonotonic. Third, spike dithering, even if as small as a fraction of the interspike interval, can falsify the inference on coordinated firing.

Synchrony and neural coding in cerebellar circuits

The cerebellum regulates complex movements and is also implicated in cognitive tasks, and cerebellar dysfunction is consequently associated not only with movement disorders, but also with conditions like autism and dyslexia. How information is encoded by specific cerebellar firing patterns remains debated, however. A central question is how the cerebellar cortex transmits its integrated output to the cerebellar nuclei via GABAergic synapses from Purkinje neurons. Possible answers come from accumulating evidence that subsets of Purkinje cells synchronize their firing during behaviors that require the cerebellum. Consistent with models predicting that coherent activity of inhibitory networks has the capacity to dictate firing patterns of target neurons, recent experimental work supports the idea that inhibitory synchrony may regulate the response of cerebellar nuclear cells to Purkinje inputs, owing to the interplay between unusually fast inhibitory synaptic responses and high rates of intrinsic activity. Data from multiple laboratories lead to a working hypothesis that synchronous inhibitory input from Purkinje cells can set the timing and rate of action potentials produced by cerebellar nuclear cells, thereby relaying information out of the cerebellum. If so, then changing spatiotemporal patterns of Purkinje activity would allow different subsets of inhibitory neurons to control cerebellar output at different times. Here we explore the evidence for and against the idea that a synchrony code defines, at least in part, the input–output function between the cerebellar cortex and nuclei. We consider the literature on the existence of simple spike synchrony, convergence of Purkinje neurons onto nuclear neurons, and intrinsic properties of nuclear neurons that contribute to responses to inhibition. Finally, we discuss factors that may disrupt or modulate a synchrony code and describe the potential contributions of inhibitory synchrony to other motor circuits.

High-capacity embedding of synfire chains in a cortical network model

Synfire chains, sequences of pools linked by feedforward connections, support the propagation of precisely timed spike sequences, or synfire waves. An important question remains, how synfire chains can efficiently be embedded in cortical architecture. We present a model of synfire chain embedding in a cortical scale recurrent network using conductance-based synapses, balanced chains, and variable transmission delays. The network attains substantially higher embedding capacities than previous spiking neuron models and allows all its connections to be used for embedding. The number of waves in the model is regulated by recurrent background noise. We computationally explore the embedding capacity limit, and use a mean field analysis to describe the equilibrium state. Simulations confirm the mean field analysis over broad ranges of pool sizes and connectivity levels; the number of pools embedded in the system trades off against the firing rate and the number of waves. An optimal inhibition level balances the conflicting requirements of stable synfire propagation and limited response to background noise. A simplified analysis shows that the present conductance-based synapses achieve higher contrast between the responses to synfire input and background noise compared to current-based synapses, while regulation of wave numbers is traced to the use of variable transmission delays.

State-space analysis of time-varying higher-order spike correlation for multiple neural spike train data

Precise spike coordination between the spiking activities of multiple neurons is suggested as an indication of coordinated network activity in active cell assemblies. Spike correlation analysis aims to identify such cooperative network activity by detecting excess spike synchrony in simultaneously recorded multiple neural spike sequences. Cooperative activity is expected to organize dynamically during behavior and cognition; therefore currently available analysis techniques must be extended to enable the estimation of multiple time-varying spike interactions between neurons simultaneously. In particular, new methods must take advantage of the simultaneous observations of multiple neurons by addressing their higher-order dependencies, which cannot be revealed by pairwise analyses alone. In this paper, we develop a method for estimating time-varying spike interactions by means of a state-space analysis. Discretized parallel spike sequences are modeled as multi-variate binary processes using a log-linear model that provides a well-defined measure of higher-order spike correlation in an information geometry framework. We construct a recursive Bayesian filter/smoother for the extraction of spike interaction parameters. This method can simultaneously estimate the dynamic pairwise spike interactions of multiple single neurons, thereby extending the Ising/spin-glass model analysis of multiple neural spike train data to a nonstationary analysis. Furthermore, the method can estimate dynamic higher-order spike interactions. To validate the inclusion of the higher-order terms in the model, we construct an approximation method to assess the goodness-of-fit to spike data. In addition, we formulate a test method for the presence of higher-order spike correlation even in nonstationary spike data, e.g., data from awake behaving animals. The utility of the proposed methods is tested using simulated spike data with known underlying correlation dynamics. Finally, we apply the methods to neural spike data simultaneously recorded from the motor cortex of an awake monkey and demonstrate that the higher-order spike correlation organizes dynamically in relation to a behavioral demand.

Nearly half a century ago, the Canadian psychologist D. O. Hebb postulated the formation of assemblies of tightly connected cells in cortical recurrent networks because of changes in synaptic weight (Hebb's learning rule) by repetitive sensory stimulation of the network. Consequently, the activation of such an assembly for processing sensory or behavioral information is likely to be expressed by precisely coordinated spiking activities of the participating neurons. However, the available analysis techniques for multiple parallel neural spike data do not allow us to reveal the detailed structure of transiently active assemblies as indicated by their dynamical pairwise and higher-order spike correlations. Here, we construct a state-space model of dynamic spike interactions, and present a recursive Bayesian method that makes it possible to trace multiple neurons exhibiting such precisely coordinated spiking activities in a time-varying manner. We also formulate a hypothesis test of the underlying dynamic spike correlation, which enables us to detect the assemblies activated in association with behavioral events. Therefore, the proposed method can serve as a useful tool to test Hebb's cell assembly hypothesis.

The effects of pooling on spike train correlations

Neurons integrate inputs from thousands of afferents. Similarly, some experimental techniques record the pooled activity of large populations of cells. When cells in these populations are correlated, the correlation coefficient between the collective activity of two subpopulations is typically much larger than the correlation coefficient between individual cells: The act of pooling individual cell signals amplifies correlations. We give an overview of this phenomenon and present several implications. In particular, we show that pooling leads to synchronization in feedforward networks and that it can amplify and otherwise distort correlations between recorded signals.

The local field potential reflects surplus spike synchrony

While oscillations of the local field potential (LFP) are commonly attributed to the synchronization of neuronal firing rate on the same time scale, their relationship to coincident spiking in the millisecond range is unknown. Here, we present experimental evidence to reconcile the notions of synchrony at the level of spiking and at the mesoscopic scale. We demonstrate that only in time intervals of significant spike synchrony that cannot be explained on the basis of firing rates, coincident spikes are better phase locked to the LFP than predicted by the locking of the individual spikes. This effect is enhanced in periods of large LFP amplitudes. A quantitative model explains the LFP dynamics by the orchestrated spiking activity in neuronal groups that contribute the observed surplus synchrony. From the correlation analysis, we infer that neurons participate in different constellations but contribute only a fraction of their spikes to temporally precise spike configurations. This finding provides direct evidence for the hypothesized relation that precise spike synchrony constitutes a major temporally and spatially organized component of the LFP.

Evoked potentials in motor cortical local field potentials reflect task timing and behavioral performance

Evoked potentials (EPs) are observed in motor cortical local field potentials (LFPs) during movement execution (movement-related potentials [MRPs]) and in response to relevant visual cues (visual evoked potentials [VEPs]). Motor cortical EPs may be directionally selective, but little is known concerning their relation to other aspects of motor behavior, such as task timing and performance. We recorded LFPs in motor cortex of two monkeys during performance of a precued arm-reaching task. A time cue at the start of each trial signaled delay duration and thereby the pace of the task and the available time for movement preparation. VEPs and MRPs were strongly modulated by the delay duration, VEPs being systematically larger in short-delay trials and MRPs larger in long-delay trials. Despite these systematic modulations related to the task timing, directional selectivity was similar in short and long trials. The behavioral reaction time was positively correlated with MRP size and negatively correlated with VEP size, within sessions. In addition, the behavioral performance improved across sessions, in parallel with a slow decrease in the size of VEPs and MRPs. Our results clearly show the strong influence of the behavioral context and performance on motor cortical population activity during movement preparation and execution.

Differential involvement of excitatory and inhibitory neurons of cat motor cortex in coincident spike activity related to behavioral context

To assess temporal associations in spike activity between pairs of neurons in the primary motor cortex (MI) related to different behaviors, we compared the incidence of coincident spiking activity of task-related (TR) and non-task-related (NTR) neurons during a skilled motor task and sitting quietly in adult cats (Felis domestica). Chronically implanted microwires were used to record spike activity of MI neurons in four animals (two male and two female) trained to perform a skilled reaching task or sit quietly. Neurons were identified as TR if spike activity was modulated during the task (and NTR if not). Based on spike characteristics, they were also classified as either regular-spiking (RS, putatively excitatory) or fast-spiking (FS, putatively inhibitory) neurons. Temporal associations in the activities of simultaneously recorded neurons were evaluated using shuffle-corrected cross-correlograms. Pairs of NTR and TR neurons showed associations in their firing patterns over wide areas of MI (representing forelimb and hindlimb movements) during quiet sitting, more commonly involving RS neurons. During skilled task performance, however, significantly coincident firing was seen almost exclusively between TR neurons in a smaller part of MI (representing forelimb movements), involving mainly FS neurons. The findings of this study show evidence for widespread interactions in MI when the animal sits quietly, which changes to a more specific and restricted pattern of interactions during task performance. Different populations of excitatory and inhibitory neurons appear to be synchronized during skilled movement and quiet sitting.

Estimating the contribution of assembly activity to cortical dynamics from spike and population measures

The hypothesis that cortical networks employ the coordinated activity of groups of neurons, termed assemblies, to process information is debated. Results from multiple single-unit recordings are not conclusive because of the dramatic undersampling of the system. However, the local field potential (LFP) is a mesoscopic signal reflecting synchronized network activity. This raises the question whether the LFP can be employed to overcome the problem of undersampling. In a recent study in the motor cortex of the awake behaving monkey based on the locking of coincidences to the LFP we determined a lower bound for the fraction of spike coincidences originating from assembly activation. This quantity together with the locking of single spikes leads to a lower bound for the fraction of spikes originating from any assembly activity. Here we derive a statistical method to estimate the fraction of spike synchrony caused by assemblies—not its lower bound—from the spike data alone. A joint spike and LFP surrogate data model demonstrates consistency of results and the sensitivity of the method. Combining spike and LFP signals, we obtain an estimate of the fraction of spikes resulting from assemblies in the experimental data.