Reverberation of recent visual experience in spontaneous cortical waves

Bayesian inference of neuronal assemblies

In many areas of the brain, both spontaneous and stimulus-evoked activity can manifest as synchronous activation of neuronal assemblies. The characterization of assembly structure and dynamics provides important insights into how brain computations are distributed across neural networks. The proliferation of experimental techniques for recording the activity of neuronal assemblies calls for a comprehensive statistical method to describe, analyze and characterize these high dimensional datasets. The performance of existing methods for defining assemblies is sensitive to noise and stochasticity in neuronal firing patterns and assembly heterogeneity. To address these problems, we introduce a generative hierarchical model of synchronous activity to describe the organization of neurons into assemblies. Unlike existing methods, our analysis provides a simultaneous estimation of assembly composition, dynamics and within-assembly statistical features, such as the levels of activity, noise and assembly synchrony. We have used our method to characterize population activity throughout the tectum of larval zebrafish, allowing us to make statistical inference on the spatiotemporal organization of tectal assemblies, their composition and the logic of their interactions. We have also applied our method to functional imaging and neuropixels recordings from the mouse, allowing us to relate the activity of identified assemblies to specific behaviours such as running or changes in pupil diameter.

Estimating repetitive spatiotemporal patterns from many subjects' resting-state fMRIs

Recently, we proposed a method to estimate repetitive spatiotemporal patterns from resting-state brain activity data (SpatioTemporal Pattern estimation, STeP) (Takeda et al., 2016). From such resting-state data as functional MRI (fMRI), STeP can estimate several spatiotemporal patterns and their onsets even if they are overlapping. Nowadays, a growing number of resting-state data are publicly available from such databases as the Autism Brain Imaging Data Exchange (ABIDE), which promote a better understanding of resting-state brain activities. In this study, we extend STeP to make it applicable to such big databases, thus proposing the method we call BigSTeP. From many subjects' resting-state data, BigSTeP estimates spatiotemporal patterns that are common across subjects (common spatiotemporal patterns) as well as the corresponding spatiotemporal patterns in each subject (subject-specific spatiotemporal patterns). After verifying the performance of BigSTeP by simulation tests, we applied it to over 1,000 subjects' resting-state fMRIs (rsfMRIs) obtained from ABIDE I. This revealed two common spatiotemporal patterns and the corresponding subject-specific spatiotemporal patterns. The common spatiotemporal patterns included spatial patterns resembling the default mode (DMN), sensorimotor, auditory, and visual networks, suggesting that these networks are time-locked with each other. We compared the subject-specific spatiotemporal patterns between autism spectrum disorder (ASD) and typically developed (TD) groups. As a result, significant differences were concentrated at a specific time in a pattern, when the DMN exhibited large positive activity. This suggests that the differences are context-dependent, that is, the differences in fMRI activities between ASDs and TDs do not always occur during the resting state but tend to occur when the DMN exhibits large positive activity. All of these results demonstrate the usefulness of BigSTeP in extracting inspiring hypotheses from big databases in a data-driven way.

A dual role of prestimulus spontaneous neural activity in visual object recognition

Vision relies on both specific knowledge of visual attributes, such as object categories, and general brain states, such as those reflecting arousal. We hypothesized that these phenomena independently influence recognition of forthcoming stimuli through distinct processes reflected in spontaneous neural activity. Here, we recorded magnetoencephalographic (MEG) activity in participants (N = 24) who viewed images of objects presented at recognition threshold. Using multivariate analysis applied to sensor-level activity patterns recorded before stimulus presentation, we identified two neural processes influencing subsequent subjective recognition: a general process, which disregards stimulus category and correlates with pupil size, and a specific process, which facilitates category-specific recognition. The two processes are doubly-dissociable: the general process correlates with changes in criterion but not in sensitivity, whereas the specific process correlates with changes in sensitivity but not in criterion. Our findings reveal distinct mechanisms of how spontaneous neural activity influences perception and provide a framework to integrate previous findings.

The effect of spontaneous variations in prestimulus neural activity on subsequent perception is incompletely understood. Here, using MEG, the authors identify two distinct neural processes that can influence object recognition in different ways.

Interhemispheric Synchrony of Spontaneous Cortical States at the Cortical Column Level

In cat early visual cortex, neural activity patterns resembling evoked orientation maps emerge spontaneously under anesthesia. To test if such patterns are synchronized between hemispheres, we performed bilateral imaging in anesthetized cats using a new improved voltage-sensitive dye. We observed map-like activity patterns spanning early visual cortex in both hemispheres simultaneously. Patterns virtually identical to maps associated with the cardinal and oblique orientations emerged as leading principal components of the spontaneous fluctuations, and the strength of transient orientation states was correlated with their duration, providing evidence that these maps are transiently attracting states. A neural mass model we developed reproduced the dynamics of both smooth and abrupt orientation state transitions observed experimentally. The model suggests that map-like activity arises from slow modulations in spontaneous firing in conjunction with interplay between excitation and inhibition. Our results highlight the efficiency and functional precision of interhemispheric connectivity.

Complex Dynamics of Propagating Waves in a Two-Dimensional Neural Field

Propagating waves with complex dynamics have been widely observed in neural population activity. To understand their formation mechanisms, we investigate a type of two-dimensional neural field model by systematically varying its recurrent excitatory and inhibitory inputs. We show that the neural field model exhibits a rich repertoire of dynamical activity states when the relevant strength of excitation and inhibition is increased, ranging from localized rotating and traveling waves to global waves. Particularly, near the transition between stable states of rotating and traveling waves, the model exhibits a bistable state; that is, both the rotating and the traveling waves can exist, and the inclusion of noise can induce spontaneous transitions between them. Furthermore, we demonstrate that when there are multiple propagating waves, they exhibit rich collective propagation dynamics with variable propagating speeds and trajectories. We use techniques from time series analysis such detrended fluctuation analysis to characterize the effect of the strength of excitation and inhibition on these collective dynamics, which range from purely random motion to motion with long-range spatiotemporal correlations. These results provide insights into the possible contribution of excitation and inhibition toward a range of previously observed spatiotemporal wave phenomena.

Scaling of a Large-Scale Simulation of Synchronous Slow-Wave and Asynchronous Awake-Like Activity of a Cortical Model With Long-Range Interconnections

Cortical synapse organization supports a range of dynamic states on multiple spatial and temporal scales, from synchronous slow wave activity (SWA), characteristic of deep sleep or anesthesia, to fluctuating, asynchronous activity during wakefulness (AW). Such dynamic diversity poses a challenge for producing efficient large-scale simulations that embody realistic metaphors of short- and long-range synaptic connectivity. In fact, during SWA and AW different spatial extents of the cortical tissue are active in a given timespan and at different firing rates, which implies a wide variety of loads of local computation and communication. A balanced evaluation of simulation performance and robustness should therefore include tests of a variety of cortical dynamic states. Here, we demonstrate performance scaling of our proprietary Distributed and Plastic Spiking Neural Networks (DPSNN) simulation engine in both SWA and AW for bidimensional grids of neural populations, which reflects the modular organization of the cortex. We explored networks up to 192 × 192 modules, each composed of 1,250 integrate-and-fire neurons with spike-frequency adaptation, and exponentially decaying inter-modular synaptic connectivity with varying spatial decay constant. For the largest networks the total number of synapses was over 70 billion. The execution platform included up to 64 dual-socket nodes, each socket mounting 8 Intel Xeon Haswell processor cores @ 2.40 GHz clock rate. Network initialization time, memory usage, and execution time showed good scaling performances from 1 to 1,024 processes, implemented using the standard Message Passing Interface (MPI) protocol. We achieved simulation speeds of between 2.3 × 109 and 4.1 × 109 synaptic events per second for both cortical states in the explored range of inter-modular interconnections.

Dynamical patterns underlying response properties of cortical circuits

Recent experimental studies show cortical circuit responses to external stimuli display varied dynamical properties. These include stimulus strength-dependent population response patterns, a shift from synchronous to asynchronous states and a decline in neural variability. To elucidate the mechanisms underlying these response properties and explore how they are mechanistically related, we develop a neural circuit model that incorporates two essential features widely observed in the cerebral cortex. The first feature is a balance between excitatory and inhibitory inputs to individual neurons; the second feature is distance-dependent connectivity. We show that applying a weak external stimulus to the model evokes a wave pattern propagating along lateral connections, but a strong external stimulus triggers a localized pattern; these stimulus strength-dependent population response patterns are quantitatively comparable with those measured in experimental studies. We identify network mechanisms underlying this population response, and demonstrate that the dynamics of population-level response patterns can explain a range of prominent features in neural responses, including changes to the dynamics of neurons' membrane potentials and synaptic inputs that characterize the shift of cortical states, and the stimulus-evoked decline in neuron response variability. Our study provides a unified population activity pattern-based view of diverse cortical response properties, thus shedding new insights into cortical processing.

Dynamic Computation in Visual Thalamocortical Networks

Contemporary neurodynamical frameworks, such as coordination dynamics and winnerless competition, posit that the brain approximates symbolic computation by transitioning between metastable attractive states. This article integrates these accounts with electrophysiological data suggesting that coherent, nested oscillations facilitate information representation and transmission in thalamocortical networks. We review the relationship between criticality, metastability, and representational capacity, outline existing methods for detecting metastable oscillatory patterns in neural time series data, and evaluate plausible spatiotemporal coding schemes based on phase alignment. We then survey the circuitry and the mechanisms underlying the generation of coordinated alpha and gamma rhythms in the primate visual system, with particular emphasis on the pulvinar and its role in biasing visual attention and awareness. To conclude the review, we begin to integrate this perspective with longstanding theories of consciousness and cognition.

Reduced Repertoire of Cortical Microstates and Neuronal Ensembles in Medically Induced Loss of Consciousness

Medically induced loss of consciousness (mLOC) during anesthesia is associated with a macroscale breakdown of brain connectivity, yet the neural microcircuit correlates of mLOC remain unknown. To explore this, we applied different analytical approaches (t-SNE/watershed segmentation, affinity propagation clustering, PCA, and LZW complexity) to two-photon calcium imaging of neocortical and hippocampal microcircuit activity and local field potential (LFP) measurements across different anesthetic depths in mice, and to micro-electrode array recordings in human subjects. We find that in both cases, mLOC disrupts population activity patterns by generating (1) fewer discriminable network microstates and (2) fewer neuronal ensembles. Our results indicate that local neuronal ensemble dynamics could causally contribute to the emergence of conscious states.

Spontaneous behaviors drive multidimensional, brainwide activity

Neuronal populations in sensory cortex produce variable responses to sensory stimuli and exhibit intricate spontaneous activity even without external sensory input. Cortical variability and spontaneous activity have been variously proposed to represent random noise, recall of prior experience, or encoding of ongoing behavioral and cognitive variables. Recording more than 10,000 neurons in mouse visual cortex, we observed that spontaneous activity reliably encoded a high-dimensional latent state, which was partially related to the mouse's ongoing behavior and was represented not just in visual cortex but also across the forebrain. Sensory inputs did not interrupt this ongoing signal but added onto it a representation of external stimuli in orthogonal dimensions. Thus, visual cortical population activity, despite its apparently noisy structure, reliably encodes an orthogonal fusion of sensory and multidimensional behavioral information.

Metastable brain waves

Traveling patterns of neuronal activity-brain waves-have been observed across a breadth of neuronal recordings, states of awareness, and species, but their emergence in the human brain lacks a firm understanding. Here we analyze the complex nonlinear dynamics that emerge from modeling large-scale spontaneous neural activity on a whole-brain network derived from human tractography. We find a rich array of three-dimensional wave patterns, including traveling waves, spiral waves, sources, and sinks. These patterns are metastable, such that multiple spatiotemporal wave patterns are visited in sequence. Transitions between states correspond to reconfigurations of underlying phase flows, characterized by nonlinear instabilities. These metastable dynamics accord with empirical data from multiple imaging modalities, including electrical waves in cortical tissue, sequential spatiotemporal patterns in resting-state MEG data, and large-scale waves in human electrocorticography. By moving the study of functional networks from a spatially static to an inherently dynamic (wave-like) frame, our work unifies apparently diverse phenomena across functional neuroimaging modalities and makes specific predictions for further experimentation.

Scale-Change Symmetry in the Rules Governing Neural Systems

Similar universal phenomena can emerge in different complex systems when those systems share a common symmetry in their governing laws. In physical systems operating near a critical phase transition, the governing physical laws obey a fractal symmetry; they are the same whether considered at fine or coarse scales. This scale-change symmetry is responsible for universal critical phenomena found across diverse systems. Experiments suggest that the cerebral cortex can also operate near a critical phase transition. Thus we hypothesize that the laws governing cortical dynamics may obey scale-change symmetry. Here we develop a practical approach to test this hypothesis. We confirm, using two different computational models, that neural dynamical laws exhibit scale-change symmetry near a dynamical phase transition. Moreover, we show that as a mouse awakens from anesthesia, scale-change symmetry emerges. Scale-change symmetry of the rules governing cortical dynamics may explain observations of similar critical phenomena across diverse neural systems.

Random Neuronal Networks show homeostatic regulation of global activity while showing persistent changes in specific connectivity paths to theta burst stimuli

Learning in neuronal networks based on Hebbian principle has been shown to lead to destabilizing effects. Mechanisms have been identified that maintain homeostasis in such networks. However, the way in which these two opposing forces operate to support learning while maintaining stability is an active area of research. In this study, using neuronal networks grown on multi electrode arrays, we show that theta burst stimuli lead to persistent changes in functional connectivity along specific paths while the network maintains a global homeostasis. Simultaneous observations of spontaneous activity and stimulus evoked responses over several hours with theta burst training stimuli shows that global activity of the network quantified from spontaneous activity, which is disturbed due to theta burst stimuli is restored by homeostatic mechanisms while stimulus evoked changes in specific connectivity paths retain a memory trace of the training.

Robust entropy requires strong and balanced excitatory and inhibitory synapses

It is widely appreciated that balanced excitation and inhibition are necessary for proper function in neural networks. However, in principle, balance could be achieved by many possible configurations of excitatory and inhibitory synaptic strengths and relative numbers of excitatory and inhibitory neurons. For instance, a given level of excitation could be balanced by either numerous inhibitory neurons with weak synapses or a few inhibitory neurons with strong synapses. Among the continuum of different but balanced configurations, why should any particular configuration be favored? Here, we address this question in the context of the entropy of network dynamics by studying an analytically tractable network of binary neurons. We find that entropy is highest at the boundary between excitation-dominant and inhibition-dominant regimes. Entropy also varies along this boundary with a trade-off between high and robust entropy: weak synapse strengths yield high network entropy which is fragile to parameter variations, while strong synapse strengths yield a lower, but more robust, network entropy. In the case where inhibitory and excitatory synapses are constrained to have similar strength, we find that a small, but non-zero fraction of inhibitory neurons, like that seen in mammalian cortex, results in robust and relatively high entropy.

Feature-Specific Awake Reactivation in Human V1 after Visual Training

Brain activity patterns exhibited during task performance have been shown to spontaneously reemerge in the following restful awake state. Such "awake reactivation" has been observed across higher-order cortex for complex images or associations. However, it is still unclear whether the reactivation extends to primary sensory areas that encode simple stimulus features. To address this question, we trained human subjects from both sexes on a particular visual feature (Gabor orientation) and tested whether this feature will be reactivated immediately after training. We found robust reactivation in human V1 that lasted for at least 8 min after training offset. This effect was not present in higher retinotopic areas, such as V2, V3, V3A, or V4v. Further analyses suggested that the amount of awake reactivation was related to the amount of performance improvement on the visual task. These results demonstrate that awake reactivation extends beyond higher-order areas and also occurs in early sensory cortex.SIGNIFICANCE STATEMENT How do we acquire new memories and skills? New information is known to be consolidated during offline periods of rest. Recent studies suggest that a critical process during this period of consolidation is the spontaneous reactivation of previously experienced patterns of neural activity. However, research in humans has mostly examined such reactivation processes in higher-order cortex. Here we show that awake reactivation occurs even in the primary visual cortex V1 and that this reactivation is related to the amount of behavioral learning. These results pinpoint awake reactivation as a process that likely occurs across the entire human brain and could play an integral role in memory consolidation.

Representation of Rapid Image Sequences in V4 Networks

Natural viewing often consists of sequences of brief fixations to image patches of different structure. Whether and how briefly presented sequential stimuli are encoded in a temporal-position manner is poorly understood. Here, we performed multiple-electrode recordings in the visual cortex (area V4) of nonhuman primates (Macaca mulatta) viewing a sequence of 7 briefly flashed natural images, and measured correlations between the cue-triggered population response in the presence and absence of the stimulus. Surprisingly, we found significant correlations for images occurring at the beginning and the end of a sequence, but not for those in the middle. The correlation strength increased with stimulus exposure and favored the image position in the sequence rather than image identity. These results challenge the commonly held view that images are represented in visual cortex exclusively based on their informational content, and indicate that, in the absence of sensory information, neuronal populations exhibit reactivation of stimulus-evoked responses in a way that reflects temporal position within a stimulus sequence.

Milliseconds of Sensory Input Abruptly Modulate the Dynamics of Cortical States for Seconds

Spontaneous internal activity plays a major role in higher brain functions. The question of how it modulates sensory evoked activity and behavior has been explored in anesthetized rodents, cats, monkeys and in behaving human subjects. However, the complementary question of how a brief sensory input modulates the internally generated activity in vivo remains unresolved, and high-resolution mapping of these bidirectional interactions was never performed. Integrating complementary methodologies, at population and single cells levels, we explored this question. Voltage-sensitive dye imaging of population activity in anesthetized rats' somatosensory cortex revealed that spontaneous up-states were largely diminished for ~2 s, even after a single weak whisker deflection. This effect was maximal at the stimulated barrel but spread across several cortical areas. A higher velocity whisker deflection evoked activity at ~15Hz. Two-photon calcium imaging activity and cell-attached recordings confirmed the VSD results and revealed that for several seconds most single cells decreased their firing, but a small number increased firing. Comparing single deflection with long train stimulation, we found a dominant effect of the first population spike. We suggest that, at the onset of a sensory input, some internal messages are silenced to prevent overloading of the processing of relevant incoming sensory information.

Coordinated neuronal ensembles in primary auditory cortical columns

The synchronous activity of groups of neurons is increasingly thought to be important in cortical information processing and transmission. However, most studies of processing in the primary auditory cortex (AI) have viewed neurons as independent filters; little is known about how coordinated AI neuronal activity is expressed throughout cortical columns and how it might enhance the processing of auditory information. To address this, we recorded from populations of neurons in AI cortical columns of anesthetized rats and, using dimensionality reduction techniques, identified multiple coordinated neuronal ensembles (cNEs), which are groups of neurons with reliable synchronous activity. We show that cNEs reflect local network configurations with enhanced information encoding properties that cannot be accounted for by stimulus-driven synchronization alone. Furthermore, similar cNEs were identified in both spontaneous and evoked activity, indicating that columnar cNEs are stable functional constructs that may represent principal units of information processing in AI.

Classification of Spatiotemporal Neural Activity Patterns in Brain Imaging Data

Various patterns of neural activity are observed in dynamic cortical imaging data. Such patterns may reflect how neurons communicate using the underlying circuitry to perform appropriate functions; thus it is crucial to investigate the spatiotemporal characteristics of the observed neural activity patterns. In general, however, neural activities are highly nonlinear and complex, so it is a demanding job to analyze them quantitatively or to classify the patterns of observed activities in various types of imaging data. Here, we present our implementation of a novel method that successfully addresses the above issues for precise comparison and classification of neural activity patterns. Based on two-dimensional representations of the geometric structure and temporal evolution of activity patterns, our method successfully classified a number of computer-generated sample patterns created from combinations of various spatial and temporal patterns. In addition, we validated our method with voltage-sensitive dye imaging data of Alzheimer's disease (AD) model mice. Our analysis algorithm successfully distinguished the activity data of AD mice from that of wild type with significantly higher performance than previously suggested methods. Our result provides a pragmatic solution for precise analysis of spatiotemporal patterns of neural imaging data.

Topology of Functional Connectivity and Hub Dynamics in the Beta Band As Temporal Prior for Natural Vision in the Human Brain

Networks hubs represent points of convergence for the integration of information across many different nodes and systems. Although a great deal is known on the topology of hub regions in the human brain, little is known about their temporal dynamics. Here, we examine the static and dynamic centrality of hub regions when measured in the absence of a task (rest) or during the observation of natural or synthetic visual stimuli. We used Magnetoencephalography (MEG) in humans (both sexes) to measure static and transient regional and network-level interaction in α- and β-band limited power (BLP) in three conditions: visual fixation (rest), viewing of movie clips (natural vision), and time-scrambled versions of the same clips (scrambled vision). Compared with rest, we observed in both movie conditions a robust decrement of α-BLP connectivity. Moreover, both movie conditions caused a significant reorganization of connections in the α band, especially between networks. In contrast, β-BLP connectivity was remarkably similar between rest and natural vision. Not only the topology did not change, but the joint dynamics of hubs in a core network during natural vision was predicted by similar fluctuations in the resting state. We interpret these findings by suggesting that slow-varying fluctuations of integration occurring in higher-order regions in the β band may be a mechanism to anticipate and predict slow-varying temporal patterns of the visual environment.SIGNIFICANCE STATEMENT A fundamental question in neuroscience concerns the function of spontaneous brain connectivity. Here, we tested the hypothesis that topology of intrinsic brain connectivity and its dynamics might predict those observed during natural vision. Using MEG, we tracked the static and time-varying brain functional connectivity when observers were either fixating or watching different movie clips. The spatial distribution of connections and the dynamics of centrality of a set of regions were similar during rest and movie in the β band, but not in the α band. These results support the hypothesis that the intrinsic β-rhythm integration occurs with a similar temporal structure during natural vision, possibly providing advanced information about incoming stimuli.

LFP beta amplitude is linked to mesoscopic spatio-temporal phase patterns

Beta oscillations observed in motor cortical local field potentials (LFPs) recorded on separate electrodes of a multi-electrode array have been shown to exhibit non-zero phase shifts that organize into planar waves. Here, we generalize this concept to additional classes of salient patterns that fully describe the spatial organization of beta oscillations. During a delayed reach-to-grasp task we distinguish planar, synchronized, random, circular, and radial phase patterns in monkey primary motor and dorsal premotor cortices. We observe that patterns correlate with the beta amplitude (envelope): Coherent planar/radial wave propagation accelerates with growing amplitude, and synchronized patterns are observed at largest amplitudes. In contrast, incoherent random or circular patterns are observed almost exclusively when beta is strongly attenuated. The occurrence probability of a particular pattern modulates with behavioral epochs in the same way as beta amplitude: Coherent patterns are more present during movement preparation where amplitudes are large, while incoherent phase patterns are dominant during movement execution where amplitudes are small. Thus, we uncover a trigonal link between the spatial arrangement of beta phases, beta amplitude, and behavior. Together with previous findings, we discuss predictions on the spatio-temporal organization of precisely coordinated spiking on the mesoscopic scale as a function of beta power.

Cortical travelling waves: mechanisms and computational principles

Multichannel recording technologies have revealed travelling waves of neural activity in multiple sensory, motor and cognitive systems. These waves can be spontaneously generated by recurrent circuits or evoked by external stimuli. They travel along brain networks at multiple scales, transiently modulating spiking and excitability as they pass. Here, we review recent experimental findings that have found evidence for travelling waves at single-area (mesoscopic) and whole-brain (macroscopic) scales. We place these findings in the context of the current theoretical understanding of wave generation and propagation in recurrent networks. During the large low-frequency rhythms of sleep or the relatively desynchronized state of the awake cortex, travelling waves may serve a variety of functions, from long-term memory consolidation to processing of dynamic visual stimuli. We explore new avenues for experimental and computational understanding of the role of spatiotemporal activity patterns in the cortex.

Spontaneous Fluctuations in Visual Cortical Responses Influence Population Coding Accuracy

Information processing in the cerebral cortex depends not only on the nature of incoming stimuli, but also on the state of neuronal networks at the time of stimulation. That is, the same stimulus will be processed differently depending on the neuronal context in which it is received. A major factor that could influence neuronal context is the background, or ongoing neuronal activity before stimulation. In visual cortex, ongoing activity is known to play a critical role in the development of local circuits, yet whether it influences the coding of visual features in adult cortex is unclear. Here, we investigate whether and how the information encoded by individual neurons and populations in primary visual cortex (V1) depends on the ongoing activity before stimulus presentation. We report that when individual neurons are in a "low" prestimulus state, they have a higher capacity to discriminate stimulus features, such as orientation, despite their reduction in evoked responses. By measuring the distribution of prestimulus activity across a population of neurons, we found that network discrimination accuracy is improved in the low prestimulus state. Thus, the distribution of ongoing activity states across the network creates an "internal context" that dynamically filters incoming stimuli to modulate the accuracy of sensory coding. The modulation of stimulus coding by ongoing activity state is consistent with recurrent network models in which ongoing activity dynamically controls the balanced background excitation and inhibition to individual neurons.

Beyond the evoked/intrinsic neural process dichotomy

Contemporary functional neuroimaging research has increasingly focused on characterization of intrinsic or "spontaneous" brain activity. Analysis of intrinsic activity is often contrasted with analysis of task-evoked activity that has traditionally been the focus of cognitive neuroscience. But does this evoked/intrinsic dichotomy adequately characterize human brain function? Based on empirical data demonstrating a close functional interdependence between intrinsic and task-evoked activity, we argue that the dichotomy between intrinsic and task-evoked activity as unobserved contributions to brain activity is artificial. We present an alternative picture of brain function in which the brain's spatiotemporal dynamics do not consist of separable intrinsic and task-evoked components, but reflect the enaction of a system of mutual constraints to move the brain into and out of task-appropriate functional configurations. According to this alternative picture, cognitive neuroscientists are tasked with describing both the temporal trajectory of brain activity patterns across time, and the modulation of this trajectory by task states, without separating this process into intrinsic and task-evoked components. We argue that this alternative picture of brain function is best captured in a novel explanatory framework called enabling constraint. Overall, these insights call for a reconceptualization of functional brain activity, and should drive future methodological and empirical efforts.

Cortical response states for enhanced sensory discrimination

Brain activity during wakefulness is characterized by rapid fluctuations in neuronal responses. Whether these fluctuations play any role in modulating the accuracy of behavioral responses is poorly understood. Here, we investigated whether and how trial changes in the population response impact sensory coding in monkey V1 and perceptual performance. Although the responses of individual neurons varied widely across trials, many cells tended to covary with the local population. When population activity was in a ‘low’ state, neurons had lower evoked responses and correlated variability, yet higher probability to predict perceptual accuracy. The impact of firing rate fluctuations on network and perceptual accuracy was strongest 200 ms before stimulus presentation, and it greatly diminished when the number of cells used to measure the state of the population was decreased. These findings indicate that enhanced perceptual discrimination occurs when population activity is in a ‘silent’ response mode in which neurons increase information extraction.

[Neuronet restructuring in focal and generalized epilepsy according to resting state fMRI]

AIM

To compare neuronet restructuring in focal and generalized epilepsy.

MATERIAL AND METHODS

Seventy-seven patients, aged from 18 to 65 years, with the diagnosis of epilepsy, including 63 patients with focal epilepsy and 14 with generalized epilepsy, were examined. A control group included 23 healthy people. Neuronet restructuring was studied using fMRI.

RESULTS AND CONCLUSION

According to resting state fMRI, there were between-group differences in spatial organization (activity map) of the brain structures as well as in the results of cross-correlation analysis of interaction maps of resting-state networks. It has been concluded that functional restructuring in connectomes in focal and generalized epilepsy have the opposite patterns of disorganization (toward increase or decrease) in most structures studied though there are structures with the same direction of connectivity changes.

How networks communicate: propagation patterns in spontaneous brain activity

Initially regarded as 'noise', spontaneous (intrinsic) activity accounts for a large portion of the brain's metabolic cost. Moreover, it is now widely known that infra-slow (less than 0.1 Hz) spontaneous activity, measured using resting state functional magnetic resonance imaging of the blood oxygen level-dependent (BOLD) signal, is correlated within functionally defined resting state networks (RSNs). However, despite these advances, the temporal organization of spontaneous BOLD fluctuations has remained elusive. By studying temporal lags in the resting state BOLD signal, we have recently shown that spontaneous BOLD fluctuations consist of remarkably reproducible patterns of whole brain propagation. Embedded in these propagation patterns are unidirectional 'motifs' which, in turn, give rise to RSNs. Additionally, propagation patterns are markedly altered as a function of state, whether physiological or pathological. Understanding such propagation patterns will likely yield deeper insights into the role of spontaneous activity in brain function in health and disease.This article is part of the themed issue 'Interpreting blood oxygen level-dependent: a dialogue between cognitive and cellular neuroscience'.

The effect of prior knowledge on post-encoding brain connectivity and its relation to subsequent memory

It is known that prior knowledge can facilitate memory acquisition. It is unclear, however, whether prior knowledge can affect post-encoding brain activity to facilitate memory consolidation. In this fMRI study, we asked participants to associate novel houses with famous/nonfamous faces and investigated how associative-encoding tasks with/without prior knowledge differentially affected post-encoding brain connectivity during rest. Besides memory advantages in the famous condition, we found that post-encoding hippocampal connectivity with the fusiform face area (FFA) and ventral-medial-prefrontal cortex (vmPFC) was stronger following encoding of associations with famous than non-famous faces. Importantly, post-encoding functional connectivity between the hippocampus (HPC) and FFA, and between the anterior temporal pole region (aTPL) and posterior perceptual regions (i.e., FFA and the parahippocampal place area), together predicted a large proportion of the variance in subsequent memory performance. This prediction was specific for face-house associative memory, not face/house item memory, and only in the famous condition where prior knowledge was involved. These results support the idea that when prior knowledge is involved, the HPC, vmPFC, and aTPL, which support prior episodic, social-evaluative/schematic, and semantic memories, respectively, continue to interact with each other and posterior perceptual brain regions during the post-encoding rest to facilitate off-line processing of the newly formed memory, and enhance memory consolidation.

Binocular deprivation induces both age-dependent and age-independent forms of plasticity in parvalbumin inhibitory neuron visual response properties

Activity of cortical inhibitory interneurons is rapidly reduced in response to monocular deprivation during the critical period for ocular dominance plasticity and in response to salient events encountered during learning. In the case of primary sensory cortex, a decrease in mean evoked firing rate of parvalbumin-positive (PV) inhibitory neurons is causally linked to a reorganization of excitatory networks following sensory perturbation. Converging evidence indicates that it is deprivation, and not an imbalance between open- and closed-eye inputs, that triggers rapid plasticity in PV neurons. However, this has not been directly tested in vivo. Using two-photon guided cell-attached recording, we examined the impact of closing both eyes for 24 h on PV neuron response properties in mouse primary visual cortex. We found that binocular deprivation induces a 30% reduction in stimulus-evoked mean firing rate and that this reduction is specific to critical period-aged mice. The number of PV neurons showing detectable tuning to orientation increased after 24 h of deprivation, and this effect was also specific to critical period-aged mice. In contrast to evoked mean firing rate and orientation tuning, measurements of trial-to-trial variability revealed that stimulus-driven decreases in variability are significantly dampened by deprivation during both the critical period and the postcritical period. These data establish that open-eye inputs are not required to drive deprivation-induced weakening of PV neuron evoked activity and that other aspects of in vivo PV neuron activity are malleable throughout life. NEW & NOTEWORTHY Parvalbumin-positive (PV) neurons in sensory cortex are generally considered to be mediators of experience-dependent plasticity, and their plasticity is restricted to the critical period. However, in regions outside of sensory cortex, accumulating evidence demonstrates that PV neurons are plastic in adults, raising the possibility that aspects of PV response properties may be plastic throughout life. Here we identify a feature of in vivo PV neuron activity that remains plastic past the critical period.

Catching the voltage gradient-asymmetric boost of cortical spread generates motion signals across visual cortex: a brief review with special thanks to Amiram Grinvald

Wide-field voltage imaging is unique in its capability to capture snapshots of activity-across the full gradient of average changes in membrane potentials from subthreshold to suprathreshold levels-of hundreds of thousands of superficial cortical neurons that are simultaneously active. Here, I highlight two examples where voltage-sensitive dye imaging (VSDI) was exploited to track gradual space-time changes of activity within milliseconds across several millimeters of cortex at submillimeter resolution: the line-motion condition, measured in Amiram Grinvald's Laboratory more than 10 years ago and-coming full circle running VSDI in my laboratory-another motion-inducing condition, in which two neighboring stimuli counterchange luminance simultaneously. In both examples, cortical spread is asymmetrically boosted, creating suprathreshold activity drawn out over primary visual cortex. These rapidly propagating waves may integrate brain signals that encode motion independent of direction-selective circuits.

'Blue' voltage-sensitive dyes for studying spatiotemporal dynamics in the brain: visualizing cortical waves

Among many distinct contributions made by Amiram Grinvald's group, the "Blue dyes" is a special gift for visualizing cortical population neuronal activity. The excitation wavelength of blue dyes has minimal overlap with the absorption of hemoglobin, and hence has minimal pulsation artifacts. This advantage leads to high signal-to-noise ratio optical recordings of cortical activity, with sensitivity as good as that of local field potential recordings. High sensitivity imaging allows for recording of spontaneous and evoked activity in single trials without spatial or temporal averaging, and has benefitted many scientists in their research projects. Single trial recording is particularly important for studying the cortex, because spontaneous and ongoing activities interact with sensory evoked events, creating rich dynamics in the wave patterns. Signal averaging in space and time would diminish the dynamic components in the patterns. Here, we discuss how the blue dyes help to achieve high-sensitivity voltage-sensitive dye imaging of spontaneous and evoked cortical activities. Spontaneous cortical activity has a constantly changing spatial pattern and temporal frequency, making it impossible to average in space and time. Amiran Grinvald's invention of blue dyes made it possible to examine the spatiotemporal patterns of cortical dynamics, about 15 years before the first useful genetically coded voltage proteins became available.

Review: How do spontaneous and sensory-evoked activities interact?

Twenty years ago, the seminal work of Grinvald et al. revolutionized the view cast on spontaneous cortical activity by showing how, instead of being a mere measure of noise, it profoundly impacts cortical responses to a sensory input and therefore could play a role in sensory processing. This paved the way for a number of studies on the interactions between spontaneous and sensory-evoked activities. Spontaneous activity has subsequently been found to be highly structured and to participate in high cognitive functions, such as influencing conscious perception in humans. However, its functional role remains poorly understood, and only a few speculations exist, from the maintenance of the cortical network to the internal representation of an a priori knowledge of the environment. Furthermore, elucidation of this functional role could stem from studying the opposite relationship between spontaneous and sensory-evoked activities, namely, how a sensory input influences subsequent internal activities. Indeed, this question has remained largely unexplored, but a recent study by the Grinvald laboratory shows that a brief sensory input largely dampens spontaneous rhythms, suggesting a more sophisticated view where some spontaneous rhythms might relate to sensory processing and some others not.

Basal forebrain activation enhances between-trial reliability of low-frequency local field potentials (LFP) and spiking activity in tree shrew primary visual cortex (V1)

Brain state has profound effects on neural processing and stimulus encoding in sensory cortices. While the synchronized state is dominated by low-frequency local field potential (LFP) activity, low-frequency LFP power is suppressed in the desynchronized state, where a concurrent enhancement in gamma power is observed. Recently, it has been shown that cortical desynchronization co-occurs with enhanced between-trial reliability of spiking activity in sensory neurons, but it is currently unclear whether this effect is also evident in LFP signals. Here, we address this question by recording both spike trains and LFP in primary visual cortex during natural movie stimulation, and using isoflurane anesthesia and basal forebrain (BF) electrical activation as proxies for synchronized and desynchronized brain states. We show that indeed, low-frequency LFP modulations ("LFP events") also occur more reliably following BF activation. Interestingly, while being more reliable, these LFP events are smaller in amplitude compared to those generated in the synchronized brain state. We further demonstrate that differences in reliability of spiking activity between cortical states can be linked to amplitude and probability of LFP events. The correlated temporal dynamics between low-frequency LFP and spiking response reliability in visual cortex suggests that these effects may both be the result of the same neural circuit activation triggered by BF stimulation, which facilitates switching between processing of incoming sensory information in the desynchronized and reverberation of internal signals in the synchronized state.

Optical-flow analysis toolbox for characterization of spatiotemporal dynamics in mesoscale optical imaging of brain activity

Wide-field optical imaging techniques constitute powerful tools to investigate mesoscale neuronal activity. The sampled data constitutes a sequence of image frames in which one can investigate the flow of brain activity starting and terminating at source and sink locations respectively. Approaches to the analyses of information flow include qualitative assessment to identify sources and sinks of activity as well as their trajectories, and quantitative measurements based on computing the temporal variation of the intensity of pixels. Furthermore, in a few studies estimates of wave motion have been reported using optical-flow techniques from computer vision. However, a comprehensive toolbox for the quantitative analyses of mesoscale brain activity data is still lacking. We present a graphical-user-interface toolbox based in Matlab® for investigating the spatiotemporal dynamics of mesoscale brain activity using optical-flow analyses. The toolbox includes the implementation of three optical-flow methods namely Horn-Schunck, Combined Local-Global, and Temporospatial algorithms for estimating velocity vector fields of flow of mesoscale brain activity. From the velocity vector fields we determined the locations of sources and sinks as well as the trajectories and temporal velocities of flow of activity. Using simulated data as well as experimentally derived sensory-evoked voltage and calcium imaging data from mice, we compared the efficacy of the three optical-flow methods for determining spatiotemporal dynamics. Our results indicate that the combined local-global method we employed, yields the best results for estimating wave motion. The automated approach permits rapid and effective quantification of mesoscale brain dynamics and may facilitate the study of brain function in response to new experiences or pathology.

Speed hysteresis and noise shaping of traveling fronts in neural fields: role of local circuitry and nonlocal connectivity

Neural field models are powerful tools to investigate the richness of spatiotemporal activity patterns like waves and bumps, emerging from the cerebral cortex. Understanding how spontaneous and evoked activity is related to the structure of underlying networks is of central interest to unfold how information is processed by these systems. Here we focus on the interplay between local properties like input-output gain function and recurrent synaptic self-excitation of cortical modules, and nonlocal intermodular synaptic couplings yielding to define a multiscale neural field. In this framework, we work out analytic expressions for the wave speed and the stochastic diffusion of propagating fronts uncovering the existence of an optimal balance between local and nonlocal connectivity which minimizes the fluctuations of the activation front propagation. Incorporating an activity-dependent adaptation of local excitability further highlights the independent role that local and nonlocal connectivity play in modulating the speed of propagation of the activation and silencing wavefronts, respectively. Inhomogeneities in space of local excitability give raise to a novel hysteresis phenomenon such that the speed of waves traveling in opposite directions display different velocities in the same location. Taken together these results provide insights on the multiscale organization of brain slow-waves measured during deep sleep and anesthesia.

Large Scale Cortical Functional Networks Associated with Slow-Wave and Spindle-Burst-Related Spontaneous Activity

Cortical sensory systems are active with rich patterns of activity during sleep and under light anesthesia. Remarkably, this activity shares many characteristics with those present when the awake brain responds to sensory stimuli. We review two specific forms of such activity: slow-wave activity (SWA) in the adult brain and spindle bursts in developing brain. SWA is composed of 0.5-4 Hz resting potential fluctuations. Although these fluctuations synchronize wide regions of cortex, recent large-scale imaging has shown spatial details of their distribution that reflect underlying cortical structural projections and networks. These networks are regulated, as prior awake experiences alter both the spatial and temporal features of SWA in subsequent sleep. Activity patterns of the immature brain, however, are very different from those of the adult. SWA is absent, and the dominant pattern is spindle bursts, intermittent high frequency oscillations superimposed on slower depolarizations within sensory cortices. These bursts are driven by intrinsic brain activity, which act to generate peripheral inputs, for example via limb twitches. They are present within developing sensory cortex before they are mature enough to exhibit directed movements and respond to external stimuli. Like in the adult, these patterns resemble those evoked by sensory stimulation when awake. It is suggested that spindle-burst activity is generated purposefully by the developing nervous system as a proxy for true external stimuli. While the sleep-related functions of both slow-wave and spindle-burst activity may not be entirely clear, they reflect robust regulated phenomena which can engage select wide-spread cortical circuits. These circuits are similar to those activated during sensory processing and volitional events. We highlight these two patterns of brain activity because both are prominent and well-studied forms of spontaneous activity that will yield valuable insights into brain function in the coming years.

Spontaneous emergence of fast attractor dynamics in a model of developing primary visual cortex

Recent evidence suggests that neurons in primary sensory cortex arrange into competitive groups, representing stimuli by their joint activity rather than as independent feature analysers. A possible explanation for these results is that sensory cortex implements attractor dynamics, although this proposal remains controversial. Here we report that fast attractor dynamics emerge naturally in a computational model of a patch of primary visual cortex endowed with realistic plasticity (at both feedforward and lateral synapses) and mutual inhibition. When exposed to natural images (but not random pixels), the model spontaneously arranges into competitive groups of reciprocally connected, similarly tuned neurons, while developing realistic, orientation-selective receptive fields. Importantly, the same groups are observed in both stimulus-evoked and spontaneous (stimulus-absent) activity. The resulting network is inhibition-stabilized and exhibits fast, non-persistent attractor dynamics. Our results suggest that realistic plasticity, mutual inhibition and natural stimuli are jointly necessary and sufficient to generate attractor dynamics in primary sensory cortex.

Sensory cortices represent stimuli through joint activity of competing neuronal assemblies. Here the authors show that a model of visual cortex with plastic feedforward and recurrent synapses, exposed to natural images, spontaneously develops attractor dynamics between groups of similarly tuned neurons.

Cardiac Arrest-Induced Global Brain Hypoxia-Ischemia during Development Affects Spontaneous Activity Organization in Rat Sensory and Motor Thalamocortical Circuits during Adulthood

Normal maturation of sensory information processing in the cortex requires patterned synaptic activity during developmentally regulated critical periods. During early development, spontaneous synaptic activity establishes required patterns of synaptic input, and during later development it influences patterns of sensory experience-dependent neuronal firing. Thalamocortical neurons occupy a critical position in regulating the flow of patterned sensory information from the periphery to the cortex. Abnormal thalamocortical inputs may permanently affect the organization and function of cortical neuronal circuits, especially if they occur during a critical developmental window. We examined the effect of cardiac arrest (CA)-associated global brain hypoxia-ischemia in developing rats on spontaneous and evoked firing of somatosensory thalamocortical neurons and on large-scale correlations in the motor thalamocortical circuit. The mean spontaneous and sensory-evoked firing rate activity and variability were higher in CA injured rats. Furthermore, spontaneous and sensory-evoked activity and variability were correlated in uninjured rats, but not correlated in neurons from CA rats. Abnormal activity patterns of ventroposterior medial nucleus (VPm) neurons persisted into adulthood. Additionally, we found that neurons in the entopeduncular nucleus (EPN) in the basal ganglia had lower firing rates yet had higher variability and higher levels of burst firing after injury. Correlated levels of power in local field potentials (LFPs) between the EPN and the motor cortex (MCx) were also disrupted by injury. Our findings indicate that hypoxic-ischemic injury during development leads to abnormal spontaneous and sensory stimulus-evoked input patterns from thalamus to cortex. Abnormal thalamic inputs likely permanently and detrimentally affect the organization of cortical circuitry and processing of sensory information. Hypoxic-ischemic injury also leads to abnormal single neuron and population level activity in the basal ganglia that may contribute to motor dysfunction after injury. Combination of deficits in sensory and motor thalamocortical circuit function may negatively impact sensorimotor integration in CA survivors. Modulation of abnormal activity patterns post-injury may represent a novel therapeutic target to improve neurologic function in survivors.

Auditory-induced neural dynamics in sensory-motor circuitry predict learned temporal and sequential statistics of birdsong

Predicting future events is a critical computation for both perception and behavior. Despite the essential nature of this computation, there are few studies demonstrating neural activity that predicts specific events in learned, probabilistic sequences. Here, we test the hypotheses that the dynamics of internally generated neural activity are predictive of future events and are structured by the learned temporal-sequential statistics of those events. We recorded neural activity in Bengalese finch sensory-motor area HVC in response to playback of sequences from individuals' songs, and examined the neural activity that continued after stimulus offset. We found that the strength of response to a syllable in the sequence depended on the delay at which that syllable was played, with a maximal response when the delay matched the intersyllable gap normally present for that specific syllable during song production. Furthermore, poststimulus neural activity induced by sequence playback resembled the neural response to the next syllable in the sequence when that syllable was predictable, but not when the next syllable was uncertain. Our results demonstrate that the dynamics of internally generated HVC neural activity are predictive of the learned temporal-sequential structure of produced song and that the strength of this prediction is modulated by uncertainty.

Translaminar Cortical Membrane Potential Synchrony in Behaving Mice

The synchronized activity of six layers of cortical neurons is critical for sensory perception and the control of voluntary behavior, but little is known about the synaptic mechanisms of cortical synchrony across layers in behaving animals. We made single and dual whole-cell recordings from the primary somatosensory forepaw cortex in awake mice and show that L2/3 and L5 excitatory neurons have layer-specific intrinsic properties and membrane potential dynamics that shape laminar-specific firing rates and subthreshold synchrony. First, while sensory and movement-evoked synaptic input was tightly correlated across layers, spontaneous action potentials and slow spontaneous subthreshold fluctuations had laminar-specific timing; second, longer duration forepaw movement was associated with a decorrelation of subthreshold activity; third, spontaneous and sensory-evoked forepaw movements were signaled more strongly by L5 than L2/3 neurons. Together, our data suggest that the degree of translaminar synchrony is dependent upon the origin (sensory, spontaneous, and movement) of the synaptic input.

•

We made dual whole-cell recordings from L2/3 and L5 cortical neurons in behaving mice

•

Layer-specific membrane properties determine higher mean firing rates of L5 neurons

•

Synchrony of translaminar synaptic activity is determined by the origin of input

•

L5 neurons signal spontaneous and sensory-triggered movements

Reactivation of visual-evoked activity in human cortical networks

In the absence of sensory input, neuronal networks are far from being silent. Whether spontaneous changes in ongoing activity reflect previous sensory experience or stochastic fluctuations in brain activity is not well understood. Here we demonstrate reactivation of stimulus-evoked activity that is distributed across large areas in the human brain. We performed simultaneous electrocorticography recordings from occipital, parietal, temporal, and frontal areas in awake humans in the presence and absence of sensory stimulation. We found that, in the absence of visual input, repeated exposure to brief natural movies induces robust stimulus-specific reactivation at individual recording sites. The reactivation sites were characterized by greater global connectivity compared with those sites that did not exhibit reactivation. Our results indicate a surprising degree of short-term plasticity across multiple networks in the human brain as a result of repeated exposure to unattended information.

Estimating repetitive spatiotemporal patterns from resting-state brain activity data

Repetitive spatiotemporal patterns in spontaneous brain activities have been widely examined in non-human studies. These studies have reported that such patterns reflect past experiences embedded in neural circuits. In human magnetoencephalography (MEG) and electroencephalography (EEG) studies, however, spatiotemporal patterns in resting-state brain activities have not been extensively examined. This is because estimating spatiotemporal patterns from resting-state MEG/EEG data is difficult due to their unknown onsets. Here, we propose a method to estimate repetitive spatiotemporal patterns from resting-state brain activity data, including MEG/EEG. Without the information of onsets, the proposed method can estimate several spatiotemporal patterns, even if they are overlapping. We verified the performance of the method by detailed simulation tests. Furthermore, we examined whether the proposed method could estimate the visual evoked magnetic fields (VEFs) without using stimulus onset information. The proposed method successfully detected the stimulus onsets and estimated the VEFs, implying the applicability of this method to real MEG data. The proposed method was applied to resting-state functional magnetic resonance imaging (fMRI) data and MEG data. The results revealed informative spatiotemporal patterns representing consecutive brain activities that dynamically change with time. Using this method, it is possible to reveal discrete events spontaneously occurring in our brains, such as memory retrieval.

Propagation of spontaneous slow-wave activity across columns and layers of the adult rat barrel cortex in vivo

During slow-wave sleep, neocortical networks exhibit self-organized activity switching between periods of concurrent spiking (up-states) and periods of network silence (down-states), a phenomenon also occurring under the effects of different anesthetics and in in vitro brain slice preparations. Although this type of ongoing activity has been implicated into important functions such as memory consolidation and learning, the manner in which it propagates across different cortical modules (i.e., columns and layers) has not been fully characterized. In the present study, we investigated this issue by measuring spontaneous activity at large scale in the adult rat barrel cortex under urethane anesthesia by means of voltage-sensitive dye imaging and 128-channel probe recordings. Up to 74 neurons located in all layers of up to four functionally identified barrel-related columns were recorded simultaneously. The spontaneous activity propagated isotropically across the cortical surface with a median speed of ~35 µm/ms. A concomitant radial spread of activation was present from deep to superficial cortical layers. Thus, spontaneous activity occurred rather globally in the barrel cortex, with ≥50 % of the up-states presenting spikes in ≥3 columns and layers. Temporally precise spike sequences, which occurred repeatedly (although sporadically) within the up-states, were typically led by putative excitatory neurons in the infragranular cortical layers. In summary, our data provide for the first time an overall view of the spontaneous slow-wave activity within the barrel cortex circuit, characterizing its propagation across columns and layers at high spatio-temporal resolution.

Where's the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network

Even in the absence of sensory stimulation the brain is spontaneously active. This background “noise” seems to be the dominant cause of the notoriously high trial-to-trial variability of neural recordings. Recent experimental observations have extended our knowledge of trial-to-trial variability and spontaneous activity in several directions: 1. Trial-to-trial variability systematically decreases following the onset of a sensory stimulus or the start of a motor act. 2. Spontaneous activity states in sensory cortex outline the region of evoked sensory responses. 3. Across development, spontaneous activity aligns itself with typical evoked activity patterns. 4. The spontaneous brain activity prior to the presentation of an ambiguous stimulus predicts how the stimulus will be interpreted. At present it is unclear how these observations relate to each other and how they arise in cortical circuits. Here we demonstrate that all of these phenomena can be accounted for by a deterministic self-organizing recurrent neural network model (SORN), which learns a predictive model of its sensory environment. The SORN comprises recurrently coupled populations of excitatory and inhibitory threshold units and learns via a combination of spike-timing dependent plasticity (STDP) and homeostatic plasticity mechanisms. Similar to balanced network architectures, units in the network show irregular activity and variable responses to inputs. Additionally, however, the SORN exhibits sequence learning abilities matching recent findings from visual cortex and the network’s spontaneous activity reproduces the experimental findings mentioned above. Intriguingly, the network’s behaviour is reminiscent of sampling-based probabilistic inference, suggesting that correlates of sampling-based inference can develop from the interaction of STDP and homeostasis in deterministic networks. We conclude that key observations on spontaneous brain activity and the variability of neural responses can be accounted for by a simple deterministic recurrent neural network which learns a predictive model of its sensory environment via a combination of generic neural plasticity mechanisms.

Neural recordings seem very noisy. If the exact same stimulus is shown to an animal multiple times, the neural response will vary substantially. In fact, the activity of a single neuron shows many features of a random process. Furthermore, the spontaneous activity occurring in the absence of any sensory stimulus, which is usually considered a kind of background noise, often has a magnitude comparable to the activity evoked by stimulus presentation and interacts with sensory inputs in interesting ways. Here we show that the key features of neural variability and spontaneous activity can all be accounted for by a simple and completely deterministic neural network learning a predictive model of its sensory inputs. The network’s deterministic dynamics give rise to structured but variable responses matching key experimental findings obtained in different mammalian species with different recording techniques. Our results suggest that the notorious variability of neural recordings and the complex features of spontaneous brain activity could reflect the dynamics of a largely deterministic but highly adaptive network learning a predictive model of its sensory environment.

Fast Learning with Weak Synaptic Plasticity

New sensory stimuli can be learned with a single or a few presentations. Similarly, the responses of cortical neurons to a stimulus have been shown to increase reliably after just a few repetitions. Long-term memory is thought to be mediated by synaptic plasticity, but in vitro experiments in cortical cells typically show very small changes in synaptic strength after a pair of presynaptic and postsynaptic spikes. Thus, it is traditionally thought that fast learning requires stronger synaptic changes, possibly because of neuromodulation. Here we show theoretically that weak synaptic plasticity can, in fact, support fast learning, because of the large number of synapses N onto a cortical neuron. In the fluctuation-driven regime characteristic of cortical neurons in vivo, the size of membrane potential fluctuations grows only as √N, whereas a single output spike leads to potentiation of a number of synapses proportional to N. Therefore, the relative effect of a single spike on synaptic potentiation grows as √N. This leverage effect requires precise spike timing. Thus, the large number of synapses onto cortical neurons allows fast learning with very small synaptic changes. Significance statement: Long-term memory is thought to rely on the strengthening of coactive synapses. This physiological mechanism is generally considered to be very gradual, and yet new sensory stimuli can be learned with just a few presentations. Here we show theoretically that this apparent paradox can be solved when there is a tight balance between excitatory and inhibitory input. In this case, small synaptic modifications applied to the many synapses onto a given neuron disrupt that balance and produce a large effect even for modifications induced by a single stimulus. This effect makes fast learning possible with small synaptic changes and reconciles physiological and behavioral observations.