Spontaneous traveling waves naturally emerge from horizontal fiber time delays and travel through locally asynchronous-irregular states

Transformers and cortical waves: encoders for pulling in context across time

The capabilities of transformer networks such as ChatGPT and other large language models (LLMs) have captured the world's attention. The crucial computational mechanism underlying their performance relies on transforming a complete input sequence - for example, all the words in a sentence - into a long 'encoding vector' that allows transformers to learn long-range temporal dependencies in naturalistic sequences. Specifically, 'self-attention' applied to this encoding vector enhances temporal context in transformers by computing associations between pairs of words in the input sequence. We suggest that waves of neural activity traveling across single cortical areas, or multiple regions on the whole-brain scale, could implement a similar encoding principle. By encapsulating recent input history into a single spatial pattern at each moment in time, cortical waves may enable a temporal context to be extracted from sequences of sensory inputs, the same computational principle as that used in transformers.

Horizontal cortical connections shape intrinsic traveling waves into feature-selective motifs that regulate perceptual sensitivity

Intrinsic cortical activity forms traveling waves that modulate sensory-evoked responses and perceptual sensitivity. These intrinsic traveling waves (iTWs) may arise from the coordination of synaptic activity through long-range feature-dependent horizontal connectivity within cortical areas. In a spiking network model that incorporates feature-selective patchy connections, we observe iTW motifs that result from shifts in excitatory/inhibitory balance as action potentials traverse these patchy connections. To test whether feature-selective motifs occur in vivo, we examined data recorded in the middle temporal visual area (Area MT) of marmosets performing a visual detection task. We find that some iTWs form motifs that are feature selective, exhibiting direction-selective modulations in spiking activity. Further, motifs modulate the gain of target-evoked responses and perceptual sensitivity if the target matches the preference of the motif. These results suggest that iTWs are shaped by the patchy horizontal fiber projections in the cortex and can regulate neural and perceptual sensitivity in a feature-selective manner.

Macroscale traveling waves evoked by single-pulse stimulation of the human brain

Understanding the spatiotemporal dynamics of neural signal propagation is fundamental to unraveling the complexities of brain function. Emerging evidence suggests that cortico-cortical evoked potentials (CCEPs) resulting from single-pulse electrical stimulation may be used to characterize the patterns of information flow between and within brain networks. At present, the basic spatiotemporal dynamics of CCEP propagation cortically and subcortically are incompletely understood. We hypothesized that single-pulse electrical stimulation evokes neural traveling waves detectable in the three-dimensional space sampled by intracranial stereoelectroencephalography. Across a cohort of 21 adult patients with intractable epilepsy, we delivered 17,631 stimulation pulses and recorded CCEP responses in 1,019 electrode contacts. The distance between each pair of electrode contacts was approximated using three different metrics (Euclidean distance, path length, and geodesic distance), representing direct, tractographic, and transcortical propagation, respectively. For each robust CCEP, we extracted amplitude-, spectral-, and phase-based features to identify traveling waves emanating from the site of stimulation. Many evoked responses to stimulation appear to propagate as traveling waves (~14-28%), despite sparse sampling throughout the brain. These stimulation-evoked traveling waves exhibited biologically plausible propagation velocities (range 0.1-9.6 m/s). Our results reveal that direct electrical stimulation elicits neural activity with variable spatiotemporal dynamics, including the initiation of neural traveling waves.

A comprehensive data-driven model of cat primary visual cortex

Knowledge integration based on the relationship between structure and function of the neural substrate is one of the main targets of neuroinformatics and data-driven computational modeling. However, the multiplicity of data sources, the diversity of benchmarks, the mixing of observables of different natures, and the necessity of a long-term, systematic approach make such a task challenging. Here we present a first snapshot of a long-term integrative modeling program designed to address this issue in the domain of the visual system: a comprehensive spiking model of cat primary visual cortex. The presented model satisfies an extensive range of anatomical, statistical and functional constraints under a wide range of visual input statistics. In the presence of physiological levels of tonic stochastic bombardment by spontaneous thalamic activity, the modeled cortical reverberations self-generate a sparse asynchronous ongoing activity that quantitatively matches a range of experimentally measured statistics. When integrating feed-forward drive elicited by a high diversity of visual contexts, the simulated network produces a realistic, quantitatively accurate interplay between visually evoked excitatory and inhibitory conductances; contrast-invariant orientation-tuning width; center surround interactions; and stimulus-dependent changes in the precision of the neural code. This integrative model offers insights into how the studied properties interact, contributing to a better understanding of visual cortical dynamics. It provides a basis for future development towards a comprehensive model of low-level perception.

Thalamic contributions to the state and contents of consciousness

Consciousness can be conceptualized as varying along at least two dimensions: the global state of consciousness and the content of conscious experience. Here, we highlight the cellular and systems-level contributions of the thalamus to conscious state and then argue for thalamic contributions to conscious content, including the integrated, segregated, and continuous nature of our experience. We underscore vital, yet distinct roles for core- and matrix-type thalamic neurons. Through reciprocal interactions with deep-layer cortical neurons, matrix neurons support wakefulness and determine perceptual thresholds, whereas the cortical interactions of core neurons maintain content and enable perceptual constancy. We further propose that conscious integration, segregation, and continuity depend on the convergent nature of corticothalamic projections enabling dimensionality reduction, a thalamic reticular nucleus-mediated divisive normalization-like process, and sustained coherent activity in thalamocortical loops, respectively. Overall, we conclude that the thalamus plays a central topological role in brain structures controlling conscious experience.

A Translaminar Spacetime Code Supports Touch-Evoked Traveling Waves

Linking sensory-evoked traveling waves to underlying circuit patterns is critical to understanding the neural basis of sensory perception. To form this link, we performed simultaneous electrophysiology and two-photon calcium imaging through transparent NeuroGrids and mapped touch-evoked cortical traveling waves and their underlying microcircuit dynamics. In awake mice, both passive and active whisker touch elicited traveling waves within and across barrels, with a fast early component followed by a variable late wave that lasted hundreds of milliseconds post-stimulus. Strikingly, late-wave dynamics were modulated by stimulus value and correlated with task performance. Mechanistically, the late wave component was i) modulated by motor feedback, ii) complemented by a sparse ensemble pattern across layer 2/3, which a balanced-state network model reconciled via inhibitory stabilization, and iii) aligned to regenerative Layer-5 apical dendritic Ca 2+ events. Our results reveal a translaminar spacetime pattern organized by cortical feedback in the sensory cortex that supports touch-evoked traveling waves.

GRAPHICAL ABSTRACT AND HIGHLIGHTS

Whisker touch evokes both early- and late-traveling waves in the barrel cortex over 100's of millisecondsReward reinforcement modulates wave dynamics Late wave emergence coincides with network sparsity in L23 and time-locked L5 dendritic Ca 2+ spikes Experimental and computational results link motor feedback to distinct translaminar spacetime patterns.

Human connectome topology directs cortical traveling waves and shapes frequency gradients

Traveling waves and neural oscillation frequency gradients are pervasive in the human cortex. While the direction of traveling waves has been linked to brain function and dysfunction, the factors that determine this direction remain elusive. We hypothesized that structural connectivity instrength gradients - defined as the gradually varying sum of incoming connection strengths across the cortex - could shape both traveling wave direction and frequency gradients. We confirm the presence of instrength gradients in the human connectome across diverse cohorts and parcellations. Using a cortical network model, we demonstrate how these instrength gradients direct traveling waves and shape frequency gradients. Our model fits resting-state MEG functional connectivity best in a regime where instrength-directed traveling waves and frequency gradients emerge. We further show how structural subnetworks of the human connectome generate opposing wave directions and frequency gradients observed in the alpha and beta bands. Our findings suggest that structural connectivity instrength gradients affect both traveling wave direction and frequency gradients.

Neural assemblies coordinated by cortical waves are associated with waking and hallucinatory brain states

The relationship between sensory stimuli and perceptions is brain-state dependent: in wakefulness, suprathreshold stimuli evoke perceptions; under anesthesia, perceptions are abolished; and during dreaming and in dissociated states, percepts are internally generated. Here, we exploit this state dependence to identify brain activity associated with internally generated or stimulus-evoked perceptions. In awake mice, visual stimuli phase reset spontaneous cortical waves to elicit 3-6 Hz feedback traveling waves. These stimulus-evoked waves traverse the cortex and entrain visual and parietal neurons. Under anesthesia as well as during ketamine-induced dissociation, visual stimuli do not disrupt spontaneous waves. Uniquely, in the dissociated state, spontaneous waves traverse the cortex caudally and entrain visual and parietal neurons, akin to stimulus-evoked waves in wakefulness. Thus, coordinated neuronal assemblies orchestrated by traveling cortical waves emerge in states in which perception can manifest. The awake state is privileged in that this coordination is reliably elicited by external visual stimuli.

Horizontal cortical connections shape intrinsic traveling waves into feature-selective motifs that regulate perceptual sensitivity

Intrinsic, ongoing fluctuations of cortical activity form traveling waves that modulate the gain of sensory-evoked responses and perceptual sensitivity. Several lines of evidence suggest that intrinsic traveling waves (iTWs) may arise, in part, from the coordination of synaptic activity through the recurrent horizontal connectivity within cortical areas, which include long range patchy connections that link neurons with shared feature preferences. In a spiking network model with anatomical topology that incorporates feature-selective patchy connections, which we call the Balanced Patchy Network (BPN), we observe repeated iTWs, which we refer to as motifs. In the model, motifs stem from fluctuations in the excitability of like-tuned neurons that result from shifts in E/I balance as action potentials traverse these patchy connections. To test if feature-selective motifs occur in vivo, we examined data previously recorded using multielectrode arrays in Area MT of marmosets trained to perform a threshold visual detection task. Using a newly developed method for comparing the similarity of wave patterns we found that some iTWs can be grouped into motifs. As predicted by the BPN, many of these motifs are feature selective, exhibiting direction-selective modulations in ongoing spiking activity. Further, motifs modulate the gain of the response evoked by a target and perceptual sensitivity to the target if the target matches the preference of the motif. These results provide evidence that iTWs are shaped by the patterns of horizontal fiber projections in the cortex and that patchy connections enable iTWs to regulate neural and perceptual sensitivity in a feature selective manner.

Breathing cluster in complex neuron-astrocyte networks

Brain activities are featured by spatially distributed neural clusters of coherent firings and a spontaneous slow switching of the clusters between the coherent and incoherent states. Evidences from recent in vivo experiments suggest that astrocytes, a type of glial cell regarded previously as providing only structural and metabolic supports to neurons, participate actively in brain functions by regulating the neural firing activities, yet the underlying mechanism remains unknown. Here, introducing astrocyte as a reservoir of the glutamate released from the neuron synapses, we propose the model of the complex neuron-astrocyte network, and investigate the roles of astrocytes in regulating the cluster synchronization behaviors of networked chaotic neurons. It is found that a specific set of neurons on the network are synchronized and form a cluster, while the remaining neurons are kept as desynchronized. Moreover, during the course of network evolution, the cluster is switching between the synchrony and asynchrony states in an intermittent fashion, henceforth the phenomenon of "breathing cluster." By the method of symmetry-based analysis, we conduct a theoretical investigation on the synchronizability of the cluster. It is revealed that the contents of the cluster are determined by the network symmetry, while the breathing of the cluster is attributed to the interplay between the neural network and the astrocyte. The phenomenon of breathing cluster is demonstrated in different network models, including networks with different sizes, nodal dynamics, and coupling functions. The findings shed light on the cellular mechanism of astrocytes in regulating neural activities and give insights into the state-switching of the neocortex.

Learning heterogeneous delays in a layer of spiking neurons for fast motion detection

The precise timing of spikes emitted by neurons plays a crucial role in shaping the response of efferent biological neurons. This temporal dimension of neural activity holds significant importance in understanding information processing in neurobiology, especially for the performance of neuromorphic hardware, such as event-based cameras. Nonetheless, many artificial neural models disregard this critical temporal dimension of neural activity. In this study, we present a model designed to efficiently detect temporal spiking motifs using a layer of spiking neurons equipped with heterogeneous synaptic delays. Our model capitalizes on the diverse synaptic delays present on the dendritic tree, enabling specific arrangements of temporally precise synaptic inputs to synchronize upon reaching the basal dendritic tree. We formalize this process as a time-invariant logistic regression, which can be trained using labeled data. To demonstrate its practical efficacy, we apply the model to naturalistic videos transformed into event streams, simulating the output of the biological retina or event-based cameras. To evaluate the robustness of the model in detecting visual motion, we conduct experiments by selectively pruning weights and demonstrate that the model remains efficient even under significantly reduced workloads. In conclusion, by providing a comprehensive, event-driven computational building block, the incorporation of heterogeneous delays has the potential to greatly improve the performance of future spiking neural network algorithms, particularly in the context of neuromorphic chips.

Beta traveling waves in monkey frontal and parietal areas encode recent reward history

Brain function depends on neural communication, but the mechanisms of this communication are not well understood. Recent studies suggest that one form of neural communication is through traveling waves (TWs)-patterns of neural oscillations that propagate within and between brain areas. We show that TWs are robust in microarray recordings in frontal and parietal cortex and encode recent reward history. Two adult male monkeys made saccades to obtain probabilistic rewards and were sensitive to the (statistically irrelevant) reward on the previous trial. TWs in frontal and parietal areas were stronger in trials that followed a prior reward versus a lack of reward and, in the frontal lobe, correlated with the monkeys' behavioral sensitivity to the prior reward. The findings suggest that neural communication mediated by TWs within the frontal and parietal lobes contribute to maintaining information about recent reward history and mediating the impact of this history on the monkeys' expectations.

Waves traveling over a map of visual space can ignite short-term predictions of sensory input

Recent analyses have found waves of neural activity traveling across entire visual cortical areas in awake animals. These traveling waves modulate the excitability of local networks and perceptual sensitivity. The general computational role of these spatiotemporal patterns in the visual system, however, remains unclear. Here, we hypothesize that traveling waves endow the visual system with the capacity to predict complex and naturalistic inputs. We present a network model whose connections can be rapidly and efficiently trained to predict individual natural movies. After training, a few input frames from a movie trigger complex wave patterns that drive accurate predictions many frames into the future solely from the network's connections. When the recurrent connections that drive waves are randomly shuffled, both traveling waves and the ability to predict are eliminated. These results suggest traveling waves may play an essential computational role in the visual system by embedding continuous spatiotemporal structures over spatial maps.

Neural assemblies coordinated by cortical waves are associated with waking and hallucinatory brain states

The relationship between sensory stimuli and perceptions is brain-state dependent: in wakefulness stimuli evoke perceptions; under anesthesia perceptions are abolished; during dreaming and in dissociated states, percepts are internally generated. Here, we exploit this state dependence to identify brain activity associated with internally generated or stimulus-evoked perception. In awake mice, visual stimuli phase reset spontaneous cortical waves to elicit 3-6 Hz feedback traveling waves. These stimulus-evoked waves traverse the cortex and entrain visual and parietal neurons. Under anesthesia and during ketamine-induced dissociation, visual stimuli do not disrupt spontaneous waves. Uniquely in the dissociated state, spontaneous waves traverse the cortex caudally and entrain visual and parietal neurons, akin to stimulus-evoked waves in wakefulness. Thus, coordinated neuronal assemblies orchestrated by traveling cortical waves emerge in states in which perception can manifest. The awake state is privileged in that this coordination is elicited by specifically by external visual stimuli.

Computational models for state-dependent traveling waves in hippocampal formation

Hippocampal theta (4-10 Hz) oscillations have been identified as traveling waves in both rodents and humans. In freely foraging rodents, the theta traveling wave is a planar wave propagating from the dorsal to ventral hippocampus along the septotemporal axis. Motivated from experimental findings, we develop a spiking neural network of excitatory and inhibitory neurons to generate state-dependent hippocampal traveling waves to improve current mechanistic understanding of propagating waves. Model simulations demonstrate the necessary conditions for generating wave propagation and characterize the traveling wave properties with respect to model parameters, running speed and brain state of the animal. Networks with long-range inhibitory connections are more suitable than networks with long-range excitatory connections. We further generalize the spiking neural network to model traveling waves in the medial entorhinal cortex (MEC) and predict that traveling theta waves in the hippocampus and entorhinal cortex are in sink.

Development of top-down cortical propagations in youth

Hierarchical processing requires activity propagating between higher- and lower-order cortical areas. However, functional neuroimaging studies have chiefly quantified fluctuations within regions over time rather than propagations occurring over space. Here, we leverage advances in neuroimaging and computer vision to track cortical activity propagations in a large sample of youth (n = 388). We delineate cortical propagations that systematically ascend and descend a cortical hierarchy in all individuals in our developmental cohort, as well as in an independent dataset of densely sampled adults. Further, we demonstrate that top-down, descending hierarchical propagations become more prevalent with greater demands for cognitive control as well as with development in youth. These findings emphasize that hierarchical processing is reflected in the directionality of propagating cortical activity and suggest top-down propagations as a potential mechanism of neurocognitive maturation in youth.

Spatiotemporal organisation of human sensorimotor beta burst activity

Beta oscillations in human sensorimotor cortex are hallmark signatures of healthy and pathological movement. In single trials, beta oscillations include bursts of intermittent, transient periods of high-power activity. These burst events have been linked to a range of sensory and motor processes, but their precise spatial, spectral, and temporal structure remains unclear. Specifically, a role for beta burst activity in information coding and communication suggests spatiotemporal patterns, or travelling wave activity, along specific anatomical gradients. We here show in human magnetoencephalography recordings that burst activity in sensorimotor cortex occurs in planar spatiotemporal wave-like patterns that dominate along two axes either parallel or perpendicular to the central sulcus. Moreover, we find that the two propagation directions are characterised by distinct anatomical and physiological features. Finally, our results suggest that sensorimotor beta bursts occurring before and after a movement can be distinguished by their anatomical, spectral, and spatiotemporal characteristics, indicating distinct functional roles.

Beta oscillations and waves in motor cortex can be accounted for by the interplay of spatially structured connectivity and fluctuating inputs

The beta rhythm (13-30 Hz) is a prominent brain rhythm. Recordings in primates during instructed-delay reaching tasks have shown that different types of traveling waves of oscillatory activity are associated with episodes of beta oscillations in motor cortex during movement preparation. We propose here a simple model of motor cortex based on local excitatory-inhibitory neuronal populations coupled by long-range excitation, where additionally inputs to the motor cortex from other neural structures are represented by stochastic inputs on the different model populations. We show that the model accurately reproduces the statistics of recording data when these external inputs are correlated on a short time scale (25 ms) and have two different components, one that targets the motor cortex locally and another one that targets it in a global and synchronized way. The model reproduces the distribution of beta burst durations, the proportion of the different observed wave types, and wave speeds, which we show not to be linked to axonal propagation speed. When the long-range connectivity or the local input targets are anisotropic, traveling waves are found to preferentially propagate along the axis where connectivity decays the fastest. Different from previously proposed mechanistic explanations, the model suggests that traveling waves in motor cortex are the reflection of the dephasing by external inputs, putatively of thalamic origin, of an oscillatory activity that would otherwise be spatially synchronized by recurrent connectivity.

Precise Spiking Motifs in Neurobiological and Neuromorphic Data

Why do neurons communicate through spikes? By definition, spikes are all-or-none neural events which occur at continuous times. In other words, spikes are on one side binary, existing or not without further details, and on the other, can occur at any asynchronous time, without the need for a centralized clock. This stands in stark contrast to the analog representation of values and the discretized timing classically used in digital processing and at the base of modern-day neural networks. As neural systems almost systematically use this so-called event-based representation in the living world, a better understanding of this phenomenon remains a fundamental challenge in neurobiology in order to better interpret the profusion of recorded data. With the growing need for intelligent embedded systems, it also emerges as a new computing paradigm to enable the efficient operation of a new class of sensors and event-based computers, called neuromorphic, which could enable significant gains in computation time and energy consumption-a major societal issue in the era of the digital economy and global warming. In this review paper, we provide evidence from biology, theory and engineering that the precise timing of spikes plays a crucial role in our understanding of the efficiency of neural networks.

Spatiotemporal dynamics in large-scale cortical networks

Investigating links between nervous system function and behavior requires monitoring neuronal activity at a range of spatial and temporal scales. Here, we summarize recent progress in applying two distinct but complementary approaches to the study of network dynamics in the neocortex. Mesoscopic calcium imaging allows simultaneous monitoring of activity across most of the cortex at moderate spatiotemporal resolution. Electrophysiological recordings provide extremely high temporal resolution of neural signals at multiple targeted locations. A number of recent studies have used these tools to reveal novel patterns of activity across distributed cortical subnetworks. This growing body of work strongly supports the hypothesis that the dynamic coordination of spatially distinct regions is a fundamental aspect of cortical function that supports cognition and behavior.

Waveform detection by deep learning reveals multi-area spindles that are selectively modulated by memory load

Sleep is generally considered to be a state of large-scale synchrony across thalamus and neocortex; however, recent work has challenged this idea by reporting isolated sleep rhythms such as slow oscillations and spindles. What is the spatial scale of sleep rhythms? To answer this question, we adapted deep learning algorithms initially developed for detecting earthquakes and gravitational waves in high-noise settings for analysis of neural recordings in sleep. We then studied sleep spindles in non-human primate electrocorticography (ECoG), human electroencephalogram (EEG), and clinical intracranial electroencephalogram (iEEG) recordings in the human. Within each recording type, we find widespread spindles occur much more frequently than previously reported. We then analyzed the spatiotemporal patterns of these large-scale, multi-area spindles and, in the EEG recordings, how spindle patterns change following a visual memory task. Our results reveal a potential role for widespread, multi-area spindles in consolidation of memories in networks widely distributed across primate cortex.

The brain processes memories as we sleep, generating rhythms of electrical activity called ‘sleep spindles’. Sleep spindles were long thought to be a state where the entire brain was fully synchronized by this rhythm. This was based on EEG recordings, short for electroencephalogram, a technique that uses electrodes on the scalp to measure electrical activity in the outermost layer of the brain, the cortex. But more recent intracranial recordings of people undergoing brain surgery have challenged this idea and suggested that sleep spindles may not be a state of global brain synchronization, but rather localised to specific areas.

Mofrad et al. sought to clarify the extent to which spindles co-occur at multiple sites in the brain, which could shed light on how networks of neurons coordinate memory storage during sleep. To analyse highly variable brain wave recordings, Mofrad et al. adapted deep learning algorithms initially developed for detecting earthquakes and gravitational waves. The resulting algorithm, designed to more sensitively detect spindles amongst other brain activity, was then applied to a range of sleep recordings from humans and macaque monkeys.

The analyses revealed that widespread and complex patterns of spindle rhythms, spanning multiple areas in the cortex of the brain, actually appear much more frequently than previously thought. This finding was consistent across all the recordings analysed, even recordings under the skull, which provide the clearest window into brain circuits. Further analyses found that these multi-area spindles occurred more often in sleep after people had completed tasks that required holding many visual scenes in memory, as opposed to control conditions with fewer visual scenes.

In summary, Mofrad et al. show that neuroscientists had previously not appreciated the complex and dynamic patterns in this sleep rhythm. These patterns in sleep spindles may be able to adapt based on the demands needed for memory storage, and this will be the subject of future work. Moreover, the findings support the idea that sleep spindles help coordinate the consolidation of memories in brain circuits that stretch across the cortex. Understanding this mechanism may provide insights into how memory falters in aging and sleep-related diseases, such as Alzheimer’s disease. Lastly, the algorithm developed by Mofrad et al. stands to be a useful tool for analysing other rhythmic waveforms in noisy recordings.