A Diversity of Intrinsic Timescales Underlie Neural Computations

Multi-timescale neural dynamics for multisensory integration

Carrying out any everyday task, be it driving in traffic, conversing with friends or playing basketball, requires rapid selection, integration and segregation of stimuli from different sensory modalities. At present, even the most advanced artificial intelligence-based systems are unable to replicate the multisensory processes that the human brain routinely performs, but how neural circuits in the brain carry out these processes is still not well understood. In this Perspective, we discuss recent findings that shed fresh light on the oscillatory neural mechanisms that mediate multisensory integration (MI), including power modulations, phase resetting, phase-amplitude coupling and dynamic functional connectivity. We then consider studies that also suggest multi-timescale dynamics in intrinsic ongoing neural activity and during stimulus-driven bottom-up and cognitive top-down neural network processing in the context of MI. We propose a new concept of MI that emphasizes the critical role of neural dynamics at multiple timescales within and across brain networks, enabling the simultaneous integration, segregation, hierarchical structuring and selection of information in different time windows. To highlight predictions from our multi-timescale concept of MI, real-world scenarios in which multi-timescale processes may coordinate MI in a flexible and adaptive manner are considered.

Slow ramping emerges from spontaneous fluctuations in spiking neural networks

The capacity to initiate actions endogenously is critical for goal-directed behavior. Spontaneous voluntary actions are typically preceded by slow-ramping activity in medial frontal cortex that begins around two seconds before movement, which may reflect spontaneous fluctuations that influence action timing. However, the mechanisms by which these slow ramping signals emerge from single-neuron and network dynamics remain poorly understood. Here, we developed a spiking neural-network model that produces spontaneous slow ramping activity in single neurons and population activity with onsets ~2 s before threshold crossings. A key prediction of our model is that neurons that ramp together have correlated firing patterns before ramping onset. We confirmed this model-derived hypothesis in a dataset of human single neuron recordings from medial frontal cortex. Our results suggest that slow ramping signals reflect bounded spontaneous fluctuations that emerge from quasi-winner-take-all dynamics in clustered networks that are temporally stabilized by slow-acting synapses.

Atypical intrinsic neural timescale in the left angular gyrus in Alzheimer's disease

Alzheimer's disease is characterized by cognitive impairment and progressive brain atrophy. Recent human neuroimaging studies reported atypical anatomical and functional changes in some regions in the default mode network in patients with Alzheimer's disease, but which brain area of the default mode network is the key region whose atrophy disturbs the entire network activity and consequently contributes to the symptoms of the disease remains unidentified. Here, in this case-control study, we aimed to identify crucial neural regions that mediated the phenotype of Alzheimer's disease, and as such, we examined the intrinsic neural timescales-a functional metric to evaluate the capacity to integrate diverse neural information-and grey matter volume of the regions in the default mode network using resting-state functional MRI images and structural MRI data obtained from individuals with Alzheimer's disease and cognitively typical people. After confirming the atypically short neural timescale of the entire default mode network in Alzheimer's disease and its link with the symptoms of the disease, we found that the shortened neural timescale of the default mode network was associated with the aberrantly short neural timescale of the left angular gyrus. Moreover, we revealed that the shortened neural timescale of the angular gyrus was correlated with the atypically reduced grey matter volume of this parietal region. Furthermore, we identified an association between the neural structure, brain function and symptoms and proposed a model in which the reduced grey matter volume of the left angular gyrus shortened the intrinsic neural time of the region, which then destabilized the entire neural timescale of the default mode network and resultantly contributed to cognitive decline in Alzheimer's disease. These findings highlight the key role of the left angular gyrus in the anatomical and functional aetiology of Alzheimer's disease.

Altered Hierarchical Gradients of Intrinsic Neural Timescales in Mild Cognitive Impairment and Alzheimer's Disease

Alzheimer's disease (AD) is a devastating neurodegenerative disease that affects millions of seniors in the United States. Resting-state functional magnetic resonance imaging (rs-fMRI) is widely used to study neurophysiology in AD and its prodromal condition, mild cognitive impairment (MCI). The intrinsic neural timescale (INT), which can be estimated through the magnitude of the autocorrelation of neural signals from rs-fMRI, is thought to quantify the duration that neural information is stored in a local circuit. Such heterogeneity of the timescales forms a basis of the brain functional hierarchy and captures an aspect of circuit dynamics relevant to excitation/inhibition balance, which is broadly relevant for cognitive functions. Given that, we applied rs-fMRI to test whether distinct changes of INT at different hierarchies are present in people with MCI, those progressing to AD (called Converter), and AD patients of both sexes. Linear mixed-effect model was implemented to detect altered hierarchical gradients across populations followed by pairwise comparisons to identify regional differences. High similarities between AD and Converter were observed. Specifically, the inferior temporal, caudate, and pallidum areas exhibit significant alterations in both AD and Converter. Distinct INT-related pathological changes in MCI and AD were found. For AD/Converter, neural information is stored for a longer time in lower hierarchical areas, while higher levels of hierarchy seem to be preferentially impaired in MCI leading to a less pronounced hierarchical gradient. These results inform that the INT holds great potential as an additional measure for AD prediction, even a stable biomarker for clinical diagnosis.

Spiking activity in the visual thalamus is coupled to pupil dynamics across temporal scales

The processing of sensory information, even at early stages, is influenced by the internal state of the animal. Internal states, such as arousal, are often characterized by relating neural activity to a single "level" of arousal, defined by a behavioral indicator such as pupil size. In this study, we expand the understanding of arousal-related modulations in sensory systems by uncovering multiple timescales of pupil dynamics and their relationship to neural activity. Specifically, we observed a robust coupling between spiking activity in the mouse dorsolateral geniculate nucleus (dLGN) of the thalamus and pupil dynamics across timescales spanning a few seconds to several minutes. Throughout all these timescales, 2 distinct spiking modes-individual tonic spikes and tightly clustered bursts of spikes-preferred opposite phases of pupil dynamics. This multi-scale coupling reveals modulations distinct from those captured by pupil size per se, locomotion, and eye movements. Furthermore, coupling persisted even during viewing of a naturalistic movie, where it contributed to differences in the encoding of visual information. We conclude that dLGN spiking activity is under the simultaneous influence of multiple arousal-related processes associated with pupil dynamics occurring over a broad range of timescales.

Taking time to compose thoughts with prefrontal schemata

Under what conditions can prefrontal cortex direct the composition of brain states, to generate coherent streams of thoughts? Using a simplified Potts model of cortical dynamics, crudely differentiated into two halves, we show that once activity levels are regulated, so as to disambiguate a single temporal sequence, whether the contents of the sequence are mainly determined by the frontal or by the posterior half, or by neither, depends on statistical parameters that describe its microcircuits. The frontal cortex tends to lead if it has more local attractors, longer lasting and stronger ones, in order of increasing importance. Its guidance is particularly effective to the extent that posterior cortices do not tend to transition from state to state on their own. The result may be related to prefrontal cortex enforcing its temporally-oriented schemata driving coherent sequences of brain states, unlike the atemporal "context" contributed by the hippocampus. Modelling a mild prefrontal (vs. posterior) lesion offers an account of mind-wandering and event construction deficits observed in prefrontal patients.

Repertoire of timescales in uni - and transmodal regions mediate working memory capacity

Working memory (WM) describes the dynamic process of maintenance and manipulation of information over a certain time delay. Neuronally, WM recruits a distributed network of cortical regions like the visual and dorsolateral prefrontal cortex as well as the subcortical hippocampus. How the input dynamics and subsequent neural dynamics impact WM remains unclear though. To answer this question, we combined the analysis of behavioral WM capacity with measuring neural dynamics through task-related power spectrum changes, e.g., median frequency (MF) in functional magnetic resonance imaging (fMRI). We show that the processing of the input dynamics, e.g., the task structure's specific timescale, leads to changes in the unimodal visual cortex's corresponding timescale which also relates to working memory capacity. While the more transmodal hippocampus relates to working memory capacity through its balance across multiple timescales or frequencies. In conclusion, we here show the relevance of both input dynamics and different neural timescales for WM capacity in uni - and transmodal regions like visual cortex and hippocampus for the subject's WM performance.

Computational Language Modeling and the Promise of In Silico Experimentation

Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.

Neural timescales reflect behavioral demands in freely moving rhesus macaques

Previous work demonstrated a highly reproducible cortical hierarchy of neural timescales at rest, with sensory areas displaying fast, and higher-order association areas displaying slower timescales. The question arises how such stable hierarchies give rise to adaptive behavior that requires flexible adjustment of temporal coding and integration demands. Potentially, this lack of variability in the hierarchical organization of neural timescales could reflect the structure of the laboratory contexts. We posit that unconstrained paradigms are ideal to test whether the dynamics of neural timescales reflect behavioral demands. Here we measured timescales of local field potential activity while male rhesus macaques foraged in an open space. We found a hierarchy of neural timescales that differs from previous work. Importantly, although the magnitude of neural timescales expanded with task engagement, the brain areas' relative position in the hierarchy was stable. Next, we demonstrated that the change in neural timescales is dynamic and contains functionally-relevant information, differentiating between similar events in terms of motor demands and associated reward. Finally, we demonstrated that brain areas are differentially affected by these behavioral demands. These results demonstrate that while the space of neural timescales is anatomically constrained, the observed hierarchical organization and magnitude is dependent on behavioral demands.

Bayesian inference is facilitated by modular neural networks with different time scales

Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference by the brain, the prior distribution must be acquired and represented by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. Our findings reveal that networks with modular structures, composed of fast and slow modules, are adept at representing this prior distribution, enabling more accurate Bayesian inferences. Specifically, the modular network that consists of a main module connected with input and output layers and a sub-module with slower neural activity connected only with the main module outperformed networks with uniform time scales. Prior information was represented specifically by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the neural network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure and the division of roles in which prior knowledge is selectively represented in the slow sub-modules spontaneously emerged. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales.

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.

Cortical timescales and the modular organization of structural and functional brain networks

Recent years have seen growing interest in characterizing the properties of regional brain dynamics and their relationship to other features of brain structure and function. In particular, multiple studies have observed regional differences in the "timescale" over which activity fluctuates during periods of quiet rest. In the cerebral cortex, these timescales have been associated with both local circuit properties as well as patterns of inter-regional connectivity, including the extent to which each region exhibits widespread connectivity to other brain areas. In the current study, we build on prior observations of an association between connectivity and dynamics in the cerebral cortex by investigating the relationship between BOLD fMRI timescales and the modular organization of structural and functional brain networks. We characterize network community structure across multiple scales and find that longer timescales are associated with greater within-community functional connectivity and diverse structural connectivity. We also replicate prior observations of a positive correlation between timescales and structural connectivity degree. Finally, we find evidence for preferential functional connectivity between cortical areas with similar timescales. We replicate these findings in an independent dataset. These results contribute to our understanding of functional brain organization and structure-function relationships in the human brain, and support the notion that regional differences in cortical dynamics may in part reflect the topological role of each region within macroscale brain networks.

The Primate Cortical LFP Exhibits Multiple Spectral and Temporal Gradients and Widespread Task-Dependence During Visual Short-Term Memory

Although cognitive functions are hypothesized to be mediated by synchronous neuronal interactions in multiple frequency bands among widely distributed cortical areas, we still lack a basic understanding of the distribution and task dependence of oscillatory activity across the cortical map. Here, we ask how the spectral and temporal properties of the local field potential (LFP) vary across the primate cerebral cortex, and how they are modulated during visual short-term memory. We measured the LFP from 55 cortical areas in two macaque monkeys while they performed a visual delayed match to sample task. Analysis of peak frequencies in the LFP power spectra reveals multiple discrete frequency bands between 3-80 Hz that differ between the two monkeys. The LFP power in each band, as well as the Sample Entropy, a measure of signal complexity, display distinct spatial gradients across the cortex, some of which correlate with reported spine counts in layer 3 pyramidal neurons. Cortical areas can be robustly decoded using a small number of spectral and temporal parameters, and significant task dependent increases and decreases in spectral power occur in all cortical areas. These findings reveal pronounced, widespread and spatially organized gradients in the spectral and temporal activity of cortical areas. Task-dependent changes in cortical activity are globally distributed, even for a simple cognitive task.

Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics

It is widely believed the brain-inspired spiking neural networks have the capability of processing temporal information owing to their dynamic attributes. However, how to understand what kind of mechanisms contributing to the learning ability and exploit the rich dynamic properties of spiking neural networks to satisfactorily solve complex temporal computing tasks in practice still remains to be explored. In this article, we identify the importance of capturing the multi-timescale components, based on which a multi-compartment spiking neural model with temporal dendritic heterogeneity, is proposed. The model enables multi-timescale dynamics by automatically learning heterogeneous timing factors on different dendritic branches. Two breakthroughs are made through extensive experiments: the working mechanism of the proposed model is revealed via an elaborated temporal spiking XOR problem to analyze the temporal feature integration at different levels; comprehensive performance benefits of the model over ordinary spiking neural networks are achieved on several temporal computing benchmarks for speech recognition, visual recognition, electroencephalogram signal recognition, and robot place recognition, which shows the best-reported accuracy and model compactness, promising robustness and generalization, and high execution efficiency on neuromorphic hardware. This work moves neuromorphic computing a significant step toward real-world applications by appropriately exploiting biological observations.

Auditory inputs modulate intrinsic neuronal timescales during sleep

Functional magnetic resonance imaging (fMRI) studies have demonstrated that intrinsic neuronal timescales (INT) undergo modulation by external stimulation during consciousness. It remains unclear if INT keep the ability for significant stimulus-induced modulation during primary unconscious states, such as sleep. This fMRI analysis addresses this question via a dataset that comprises an awake resting-state plus rest and stimulus states during sleep. We analyzed INT measured via temporal autocorrelation supported by median frequency (MF) in the frequency-domain. Our results were replicated using a biophysical model. There were two main findings: (1) INT prolonged while MF decreased from the awake resting-state to the N2 resting-state, and (2) INT shortened while MF increased during the auditory stimulus in sleep. The biophysical model supported these results by demonstrating prolonged INT in slowed neuronal populations that simulate the sleep resting-state compared to an awake state. Conversely, under sine wave input simulating the stimulus state during sleep, the model's regions yielded shortened INT that returned to the awake resting-state level. Our results highlight that INT preserve reactivity to stimuli in states of unconsciousness like sleep, enhancing our understanding of unconscious brain dynamics and their reactivity to stimuli.

Quantifying decision-making in dynamic, continuously evolving environments

During perceptual decision-making tasks, centroparietal electroencephalographic (EEG) potentials report an evidence accumulation-to-bound process that is time locked to trial onset. However, decisions in real-world environments are rarely confined to discrete trials; they instead unfold continuously, with accumulation of time-varying evidence being recency-weighted towards its immediate past. The neural mechanisms supporting recency-weighted continuous decision-making remain unclear. Here, we use a novel continuous task design to study how the centroparietal positivity (CPP) adapts to different environments that place different constraints on evidence accumulation. We show that adaptations in evidence weighting to these different environments are reflected in changes in the CPP. The CPP becomes more sensitive to fluctuations in sensory evidence when large shifts in evidence are less frequent, and the potential is primarily sensitive to fluctuations in decision-relevant (not decision-irrelevant) sensory input. A complementary triphasic component over occipito-parietal cortex encodes the sum of recently accumulated sensory evidence, and its magnitude covaries with parameters describing how different individuals integrate sensory evidence over time. A computational model based on leaky evidence accumulation suggests that these findings can be accounted for by a shift in decision threshold between different environments, which is also reflected in the magnitude of pre-decision EEG activity. Our findings reveal how adaptations in EEG responses reflect flexibility in evidence accumulation to the statistics of dynamic sensory environments.

Altered hierarchical gradients of intrinsic neural timescales in mild cognitive impairment and Alzheimer's disease

Alzheimer's disease (AD) is a devastating neurodegenerative disease that affects millions of older adults in the US and worldwide. Resting-state functional magnetic resonance imaging (rs-fMRI) has become a widely used neuroimaging tool to study neurophysiology in AD and its prodromal condition, mild cognitive impairment (MCI). The intrinsic neural timescale (INT), which can be estimated through the magnitude of the autocorrelation of intrinsic neural signals using rs-fMRI, is thought to quantify the duration that neural information is stored in a local cortical circuit. The heterogeneity of the timescales is considered to be a basis of the functional hierarchy in the brain. In addition, INT captures an aspect of circuit dynamics relevant to excitation/inhibition (E/I) balance, which is thought to be broadly relevant for cognitive functions. Here we examined its relevance to AD. We used rs-fMRI data of 904 individuals from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The subjects were divided into 4 groups based on their baseline and end-visit clinical status, which were cognitively normal (CN), stable MCI, Converter, and AD groups. Linear mixed effect model and pairwise comparison were implemented to investigate the large-scale hierarchical organization and local differences. We observed high similarities between AD and Converter groups. Specifically, among the eight identified ROIs with distinct INT alterations in AD, three ROIs (inferior temporal, caudate, pallidum areas) exhibit stable and significant alteration in AD converter. In addition, distinct INT related pathological changes in stable MCI and AD/Converter were found. For AD and Converter groups, neural information is stored for a longer time in lower hierarchical order areas, while higher levels of hierarchy seem to be preferentially impaired in stable MCI leading to a less pronounced hierarchical gradient effect. These results inform that the INT holds great potential as an additional measure for AD prediction, a stable biomarker for clinical diagnosis and an important therapeutic target in AD.

As without, so within: how the brain's temporo-spatial alignment to the environment shapes consciousness

Consciousness is constituted by a structure that includes contents as foreground and the environment as background. This structural relation between the experiential foreground and background presupposes a relationship between the brain and the environment, often neglected in theories of consciousness. The temporo-spatial theory of consciousness addresses the brain-environment relation by a concept labelled 'temporo-spatial alignment'. Briefly, temporo-spatial alignment refers to the brain's neuronal activity's interaction with and adaption to interoceptive bodily and exteroceptive environmental stimuli, including their symmetry as key for consciousness. Combining theory and empirical data, this article attempts to demonstrate the yet unclear neuro-phenomenal mechanisms of temporo-spatial alignment. First, we suggest three neuronal layers of the brain's temporo-spatial alignment to the environment. These neuronal layers span across a continuum from longer to shorter timescales. (i) The background layer comprises longer and more powerful timescales mediating topographic-dynamic similarities between different subjects' brains. (ii) The intermediate layer includes a mixture of medium-scaled timescales allowing for stochastic matching between environmental inputs and neuronal activity through the brain's intrinsic neuronal timescales and temporal receptive windows. (iii) The foreground layer comprises shorter and less powerful timescales for neuronal entrainment of stimuli temporal onset through neuronal phase shifting and resetting. Second, we elaborate on how the three neuronal layers of temporo-spatial alignment correspond to their respective phenomenal layers of consciousness. (i) The inter-subjectively shared contextual background of consciousness. (ii) An intermediate layer that mediates the relationship between different contents of consciousness. (iii) A foreground layer that includes specific fast-changing contents of consciousness. Overall, temporo-spatial alignment may provide a mechanism whose different neuronal layers modulate corresponding phenomenal layers of consciousness. Temporo-spatial alignment can provide a bridging principle for linking physical-energetic (free energy), dynamic (symmetry), neuronal (three layers of distinct time-space scales) and phenomenal (form featured by background-intermediate-foreground) mechanisms of consciousness.

Targeting operational regimes of interest in recurrent neural networks

Neural computations emerge from local recurrent neural circuits or computational units such as cortical columns that comprise hundreds to a few thousand neurons. Continuous progress in connectomics, electrophysiology, and calcium imaging require tractable spiking network models that can consistently incorporate new information about the network structure and reproduce the recorded neural activity features. However, for spiking networks, it is challenging to predict which connectivity configurations and neural properties can generate fundamental operational states and specific experimentally reported nonlinear cortical computations. Theoretical descriptions for the computational state of cortical spiking circuits are diverse, including the balanced state where excitatory and inhibitory inputs balance almost perfectly or the inhibition stabilized state (ISN) where the excitatory part of the circuit is unstable. It remains an open question whether these states can co-exist with experimentally reported nonlinear computations and whether they can be recovered in biologically realistic implementations of spiking networks. Here, we show how to identify spiking network connectivity patterns underlying diverse nonlinear computations such as XOR, bistability, inhibitory stabilization, supersaturation, and persistent activity. We establish a mapping between the stabilized supralinear network (SSN) and spiking activity which allows us to pinpoint the location in parameter space where these activity regimes occur. Notably, we find that biologically-sized spiking networks can have irregular asynchronous activity that does not require strong excitation-inhibition balance or large feedforward input and we show that the dynamic firing rate trajectories in spiking networks can be precisely targeted without error-driven training algorithms.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

Principles of large-scale neural interactions

What mechanisms underlie flexible inter-areal communication in the cortex? We consider four mechanisms for temporal coordination and their contributions to communication: (1) Oscillatory synchronization (communication-through-coherence); (2) communication-through-resonance; (3) non-linear integration; and (4) linear signal transmission (coherence-through-communication). We discuss major challenges for communication-through-coherence based on layer- and cell-type-specific analyses of spike phase-locking, heterogeneity of dynamics across networks and states, and computational models for selective communication. We argue that resonance and non-linear integration are viable alternative mechanisms that facilitate computation and selective communication in recurrent networks. Finally, we consider communication in relation to cortical hierarchy and critically examine the hypothesis that feedforward and feedback communication use fast (gamma) and slow (alpha/beta) frequencies, respectively. Instead, we propose that feedforward propagation of prediction errors relies on the non-linear amplification of aperiodic transients, whereas gamma and beta rhythms represent rhythmic equilibrium states that facilitate sustained and efficient information encoding and amplification of short-range feedback via resonance.

Intrinsic timescales in the visual cortex change with selective attention and reflect spatial connectivity

Intrinsic timescales characterize dynamics of endogenous fluctuations in neural activity. Variation of intrinsic timescales across the neocortex reflects functional specialization of cortical areas, but less is known about how intrinsic timescales change during cognitive tasks. We measured intrinsic timescales of local spiking activity within columns of area V4 in male monkeys performing spatial attention tasks. The ongoing spiking activity unfolded across at least two distinct timescales, fast and slow. The slow timescale increased when monkeys attended to the receptive fields location and correlated with reaction times. By evaluating predictions of several network models, we found that spatiotemporal correlations in V4 activity were best explained by the model in which multiple timescales arise from recurrent interactions shaped by spatially arranged connectivity, and attentional modulation of timescales results from an increase in the efficacy of recurrent interactions. Our results suggest that multiple timescales may arise from the spatial connectivity in the visual cortex and flexibly change with the cognitive state due to dynamic effective interactions between neurons.

A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time

This article presents an overview of a theory for performing temporal smoothing on temporal signals in such a way that: (i) temporally smoothed signals at coarser temporal scales are guaranteed to constitute simplifications of corresponding temporally smoothed signals at any finer temporal scale (including the original signal) and (ii) the temporal smoothing process is both time-causal and time-recursive, in the sense that it does not require access to future information and can be performed with no other temporal memory buffer of the past than the resulting smoothed temporal scale-space representations themselves. For specific subsets of parameter settings for the classes of linear and shift-invariant temporal smoothing operators that obey this property, it is shown how temporal scale covariance can be additionally obtained, guaranteeing that if the temporal input signal is rescaled by a uniform temporal scaling factor, then also the resulting temporal scale-space representations of the rescaled temporal signal will constitute mere rescalings of the temporal scale-space representations of the original input signal, complemented by a shift along the temporal scale dimension. The resulting time-causal limit kernel that obeys this property constitutes a canonical temporal kernel for processing temporal signals in real-time scenarios when the regular Gaussian kernel cannot be used, because of its non-causal access to information from the future, and we cannot additionally require the temporal smoothing process to comprise a complementary memory of the past beyond the information contained in the temporal smoothing process itself, which in this way also serves as a multi-scale temporal memory of the past. We describe how the time-causal limit kernel relates to previously used temporal models, such as Koenderink's scale-time kernels and the ex-Gaussian kernel. We do also give an overview of how the time-causal limit kernel can be used for modelling the temporal processing in models for spatio-temporal and spectro-temporal receptive fields, and how it more generally has a high potential for modelling neural temporal response functions in a purely time-causal and time-recursive way, that can also handle phenomena at multiple temporal scales in a theoretically well-founded manner. We detail how this theory can be efficiently implemented for discrete data, in terms of a set of recursive filters coupled in cascade. Hence, the theory is generally applicable for both: (i) modelling continuous temporal phenomena over multiple temporal scales and (ii) digital processing of measured temporal signals in real time. We conclude by stating implications of the theory for modelling temporal phenomena in biological, perceptual, neural and memory processes by mathematical models, as well as implications regarding the philosophy of time and perceptual agents. Specifically, we propose that for A-type theories of time, as well as for perceptual agents, the notion of a non-infinitesimal inner temporal scale of the temporal receptive fields has to be included in representations of the present, where the inherent nonzero temporal delay of such time-causal receptive fields implies a need for incorporating predictions from the actual time-delayed present in the layers of a perceptual hierarchy, to make it possible for a representation of the perceptual present to constitute a representation of the environment with timing properties closer to the actual present.

Neural timescales reflect behavioral demands in freely moving rhesus macaques

Previous work has demonstrated remarkably reproducible and consistent hierarchies of neural timescales across cortical areas at rest. The question arises how such stable hierarchies give rise to adaptive behavior that requires flexible adjustment of temporal coding and integration demands. Potentially, this previously found lack of variability in the hierarchical organization of neural timescales could be a reflection of the structure of the laboratory contexts in which they were measured. Indeed, computational work demonstrates the existence of multiple temporal hierarchies within the same anatomical network when the input structure is altered. We posit that unconstrained behavioral environments where relatively little temporal demands are imposed from the experimenter are an ideal test bed to address the question of whether the hierarchical organization and the magnitude of neural timescales reflect ongoing behavioral demands. To tackle this question, we measured timescales of local field potential activity while rhesus macaques were foraging freely in a large open space. We find a hierarchy of neural timescales that is unique to this foraging environment. Importantly, although the magnitude of neural timescales generally expanded with task engagement, the brain areas' relative position in the hierarchy was stable across the recording sessions. Notably, the magnitude of neural timescales monotonically expanded with task engagement across a relatively long temporal scale spanning the duration of the recording session. Over shorter temporal scales, the magnitude of neural timescales changed dynamically around foraging events. Moreover, the change in the magnitude of neural timescales contained functionally relevant information, differentiating between seemingly similar events in terms of motor demands and associated reward. That is, the patterns of change were associated with the cognitive and behavioral meaning of these events. Finally, we demonstrated that brain areas were differentially affected by these behavioral demands - i.e., the expansion of neural timescales was not the same across all areas. Together, these results demonstrate that the observed hierarchy of neural timescales is context-dependent and that changes in the magnitude of neural timescales are closely related to overall task engagement and behavioral demands.

A deep generative adversarial network capturing complex spiral waves in disinhibited circuits of the cerebral cortex

BACKGROUND

In the cerebral cortex, disinhibited activity is characterized by propagating waves that spread across neural tissue. In this pathological state, a widely reported form of activity are spiral waves that travel in a circular pattern around a fixed spatial locus termed the center of mass. Spiral waves exhibit stereotypical activity and involve broad patterns of co-fluctuations, suggesting that they may be of lower complexity than healthy activity.

RESULTS

To evaluate this hypothesis, we performed dense multi-electrode recordings of cortical networks where disinhibition was induced by perfusing a pro-epileptiform solution containing 4-Aminopyridine as well as increased potassium and decreased magnesium. Spiral waves were identified based on a spatially delimited center of mass and a broad distribution of instantaneous phases across electrodes. Individual waves were decomposed into "snapshots" that captured instantaneous neural activation across the entire network. The complexity of these snapshots was examined using a measure termed the participation ratio. Contrary to our expectations, an eigenspectrum analysis of these snapshots revealed a broad distribution of eigenvalues and an increase in complexity compared to baseline networks. A deep generative adversarial network was trained to generate novel exemplars of snapshots that closely captured cortical spiral waves. These synthetic waves replicated key features of experimental data including a tight center of mass, a broad eigenvalue distribution, spatially-dependent correlations, and a high complexity. By adjusting the input to the model, new samples were generated that deviated in systematic ways from the experimental data, thus allowing the exploration of a broad range of states from healthy to pathologically disinhibited neural networks.

CONCLUSIONS

Together, results show that the complexity of population activity serves as a marker along a continuum from healthy to disinhibited brain states. The proposed generative adversarial network opens avenues for replicating the dynamics of cortical seizures and accelerating the design of optimal neurostimulation aimed at suppressing pathological brain activity.

Cingulo-Opercular Subnetworks Motivate Frontoparietal Subnetworks during Distinct Cognitive Control Demands

Cognitive control is the ability to flexibly adapt behavior in a goal-directed manner when habit will not suffice. Control can be separated into distinct forms based on the timescale (present-future) and/or medium (external-internal) over which it operates. Both the frontoparietal network (FPN) and cingulo-opercular network (CON) are engaged during control, but their respective functions and interactions remain unclear. Here, we examined activations in the FPN and CON with fMRI in humans (male and female) during a task that manipulated control across timescales/mediums. The findings show that the CON can be distinguished into the following two separable subnetworks mirroring the FPN: a rostral/ventral subnetwork sensitive to future-oriented control involving internal representations, and a caudal/dorsal subnetwork sensitive to present-oriented control involving external representations. Relative to the FPN, activation in the CON was particularly pronounced during transitions into and out of particular control demands. Moreover, the relationship of each CON subnetwork to behavior was mediated by a respective FPN subnetwork. Such data are consistent with the idea that the CON motivates the FPN, which, in turn, drives behavior. Within the CON, the dorsomedial prefrontal cortex (dmPFC) mediated the relationship between the anterior insula and FPN, suggesting that the dmPFC acts as the crux that links the CON to the FPN. Collectively, these data indicate that parallel CON-FPN subnetworks mediate controlled behaviors at distinct timescales/mediums.SIGNIFICANCE STATEMENT The cingulo-opercular network (CON) and frontoparietal network (FPN) are engaged in diverse, demanding tasks. A functional model describing how areas within these networks can be distinguished, and also interact, would facilitate understanding of how the brain adapts to demanding situations. During a comprehensive control task, fMRI data revealed that the FPN and CON can be fractionated into subnetworks based on control demands that are either externally oriented for use in the present, or control demands that operate internally to guide future behavior. Moreover, we found evidence for a chain of relationships from the CON to FPN to behavior consistent with the idea that the CON drives the FPN to adapt behavior.

Multiple timescales of sensory-evidence accumulation across the dorsal cortex

Cortical areas seem to form a hierarchy of intrinsic timescales, but the relevance of this organization for cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of all tested areas affected the evidence-accumulation computation. Specifically, we observed distinct changes in the weighting of sensory evidence occurring during and before silencing, such that frontal inactivations led to stronger deficits on long timescales than posterior cortical ones. Inactivation of a subset of frontal areas also led to moderate effects on behavioral processes beyond evidence accumulation. Moreover, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows. Our findings suggest that the intrinsic timescale hierarchy of distributed cortical areas is an important component of evidence-accumulation mechanisms.

Intrinsic timescales as an organizational principle of neural processing across the whole rhesus macaque brain

Hierarchical temporal dynamics are a fundamental computational property of the brain; however, there are no whole brain, noninvasive investigations into timescales of neural processing in animal models. To that end, we used the spatial resolution and sensitivity of ultrahigh field functional magnetic resonance imaging (fMRI) performed at 10.5 T to probe timescales across the whole macaque brain. We uncovered within-species consistency between timescales estimated from fMRI and electrophysiology. Crucially, we extended existing electrophysiological hierarchies to whole-brain topographies. Our results validate the complementary use of hemodynamic and electrophysiological intrinsic timescales, establishing a basis for future translational work. Further, with these results in hand, we were able to show that one facet of the high-dimensional functional connectivity (FC) topography of any region in the brain is closely related to hierarchical temporal dynamics. We demonstrated that intrinsic timescales are organized along spatial gradients that closely match FC gradient topographies across the whole brain. We conclude that intrinsic timescales are a unifying organizational principle of neural processing across the whole brain.

Hierarchical timescales in the neocortex: Mathematical mechanism and biological insights

A cardinal feature of the neocortex is the progressive increase of the spatial receptive fields along the cortical hierarchy. Recently, theoretical and experimental findings have shown that the temporal response windows also gradually enlarge, so that early sensory neural circuits operate on short timescales whereas higher-association areas are capable of integrating information over a long period of time. While an increased receptive field is accounted for by spatial summation of inputs from neurons in an upstream area, the emergence of timescale hierarchy cannot be readily explained, especially given the dense interareal cortical connectivity known in the modern connectome. To uncover the required neurobiological properties, we carried out a rigorous analysis of an anatomically based large-scale cortex model of macaque monkeys. Using a perturbation method, we show that the segregation of disparate timescales is defined in terms of the localization of eigenvectors of the connectivity matrix, which depends on three circuit properties: 1) a macroscopic gradient of synaptic excitation, 2) distinct electrophysiological properties between excitatory and inhibitory neuronal populations, and 3) a detailed balance between long-range excitatory inputs and local inhibitory inputs for each area-to-area pathway. Our work thus provides a quantitative understanding of the mechanism underlying the emergence of timescale hierarchy in large-scale primate cortical networks.

Cerebral cortical processing time is elongated in human brain evolution

An increase in number of neurons is presumed to underlie the enhancement of cognitive abilities in brain evolution. The evolution of human cognition is then expected to have accompanied a prolongation of net neural-processing time due to the accumulation of processing time of individual neurons over an expanded number of neurons. Here, we confirmed this prediction and quantified the amount of prolongation in vivo, using noninvasive measurements of brain responses to sounds in unanesthetized human and nonhuman primates. Latencies of the N1 component of auditory-evoked potentials recorded from the scalp were approximately 40, 50, 60, and 100 ms for the common marmoset, rhesus monkey, chimpanzee, and human, respectively. Importantly, the prominent increase in human N1 latency could not be explained by the physical lengthening of the auditory pathway, and therefore reflected an extended dwell time for auditory cortical processing. A longer time window for auditory cortical processing is advantageous for analyzing time-varying acoustic stimuli, such as those important for speech perception. A novel hypothesis concerning human brain evolution then emerges: the increase in cortical neuronal number widened the timescale of sensory cortical processing, the benefits of which outweighed the disadvantage of slow cognition and reaction.

Intrinsic neural timescales: temporal integration and segregation

We are continuously bombarded by external inputs of various timescales from the environment. How does the brain process this multitude of timescales? Recent resting state studies show a hierarchy of intrinsic neural timescales (INT) with a shorter duration in unimodal regions (e.g., visual cortex and auditory cortex) and a longer duration in transmodal regions (e.g., default mode network). This unimodal-transmodal hierarchy is present across acquisition modalities [electroencephalogram (EEG)/magnetoencephalogram (MEG) and fMRI] and can be found in different species and during a variety of different task states. Together, this suggests that the hierarchy of INT is central to the temporal integration (combining successive stimuli) and segregation (separating successive stimuli) of external inputs from the environment, leading to temporal segmentation and prediction in perception and cognition.

Timescales of Local and Cross-Area Interactions during Neuroprosthetic Learning

How does the brain integrate signals with different timescales to drive purposeful actions? Brain-machine interfaces (BMIs) offer a powerful tool to causally test how distributed neural networks achieve specific neural patterns. During neuroprosthetic learning, actuator movements are causally linked to primary motor cortex (M1) neurons, i.e., "direct" neurons that project to the decoder and whose firing is required to successfully perform the task. However, it is unknown how such direct M1 neurons interact with both "indirect" local (in M1 but not part of the decoder) and across area neural populations (e.g., in premotor cortex/M2), all of which are embedded in complex biological recurrent networks. Here, we trained male rats to perform a M1-BMI task and simultaneously recorded the activity of indirect neurons in both M2 and M1. We found that both M2 and M1 indirect neuron populations could be used to predict the activity of the direct neurons (i.e., "BMI-potent activity"). Interestingly, compared with M1 indirect activity, M2 neural activity was correlated with BMI-potent activity across a longer set of time lags, and the timescale of population activity patterns evolved more slowly. M2 units also predicted the activity of both M1 direct and indirect neural populations, suggesting that M2 population dynamics provide a continuous modulatory influence on M1 activity as a whole, rather than a moment-by-moment influence solely on neurons most relevant to a task. Together, our results indicate that longer timescale M2 activity provides modulatory influence over extended time lags on shorter-timescale control signals in M1.SIGNIFICANCE STATEMENT A central question in the study of motor control is whether primary motor cortex (M1) and premotor cortex (M2) interact through task-specific subpopulations of neurons, or whether tasks engage broader correlated networks. Brain-machine interfaces (BMIs) are powerful tools to study cross-area interactions. Here, we performed simultaneous recordings of M1 and M2 in a BMI task using a subpopulation of M1 neurons (direct neurons). We found that activity outside of direct neurons in M1 and M2 was predictive of M1-BMI task activity, and that M2 activity evolved at slower timescales than M1. These findings suggest that M2 provides a continuous modulatory influence on M1 as a whole, supporting a model of interactions through broad correlated networks rather than task-specific neural subpopulations.

Distinct timescales for the neuronal encoding of vocal signals in a high-order auditory area

The ability of the auditory system to selectively recognize natural sound categories while maintaining a certain degree of tolerance towards variations within these categories, which may have functional roles, is thought to be crucial for vocal communication. To date, it is still largely unknown how the balance between tolerance and sensitivity to variations in acoustic signals is coded at a neuronal level. Here, we investigate whether neurons in a high-order auditory area in zebra finches, a songbird species, are sensitive to natural variations in vocal signals by recording their responses to repeated exposures to identical and variant sound sequences. We used the songs of male birds which tend to be highly repetitive with only subtle variations between renditions. When playing these songs to both anesthetized and awake birds, we found that variations between songs did not affect the neuron firing rate but the temporal reliability of responses. This suggests that auditory processing operates on a range of distinct timescales, namely a short one to detect variations in vocal signals, and longer ones that allow the birds to tolerate variations in vocal signal structure and to encode the global context.

Memory and Markov Blankets

In theoretical biology, we are often interested in random dynamical systems-like the brain-that appear to model their environments. This can be formalized by appealing to the existence of a (possibly non-equilibrium) steady state, whose density preserves a conditional independence between a biological entity and its surroundings. From this perspective, the conditioning set, or Markov blanket, induces a form of vicarious synchrony between creature and world-as if one were modelling the other. However, this results in an apparent paradox. If all conditional dependencies between a system and its surroundings depend upon the blanket, how do we account for the mnemonic capacity of living systems? It might appear that any shared dependence upon past blanket states violates the independence condition, as the variables on either side of the blanket now share information not available from the current blanket state. This paper aims to resolve this paradox, and to demonstrate that conditional independence does not preclude memory. Our argument rests upon drawing a distinction between the dependencies implied by a steady state density, and the density dynamics of the system conditioned upon its configuration at a previous time. The interesting question then becomes: What determines the length of time required for a stochastic system to 'forget' its initial conditions? We explore this question for an example system, whose steady state density possesses a Markov blanket, through simple numerical analyses. We conclude with a discussion of the relevance for memory in cognitive systems like us.

The brain and its time: intrinsic neural timescales are key for input processing

We process and integrate multiple timescales into one meaningful whole. Recent evidence suggests that the brain displays a complex multiscale temporal organization. Different regions exhibit different timescales as described by the concept of intrinsic neural timescales (INT); however, their function and neural mechanisms remains unclear. We review recent literature on INT and propose that they are key for input processing. Specifically, they are shared across different species, i.e., input sharing. This suggests a role of INT in encoding inputs through matching the inputs' stochastics with the ongoing temporal statistics of the brain's neural activity, i.e., input encoding. Following simulation and empirical data, we point out input integration versus segregation and input sampling as key temporal mechanisms of input processing. This deeply grounds the brain within its environmental and evolutionary context. It carries major implications in understanding mental features and psychiatric disorders, as well as going beyond the brain in integrating timescales into artificial intelligence.

Frontal circuit specialisations for decision making

There is widespread consensus that distributed circuits across prefrontal and anterior cingulate cortex (PFC/ACC) are critical for reward-based decision making. The circuit specialisations of these areas in primates were likely shaped by their foraging niche, in which decision making is typically sequential, attention-guided and temporally extended. Here, I argue that in humans and other primates, PFC/ACC circuits are functionally specialised in two ways. First, microcircuits found across PFC/ACC are highly recurrent in nature and have synaptic properties that support persistent activity across temporally extended cognitive tasks. These properties provide the basis of a computational account of time-varying neural activity within PFC/ACC as a decision is being made. Second, the macrocircuit connections (to other brain areas) differ between distinct PFC/ACC cytoarchitectonic subregions. This variation in macrocircuit connections explains why PFC/ACC subregions make unique contributions to reward-based decision tasks and how these contributions are shaped by attention. They predict dissociable neural representations to emerge in orbitofrontal, anterior cingulate and dorsolateral prefrontal cortex during sequential attention-guided choice, as recently confirmed in neurophysiological recordings.

Central Thalamic-Medial Prefrontal Control of Adaptive Responding in the Rat: Many Players in the Chamber

The medial prefrontal cortex (mPFC) has robust afferent and efferent connections with multiple nuclei clustered in the central thalamus. These nuclei are elements in large-scale networks linking mPFC with the hippocampus, basal ganglia, amygdala, other cortical areas, and visceral and arousal systems in the brainstem that give rise to adaptive goal-directed behavior. Lesions of the mediodorsal nucleus (MD), the main source of thalamic input to middle layers of PFC, have limited effects on delayed conditional discriminations, like DMTP and DNMTP, that depend on mPFC. Recent evidence suggests that MD sustains and amplifies neuronal responses in mPFC that represent salient task-related information and is important for detecting and encoding contingencies between actions and their consequences. Lesions of rostral intralaminar (rIL) and ventromedial (VM) nuclei produce delay-independent impairments of egocentric DMTP and DNMTP that resemble effects of mPFC lesions on response speed and accuracy: results consistent with projections of rIL to striatum and VM to motor cortices. The ventral midline and anterior thalamic nuclei affect allocentric spatial cognition and memory consistent with their connections to mPFC and hippocampus. The dorsal midline nuclei spare DMTP and DNMTP. They have been implicated in behavioral-state control and response to salient stimuli in associative learning. mPFC functions are served during DNMTP by discrete populations of neurons with responses related to motor preparation, movements, lever press responses, reinforcement anticipation, reinforcement delivery, and memory delay. Population analyses show that different responses are timed so that they effectively tile the temporal interval from when DNMTP trials are initiated until the end. Event-related responses of MD neurons during DNMTP are predominantly related to movement and reinforcement, information important for DNMTP choice. These responses closely mirror the activity of mPFC neurons with similar responses. Pharmacological inactivation of MD and adjacent rIL affects the expression of diverse action- and outcome-related responses of mPFC neurons. Lesions of MD before training are associated with a shift away from movement-related responses in mPFC important for DNMTP choice. These results suggest that MD has short-term effects on the expression of event-related activity in mPFC and long-term effects that tune mPFC neurons to respond to task-specific information.