Intrinsic timescales in the visual cortex change with selective attention and reflect spatial connectivity

Spiking activity in the visual thalamus is coupled to pupil dynamics across temporal scales

The processing of sensory information, even at early stages, is influenced by the internal state of the animal. Internal states, such as arousal, are often characterized by relating neural activity to a single "level" of arousal, defined by a behavioral indicator such as pupil size. In this study, we expand the understanding of arousal-related modulations in sensory systems by uncovering multiple timescales of pupil dynamics and their relationship to neural activity. Specifically, we observed a robust coupling between spiking activity in the mouse dorsolateral geniculate nucleus (dLGN) of the thalamus and pupil dynamics across timescales spanning a few seconds to several minutes. Throughout all these timescales, 2 distinct spiking modes-individual tonic spikes and tightly clustered bursts of spikes-preferred opposite phases of pupil dynamics. This multi-scale coupling reveals modulations distinct from those captured by pupil size per se, locomotion, and eye movements. Furthermore, coupling persisted even during viewing of a naturalistic movie, where it contributed to differences in the encoding of visual information. We conclude that dLGN spiking activity is under the simultaneous influence of multiple arousal-related processes associated with pupil dynamics occurring over a broad range of timescales.

Repertoire of timescales in uni - and transmodal regions mediate working memory capacity

Working memory (WM) describes the dynamic process of maintenance and manipulation of information over a certain time delay. Neuronally, WM recruits a distributed network of cortical regions like the visual and dorsolateral prefrontal cortex as well as the subcortical hippocampus. How the input dynamics and subsequent neural dynamics impact WM remains unclear though. To answer this question, we combined the analysis of behavioral WM capacity with measuring neural dynamics through task-related power spectrum changes, e.g., median frequency (MF) in functional magnetic resonance imaging (fMRI). We show that the processing of the input dynamics, e.g., the task structure's specific timescale, leads to changes in the unimodal visual cortex's corresponding timescale which also relates to working memory capacity. While the more transmodal hippocampus relates to working memory capacity through its balance across multiple timescales or frequencies. In conclusion, we here show the relevance of both input dynamics and different neural timescales for WM capacity in uni - and transmodal regions like visual cortex and hippocampus for the subject's WM performance.

Low-dimensional criticality embedded in high-dimensional awake brain dynamics

Whether cortical neurons operate in a strongly or weakly correlated dynamical regime determines fundamental information processing capabilities and has fueled decades of debate. We offer a resolution of this debate; we show that two important dynamical regimes, typically considered incompatible, can coexist in the same local cortical circuit by separating them into two different subspaces. In awake mouse motor cortex, we find a low-dimensional subspace with large fluctuations consistent with criticality-a dynamical regime with moderate correlations and multi-scale information capacity and transmission. Orthogonal to this critical subspace, we find a high-dimensional subspace containing a desynchronized dynamical regime, which may optimize input discrimination. The critical subspace is apparent only at long timescales, which explains discrepancies among some previous studies. Using a computational model, we show that the emergence of a low-dimensional critical subspace at large timescales agrees with established theory of critical dynamics. Our results suggest that the cortex leverages its high dimensionality to multiplex dynamical regimes across different subspaces.

Neural timescales reflect behavioral demands in freely moving rhesus macaques

Previous work demonstrated a highly reproducible cortical hierarchy of neural timescales at rest, with sensory areas displaying fast, and higher-order association areas displaying slower timescales. The question arises how such stable hierarchies give rise to adaptive behavior that requires flexible adjustment of temporal coding and integration demands. Potentially, this lack of variability in the hierarchical organization of neural timescales could reflect the structure of the laboratory contexts. We posit that unconstrained paradigms are ideal to test whether the dynamics of neural timescales reflect behavioral demands. Here we measured timescales of local field potential activity while male rhesus macaques foraged in an open space. We found a hierarchy of neural timescales that differs from previous work. Importantly, although the magnitude of neural timescales expanded with task engagement, the brain areas' relative position in the hierarchy was stable. Next, we demonstrated that the change in neural timescales is dynamic and contains functionally-relevant information, differentiating between similar events in terms of motor demands and associated reward. Finally, we demonstrated that brain areas are differentially affected by these behavioral demands. These results demonstrate that while the space of neural timescales is anatomically constrained, the observed hierarchical organization and magnitude is dependent on behavioral demands.

Editorial for "MRI Assessment of Intrinsic Neural Timescale and Grey Matter Volume in Parkinson's Disease"

Level of Evidence

5

Technical Efficacy Stage

3

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.

Training-Dependent Gradients of Timescales of Neural Dynamics in the Primate Prefrontal Cortex and Their Contributions to Working Memory

Cortical neurons exhibit multiple timescales related to dynamics of spontaneous fluctuations (intrinsic timescales) and response to task events (seasonal timescales) in addition to selectivity to task-relevant signals. These timescales increase systematically across the cortical hierarchy, for example, from parietal to prefrontal and cingulate cortex, pointing to their role in cortical computations. It is currently unknown whether these timescales are inherent properties of neurons and/or depend on training in a specific task and if the latter, how their modulations contribute to task performance. To address these questions, we analyzed single-cell recordings within five subregions of the prefrontal cortex (PFC) of male macaques before and after training on a working-memory task. We found fine-grained but opposite gradients of intrinsic and seasonal timescales that mainly appeared after training. Intrinsic timescales decreased whereas seasonal timescales increased from posterior to anterior subregions within both dorsal and ventral PFC. Moreover, training was accompanied by increases in proportions of neurons that exhibited intrinsic and seasonal timescales. These effects were comparable to the emergence of response selectivity due to training. Finally, task selectivity accompanied opposite neural dynamics such that neurons with task-relevant selectivity exhibited longer intrinsic and shorter seasonal timescales. Notably, neurons with longer intrinsic and shorter seasonal timescales exhibited superior population-level coding, but these advantages extended to the delay period mainly after training. Together, our results provide evidence for plastic, fine-grained gradients of timescales within PFC that can influence both single-cell and population coding, pointing to the importance of these timescales in understanding cognition.

Propagation of activity through the cortical hierarchy and perception are determined by neural variability

Brains are composed of anatomically and functionally distinct regions performing specialized tasks, but regions do not operate in isolation. Orchestration of complex behaviors requires communication between brain regions, but how neural dynamics are organized to facilitate reliable transmission is not well understood. Here we studied this process directly by generating neural activity that propagates between brain regions and drives behavior, assessing how neural populations in sensory cortex cooperate to transmit information. We achieved this by imaging two densely interconnected regions-the primary and secondary somatosensory cortex (S1 and S2)-in mice while performing two-photon photostimulation of S1 neurons and assigning behavioral salience to the photostimulation. We found that the probability of perception is determined not only by the strength of the photostimulation but also by the variability of S1 neural activity. Therefore, maximizing the signal-to-noise ratio of the stimulus representation in cortex relative to the noise or variability is critical to facilitate activity propagation and perception.

Training-dependent gradients of timescales of neural dynamics in the primate prefrontal cortex and their contributions to working memory

Cortical neurons exhibit multiple timescales related to dynamics of spontaneous fluctuations (intrinsic timescales) and response to task events (seasonal timescales) in addition to selectivity to task-relevant signals. These timescales increase systematically across the cortical hierarchy, e.g., from parietal to prefrontal and cingulate cortex, pointing to their role in cortical computations. It is currently unknown whether these timescales depend on training in a specific task and/or are an inherent property of neurons, and whether more fine-grained hierarchies of timescales exist within specific cortical regions. To address these questions, we analyzed single-cell recordings within five subregions of the prefrontal cortex (PFC) of male macaques before and after training on a working-memory task. We found fine-grained but opposite gradients of intrinsic and seasonal timescales that mainly appeared after training. Intrinsic timescales decreased whereas seasonal timescales increased from posterior to anterior subregions within both dorsal and ventral PFC. Moreover, training was accompanied by increases in proportions of neurons that exhibited intrinsic and seasonal timescales. These effects were comparable to the emergence of response selectivity due to training. Finally, task selectivity accompanied opposite neural dynamics such that neurons with task-relevant selectivity exhibited longer intrinsic and shorter seasonal timescales. Notably, neurons with longer intrinsic and shorter seasonal timescales exhibited superior population-level coding, but these advantages extended to the delay period mainly after training. Together, our results provide evidence for plastic, fine-grained gradients of timescales within PFC that can influence both single-cell and population coding, pointing to the importance of these timescales in understanding cognition.

Significance statement

Recent studies have demonstrated that neural responses exhibit dynamics with different timescales that follow a certain order or hierarchy across cortical areas. While the hierarchy of timescales is consistent across different tasks, it is unknown if these timescales emerge only after training or if they represent inherent properties of neurons. To answer this question, we estimated multiple timescales in neural response across five subregions of the monkeys' lateral prefrontal cortex before and after training on a working-memory task. Our results provide evidence for fine-grained gradients related to certain neural dynamics. Moreover, we show that these timescales depend on and can be modulated by training in a cognitive task, and contribute to encoding of task-relevant information at single-cell and population levels.

Fast-local and slow-global neural ensembles in the mouse brain

Ensembles of neurons are thought to be coactive when participating in brain computations. However, it is unclear what principles determine whether an ensemble remains localised within a single brain region, or spans multiple brain regions. To address this, we analysed electrophysiological neural population data from hundreds of neurons recorded simultaneously across nine brain regions in awake mice. At fast subsecond timescales, spike count correlations between pairs of neurons in the same brain region were stronger than for pairs of neurons spread across different brain regions. In contrast at slower timescales, within- and between-region spike count correlations were similar. Correlations between high-firing-rate neuron pairs showed a stronger dependence on timescale than low-firing-rate neuron pairs. We applied an ensemble detection algorithm to the neural correlation data and found that at fast timescales each ensemble was mostly contained within a single brain region, whereas at slower timescales ensembles spanned multiple brain regions. These results suggest that the mouse brain may perform fast-local and slow-global computations in parallel.

Intrinsic Neural Timescales in the Temporal Lobe Support an Auditory Processing Hierarchy

During rest, intrinsic neural dynamics manifest at multiple timescales, which progressively increase along visual and somatosensory hierarchies. Theoretically, intrinsic timescales are thought to facilitate processing of external stimuli at multiple stages. However, direct links between timescales at rest and sensory processing, as well as translation to the auditory system are lacking. Here, we measured intracranial EEG in 11 human patients with epilepsy (4 women), while listening to pure tones. We show that, in the auditory network, intrinsic neural timescales progressively increase, while the spectral exponent flattens, from temporal to entorhinal cortex, hippocampus, and amygdala. Within the neocortex, intrinsic timescales exhibit spatial gradients that follow the temporal lobe anatomy. Crucially, intrinsic timescales at baseline can explain the latency of auditory responses: as intrinsic timescales increase, so do the single-electrode response onset and peak latencies. Our results suggest that the human auditory network exhibits a repertoire of intrinsic neural dynamics, which manifest in cortical gradients with millimeter resolution and may provide a variety of temporal windows to support auditory processing.SIGNIFICANCE STATEMENT Endogenous neural dynamics are often characterized by their intrinsic timescales. These are thought to facilitate processing of external stimuli. However, a direct link between intrinsic timing at rest and sensory processing is missing. Here, with intracranial EEG, we show that intrinsic timescales progressively increase from temporal to entorhinal cortex, hippocampus, and amygdala. Intrinsic timescales at baseline can explain the variability in the timing of intracranial EEG responses to sounds: cortical electrodes with fast timescales also show fast- and short-lasting responses to auditory stimuli, which progressively increase in the hippocampus and amygdala. Our results suggest that a hierarchy of neural dynamics in the temporal lobe manifests across cortical and limbic structures and can explain the temporal richness of auditory responses.