A hierarchy of intrinsic timescales across primate cortex

A robust event-driven approach to always-on object recognition

We propose a neuromimetic architecture capable of always-on pattern recognition, i.e. at any time during processing. To achieve this, we have extended an existing event-based algorithm (Lagorce et al., 2017), which introduced novel spatio-temporal features as a Hierarchy Of Time-Surfaces (HOTS). Built from asynchronous events captured by a neuromorphic camera, these time surfaces allow to encode the local dynamics of a visual scene and to create an efficient event-based pattern recognition architecture. Inspired by neuroscience, we have extended this method to improve its performance. First, we add a homeostatic gain control on the activity of neurons to improve the learning of spatio-temporal patterns (Grimaldi et al., 2021). We also provide a new mathematical formalism that allows an analogy to be drawn between the HOTS algorithm and Spiking Neural Networks (SNN). Following this analogy, we transform the offline pattern categorization method into an online and event-driven layer. This classifier uses the spiking output of the network to define new time surfaces and we then perform the online classification with a neuromimetic implementation of a multinomial logistic regression. These improvements not only consistently increase the performance of the network, but also bring this event-driven pattern recognition algorithm fully online. The results have been validated on different datasets: Poker-DVS (Serrano-Gotarredona and Linares-Barranco, 2015), N-MNIST (Orchard, Jayawant et al., 2015) and DVS Gesture (Amir et al., 2017). This demonstrates the efficiency of this bio-realistic SNN for ultra-fast object recognition through an event-by-event categorization process.

Timescales of learning in prefrontal cortex

The lateral prefrontal cortex (PFC) in humans and other primates is critical for immediate, goal-directed behaviour and working memory, which are classically considered distinct from the cognitive and neural circuits that support long-term learning and memory. Over the past few years, a reconsideration of this textbook perspective has emerged, in that different timescales of memory-guided behaviour are in constant interaction during the pursuit of immediate goals. Here, we will first detail how neural activity related to the shortest timescales of goal-directed behaviour (which requires maintenance of current states and goals in working memory) is sculpted by long-term knowledge and learning - that is, how the past informs present behaviour. Then, we will outline how learning across different timescales (from seconds to years) drives plasticity in the primate lateral PFC, from single neuron firing rates to mesoscale neuroimaging activity patterns. Finally, we will review how, over days and months of learning, dense local and long-range connectivity patterns in PFC facilitate longer-lasting changes in population activity by changing synaptic weights and recruiting additional neural resources to inform future behaviour. Our Review sheds light on how the machinery of plasticity in PFC circuits facilitates the integration of learned experiences across time to best guide adaptive behaviour.

Multi-timescale neural dynamics for multisensory integration

Carrying out any everyday task, be it driving in traffic, conversing with friends or playing basketball, requires rapid selection, integration and segregation of stimuli from different sensory modalities. At present, even the most advanced artificial intelligence-based systems are unable to replicate the multisensory processes that the human brain routinely performs, but how neural circuits in the brain carry out these processes is still not well understood. In this Perspective, we discuss recent findings that shed fresh light on the oscillatory neural mechanisms that mediate multisensory integration (MI), including power modulations, phase resetting, phase-amplitude coupling and dynamic functional connectivity. We then consider studies that also suggest multi-timescale dynamics in intrinsic ongoing neural activity and during stimulus-driven bottom-up and cognitive top-down neural network processing in the context of MI. We propose a new concept of MI that emphasizes the critical role of neural dynamics at multiple timescales within and across brain networks, enabling the simultaneous integration, segregation, hierarchical structuring and selection of information in different time windows. To highlight predictions from our multi-timescale concept of MI, real-world scenarios in which multi-timescale processes may coordinate MI in a flexible and adaptive manner are considered.

Signatures of hierarchical temporal processing in the mouse visual system

A core challenge for the brain is to process information across various timescales. This could be achieved by a hierarchical organization of temporal processing through intrinsic mechanisms (e.g., recurrent coupling or adaptation), but recent evidence from spike recordings of the rodent visual system seems to conflict with this hypothesis. Here, we used an optimized information-theoretic and classical autocorrelation analysis to show that information- and correlation timescales of spiking activity increase along the anatomical hierarchy of the mouse visual system under visual stimulation, while information-theoretic predictability decreases. Moreover, intrinsic timescales for spontaneous activity displayed a similar hierarchy, whereas the hierarchy of predictability was stimulus-dependent. We could reproduce these observations in a basic recurrent network model with correlated sensory input. Our findings suggest that the rodent visual system employs intrinsic mechanisms to achieve longer integration for higher cortical areas, while simultaneously reducing predictability for an efficient neural code.

Intrinsic neural timescales exhibit different lengths in distinct meditation techniques

Meditation encompasses a range of practices employing diverse induction techniques, each characterized by a distinct attentional focus. In Mantra meditation, for instance, practitioners direct their attention narrowly to a given sentence that is recursively repeated, while other forms of meditation such as Shoonya meditation are induced by a wider attentional focus. Here we aimed to identify the neural underpinnings and correlates associated with this spectrum of distinct attentional foci. To accomplish this, we used EEG data to estimate the brain's intrinsic neural timescales (INTs), that is, its temporal windows of activity, by calculating the Autocorrelation Window (ACW) of the EEG signal. The autocorrelation function measures the similarity of a timeseries with a time-lagged version of itself by correlating the signal with itself on different time lags, consequently providing an estimation of INTs length. Therefore, through using the ACW metric, our objective was to explore whether there is a correspondence between the length of the brain's temporal windows of activity and the width of the attentional scope during various meditation techniques. This was performed on three groups of highly proficient practitioners belonging to different meditation traditions, as well as a meditation-naïve control group. Our results indicated that practices with a wider attentional focus, like Shoonya meditation, exhibit longer ACW durations compared to practices requiring a narrower attentional focus, such as Mantra meditation or body-scanning Vipassana meditation. Together, we demonstrated that distinct meditation techniques with varying widths of attentional foci exhibit unique durations in their brain's INTs. This may suggest that the width of the attentional scope during meditation relates and corresponds to the width of the brain's temporal windows in its neural activity. SIGNIFICANCE STATEMENT: Our research uncovered the neural mechanisms that underpin the attentional foci in various meditation techniques. We revealed that distinct meditation induction techniques, featured by their range of attentional widths, are characterized by varying lengths of intrinsic neural timescales (INTs) within the brain, as measured by the Autocorrelation Window function. This finding may bridge the gap between the width of attentional windows (subjective) and the width of the temporal windows in the brain's neural activity (objective) during different meditation techniques, offering a new understanding of how cognitive and neural processes are related to each other. This work holds significant implications, especially in the context of the increasing use of meditation in mental health and well-being interventions. By elucidating the distinct neural foundations of different meditation techniques, our research aims to pave the way for developing more tailored and effective meditation-based treatments.

Modeling short visual events through the BOLD moments video fMRI dataset and metadata

Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos' extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.

Neural dynamics underlying minute-timescale persistent behavior in the human brain

The ability to pursue long-term goals relies on a representations of task context that can both be maintained over long periods of time and switched flexibly when goals change. Little is known about the neural substrate for such minute-scale maintenance of task sets. Utilizing recordings in neurosurgical patients, we examined how groups of neurons in the human medial frontal cortex and hippocampus represent task contexts. When cued explicitly, task context was encoded in both brain areas and changed rapidly at task boundaries. Hippocampus exhibited a temporally dynamic code with fast decorrelation over time, preventing cross-temporal generalization. Medial frontal cortex exhibited a static code that decorrelated slowly, allowing generalization across minutes of time. When task context needed to be inferred as a latent variable, hippocampus encoded task context with a static code. These findings reveal two possible regimes for encoding minute-scale task-context representations that were engaged differently based on task demands.

Thalamocortical interactions shape hierarchical neural variability during stimulus perception

The brain is organized hierarchically to process sensory signals. But, how do functional connections within and across areas contribute to this hierarchical order? We addressed this problem in the thalamocortical network, while monkeys detected vibrotactile stimulus. During this task, we quantified neural variability and directed functional connectivity in simultaneously recorded neurons sharing the cutaneous receptive field within and across VPL and areas 3b and 1. Before stimulus onset, VPL and area 3b exhibited similar fast dynamics while area 1 showed slower timescales. During the stimulus presence, inter-trial neural variability increased along the network VPL-3b-1 while VPL established two main feedforward pathways with areas 3b and 1 to process the stimulus. This lower variability of VPL and area 3b was found to regulate feedforward thalamocortical pathways. Instead, intra-cortical interactions were only anticipated by higher intrinsic timescales in area 1. Overall, our results provide evidence of hierarchical functional roles along the thalamocortical network.

Learning Fixed Points of Recurrent Neural Networks by Reparameterizing the Network Model

In computational neuroscience, recurrent neural networks are widely used to model neural activity and learning. In many studies, fixed points of recurrent neural networks are used to model neural responses to static or slowly changing stimuli, such as visual cortical responses to static visual stimuli. These applications raise the question of how to train the weights in a recurrent neural network to minimize a loss function evaluated on fixed points. In parallel, training fixed points is a central topic in the study of deep equilibrium models in machine learning. A natural approach is to use gradient descent on the Euclidean space of weights. We show that this approach can lead to poor learning performance due in part to singularities that arise in the loss surface. We use a reparameterization of the recurrent network model to derive two alternative learning rules that produce more robust learning dynamics. We demonstrate that these learning rules avoid singularities and learn more effectively than standard gradient descent. The new learning rules can be interpreted as steepest descent and gradient descent, respectively, under a non-Euclidean metric on the space of recurrent weights. Our results question the common, implicit assumption that learning in the brain should be expected to follow the negative Euclidean gradient of synaptic weights.

Dissociable functional responses along the posterior-anterior gradient of the frontal and parietal cortices revealed by parametric working memory and training

While the storage capacity is limited, accumulating studies have indicated that working memory (WM) can be improved by cognitive training. However, understanding how exactly the brain copes with limited WM capacity and how cognitive training optimizes the brain remains inconclusive. Given the hierarchical functional organization of WM, we hypothesized that the activation profiles along the posterior-anterior gradient of the frontal and parietal cortices characterize WM load and training effects. To test this hypothesis, we recruited 51 healthy volunteers and adopted a parametric WM paradigm and training method. In contrast to exclusively strengthening the activation of posterior areas, a broader range of activation concurrently occurred in the anterior areas to cope with increased memory load for all subjects at baseline. Moreover, there was an imbalance in the responses of the posterior and anterior areas to the same increment of 1 item at different load levels. Although a general decrease in activation after adaptive training, the changes in the posterior and anterior areas were distinct at different memory loads. Particularly, we found that the activation gradient between the posterior and anterior areas was significantly increased at load 4-back after adaptive training, and the changes were correlated with improvement in WM performance. Together, our results demonstrate a shift in the predominant role of posterior and anterior areas in the frontal and parietal cortices when approaching WM capacity limits. Additionally, the training-induced performance improvement likely benefits from the elevated neural efficiency reflected in the increased activation gradient between the posterior and anterior areas.

Atypical intrinsic neural timescale in the left angular gyrus in Alzheimer's disease

Alzheimer's disease is characterized by cognitive impairment and progressive brain atrophy. Recent human neuroimaging studies reported atypical anatomical and functional changes in some regions in the default mode network in patients with Alzheimer's disease, but which brain area of the default mode network is the key region whose atrophy disturbs the entire network activity and consequently contributes to the symptoms of the disease remains unidentified. Here, in this case-control study, we aimed to identify crucial neural regions that mediated the phenotype of Alzheimer's disease, and as such, we examined the intrinsic neural timescales-a functional metric to evaluate the capacity to integrate diverse neural information-and grey matter volume of the regions in the default mode network using resting-state functional MRI images and structural MRI data obtained from individuals with Alzheimer's disease and cognitively typical people. After confirming the atypically short neural timescale of the entire default mode network in Alzheimer's disease and its link with the symptoms of the disease, we found that the shortened neural timescale of the default mode network was associated with the aberrantly short neural timescale of the left angular gyrus. Moreover, we revealed that the shortened neural timescale of the angular gyrus was correlated with the atypically reduced grey matter volume of this parietal region. Furthermore, we identified an association between the neural structure, brain function and symptoms and proposed a model in which the reduced grey matter volume of the left angular gyrus shortened the intrinsic neural time of the region, which then destabilized the entire neural timescale of the default mode network and resultantly contributed to cognitive decline in Alzheimer's disease. These findings highlight the key role of the left angular gyrus in the anatomical and functional aetiology of Alzheimer's disease.

Excitation/Inhibition balance relates to cognitive function and gene expression in temporal lobe epilepsy: a high density EEG assessment with aperiodic exponent

Patients with epilepsy are characterized by a dysregulation of excitation/inhibition balance (E/I). The assessment of E/I may inform clinicians during the diagnosis and therapy management, even though it is rarely performed. An accessible measure of the E/I of the brain represents a clinically relevant feature. Here, we exploited the exponent of the aperiodic component of the power spectrum of the electroencephalography (EEG) signal, as a non-invasive and cost-effective proxy of the E/I balance. We recorded resting-state activity with high-density EEG from 67 patients with temporal lobe epilepsy and 35 controls. We extracted the exponent of the aperiodic fit of the power spectrum from source-reconstructed EEG and tested differences between patients with epilepsy and controls. Spearman's correlation was performed between the exponent and clinical variables (age of onset, epilepsy duration and neuropsychology) and cortical expression of epilepsy-related genes derived from the Allen Human Brain Atlas. Patients with temporal lobe epilepsy showed a significantly larger exponent, corresponding to inhibition-directed E/I balance, in bilateral frontal and temporal regions. Lower E/I in the left entorhinal and bilateral dorsolateral prefrontal cortices corresponded to a lower performance of short-term verbal memory. Limited to patients with temporal lobe epilepsy, we detected a significant correlation between the exponent and the cortical expression of GABRA1, GRIN2A, GABRD, GABRG2, KCNA2 and PDYN genes. EEG aperiodic exponent maps the E/I balance non-invasively in patients with epilepsy and reveals a close relationship between altered E/I patterns, cognition and genetics.

A sensory-motor theory of the neocortex

Recent neurophysiological and neuroanatomical studies suggest a close interaction between sensory and motor processes across the neocortex. Here, I propose that the neocortex implements active predictive coding (APC): each cortical area estimates both latent sensory states and actions (including potentially abstract actions internal to the cortex), and the cortex as a whole predicts the consequences of actions at multiple hierarchical levels. Feedback from higher areas modulates the dynamics of state and action networks in lower areas. I show how the same APC architecture can explain (1) how we recognize an object and its parts using eye movements, (2) why perception seems stable despite eye movements, (3) how we learn compositional representations, for example, part-whole hierarchies, (4) how complex actions can be planned using simpler actions, and (5) how we form episodic memories of sensory-motor experiences and learn abstract concepts such as a family tree. I postulate a mapping of the APC model to the laminar architecture of the cortex and suggest possible roles for cortico-cortical and cortico-subcortical pathways.

Interacting ventral temporal gradients of timescales and functional connectivity and their relationships to visual behavior

Cortical gradients in endogenous and stimulus-evoked neurodynamic timescales, and long-range cortical interactions, provide organizational constraints to the brain and influence neural populations' roles in cognition. It is unclear how these functional gradients interrelate and which influence behavior. Here, intracranial recordings from 4,090 electrode contacts in 35 individuals map gradients of neural timescales and functional connectivity to assess their interactions along category-selective ventral temporal cortex. Endogenous and stimulus-evoked information processing timescales were not significantly correlated with one another suggesting that local neural timescales are context dependent and may arise through distinct neurophysiological mechanisms. Endogenous neural timescales correlated with functional connectivity even after removing the effects of shared anatomical gradients. Neural timescales and functional connectivity correlated with how strongly a population's activity predicted behavior in a simple visual task. These results suggest both interrelated and distinct neurophysiological processes give rise to different functional connectivity and neural timescale gradients, which together influence behavior.

Altered Hierarchical Gradients of Intrinsic Neural Timescales in Mild Cognitive Impairment and Alzheimer's Disease

Alzheimer's disease (AD) is a devastating neurodegenerative disease that affects millions of seniors in the United States. Resting-state functional magnetic resonance imaging (rs-fMRI) is widely used to study neurophysiology in AD and its prodromal condition, mild cognitive impairment (MCI). The intrinsic neural timescale (INT), which can be estimated through the magnitude of the autocorrelation of neural signals from rs-fMRI, is thought to quantify the duration that neural information is stored in a local circuit. Such heterogeneity of the timescales forms a basis of the brain functional hierarchy and captures an aspect of circuit dynamics relevant to excitation/inhibition balance, which is broadly relevant for cognitive functions. Given that, we applied rs-fMRI to test whether distinct changes of INT at different hierarchies are present in people with MCI, those progressing to AD (called Converter), and AD patients of both sexes. Linear mixed-effect model was implemented to detect altered hierarchical gradients across populations followed by pairwise comparisons to identify regional differences. High similarities between AD and Converter were observed. Specifically, the inferior temporal, caudate, and pallidum areas exhibit significant alterations in both AD and Converter. Distinct INT-related pathological changes in MCI and AD were found. For AD/Converter, neural information is stored for a longer time in lower hierarchical areas, while higher levels of hierarchy seem to be preferentially impaired in MCI leading to a less pronounced hierarchical gradient. These results inform that the INT holds great potential as an additional measure for AD prediction, even a stable biomarker for clinical diagnosis.

Deciphering the functional specialization of whole-brain spatiomolecular gradients in the adult brain

Cortical arealization arises during neurodevelopment from the confluence of molecular gradients representing patterned expression of morphogens and transcription factors. However, whether similar gradients are maintained in the adult brain remains unknown. Here, we uncover three axes of topographic variation in gene expression in the adult human brain that specifically capture previously identified rostral-caudal, dorsal-ventral, and medial-lateral axes of early developmental patterning. The interaction of these spatiomolecular gradients i) accurately reconstructs the position of brain tissue samples, ii) delineates known functional territories, and iii) can model the topographical variation of diverse cortical features. The spatiomolecular gradients are distinct from canonical cortical axes differentiating the primary sensory cortex from the association cortex, but radiate in parallel with the axes traversed by local field potentials along the cortex. We replicate all three molecular gradients in three independent human datasets as well as two nonhuman primate datasets and find that each gradient shows a distinct developmental trajectory across the lifespan. The gradients are composed of several well-known transcription factors (e.g., PAX6 and SIX3), and a small set of genes shared across gradients are strongly enriched for multiple diseases. Together, these results provide insight into the developmental sculpting of functionally distinct brain regions, governed by three robust transcriptomic axes embedded within brain parenchyma.

A measure centrality index for systematic empirical comparison of consciousness theories

Consciousness science is marred by disparate constructs and methodologies, making it challenging to systematically compare theories. This foundational crisis casts doubts on the scientific character of the field itself. Addressing it, we propose a framework for systematically comparing consciousness theories by introducing a novel inter-theory classification interface, the Measure Centrality Index (MCI). Recognizing its gradient distribution, the MCI assesses the degree of importance a specific empirical measure has for a given consciousness theory. We apply the MCI to probe how the empirical measures of the Global Neuronal Workspace Theory (GNW), Integrated Information Theory (IIT), and Temporospatial Theory of Consciousness (TTC) would fare within the context of the other two. We demonstrate that direct comparison of IIT, GNW, and TTC is meaningful and valid for some measures like Lempel-Ziv Complexity (LZC), Autocorrelation Window (ACW), and possibly Mutual Information (MI). In contrast, it is problematic for others like the anatomical and physiological neural correlates of consciousness (NCC) due to their MCI-based differential weightings within the structure of the theories. In sum, we introduce and provide proof-of-principle of a novel systematic method for direct inter-theory empirical comparisons, thereby addressing isolated evolution of theories and confirmatory bias issues in the state-of-the-art neuroscience of consciousness.

The neural basis of resting-state fMRI functional connectivity in fronto-limbic circuits revealed by chemogenetic manipulation

Measures of fMRI resting-state functional connectivity (rs-FC) are an essential tool for basic and clinical investigations of fronto-limbic circuits. Understanding the relationship between rs-FC and the underlying patterns of neural activity in these circuits is therefore vital. Here we introduced inhibitory designer receptors exclusively activated by designer drugs (DREADDs) into the amygdala of two male macaques. We evaluated the causal effect of activating the DREADD receptors on rs-FC and neural activity within circuits connecting amygdala and frontal cortex. Activating the inhibitory DREADD increased rs-FC between amygdala and ventrolateral prefrontal cortex. Neurophysiological recordings revealed that the DREADD-induced increase in fMRI rs-FC was associated with increased local field potential coherency in the alpha band (6.5-14.5 Hz) between amygdala and ventrolateral prefrontal cortex. Thus, our multi-modal approach reveals the specific signature of neuronal activity that underlies rs-FC in fronto-limbic circuits.

Altered intrinsic neural timescales and neurotransmitter activity in males with tobacco use disorder

Previous researches of tobacco use disorder (TUD) has overlooked the hierarchy of cortical functions and single modality design separated the relationship between macroscopic neuroimaging aberrance and microscopic molecular basis. At present, intrinsic timescale gradient of TUD and its molecular features are not fully understood. Our study recruited 146 male subjects, including 44 heavy smokers, 50 light smokers and 52 non-smokers, then obtained their rs-fMRI data and clinical scales related to smoking. Intrinsic neural timescale (INT) method was performed to describe how long neural information was stored in a brain region by calculating the autocorrelation function (ACF) of each voxel to examine the difference in the ability of information integration among the three groups. Then, correlation analyses were conducted to explore the relationship between INT abnormalities and clinical scales of smokers. Finally, cross-modal JuSpace toolbox was used to investigate the association between INT aberrance and the expression of specific receptor/transporters. Compared to healthy controls, TUD subjects displayed decreased INT in control network (CN), default mode network (DMN), sensorimotor areas and visual cortex, and such trend of decreasing INT was more pronounced in heavy smokers. Moreover, various neurotransmitters (including dopaminergic, acetylcholine and μ-opioid receptors) were involved in the molecular mechanism of timescale decreasing and differed in heavy and light smokers. These findings supplied novel insights into the brain functional aberrance in TUD from an intrinsic neural dynamic perspective and confirm INT was a potential neurobiological marker. And also established the connection between macroscopic imaging aberrance and microscopic molecular changes in TUD.

Diverging functional connectivity timescales: Capturing distinct aspects of cognitive performance in early psychosis

Background

Psychosis spectrum disorders (PSDs) are marked by cognitive impairments, the neurobiological correlates of which remain poorly understood. Here, we investigate the entropy of time-varying functional connectivity (TVFC) patterns from resting-state fMRI (rfMRI) as potential biomarker for cognitive performance in PSDs. By combining our results with multimodal reference data, we hope to generate new insights into the mechanisms underlying cognitive dysfunction in PSDs. We hypothesized that low-entropy TVFC patterns (LEN) would be more behaviorally informative than high-entropy TVFC patterns (HEN), especially for tasks that require extensive integration across diverse cognitive subdomains.

Methods

rfMRI and behavioral data from 97 patients in the early phases of psychosis and 53 controls were analyzed. Positron-Emission Tomography (PET) and magnetoencephalography (MEG) data were taken from a public repository (Hansen et al., 2022). Multivariate analyses were conducted to examine relationships between TVFC patterns at multiple spatial scales and cognitive performance in patients.

Results

Compared to HEN, LEN explained significantly more cognitive variance on average in PSD patients, driven by superior encoding of information on psychometrically more integrated tasks. HEN better captured information in specific subdomains of executive functioning. Nodal HEN-LEN transitions were spatially aligned with neurobiological gradients reflecting monoaminergic transporter densities and MEG beta power. Exploratory analyses revealed a close statistical relationship between LEN and positive PSD symptoms.

Conclusion

Our entropy-based analysis of TVFC patterns dissociates distinct aspects of cognition in PSDs. By linking topographies of neurotransmission and oscillatory dynamics with cognitive performance, it enhances our understanding of the mechanisms underlying cognitive deficits in PSDs.

CRediT Authorship Contribution Statement

Fabian Hirsch: Conceptualization, Methodology, Software, Formal analysis, Writing - Original Draft, Writing - Review & Editing, Visualization; Ângelo Bumanglag: Methodology, Software, Formal analysis, Writing - Review & Editing; Yifei Zhang: Methodology, Software, Formal analysis, Writing - Review & Editing; Afra Wohlschlaeger: Methodology, Writing - Review & Editing, Supervision, Project administration.

The meso-connectomes of mouse, marmoset, and macaque: network organization and the emergence of higher cognition

The recent publications of the inter-areal connectomes for mouse, marmoset, and macaque cortex have allowed deeper comparisons across rodent vs. primate cortical organization. In general, these show that the mouse has very widespread, "all-to-all" inter-areal connectivity (i.e. a "highly dense" connectome in a graph theoretical framework), while primates have a more modular organization. In this review, we highlight the relevance of these differences to function, including the example of primary visual cortex (V1) which, in the mouse, is interconnected with all other areas, therefore including other primary sensory and frontal areas. We argue that this dense inter-areal connectivity benefits multimodal associations, at the cost of reduced functional segregation. Conversely, primates have expanded cortices with a modular connectivity structure, where V1 is almost exclusively interconnected with other visual cortices, themselves organized in relatively segregated streams, and hierarchically higher cortical areas such as prefrontal cortex provide top-down regulation for specifying precise information for working memory storage and manipulation. Increased complexity in cytoarchitecture, connectivity, dendritic spine density, and receptor expression additionally reveal a sharper hierarchical organization in primate cortex. Together, we argue that these primate specializations permit separable deconstruction and selective reconstruction of representations, which is essential to higher cognition.

Repertoire of timescales in uni - and transmodal regions mediate working memory capacity

Working memory (WM) describes the dynamic process of maintenance and manipulation of information over a certain time delay. Neuronally, WM recruits a distributed network of cortical regions like the visual and dorsolateral prefrontal cortex as well as the subcortical hippocampus. How the input dynamics and subsequent neural dynamics impact WM remains unclear though. To answer this question, we combined the analysis of behavioral WM capacity with measuring neural dynamics through task-related power spectrum changes, e.g., median frequency (MF) in functional magnetic resonance imaging (fMRI). We show that the processing of the input dynamics, e.g., the task structure's specific timescale, leads to changes in the unimodal visual cortex's corresponding timescale which also relates to working memory capacity. While the more transmodal hippocampus relates to working memory capacity through its balance across multiple timescales or frequencies. In conclusion, we here show the relevance of both input dynamics and different neural timescales for WM capacity in uni - and transmodal regions like visual cortex and hippocampus for the subject's WM performance.

Unifying network model links recency and central tendency biases in working memory

The central tendency bias, or contraction bias, is a phenomenon where the judgment of the magnitude of items held in working memory appears to be biased toward the average of past observations. It is assumed to be an optimal strategy by the brain and commonly thought of as an expression of the brain's ability to learn the statistical structure of sensory input. On the other hand, recency biases such as serial dependence are also commonly observed and are thought to reflect the content of working memory. Recent results from an auditory delayed comparison task in rats suggest that both biases may be more related than previously thought: when the posterior parietal cortex (PPC) was silenced, both short-term and contraction biases were reduced. By proposing a model of the circuit that may be involved in generating the behavior, we show that a volatile working memory content susceptible to shifting to the past sensory experience - producing short-term sensory history biases - naturally leads to contraction bias. The errors, occurring at the level of individual trials, are sampled from the full distribution of the stimuli and are not due to a gradual shift of the memory toward the sensory distribution's mean. Our results are consistent with a broad set of behavioral findings and provide predictions of performance across different stimulus distributions and timings, delay intervals, as well as neuronal dynamics in putative working memory areas. Finally, we validate our model by performing a set of human psychophysics experiments of an auditory parametric working memory task.

Slow ramping emerges from spontaneous fluctuations in spiking neural networks

1. We reveal a mechanism for slow-ramping signals before spontaneous voluntary movements. 2. Slow synapses stabilize spontaneous fluctuations in spiking neural network. 3. We validate model predictions in human frontal cortical single-neuron recordings. 4. The model recreates the readiness potential in an EEG proxy signal. 5. Neurons that ramp together had correlated activity before ramping onset. The capacity to initiate actions endogenously is critical for goal-directed behavior. Spontaneous voluntary actions are typically preceded by slow-ramping activity in medial frontal cortex that begins around two seconds before movement, which may reflect spontaneous fluctuations that influence action timing. However, the mechanisms by which these slow ramping signals emerge from single-neuron and network dynamics remain poorly understood. Here, we developed a spiking neural-network model that produces spontaneous slow ramping activity in single neurons and population activity with onsets ∼2 seconds before threshold crossings. A key prediction of our model is that neurons that ramp together have correlated firing patterns before ramping onset. We confirmed this model-derived hypothesis in a dataset of human single neuron recordings from medial frontal cortex. Our results suggest that slow ramping signals reflect bounded spontaneous fluctuations that emerge from quasi-winner-take-all dynamics in clustered networks that are temporally stabilized by slow-acting synapses.

A new predictive coding model for a more comprehensive account of delusions

Attempts to understand psychosis-the experience of profoundly altered perceptions and beliefs-raise questions about how the brain models the world. Standard predictive coding approaches suggest that it does so by minimising mismatches between incoming sensory evidence and predictions. By adjusting predictions, we converge iteratively on a best guess of the nature of the reality. Recent arguments have shown that a modified version of this framework-hybrid predictive coding-provides a better model of how healthy agents make inferences about external reality. We suggest that this more comprehensive model gives us a richer understanding of psychosis compared with standard predictive coding accounts. In this Personal View, we briefly describe the hybrid predictive coding model and show how it offers a more comprehensive account of the phenomenology of delusions, thereby providing a potentially powerful new framework for computational psychiatric approaches to psychosis. We also make suggestions for future work that could be important in formalising this novel perspective.

Dopamine transients follow a striatal gradient of reward time horizons

Animals make predictions to guide their behavior and update those predictions through experience. Transient increases in dopamine (DA) are thought to be critical signals for updating predictions. However, it is unclear how this mechanism handles a wide range of behavioral timescales-from seconds or less (for example, if singing a song) to potentially hours or more (for example, if hunting for food). Here we report that DA transients in distinct rat striatal subregions convey prediction errors based on distinct time horizons. DA dynamics systematically accelerated from ventral to dorsomedial to dorsolateral striatum, in the tempo of spontaneous fluctuations, the temporal integration of prior rewards and the discounting of future rewards. This spectrum of timescales for evaluative computations can help achieve efficient learning and adaptive motivation for a broad range of behaviors.

Emergent neural dynamics and geometry for generalization in a transitive inference task

Relational cognition-the ability to infer relationships that generalize to novel combinations of objects-is fundamental to human and animal intelligence. Despite this importance, it remains unclear how relational cognition is implemented in the brain due in part to a lack of hypotheses and predictions at the levels of collective neural activity and behavior. Here we discovered, analyzed, and experimentally tested neural networks (NNs) that perform transitive inference (TI), a classic relational task (if A > B and B > C, then A > C). We found NNs that (i) generalized perfectly, despite lacking overt transitive structure prior to training, (ii) generalized when the task required working memory (WM), a capacity thought to be essential to inference in the brain, (iii) emergently expressed behaviors long observed in living subjects, in addition to a novel order-dependent behavior, and (iv) expressed different task solutions yielding alternative behavioral and neural predictions. Further, in a large-scale experiment, we found that human subjects performing WM-based TI showed behavior inconsistent with a class of NNs that characteristically expressed an intuitive task solution. These findings provide neural insights into a classical relational ability, with wider implications for how the brain realizes relational cognition.

Intracortical recordings reveal vision-to-action cortical gradients driving human exogenous attention

Exogenous attention, the process that makes external salient stimuli pop-out of a visual scene, is essential for survival. How attention-capturing events modulate human brain processing remains unclear. Here we show how the psychological construct of exogenous attention gradually emerges over large-scale gradients in the human cortex, by analyzing activity from 1,403 intracortical contacts implanted in 28 individuals, while they performed an exogenous attention task. The timing, location and task-relevance of attentional events defined a spatiotemporal gradient of three neural clusters, which mapped onto cortical gradients and presented a hierarchy of timescales. Visual attributes modulated neural activity at one end of the gradient, while at the other end it reflected the upcoming response timing, with attentional effects occurring at the intersection of visual and response signals. These findings challenge multi-step models of attention, and suggest that frontoparietal networks, which process sequential stimuli as separate events sharing the same location, drive exogenous attention phenomena such as inhibition of return.

Hierarchical consciousness: the Nested Observer Windows model

Foremost in our experience is the intuition that we possess a unified conscious experience. However, many observations run counter to this intuition: we experience paralyzing indecision when faced with two appealing behavioral choices, we simultaneously hold contradictory beliefs, and the content of our thought is often characterized by an internal debate. Here, we propose the Nested Observer Windows (NOW) Model, a framework for hierarchical consciousness wherein information processed across many spatiotemporal scales of the brain feeds into subjective experience. The model likens the mind to a hierarchy of nested mosaic tiles-where an image is composed of mosaic tiles, and each of these tiles is itself an image composed of mosaic tiles. Unitary consciousness exists at the apex of this nested hierarchy where perceptual constructs become fully integrated and complex behaviors are initiated via abstract commands. We define an observer window as a spatially and temporally constrained system within which information is integrated, e.g. in functional brain regions and neurons. Three principles from the signal analysis of electrical activity describe the nested hierarchy and generate testable predictions. First, nested observer windows disseminate information across spatiotemporal scales with cross-frequency coupling. Second, observer windows are characterized by a high degree of internal synchrony (with zero phase lag). Third, observer windows at the same spatiotemporal level share information with each other through coherence (with non-zero phase lag). The theoretical framework of the NOW Model accounts for a wide range of subjective experiences and a novel approach for integrating prominent theories of consciousness.

Group-common and individual-specific effects of structure-function coupling in human brain networks with graph neural networks

The human cerebral cortex is organized into functionally segregated but synchronized regions bridged by the structural connectivity of white matter pathways. While structure-function coupling has been implicated in cognitive development and neuropsychiatric disorders, studies yield inconsistent findings. The extent to which the structure-function coupling reflects reliable individual differences or primarily group-common characteristics remains unclear, at both the global and regional brain levels. By leveraging two independent, high-quality datasets, we found that the graph neural network accurately predicted unseen individuals' functional connectivity from structural connectivity, reflecting a strong structure-function coupling. This coupling was primarily driven by network topology and was substantially stronger than that of the linear models. Moreover, we observed that structure-function coupling was dominated by group-common effects, with subtle yet significant individual-specific effects. The regional group and individual effects of coupling were hierarchically organized across the cortex along a sensorimotor-association axis, with lower group and higher individual effects in association cortices. These findings emphasize the importance of considering both group and individual effects in understanding cortical structure-function coupling, suggesting insights into interpreting individual differences of the coupling and informing connectivity-guided therapeutics.

Primate thalamic nuclei select abstract rules and shape prefrontal dynamics

Flexible behavior depends on abstract rules to generalize beyond specific instances, and outcome monitoring to adjust actions. Cortical circuits are posited to read out rules from high-dimensional representations of task-relevant variables in prefrontal cortex (PFC). We instead hypothesized that converging inputs from PFC, directly or via basal ganglia (BG), enable primate-specific thalamus to select rules. To test this, we simultaneously measured spiking activity across PFC and two connected thalamic nuclei of monkeys applying rules. Abstract rule information first appeared in the ventroanterior thalamus (VA) - the main thalamic hub between BG and PFC. The mediodorsal thalamus (MD) also represented rule information before PFC, which persisted after rule cues were removed, to help maintain activation of relevant posterior PFC cell ensembles. MD, a major recipient of midbrain dopamine input, was first to represent information about behavioral outcomes. This persisted after the trial (also in PFC). A PFC-BG-thalamus model reproduced key findings, and thalamic-lesion modeling disrupted PFC rule representations. These results suggest a revised view of the neural basis of flexible behavior in primates, featuring a central role for thalamus in selecting high-level cognitive information from PFC and implementing post-error behavioral adjustments, and of the functional organization of PFC along its anterior-posterior dimension.

Neural timescales reflect behavioral demands in freely moving rhesus macaques

Previous work demonstrated a highly reproducible cortical hierarchy of neural timescales at rest, with sensory areas displaying fast, and higher-order association areas displaying slower timescales. The question arises how such stable hierarchies give rise to adaptive behavior that requires flexible adjustment of temporal coding and integration demands. Potentially, this lack of variability in the hierarchical organization of neural timescales could reflect the structure of the laboratory contexts. We posit that unconstrained paradigms are ideal to test whether the dynamics of neural timescales reflect behavioral demands. Here we measured timescales of local field potential activity while male rhesus macaques foraged in an open space. We found a hierarchy of neural timescales that differs from previous work. Importantly, although the magnitude of neural timescales expanded with task engagement, the brain areas' relative position in the hierarchy was stable. Next, we demonstrated that the change in neural timescales is dynamic and contains functionally-relevant information, differentiating between similar events in terms of motor demands and associated reward. Finally, we demonstrated that brain areas are differentially affected by these behavioral demands. These results demonstrate that while the space of neural timescales is anatomically constrained, the observed hierarchical organization and magnitude is dependent on behavioral demands.

Decreased intrinsic neural timescale in treatment-naïve adolescent depression

BACKGROUND

Major depressive disorder (MDD) is mainly characterized by its core dysfunction in higher-order brain cortices involved in emotional and cognitive processes, whose neurobiological basis remains unclear. In this study, we applied a relatively new developed resting-state functional magnetic resonance imaging (rs-fMRI) method of intrinsic neural timescale (INT), which reflects how long neural information is stored in a local brain area and reflects an ability of information integration, to investigate the local intrinsic neural dynamics using univariate and multivariate analyses in adolescent depression.

METHOD

Based on the rs-fMRI data of sixty-six treatment-naïve adolescents with MDD and fifty-two well-matched healthy controls (HCs), we calculated an INT by assessing the magnitude of autocorrelation of the resting-state brain activity, and then compared the difference of INT between the two groups. Correlation between abnormal INT and clinical features was performed. We also utilized multivariate pattern analysis to determine whether INT could differentiate MDD patients from HCs at the individual level.

RESULT

Compared with HCs, patients with MDD showed shorter INT widely distributed in cortical and partial subcortical regions. Interestingly, the decreased INT in the left hippocampus was related to disease severity of MDD. Furthermore, INT can distinguish MDD patients from HCs with the most discriminative regions located in the dorsolateral prefrontal cortex, angular, middle occipital gyrus, and cerebellar posterior lobe.

CONCLUSION

Our research aids in advancing understanding the brain abnormalities of treatment-naïve adolescents with MDD from the perspective of the local neural dynamics, highlighting the significant role of INT in understanding neurophysiological mechanisms. This study shows that the altered intrinsic timescales of local neural signals widely distributed in higher-order brain cortices regions may be the neurodynamic basis of cognitive and emotional disturbances in MDD patients, and provides preliminary support for the suggestion that these could be used to aid the identification of MDD patients in clinical practice.

Different extrapolation of moving object locations in perception, smooth pursuit, and saccades

The ability to accurately perceive and track moving objects is crucial for many everyday activities. In this study, we use a "double-drift stimulus" to explore the processing of visual motion signals that underlie perception, pursuit, and saccade responses to a moving object. Participants were presented with peripheral moving apertures filled with noise that either drifted orthogonally to the aperture's direction or had no net motion. Participants were asked to saccade to and track these targets with their gaze as soon as they appeared and then to report their direction. In the trials with internal motion, the target disappeared at saccade onset so that the first 100 ms of the postsaccadic pursuit response was driven uniquely by peripheral information gathered before saccade onset. This provided independent measures of perceptual, pursuit, and saccadic responses to the double-drift stimulus on a trial-by-trial basis. Our analysis revealed systematic differences between saccadic responses, on one hand, and perceptual and pursuit responses, on the other. These differences are unlikely to be caused by differences in the processing of motion signals because both saccades and pursuits seem to rely on shared target position and velocity information. We conclude that our results are instead due to a difference in how the processing mechanisms underlying perception, pursuit, and saccades combine motor signals with target position. These findings advance our understanding of the mechanisms underlying dissociation in visual processing between perception and eye movements.

MRI Assessment of Intrinsic Neural Timescale and Gray Matter Volume in Parkinson's Disease

BACKGROUND

Numerous studies have indicated altered temporal features of the brain function in Parkinson's disease (PD), and the autocorrelation magnitude of intrinsic neural signals, called intrinsic neural timescales, were often applied to estimate how long neural information stored in local brain areas. However, it is unclear whether PD patients at different disease stages exhibit abnormal timescales accompanied with abnormal gray matter volume (GMV).

PURPOSE

To assess the intrinsic timescale and GMV in PD.

STUDY TYPE

Prospective.

POPULATION

74 idiopathic PD patients (44 early stage (PD-ES) and 30 late stage (PD-LS), as determined by the Hoehn and Yahr (HY) severity classification scale), and 73 healthy controls (HC).

FIELD STRENGTH/SEQUENCE

3.0 T MRI scanner; magnetization prepared rapid acquisition gradient echo and echo planar imaging sequences.

ASSESSMENT

The timescales were estimated by using the autocorrelation magnitude of neural signals. Voxel-based morphometry was performed to calculate GMV in the whole brain. Severity of motor symptoms and cognitive impairments were assessed using the unified PD rating scale, the HY scale, the Montreal cognitive assessment, and the mini-mental state examination.

STATISTICAL TEST

Analysis of variance; two-sample t-test; Spearman rank correlation analysis; Mann-Whitney U test; Kruskal-Wallis' H test. A P value <0.05 was considered statistically significant.

RESULTS

The PD group had significantly abnormal intrinsic timescales in the sensorimotor, visual, and cognitive-related areas, which correlated with the symptom severity (ρ = -0.265, P = 0.022) and GMV (ρ = 0.254, P = 0.029). Compared to the HC group, the PD-ES group had significantly longer timescales in anterior cortical regions, whereas the PD-LS group had significantly shorter timescales in posterior cortical regions.

CONCLUSION

This study suggested that PD patients have abnormal timescales in multisystem and distinct patterns of timescales and GMV in cerebral cortex at different disease stages. This may provide new insights for the neural substrate of PD.

LEVEL OF EVIDENCE

2 TECHNICAL EFFICACY STAGE: 1.

Bayesian inference is facilitated by modular neural networks with different time scales

Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference by the brain, the prior distribution must be acquired and represented by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. Our findings reveal that networks with modular structures, composed of fast and slow modules, are adept at representing this prior distribution, enabling more accurate Bayesian inferences. Specifically, the modular network that consists of a main module connected with input and output layers and a sub-module with slower neural activity connected only with the main module outperformed networks with uniform time scales. Prior information was represented specifically by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the neural network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure and the division of roles in which prior knowledge is selectively represented in the slow sub-modules spontaneously emerged. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales.

Curiosity: primate neural circuits for novelty and information seeking

For many years, neuroscientists have investigated the behavioural, computational and neurobiological mechanisms that support value-based decisions, revealing how humans and animals make choices to obtain rewards. However, many decisions are influenced by factors other than the value of physical rewards or second-order reinforcers (such as money). For instance, animals (including humans) frequently explore novel objects that have no intrinsic value solely because they are novel and they exhibit the desire to gain information to reduce their uncertainties about the future, even if this information cannot lead to reward or assist them in accomplishing upcoming tasks. In this Review, I discuss how circuits in the primate brain responsible for detecting, predicting and assessing novelty and uncertainty regulate behaviour and give rise to these behavioural components of curiosity. I also briefly discuss how curiosity-related behaviours arise during postnatal development and point out some important reasons for the persistence of curiosity across generations.

Dynamic fading memory and expectancy effects in the monkey primary visual cortex

In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.

Optimal decoding of neural dynamics occurs at mesoscale spatial and temporal resolutions

Introduction

Understanding the neural code has been one of the central aims of neuroscience research for decades. Spikes are commonly referred to as the units of information transfer, but multi-unit activity (MUA) recordings are routinely analyzed in aggregate forms such as binned spike counts, peri-stimulus time histograms, firing rates, or population codes. Various forms of averaging also occur in the brain, from the spatial averaging of spikes within dendritic trees to their temporal averaging through synaptic dynamics. However, how these forms of averaging are related to each other or to the spatial and temporal units of information representation within the neural code has remained poorly understood.

Materials and methods

In this work we developed NeuroPixelHD, a symbolic hyperdimensional model of MUA, and used it to decode the spatial location and identity of static images shown to n = 9 mice in the Allen Institute Visual Coding-NeuroPixels dataset from large-scale MUA recordings. We parametrically varied the spatial and temporal resolutions of the MUA data provided to the model, and compared its resulting decoding accuracy.

Results

For almost all subjects, we found 125ms temporal resolution to maximize decoding accuracy for both the spatial location of Gabor patches (81 classes for patches presented over a 9×9 grid) as well as the identity of natural images (118 classes corresponding to 118 images) across the whole brain. This optimal temporal resolution nevertheless varied greatly between different regions, followed a sensory-associate hierarchy, and was significantly modulated by the central frequency of theta-band oscillations across different regions. Spatially, the optimal resolution was at either of two mesoscale levels for almost all mice: the area level, where the spiking activity of all neurons within each brain area are combined, and the population level, where neuronal spikes within each area are combined across fast spiking (putatively inhibitory) and regular spiking (putatively excitatory) neurons, respectively. We also observed an expected interplay between optimal spatial and temporal resolutions, whereby increasing the amount of averaging across one dimension (space or time) decreases the amount of averaging that is optimal across the other dimension, and vice versa.

Discussion

Our findings corroborate existing empirical practices of spatiotemporal binning and averaging in MUA data analysis, and provide a rigorous computational framework for optimizing the level of such aggregations. Our findings can also synthesize these empirical practices with existing knowledge of the various sources of biological averaging in the brain into a new theory of neural information processing in which the unit of information varies dynamically based on neuronal signal and noise correlations across space and time.

Unsupervised learning of mid-level visual representations

Recently, a confluence between trends in neuroscience and machine learning has brought a renewed focus on unsupervised learning, where sensory processing systems learn to exploit the statistical structure of their inputs in the absence of explicit training targets or rewards. Sophisticated experimental approaches have enabled the investigation of the influence of sensory experience on neural self-organization and its synaptic bases. Meanwhile, novel algorithms for unsupervised and self-supervised learning have become increasingly popular both as inspiration for theories of the brain, particularly for the function of intermediate visual cortical areas, and as building blocks of real-world learning machines. Here we review some of these recent developments, placing them in historical context and highlighting some research lines that promise exciting breakthroughs in the near future.

Neural tracking of continuous acoustics: properties, speech-specificity and open questions

Human speech is a particularly relevant acoustic stimulus for our species, due to its role of information transmission during communication. Speech is inherently a dynamic signal, and a recent line of research focused on neural activity following the temporal structure of speech. We review findings that characterise neural dynamics in the processing of continuous acoustics and that allow us to compare these dynamics with temporal aspects in human speech. We highlight properties and constraints that both neural and speech dynamics have, suggesting that auditory neural systems are optimised to process human speech. We then discuss the speech-specificity of neural dynamics and their potential mechanistic origins and summarise open questions in the field.

Cortical timescales and the modular organization of structural and functional brain networks

Recent years have seen growing interest in characterizing the properties of regional brain dynamics and their relationship to other features of brain structure and function. In particular, multiple studies have observed regional differences in the "timescale" over which activity fluctuates during periods of quiet rest. In the cerebral cortex, these timescales have been associated with both local circuit properties as well as patterns of inter-regional connectivity, including the extent to which each region exhibits widespread connectivity to other brain areas. In the current study, we build on prior observations of an association between connectivity and dynamics in the cerebral cortex by investigating the relationship between BOLD fMRI timescales and the modular organization of structural and functional brain networks. We characterize network community structure across multiple scales and find that longer timescales are associated with greater within-community functional connectivity and diverse structural connectivity. We also replicate prior observations of a positive correlation between timescales and structural connectivity degree. Finally, we find evidence for preferential functional connectivity between cortical areas with similar timescales. We replicate these findings in an independent dataset. These results contribute to our understanding of functional brain organization and structure-function relationships in the human brain, and support the notion that regional differences in cortical dynamics may in part reflect the topological role of each region within macroscale brain networks.

Dynamic predictive coding: A model of hierarchical sequence learning and prediction in the neocortex

We introduce dynamic predictive coding, a hierarchical model of spatiotemporal prediction and sequence learning in the neocortex. The model assumes that higher cortical levels modulate the temporal dynamics of lower levels, correcting their predictions of dynamics using prediction errors. As a result, lower levels form representations that encode sequences at shorter timescales (e.g., a single step) while higher levels form representations that encode sequences at longer timescales (e.g., an entire sequence). We tested this model using a two-level neural network, where the top-down modulation creates low-dimensional combinations of a set of learned temporal dynamics to explain input sequences. When trained on natural videos, the lower-level model neurons developed space-time receptive fields similar to those of simple cells in the primary visual cortex while the higher-level responses spanned longer timescales, mimicking temporal response hierarchies in the cortex. Additionally, the network's hierarchical sequence representation exhibited both predictive and postdictive effects resembling those observed in visual motion processing in humans (e.g., in the flash-lag illusion). When coupled with an associative memory emulating the role of the hippocampus, the model allowed episodic memories to be stored and retrieved, supporting cue-triggered recall of an input sequence similar to activity recall in the visual cortex. When extended to three hierarchical levels, the model learned progressively more abstract temporal representations along the hierarchy. Taken together, our results suggest that cortical processing and learning of sequences can be interpreted as dynamic predictive coding based on a hierarchical spatiotemporal generative model of the visual world.

Intrinsic timescales and predictive allostatic interoception in brain health and disease

The cognitive neuroscience of brain diseases faces challenges in understanding the complex relationship between brain structure and function, the heterogeneity of brain phenotypes, and the lack of dimensional and transnosological explanations. This perspective offers a framework combining the predictive coding theory of allostatic interoceptive overload (PAIO) and the intrinsic neural timescales (INT) theory to provide a more dynamic understanding of brain health in psychiatry and neurology. PAIO integrates allostasis and interoception to assess the interaction between internal patterns and environmental stressors, while INT shows that different brain regions operate on different intrinsic timescales. The allostatic overload can be understood as a failure of INT, which involves a breakdown of proper temporal integration and segregation. This can lead to dimensional disbalances between exteroceptive/interoceptive inputs across brain and whole-body levels (cardiometabolic, cardiovascular, inflammatory, immune). This approach offers new insights, presenting novel perspectives on brain spatiotemporal hierarchies and interactions. By integrating these theories, the paper opens innovative paths for studying brain health dynamics, which can inform future research in brain health and disease.

Individual variability in functional connectivity of human auditory cortex

Individual variability in functional connectivity underlies individual differences in cognition and behaviors, yet its association with functional specialization in the auditory cortex remains elusive. Using resting-state functional magnetic resonance imaging data from the Human Connectome Project, this study was designed to investigate the spatial distribution of auditory cortex individual variability in its whole-brain functional network architecture. An inherent hierarchical axis of the variability was discerned, which radiates from the medial to lateral orientation, with the left auditory cortex demonstrating more pronounced variations than the right. This variability exhibited a significant correlation with the variations in structural and functional metrics in the auditory cortex. Four auditory cortex subregions, which were identified from a clustering analysis based on this variability, exhibited unique connectional fingerprints and cognitive maps, with certain subregions showing specificity to speech perception functional activation. Moreover, the lateralization of the connectional fingerprint exhibited a U-shaped trajectory across the subregions. These findings emphasize the role of individual variability in functional connectivity in understanding cortical functional organization, as well as in revealing its association with functional specialization from the activation, connectome, and cognition perspectives.

The Primate Cortical LFP Exhibits Multiple Spectral and Temporal Gradients and Widespread Task-Dependence During Visual Short-Term Memory

Although cognitive functions are hypothesized to be mediated by synchronous neuronal interactions in multiple frequency bands among widely distributed cortical areas, we still lack a basic understanding of the distribution and task dependence of oscillatory activity across the cortical map. Here, we ask how the spectral and temporal properties of the local field potential (LFP) vary across the primate cerebral cortex, and how they are modulated during visual short-term memory. We measured the LFP from 55 cortical areas in two macaque monkeys while they performed a visual delayed match to sample task. Analysis of peak frequencies in the LFP power spectra reveals multiple discrete frequency bands between 3-80 Hz that differ between the two monkeys. The LFP power in each band, as well as the Sample Entropy, a measure of signal complexity, display distinct spatial gradients across the cortex, some of which correlate with reported spine counts in layer 3 pyramidal neurons. Cortical areas can be robustly decoded using a small number of spectral and temporal parameters, and significant task dependent increases and decreases in spectral power occur in all cortical areas. These findings reveal pronounced, widespread and spatially organized gradients in the spectral and temporal activity of cortical areas. Task-dependent changes in cortical activity are globally distributed, even for a simple cognitive task.

Inferring neural dynamics of memory during naturalistic social communication

Memory processes in complex behaviors like social communication require forming representations of the past that grow with time. The neural mechanisms that support such continually growing memory remain unknown. We address this gap in the context of fly courtship, a natural social behavior involving the production and perception of long, complex song sequences. To study female memory for male song history in unrestrained courtship, we present 'Natural Continuation' (NC)-a general, simulation-based model comparison procedure to evaluate candidate neural codes for complex stimuli using naturalistic behavioral data. Applying NC to fly courtship revealed strong evidence for an adaptive population mechanism for how female auditory neural dynamics could convert long song histories into a rich mnemonic format. Song temporal patterning is continually transformed by heterogeneous nonlinear adaptation dynamics, then integrated into persistent activity, enabling common neural mechanisms to retain continuously unfolding information over long periods and yielding state-of-the-art predictions of female courtship behavior. At a population level this coding model produces multi-dimensional advection-diffusion-like responses that separate songs over a continuum of timescales and can be linearly transformed into flexible output signals, illustrating its potential to create a generic, scalable mnemonic format for extended input signals poised to drive complex behavioral responses. This work thus shows how naturalistic behavior can directly inform neural population coding models, revealing here a novel process for memory formation.

Mixed Selectivity Coding of Content-Temporal Detail by Dorsomedial Posterior Parietal Neurons

The dorsomedial posterior parietal cortex (dmPPC) is part of a higher-cognition network implicated in elaborate processes underpinning memory formation, recollection, episode reconstruction, and temporal information processing. Neural coding for complex episodic processing is however under-documented. Here, we recorded extracellular neural activities from three male rhesus macaques (Macaca mulatta) and revealed a set of neural codes of "neuroethogram" in the primate parietal cortex. Analyzing neural responses in macaque dmPPC to naturalistic videos, we discovered several groups of neurons that are sensitive to different categories of ethogram items, low-level sensory features, and saccadic eye movement. We also discovered that the processing of category and feature information by these neurons is sustained by the accumulation of temporal information over a long timescale of up to 30 s, corroborating its reported long temporal receptive windows. We performed an additional behavioral experiment with additional two male rhesus macaques and found that saccade-related activities could not account for the mixed neuronal responses elicited by the video stimuli. We further observed monkeys' scan paths and gaze consistency are modulated by video content. Taken altogether, these neural findings explain how dmPPC weaves fabrics of ongoing experiences together in real time. The high dimensionality of neural representations should motivate us to shift the focus of attention from pure selectivity neurons to mixed selectivity neurons, especially in increasingly complex naturalistic task designs.

A week in the life of the human brain: stable states punctuated by chaotic transitions

Many important neurocognitive states, such as performing natural activities and fluctuations of arousal, shift over minutes-to-hours in the real-world. We harnessed 3-12 days of continuous multi-electrode intracranial recordings in twenty humans during natural behavior (socializing, using digital devices, sleeping, etc.) to study real-world neurodynamics. Applying deep learning with dynamical systems approaches revealed that brain networks formed consistent stable states that predicted behavior and physiology. Changes in behavior were associated with bursts of rapid neural fluctuations where brain networks chaotically explored many configurations before settling into new states. These trajectories traversed an hourglass-shaped structure anchored around a set of networks that slowly tracked levels of outward awareness related to wake-sleep stages, and a central attractor corresponding to default mode network activation. These findings indicate ways our brains use rapid, chaotic transitions that coalesce into neurocognitive states slowly fluctuating around a stabilizing central equilibrium to balance flexibility and stability during real-world behavior.