1
|
Senkowski D, Engel AK. Multi-timescale neural dynamics for multisensory integration. Nat Rev Neurosci 2024; 25:625-642. [PMID: 39090214 DOI: 10.1038/s41583-024-00845-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/02/2024] [Indexed: 08/04/2024]
Abstract
Carrying out any everyday task, be it driving in traffic, conversing with friends or playing basketball, requires rapid selection, integration and segregation of stimuli from different sensory modalities. At present, even the most advanced artificial intelligence-based systems are unable to replicate the multisensory processes that the human brain routinely performs, but how neural circuits in the brain carry out these processes is still not well understood. In this Perspective, we discuss recent findings that shed fresh light on the oscillatory neural mechanisms that mediate multisensory integration (MI), including power modulations, phase resetting, phase-amplitude coupling and dynamic functional connectivity. We then consider studies that also suggest multi-timescale dynamics in intrinsic ongoing neural activity and during stimulus-driven bottom-up and cognitive top-down neural network processing in the context of MI. We propose a new concept of MI that emphasizes the critical role of neural dynamics at multiple timescales within and across brain networks, enabling the simultaneous integration, segregation, hierarchical structuring and selection of information in different time windows. To highlight predictions from our multi-timescale concept of MI, real-world scenarios in which multi-timescale processes may coordinate MI in a flexible and adaptive manner are considered.
Collapse
Affiliation(s)
- Daniel Senkowski
- Department of Psychiatry and Neurosciences, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Andreas K Engel
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
2
|
Gavenas J, Rutishauser U, Schurger A, Maoz U. Slow ramping emerges from spontaneous fluctuations in spiking neural networks. Nat Commun 2024; 15:7285. [PMID: 39179554 DOI: 10.1038/s41467-024-51401-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 08/05/2024] [Indexed: 08/26/2024] Open
Abstract
The capacity to initiate actions endogenously is critical for goal-directed behavior. Spontaneous voluntary actions are typically preceded by slow-ramping activity in medial frontal cortex that begins around two seconds before movement, which may reflect spontaneous fluctuations that influence action timing. However, the mechanisms by which these slow ramping signals emerge from single-neuron and network dynamics remain poorly understood. Here, we developed a spiking neural-network model that produces spontaneous slow ramping activity in single neurons and population activity with onsets ~2 s before threshold crossings. A key prediction of our model is that neurons that ramp together have correlated firing patterns before ramping onset. We confirmed this model-derived hypothesis in a dataset of human single neuron recordings from medial frontal cortex. Our results suggest that slow ramping signals reflect bounded spontaneous fluctuations that emerge from quasi-winner-take-all dynamics in clustered networks that are temporally stabilized by slow-acting synapses.
Collapse
Affiliation(s)
- Jake Gavenas
- Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA.
- Schmid College of Science and Technology, Chapman University, Orange, CA, USA.
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| | - Ueli Rutishauser
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Neurology, Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Center for Neural Science and Medicine, Department of Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Aaron Schurger
- Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA
- Crean College of Health and Behavioral Sciences, Chapman University, Orange, CA, USA
- INSERM U992, Cognitive Neuroimaging Unit, NeuroSpin Center, Gif sur Yvette, 91191, France
- Commissariat à l'Energie Atomique, Direction des Sciences du Vivant, I2BM, NeuroSpin Center, Gif sur Yvette, 91191, France
| | - Uri Maoz
- Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA.
- Schmid College of Science and Technology, Chapman University, Orange, CA, USA.
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA.
- Crean College of Health and Behavioral Sciences, Chapman University, Orange, CA, USA.
- Fowler School of Engineering, Chapman University, Orange, CA, USA.
- Anderson School of Management, University of California, Los Angeles, CA, USA.
| |
Collapse
|
3
|
Murai SA, Mano T, Sanes JN, Watanabe T. Atypical intrinsic neural timescale in the left angular gyrus in Alzheimer's disease. Brain Commun 2024; 6:fcae199. [PMID: 38993284 PMCID: PMC11227993 DOI: 10.1093/braincomms/fcae199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 04/18/2024] [Accepted: 06/07/2024] [Indexed: 07/13/2024] Open
Abstract
Alzheimer's disease is characterized by cognitive impairment and progressive brain atrophy. Recent human neuroimaging studies reported atypical anatomical and functional changes in some regions in the default mode network in patients with Alzheimer's disease, but which brain area of the default mode network is the key region whose atrophy disturbs the entire network activity and consequently contributes to the symptoms of the disease remains unidentified. Here, in this case-control study, we aimed to identify crucial neural regions that mediated the phenotype of Alzheimer's disease, and as such, we examined the intrinsic neural timescales-a functional metric to evaluate the capacity to integrate diverse neural information-and grey matter volume of the regions in the default mode network using resting-state functional MRI images and structural MRI data obtained from individuals with Alzheimer's disease and cognitively typical people. After confirming the atypically short neural timescale of the entire default mode network in Alzheimer's disease and its link with the symptoms of the disease, we found that the shortened neural timescale of the default mode network was associated with the aberrantly short neural timescale of the left angular gyrus. Moreover, we revealed that the shortened neural timescale of the angular gyrus was correlated with the atypically reduced grey matter volume of this parietal region. Furthermore, we identified an association between the neural structure, brain function and symptoms and proposed a model in which the reduced grey matter volume of the left angular gyrus shortened the intrinsic neural time of the region, which then destabilized the entire neural timescale of the default mode network and resultantly contributed to cognitive decline in Alzheimer's disease. These findings highlight the key role of the left angular gyrus in the anatomical and functional aetiology of Alzheimer's disease.
Collapse
Affiliation(s)
- Shota A Murai
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, Bunkyo City, Tokyo 113-0033, Japan
| | - Tatsuo Mano
- Department of Degenerative Neurological Diseases, National Center of Neurology and Psychiatry, Tokyo 187-8551, Japan
| | - Jerome N Sanes
- Department of Neuroscience, Brown University, Providence, RI 02912, USA
- Carney Institute for Brain Science, Brown University, Providence, RI 02912, USA
- Center for Neurorestoration and Neurotechnology, Veterans Affairs Providence Healthcare System, Providence, RI 02908, USA
| | - Takamitsu Watanabe
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, Bunkyo City, Tokyo 113-0033, Japan
| |
Collapse
|
4
|
Zhang A, Wengler K, Zhu X, Horga G, Goldberg TE, Lee S. Altered Hierarchical Gradients of Intrinsic Neural Timescales in Mild Cognitive Impairment and Alzheimer's Disease. J Neurosci 2024; 44:e2024232024. [PMID: 38658167 PMCID: PMC11209657 DOI: 10.1523/jneurosci.2024-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 03/08/2024] [Accepted: 04/12/2024] [Indexed: 04/26/2024] Open
Abstract
Alzheimer's disease (AD) is a devastating neurodegenerative disease that affects millions of seniors in the United States. Resting-state functional magnetic resonance imaging (rs-fMRI) is widely used to study neurophysiology in AD and its prodromal condition, mild cognitive impairment (MCI). The intrinsic neural timescale (INT), which can be estimated through the magnitude of the autocorrelation of neural signals from rs-fMRI, is thought to quantify the duration that neural information is stored in a local circuit. Such heterogeneity of the timescales forms a basis of the brain functional hierarchy and captures an aspect of circuit dynamics relevant to excitation/inhibition balance, which is broadly relevant for cognitive functions. Given that, we applied rs-fMRI to test whether distinct changes of INT at different hierarchies are present in people with MCI, those progressing to AD (called Converter), and AD patients of both sexes. Linear mixed-effect model was implemented to detect altered hierarchical gradients across populations followed by pairwise comparisons to identify regional differences. High similarities between AD and Converter were observed. Specifically, the inferior temporal, caudate, and pallidum areas exhibit significant alterations in both AD and Converter. Distinct INT-related pathological changes in MCI and AD were found. For AD/Converter, neural information is stored for a longer time in lower hierarchical areas, while higher levels of hierarchy seem to be preferentially impaired in MCI leading to a less pronounced hierarchical gradient. These results inform that the INT holds great potential as an additional measure for AD prediction, even a stable biomarker for clinical diagnosis.
Collapse
Affiliation(s)
- Aiying Zhang
- New York State Psychiatric Institute, New York, New York 10032
- Department of Psychiatry, Columbia University, New York, New York 10032
| | - Kenneth Wengler
- New York State Psychiatric Institute, New York, New York 10032
- Department of Psychiatry, Columbia University, New York, New York 10032
| | - Xi Zhu
- New York State Psychiatric Institute, New York, New York 10032
- Department of Psychiatry, Columbia University, New York, New York 10032
| | - Guillermo Horga
- New York State Psychiatric Institute, New York, New York 10032
- Department of Psychiatry, Columbia University, New York, New York 10032
| | - Terry E Goldberg
- New York State Psychiatric Institute, New York, New York 10032
- Department of Psychiatry, Columbia University, New York, New York 10032
- Department of Anesthesiology, Columbia University Irving Medical Center, New York, New York 10032
- Taub Institute for Research on Alzheimer's Disease and the Aging Brain, Columbia University, New York, New York 10032
| | - Seonjoo Lee
- New York State Psychiatric Institute, New York, New York 10032
- Department of Psychiatry, Columbia University, New York, New York 10032
- Department of Biostatistics, Mailman School of Public Health, Columbia University, New York, New York 10032
| |
Collapse
|
5
|
Crombie D, Spacek MA, Leibold C, Busse L. Spiking activity in the visual thalamus is coupled to pupil dynamics across temporal scales. PLoS Biol 2024; 22:e3002614. [PMID: 38743775 PMCID: PMC11093384 DOI: 10.1371/journal.pbio.3002614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 04/05/2024] [Indexed: 05/16/2024] Open
Abstract
The processing of sensory information, even at early stages, is influenced by the internal state of the animal. Internal states, such as arousal, are often characterized by relating neural activity to a single "level" of arousal, defined by a behavioral indicator such as pupil size. In this study, we expand the understanding of arousal-related modulations in sensory systems by uncovering multiple timescales of pupil dynamics and their relationship to neural activity. Specifically, we observed a robust coupling between spiking activity in the mouse dorsolateral geniculate nucleus (dLGN) of the thalamus and pupil dynamics across timescales spanning a few seconds to several minutes. Throughout all these timescales, 2 distinct spiking modes-individual tonic spikes and tightly clustered bursts of spikes-preferred opposite phases of pupil dynamics. This multi-scale coupling reveals modulations distinct from those captured by pupil size per se, locomotion, and eye movements. Furthermore, coupling persisted even during viewing of a naturalistic movie, where it contributed to differences in the encoding of visual information. We conclude that dLGN spiking activity is under the simultaneous influence of multiple arousal-related processes associated with pupil dynamics occurring over a broad range of timescales.
Collapse
Affiliation(s)
- Davide Crombie
- Division of Neuroscience, Faculty of Biology, LMU Munich, Munich, Germany
- Graduate School of Systemic Neurosciences, LMU Munich, Munich, Germany
| | - Martin A. Spacek
- Division of Neuroscience, Faculty of Biology, LMU Munich, Munich, Germany
| | - Christian Leibold
- Division of Neuroscience, Faculty of Biology, LMU Munich, Munich, Germany
- Fakultät für Biologie & Bernstein Center Freiburg, Albert-Ludwigs-Universität Freiburg, Freiburg im Breisgau, Germany
| | - Laura Busse
- Division of Neuroscience, Faculty of Biology, LMU Munich, Munich, Germany
- Bernstein Center for Computational Neuroscience, Munich, Germany
| |
Collapse
|
6
|
Ryom KI, Basu A, Stendardi D, Ciaramelli E, Treves A. Taking time to compose thoughts with prefrontal schemata. Exp Brain Res 2024; 242:1101-1114. [PMID: 38483564 PMCID: PMC11078815 DOI: 10.1007/s00221-024-06785-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 01/16/2024] [Indexed: 05/12/2024]
Abstract
Under what conditions can prefrontal cortex direct the composition of brain states, to generate coherent streams of thoughts? Using a simplified Potts model of cortical dynamics, crudely differentiated into two halves, we show that once activity levels are regulated, so as to disambiguate a single temporal sequence, whether the contents of the sequence are mainly determined by the frontal or by the posterior half, or by neither, depends on statistical parameters that describe its microcircuits. The frontal cortex tends to lead if it has more local attractors, longer lasting and stronger ones, in order of increasing importance. Its guidance is particularly effective to the extent that posterior cortices do not tend to transition from state to state on their own. The result may be related to prefrontal cortex enforcing its temporally-oriented schemata driving coherent sequences of brain states, unlike the atemporal "context" contributed by the hippocampus. Modelling a mild prefrontal (vs. posterior) lesion offers an account of mind-wandering and event construction deficits observed in prefrontal patients.
Collapse
Affiliation(s)
- Kwang Il Ryom
- SISSA - Cognitive Neuroscience, via Bonomea 265, 34136, Trieste, Italy
| | - Anindita Basu
- SISSA - Cognitive Neuroscience, via Bonomea 265, 34136, Trieste, Italy
| | - Debora Stendardi
- Dip. Psicologia Renzo Canestrari, Univ. Bologna, Viale C. Berti-Pichat 5, 40126, Bologna, Italy
| | - Elisa Ciaramelli
- Dip. Psicologia Renzo Canestrari, Univ. Bologna, Viale C. Berti-Pichat 5, 40126, Bologna, Italy
| | - Alessandro Treves
- SISSA - Cognitive Neuroscience, via Bonomea 265, 34136, Trieste, Italy.
| |
Collapse
|
7
|
Wolman A, Çatal Y, Klar P, Steffener J, Northoff G. Repertoire of timescales in uni - and transmodal regions mediate working memory capacity. Neuroimage 2024; 291:120602. [PMID: 38579900 DOI: 10.1016/j.neuroimage.2024.120602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 04/01/2024] [Accepted: 04/02/2024] [Indexed: 04/07/2024] Open
Abstract
Working memory (WM) describes the dynamic process of maintenance and manipulation of information over a certain time delay. Neuronally, WM recruits a distributed network of cortical regions like the visual and dorsolateral prefrontal cortex as well as the subcortical hippocampus. How the input dynamics and subsequent neural dynamics impact WM remains unclear though. To answer this question, we combined the analysis of behavioral WM capacity with measuring neural dynamics through task-related power spectrum changes, e.g., median frequency (MF) in functional magnetic resonance imaging (fMRI). We show that the processing of the input dynamics, e.g., the task structure's specific timescale, leads to changes in the unimodal visual cortex's corresponding timescale which also relates to working memory capacity. While the more transmodal hippocampus relates to working memory capacity through its balance across multiple timescales or frequencies. In conclusion, we here show the relevance of both input dynamics and different neural timescales for WM capacity in uni - and transmodal regions like visual cortex and hippocampus for the subject's WM performance.
Collapse
Affiliation(s)
- Angelika Wolman
- School of Psychology, University of Ottawa, 136 Jean-Jacques Lussier, Ottawa, ON K1N 6N5, Canada; Mind, Brain Imaging and Neuroethics Unit, Institute of Mental Health Research, Royal Ottawa Mental Health Centre, University of Ottawa, 1145 Carling Avenue, Ottawa, ON K1Z 7K4, Canada.
| | - Yasir Çatal
- Mind, Brain Imaging and Neuroethics Unit, Institute of Mental Health Research, Royal Ottawa Mental Health Centre, University of Ottawa, 1145 Carling Avenue, Ottawa, ON K1Z 7K4, Canada
| | - Philipp Klar
- Faculty of Mathematics and Natural Sciences, Institute of Experimental Psychology, Heinrich Heine University of Düsseldorf, Düsseldorf, Germany; Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany
| | - Jason Steffener
- Interdisciplinary School of Health Science, University of Ottawa, 200 Lees Ave, Ottawa, ON K1N 6N5, Canada
| | - Georg Northoff
- Mind, Brain Imaging and Neuroethics Unit, Institute of Mental Health Research, Royal Ottawa Mental Health Centre, University of Ottawa, 1145 Carling Avenue, Ottawa, ON K1Z 7K4, Canada
| |
Collapse
|
8
|
Jain S, Vo VA, Wehbe L, Huth AG. Computational Language Modeling and the Promise of In Silico Experimentation. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:80-106. [PMID: 38645624 PMCID: PMC11025654 DOI: 10.1162/nol_a_00101] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 01/18/2023] [Indexed: 04/23/2024]
Abstract
Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.
Collapse
Affiliation(s)
- Shailee Jain
- Department of Computer Science, University of Texas at Austin, Austin, TX, USA
| | - Vy A. Vo
- Brain-Inspired Computing Lab, Intel Labs, Hillsboro, OR, USA
| | - Leila Wehbe
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Alexander G. Huth
- Department of Computer Science, University of Texas at Austin, Austin, TX, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
9
|
Manea AMG, Maisson DJN, Voloh B, Zilverstand A, Hayden B, Zimmermann J. Neural timescales reflect behavioral demands in freely moving rhesus macaques. Nat Commun 2024; 15:2151. [PMID: 38461167 PMCID: PMC10925022 DOI: 10.1038/s41467-024-46488-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 02/28/2024] [Indexed: 03/11/2024] Open
Abstract
Previous work demonstrated a highly reproducible cortical hierarchy of neural timescales at rest, with sensory areas displaying fast, and higher-order association areas displaying slower timescales. The question arises how such stable hierarchies give rise to adaptive behavior that requires flexible adjustment of temporal coding and integration demands. Potentially, this lack of variability in the hierarchical organization of neural timescales could reflect the structure of the laboratory contexts. We posit that unconstrained paradigms are ideal to test whether the dynamics of neural timescales reflect behavioral demands. Here we measured timescales of local field potential activity while male rhesus macaques foraged in an open space. We found a hierarchy of neural timescales that differs from previous work. Importantly, although the magnitude of neural timescales expanded with task engagement, the brain areas' relative position in the hierarchy was stable. Next, we demonstrated that the change in neural timescales is dynamic and contains functionally-relevant information, differentiating between similar events in terms of motor demands and associated reward. Finally, we demonstrated that brain areas are differentially affected by these behavioral demands. These results demonstrate that while the space of neural timescales is anatomically constrained, the observed hierarchical organization and magnitude is dependent on behavioral demands.
Collapse
Affiliation(s)
- Ana M G Manea
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA.
| | - David J-N Maisson
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - Benjamin Voloh
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - Anna Zilverstand
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Benjamin Hayden
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
10
|
Ichikawa K, Kaneko K. Bayesian inference is facilitated by modular neural networks with different time scales. PLoS Comput Biol 2024; 20:e1011897. [PMID: 38478575 PMCID: PMC10962854 DOI: 10.1371/journal.pcbi.1011897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 03/25/2024] [Accepted: 02/06/2024] [Indexed: 03/26/2024] Open
Abstract
Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference by the brain, the prior distribution must be acquired and represented by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. Our findings reveal that networks with modular structures, composed of fast and slow modules, are adept at representing this prior distribution, enabling more accurate Bayesian inferences. Specifically, the modular network that consists of a main module connected with input and output layers and a sub-module with slower neural activity connected only with the main module outperformed networks with uniform time scales. Prior information was represented specifically by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the neural network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure and the division of roles in which prior knowledge is selectively represented in the slow sub-modules spontaneously emerged. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales.
Collapse
Affiliation(s)
- Kohei Ichikawa
- Department of Basic Science, Graduate School of Arts and Sciences, University of Tokyo, Meguro-ku, Tokyo, Japan
| | - Kunihiko Kaneko
- Research Center for Complex Systems Biology, University of Tokyo, Bunkyo-ku, Tokyo, Japan
- The Niels Bohr Institute, University of Copenhagen, Blegdamsvej, Copenhagen, Denmark
| |
Collapse
|
11
|
Karimi-Rouzbahani H. Evidence for Multiscale Multiplexed Representation of Visual Features in EEG. Neural Comput 2024; 36:412-436. [PMID: 38363657 DOI: 10.1162/neco_a_01649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 12/01/2023] [Indexed: 02/18/2024]
Abstract
Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.
Collapse
Affiliation(s)
- Hamid Karimi-Rouzbahani
- Neurosciences Centre, Mater Hospital, Brisbane 4101, Australia
- Queensland Brain Institute, University of Queensland, Brisbane 4067, Australia
- Mater Research Institute, University of Queensland, Brisbane 4101, Australia
| |
Collapse
|
12
|
Lurie DJ, Pappas I, D'Esposito M. Cortical timescales and the modular organization of structural and functional brain networks. Hum Brain Mapp 2024; 45:e26587. [PMID: 38339903 PMCID: PMC10823764 DOI: 10.1002/hbm.26587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 12/01/2023] [Accepted: 12/21/2023] [Indexed: 02/12/2024] Open
Abstract
Recent years have seen growing interest in characterizing the properties of regional brain dynamics and their relationship to other features of brain structure and function. In particular, multiple studies have observed regional differences in the "timescale" over which activity fluctuates during periods of quiet rest. In the cerebral cortex, these timescales have been associated with both local circuit properties as well as patterns of inter-regional connectivity, including the extent to which each region exhibits widespread connectivity to other brain areas. In the current study, we build on prior observations of an association between connectivity and dynamics in the cerebral cortex by investigating the relationship between BOLD fMRI timescales and the modular organization of structural and functional brain networks. We characterize network community structure across multiple scales and find that longer timescales are associated with greater within-community functional connectivity and diverse structural connectivity. We also replicate prior observations of a positive correlation between timescales and structural connectivity degree. Finally, we find evidence for preferential functional connectivity between cortical areas with similar timescales. We replicate these findings in an independent dataset. These results contribute to our understanding of functional brain organization and structure-function relationships in the human brain, and support the notion that regional differences in cortical dynamics may in part reflect the topological role of each region within macroscale brain networks.
Collapse
Affiliation(s)
- Daniel J. Lurie
- Department of PsychologyUniversity of CaliforniaBerkeleyCaliforniaUSA
- Department of Biomedical Informatics University of Pittsburgh School of Medicine PittsburghPennsylvaniaUSA
| | - Ioannis Pappas
- Department of Neurology, Keck School of MedicineUniversity of Southern CaliforniaLos AngelesCaliforniaUSA
| | - Mark D'Esposito
- Department of Psychology and Helen Wills Neuroscience InstituteUniversity of CaliforniaBerkeleyCaliforniaUSA
| |
Collapse
|
13
|
Hoffman SJ, Dotson NM, Lima V, Gray CM. The Primate Cortical LFP Exhibits Multiple Spectral and Temporal Gradients and Widespread Task-Dependence During Visual Short-Term Memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.29.577843. [PMID: 38352585 PMCID: PMC10862751 DOI: 10.1101/2024.01.29.577843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
Although cognitive functions are hypothesized to be mediated by synchronous neuronal interactions in multiple frequency bands among widely distributed cortical areas, we still lack a basic understanding of the distribution and task dependence of oscillatory activity across the cortical map. Here, we ask how the spectral and temporal properties of the local field potential (LFP) vary across the primate cerebral cortex, and how they are modulated during visual short-term memory. We measured the LFP from 55 cortical areas in two macaque monkeys while they performed a visual delayed match to sample task. Analysis of peak frequencies in the LFP power spectra reveals multiple discrete frequency bands between 3-80 Hz that differ between the two monkeys. The LFP power in each band, as well as the Sample Entropy, a measure of signal complexity, display distinct spatial gradients across the cortex, some of which correlate with reported spine counts in layer 3 pyramidal neurons. Cortical areas can be robustly decoded using a small number of spectral and temporal parameters, and significant task dependent increases and decreases in spectral power occur in all cortical areas. These findings reveal pronounced, widespread and spatially organized gradients in the spectral and temporal activity of cortical areas. Task-dependent changes in cortical activity are globally distributed, even for a simple cognitive task.
Collapse
Affiliation(s)
- Steven J Hoffman
- Department of Cell Biology and Neuroscience, Montana State University, Bozeman, MT 59717, USA
- Current address: Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Nicholas M Dotson
- Department of Cell Biology and Neuroscience, Montana State University, Bozeman, MT 59717, USA
- Current address: Salk Institute for Biological Studies, La Jolla, CA 92037, USA
| | - Vinicius Lima
- Aix Marseille Université, INSERM, Systems Neuroscience Institute, Marseille, France
| | - Charles M Gray
- Department of Cell Biology and Neuroscience, Montana State University, Bozeman, MT 59717, USA
| |
Collapse
|
14
|
Zheng H, Zheng Z, Hu R, Xiao B, Wu Y, Yu F, Liu X, Li G, Deng L. Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics. Nat Commun 2024; 15:277. [PMID: 38177124 PMCID: PMC10766638 DOI: 10.1038/s41467-023-44614-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 12/21/2023] [Indexed: 01/06/2024] Open
Abstract
It is widely believed the brain-inspired spiking neural networks have the capability of processing temporal information owing to their dynamic attributes. However, how to understand what kind of mechanisms contributing to the learning ability and exploit the rich dynamic properties of spiking neural networks to satisfactorily solve complex temporal computing tasks in practice still remains to be explored. In this article, we identify the importance of capturing the multi-timescale components, based on which a multi-compartment spiking neural model with temporal dendritic heterogeneity, is proposed. The model enables multi-timescale dynamics by automatically learning heterogeneous timing factors on different dendritic branches. Two breakthroughs are made through extensive experiments: the working mechanism of the proposed model is revealed via an elaborated temporal spiking XOR problem to analyze the temporal feature integration at different levels; comprehensive performance benefits of the model over ordinary spiking neural networks are achieved on several temporal computing benchmarks for speech recognition, visual recognition, electroencephalogram signal recognition, and robot place recognition, which shows the best-reported accuracy and model compactness, promising robustness and generalization, and high execution efficiency on neuromorphic hardware. This work moves neuromorphic computing a significant step toward real-world applications by appropriately exploiting biological observations.
Collapse
Affiliation(s)
- Hanle Zheng
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Zhong Zheng
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Rui Hu
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Bo Xiao
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Yujie Wu
- Institute of Theoretical Computer Science, Graz University of Technology, Graz, Austria
| | - Fangwen Yu
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Xue Liu
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Guoqi Li
- Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Lei Deng
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China.
| |
Collapse
|
15
|
Klar P, Çatal Y, Fogel S, Jocham G, Langner R, Owen AM, Northoff G. Auditory inputs modulate intrinsic neuronal timescales during sleep. Commun Biol 2023; 6:1180. [PMID: 37985812 PMCID: PMC10661171 DOI: 10.1038/s42003-023-05566-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 11/09/2023] [Indexed: 11/22/2023] Open
Abstract
Functional magnetic resonance imaging (fMRI) studies have demonstrated that intrinsic neuronal timescales (INT) undergo modulation by external stimulation during consciousness. It remains unclear if INT keep the ability for significant stimulus-induced modulation during primary unconscious states, such as sleep. This fMRI analysis addresses this question via a dataset that comprises an awake resting-state plus rest and stimulus states during sleep. We analyzed INT measured via temporal autocorrelation supported by median frequency (MF) in the frequency-domain. Our results were replicated using a biophysical model. There were two main findings: (1) INT prolonged while MF decreased from the awake resting-state to the N2 resting-state, and (2) INT shortened while MF increased during the auditory stimulus in sleep. The biophysical model supported these results by demonstrating prolonged INT in slowed neuronal populations that simulate the sleep resting-state compared to an awake state. Conversely, under sine wave input simulating the stimulus state during sleep, the model's regions yielded shortened INT that returned to the awake resting-state level. Our results highlight that INT preserve reactivity to stimuli in states of unconsciousness like sleep, enhancing our understanding of unconscious brain dynamics and their reactivity to stimuli.
Collapse
Affiliation(s)
- Philipp Klar
- Faculty of Mathematics and Natural Sciences, Institute of Experimental Psychology, Heinrich Heine University of Düsseldorf, Düsseldorf, Germany.
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.
| | - Yasir Çatal
- The Royal's Institute of Mental Health Research & University of Ottawa, Brain and Mind Research Institute, Centre for Neural Dynamics, Faculty of Medicine, University of Ottawa, 145 Carling Avenue, Room 6435, Ottawa, ON, K1Z 7K4, Canada
| | - Stuart Fogel
- Sleep Unit, University of Ottawa Institute of Mental Health Research at The Royal, K1Z 7K4, Ottawa, ON, Canada
| | - Gerhard Jocham
- Faculty of Mathematics and Natural Sciences, Institute of Experimental Psychology, Heinrich Heine University of Düsseldorf, Düsseldorf, Germany
| | - Robert Langner
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Adrian M Owen
- Departments of Physiology and Pharmacology and Psychology, Western University, London, ON, N6A 5B7, Canada
| | - Georg Northoff
- The Royal's Institute of Mental Health Research & University of Ottawa, Brain and Mind Research Institute, Centre for Neural Dynamics, Faculty of Medicine, University of Ottawa, 145 Carling Avenue, Room 6435, Ottawa, ON, K1Z 7K4, Canada
- Centre for Cognition and Brain Disorders, Hangzhou Normal University, Tianmu Road 305, Hangzhou, Zhejiang Province, 310013, China
| |
Collapse
|
16
|
Ruesseler M, Weber LA, Marshall TR, O'Reilly J, Hunt LT. Quantifying decision-making in dynamic, continuously evolving environments. eLife 2023; 12:e82823. [PMID: 37883173 PMCID: PMC10602589 DOI: 10.7554/elife.82823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 10/13/2023] [Indexed: 10/27/2023] Open
Abstract
During perceptual decision-making tasks, centroparietal electroencephalographic (EEG) potentials report an evidence accumulation-to-bound process that is time locked to trial onset. However, decisions in real-world environments are rarely confined to discrete trials; they instead unfold continuously, with accumulation of time-varying evidence being recency-weighted towards its immediate past. The neural mechanisms supporting recency-weighted continuous decision-making remain unclear. Here, we use a novel continuous task design to study how the centroparietal positivity (CPP) adapts to different environments that place different constraints on evidence accumulation. We show that adaptations in evidence weighting to these different environments are reflected in changes in the CPP. The CPP becomes more sensitive to fluctuations in sensory evidence when large shifts in evidence are less frequent, and the potential is primarily sensitive to fluctuations in decision-relevant (not decision-irrelevant) sensory input. A complementary triphasic component over occipito-parietal cortex encodes the sum of recently accumulated sensory evidence, and its magnitude covaries with parameters describing how different individuals integrate sensory evidence over time. A computational model based on leaky evidence accumulation suggests that these findings can be accounted for by a shift in decision threshold between different environments, which is also reflected in the magnitude of pre-decision EEG activity. Our findings reveal how adaptations in EEG responses reflect flexibility in evidence accumulation to the statistics of dynamic sensory environments.
Collapse
Affiliation(s)
- Maria Ruesseler
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford Centre for Human Brain Activity (OHBA) University Department of Psychiatry Warneford HospitalOxfordUnited Kingdom
| | - Lilian Aline Weber
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford Centre for Human Brain Activity (OHBA) University Department of Psychiatry Warneford HospitalOxfordUnited Kingdom
- Department of Experimental Psychology, University of Oxford, Anna Watts Building, Radcliffe Observatory QuarterOxfordUnited Kingdom
| | - Tom Rhys Marshall
- Department of Experimental Psychology, University of Oxford, Anna Watts Building, Radcliffe Observatory QuarterOxfordUnited Kingdom
- Centre for Human Brain Health, University of BirminghamBirminghamUnited Kingdom
| | - Jill O'Reilly
- Department of Experimental Psychology, University of Oxford, Anna Watts Building, Radcliffe Observatory QuarterOxfordUnited Kingdom
| | - Laurence Tudor Hunt
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford Centre for Human Brain Activity (OHBA) University Department of Psychiatry Warneford HospitalOxfordUnited Kingdom
- Department of Experimental Psychology, University of Oxford, Anna Watts Building, Radcliffe Observatory QuarterOxfordUnited Kingdom
| |
Collapse
|
17
|
Zhang A, Wengler K, Zhu X, Horga G, Goldberg TE, Lee S. Altered hierarchical gradients of intrinsic neural timescales in mild cognitive impairment and Alzheimer's disease. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.26.559549. [PMID: 37808862 PMCID: PMC10557723 DOI: 10.1101/2023.09.26.559549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/10/2023]
Abstract
Alzheimer's disease (AD) is a devastating neurodegenerative disease that affects millions of older adults in the US and worldwide. Resting-state functional magnetic resonance imaging (rs-fMRI) has become a widely used neuroimaging tool to study neurophysiology in AD and its prodromal condition, mild cognitive impairment (MCI). The intrinsic neural timescale (INT), which can be estimated through the magnitude of the autocorrelation of intrinsic neural signals using rs-fMRI, is thought to quantify the duration that neural information is stored in a local cortical circuit. The heterogeneity of the timescales is considered to be a basis of the functional hierarchy in the brain. In addition, INT captures an aspect of circuit dynamics relevant to excitation/inhibition (E/I) balance, which is thought to be broadly relevant for cognitive functions. Here we examined its relevance to AD. We used rs-fMRI data of 904 individuals from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The subjects were divided into 4 groups based on their baseline and end-visit clinical status, which were cognitively normal (CN), stable MCI, Converter, and AD groups. Linear mixed effect model and pairwise comparison were implemented to investigate the large-scale hierarchical organization and local differences. We observed high similarities between AD and Converter groups. Specifically, among the eight identified ROIs with distinct INT alterations in AD, three ROIs (inferior temporal, caudate, pallidum areas) exhibit stable and significant alteration in AD converter. In addition, distinct INT related pathological changes in stable MCI and AD/Converter were found. For AD and Converter groups, neural information is stored for a longer time in lower hierarchical order areas, while higher levels of hierarchy seem to be preferentially impaired in stable MCI leading to a less pronounced hierarchical gradient effect. These results inform that the INT holds great potential as an additional measure for AD prediction, a stable biomarker for clinical diagnosis and an important therapeutic target in AD.
Collapse
|
18
|
Northoff G, Klar P, Bein M, Safron A. As without, so within: how the brain's temporo-spatial alignment to the environment shapes consciousness. Interface Focus 2023; 13:20220076. [PMID: 37065263 PMCID: PMC10102730 DOI: 10.1098/rsfs.2022.0076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 03/02/2023] [Indexed: 04/18/2023] Open
Abstract
Consciousness is constituted by a structure that includes contents as foreground and the environment as background. This structural relation between the experiential foreground and background presupposes a relationship between the brain and the environment, often neglected in theories of consciousness. The temporo-spatial theory of consciousness addresses the brain-environment relation by a concept labelled 'temporo-spatial alignment'. Briefly, temporo-spatial alignment refers to the brain's neuronal activity's interaction with and adaption to interoceptive bodily and exteroceptive environmental stimuli, including their symmetry as key for consciousness. Combining theory and empirical data, this article attempts to demonstrate the yet unclear neuro-phenomenal mechanisms of temporo-spatial alignment. First, we suggest three neuronal layers of the brain's temporo-spatial alignment to the environment. These neuronal layers span across a continuum from longer to shorter timescales. (i) The background layer comprises longer and more powerful timescales mediating topographic-dynamic similarities between different subjects' brains. (ii) The intermediate layer includes a mixture of medium-scaled timescales allowing for stochastic matching between environmental inputs and neuronal activity through the brain's intrinsic neuronal timescales and temporal receptive windows. (iii) The foreground layer comprises shorter and less powerful timescales for neuronal entrainment of stimuli temporal onset through neuronal phase shifting and resetting. Second, we elaborate on how the three neuronal layers of temporo-spatial alignment correspond to their respective phenomenal layers of consciousness. (i) The inter-subjectively shared contextual background of consciousness. (ii) An intermediate layer that mediates the relationship between different contents of consciousness. (iii) A foreground layer that includes specific fast-changing contents of consciousness. Overall, temporo-spatial alignment may provide a mechanism whose different neuronal layers modulate corresponding phenomenal layers of consciousness. Temporo-spatial alignment can provide a bridging principle for linking physical-energetic (free energy), dynamic (symmetry), neuronal (three layers of distinct time-space scales) and phenomenal (form featured by background-intermediate-foreground) mechanisms of consciousness.
Collapse
Affiliation(s)
- Georg Northoff
- Mind, Brain Imaging and Neuroethics Research Unit, TheRoyal's Institute of Mental Health Research, University of Ottawa, Ottawa, ON, Canada K1Z 7K4
- Mental Health Centre, Zhejiang University School of Medicine, Hangzhou 310053, People's Republic of China
- Centre for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou 310053, People's Republic of China
| | - Philipp Klar
- Medical Faculty, C. & O. Vogt-Institute for Brain Research, Heinrich Heine University of Düsseldorf, 40225 Düsseldorf, Germany
| | - Magnus Bein
- Department of Biology and Department of Psychiatry, McGill University, Quebec, Canada H3A 0G4
| | - Adam Safron
- Center for Psychedelic and Consciousness Research, Department of Psychiatry & Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
- Cognitive Science Program, Indiana University, Bloomington, IN 47405, USA
- Institute for Advanced Consciousness Studies, Santa Monica, CA 90403, USA
| |
Collapse
|
19
|
Ekelmans P, Kraynyukovas N, Tchumatchenko T. Targeting operational regimes of interest in recurrent neural networks. PLoS Comput Biol 2023; 19:e1011097. [PMID: 37186668 DOI: 10.1371/journal.pcbi.1011097] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 05/25/2023] [Accepted: 04/11/2023] [Indexed: 05/17/2023] Open
Abstract
Neural computations emerge from local recurrent neural circuits or computational units such as cortical columns that comprise hundreds to a few thousand neurons. Continuous progress in connectomics, electrophysiology, and calcium imaging require tractable spiking network models that can consistently incorporate new information about the network structure and reproduce the recorded neural activity features. However, for spiking networks, it is challenging to predict which connectivity configurations and neural properties can generate fundamental operational states and specific experimentally reported nonlinear cortical computations. Theoretical descriptions for the computational state of cortical spiking circuits are diverse, including the balanced state where excitatory and inhibitory inputs balance almost perfectly or the inhibition stabilized state (ISN) where the excitatory part of the circuit is unstable. It remains an open question whether these states can co-exist with experimentally reported nonlinear computations and whether they can be recovered in biologically realistic implementations of spiking networks. Here, we show how to identify spiking network connectivity patterns underlying diverse nonlinear computations such as XOR, bistability, inhibitory stabilization, supersaturation, and persistent activity. We establish a mapping between the stabilized supralinear network (SSN) and spiking activity which allows us to pinpoint the location in parameter space where these activity regimes occur. Notably, we find that biologically-sized spiking networks can have irregular asynchronous activity that does not require strong excitation-inhibition balance or large feedforward input and we show that the dynamic firing rate trajectories in spiking networks can be precisely targeted without error-driven training algorithms.
Collapse
Affiliation(s)
- Pierre Ekelmans
- Theory of Neural Dynamics group, Max Planck Institute for Brain Research, Frankfurt am Main, Germany
- Frankfurt Institute for Advanced Studies, Frankfurt am Main, Germany
| | - Nataliya Kraynyukovas
- Theory of Neural Dynamics group, Max Planck Institute for Brain Research, Frankfurt am Main, Germany
- Institute of Experimental Epileptology and Cognition Research, Life and Brain Center, Universitätsklinikum Bonn, Bonn, Germany
| | - Tatjana Tchumatchenko
- Theory of Neural Dynamics group, Max Planck Institute for Brain Research, Frankfurt am Main, Germany
- Institute of Experimental Epileptology and Cognition Research, Life and Brain Center, Universitätsklinikum Bonn, Bonn, Germany
- Institute of physiological chemistry, Medical center of the Johannes Gutenberg-University Mainz, Mainz, Germany
| |
Collapse
|
20
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
21
|
Vinck M, Uran C, Spyropoulos G, Onorato I, Broggini AC, Schneider M, Canales-Johnson A. Principles of large-scale neural interactions. Neuron 2023; 111:987-1002. [PMID: 37023720 DOI: 10.1016/j.neuron.2023.03.015] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/27/2023] [Accepted: 03/09/2023] [Indexed: 04/08/2023]
Abstract
What mechanisms underlie flexible inter-areal communication in the cortex? We consider four mechanisms for temporal coordination and their contributions to communication: (1) Oscillatory synchronization (communication-through-coherence); (2) communication-through-resonance; (3) non-linear integration; and (4) linear signal transmission (coherence-through-communication). We discuss major challenges for communication-through-coherence based on layer- and cell-type-specific analyses of spike phase-locking, heterogeneity of dynamics across networks and states, and computational models for selective communication. We argue that resonance and non-linear integration are viable alternative mechanisms that facilitate computation and selective communication in recurrent networks. Finally, we consider communication in relation to cortical hierarchy and critically examine the hypothesis that feedforward and feedback communication use fast (gamma) and slow (alpha/beta) frequencies, respectively. Instead, we propose that feedforward propagation of prediction errors relies on the non-linear amplification of aperiodic transients, whereas gamma and beta rhythms represent rhythmic equilibrium states that facilitate sustained and efficient information encoding and amplification of short-range feedback via resonance.
Collapse
Affiliation(s)
- Martin Vinck
- Ernst Struengmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands.
| | - Cem Uran
- Ernst Struengmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands
| | - Georgios Spyropoulos
- Ernst Struengmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany
| | - Irene Onorato
- Ernst Struengmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands
| | - Ana Clara Broggini
- Ernst Struengmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany
| | - Marius Schneider
- Ernst Struengmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands
| | - Andres Canales-Johnson
- Department of Psychology, University of Cambridge, CB2 3EB Cambridge, UK; Centro de Investigacion en Neuropsicologia y Neurociencias Cognitivas, Facultad de Ciencias de la Salud, Universidad Catolica del Maule, 3480122 Talca, Chile.
| |
Collapse
|
22
|
Zeraati R, Shi YL, Steinmetz NA, Gieselmann MA, Thiele A, Moore T, Levina A, Engel TA. Intrinsic timescales in the visual cortex change with selective attention and reflect spatial connectivity. Nat Commun 2023; 14:1858. [PMID: 37012299 PMCID: PMC10070246 DOI: 10.1038/s41467-023-37613-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 03/24/2023] [Indexed: 04/05/2023] Open
Abstract
Intrinsic timescales characterize dynamics of endogenous fluctuations in neural activity. Variation of intrinsic timescales across the neocortex reflects functional specialization of cortical areas, but less is known about how intrinsic timescales change during cognitive tasks. We measured intrinsic timescales of local spiking activity within columns of area V4 in male monkeys performing spatial attention tasks. The ongoing spiking activity unfolded across at least two distinct timescales, fast and slow. The slow timescale increased when monkeys attended to the receptive fields location and correlated with reaction times. By evaluating predictions of several network models, we found that spatiotemporal correlations in V4 activity were best explained by the model in which multiple timescales arise from recurrent interactions shaped by spatially arranged connectivity, and attentional modulation of timescales results from an increase in the efficacy of recurrent interactions. Our results suggest that multiple timescales may arise from the spatial connectivity in the visual cortex and flexibly change with the cognitive state due to dynamic effective interactions between neurons.
Collapse
Affiliation(s)
- Roxana Zeraati
- International Max Planck Research School for the Mechanisms of Mental Function and Dysfunction, University of Tübingen, Tübingen, Germany
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Yan-Liang Shi
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | | | - Marc A Gieselmann
- Biosciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Alexander Thiele
- Biosciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Tirin Moore
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University, Stanford, CA, USA
| | - Anna Levina
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany.
- Department of Computer Science, University of Tübingen, Tübingen, Germany.
- Bernstein Center for Computational Neuroscience Tübingen, Tübingen, Germany.
| | - Tatiana A Engel
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA.
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
| |
Collapse
|
23
|
Lindeberg T. A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time. BIOLOGICAL CYBERNETICS 2023; 117:21-59. [PMID: 36689001 PMCID: PMC10160219 DOI: 10.1007/s00422-022-00953-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 11/21/2022] [Indexed: 05/05/2023]
Abstract
This article presents an overview of a theory for performing temporal smoothing on temporal signals in such a way that: (i) temporally smoothed signals at coarser temporal scales are guaranteed to constitute simplifications of corresponding temporally smoothed signals at any finer temporal scale (including the original signal) and (ii) the temporal smoothing process is both time-causal and time-recursive, in the sense that it does not require access to future information and can be performed with no other temporal memory buffer of the past than the resulting smoothed temporal scale-space representations themselves. For specific subsets of parameter settings for the classes of linear and shift-invariant temporal smoothing operators that obey this property, it is shown how temporal scale covariance can be additionally obtained, guaranteeing that if the temporal input signal is rescaled by a uniform temporal scaling factor, then also the resulting temporal scale-space representations of the rescaled temporal signal will constitute mere rescalings of the temporal scale-space representations of the original input signal, complemented by a shift along the temporal scale dimension. The resulting time-causal limit kernel that obeys this property constitutes a canonical temporal kernel for processing temporal signals in real-time scenarios when the regular Gaussian kernel cannot be used, because of its non-causal access to information from the future, and we cannot additionally require the temporal smoothing process to comprise a complementary memory of the past beyond the information contained in the temporal smoothing process itself, which in this way also serves as a multi-scale temporal memory of the past. We describe how the time-causal limit kernel relates to previously used temporal models, such as Koenderink's scale-time kernels and the ex-Gaussian kernel. We do also give an overview of how the time-causal limit kernel can be used for modelling the temporal processing in models for spatio-temporal and spectro-temporal receptive fields, and how it more generally has a high potential for modelling neural temporal response functions in a purely time-causal and time-recursive way, that can also handle phenomena at multiple temporal scales in a theoretically well-founded manner. We detail how this theory can be efficiently implemented for discrete data, in terms of a set of recursive filters coupled in cascade. Hence, the theory is generally applicable for both: (i) modelling continuous temporal phenomena over multiple temporal scales and (ii) digital processing of measured temporal signals in real time. We conclude by stating implications of the theory for modelling temporal phenomena in biological, perceptual, neural and memory processes by mathematical models, as well as implications regarding the philosophy of time and perceptual agents. Specifically, we propose that for A-type theories of time, as well as for perceptual agents, the notion of a non-infinitesimal inner temporal scale of the temporal receptive fields has to be included in representations of the present, where the inherent nonzero temporal delay of such time-causal receptive fields implies a need for incorporating predictions from the actual time-delayed present in the layers of a perceptual hierarchy, to make it possible for a representation of the perceptual present to constitute a representation of the environment with timing properties closer to the actual present.
Collapse
Affiliation(s)
- Tony Lindeberg
- Computational Brain Science Lab, Division of Computational Science and Technology, KTH Royal Institute of Technology, 100 44, Stockholm, Sweden.
| |
Collapse
|
24
|
Manea AMG, Zilverstand A, Hayden B, Zimmermann J. Neural timescales reflect behavioral demands in freely moving rhesus macaques. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.27.534470. [PMID: 37034608 PMCID: PMC10081241 DOI: 10.1101/2023.03.27.534470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/22/2023]
Abstract
Previous work has demonstrated remarkably reproducible and consistent hierarchies of neural timescales across cortical areas at rest. The question arises how such stable hierarchies give rise to adaptive behavior that requires flexible adjustment of temporal coding and integration demands. Potentially, this previously found lack of variability in the hierarchical organization of neural timescales could be a reflection of the structure of the laboratory contexts in which they were measured. Indeed, computational work demonstrates the existence of multiple temporal hierarchies within the same anatomical network when the input structure is altered. We posit that unconstrained behavioral environments where relatively little temporal demands are imposed from the experimenter are an ideal test bed to address the question of whether the hierarchical organization and the magnitude of neural timescales reflect ongoing behavioral demands. To tackle this question, we measured timescales of local field potential activity while rhesus macaques were foraging freely in a large open space. We find a hierarchy of neural timescales that is unique to this foraging environment. Importantly, although the magnitude of neural timescales generally expanded with task engagement, the brain areas' relative position in the hierarchy was stable across the recording sessions. Notably, the magnitude of neural timescales monotonically expanded with task engagement across a relatively long temporal scale spanning the duration of the recording session. Over shorter temporal scales, the magnitude of neural timescales changed dynamically around foraging events. Moreover, the change in the magnitude of neural timescales contained functionally relevant information, differentiating between seemingly similar events in terms of motor demands and associated reward. That is, the patterns of change were associated with the cognitive and behavioral meaning of these events. Finally, we demonstrated that brain areas were differentially affected by these behavioral demands - i.e., the expansion of neural timescales was not the same across all areas. Together, these results demonstrate that the observed hierarchy of neural timescales is context-dependent and that changes in the magnitude of neural timescales are closely related to overall task engagement and behavioral demands.
Collapse
Affiliation(s)
- Ana M G Manea
- Department of Neuroscience, University of Minnesota, Minneapolis MN
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis MN
| | - Anna Zilverstand
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis MN
| | - Benjamin Hayden
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis MN
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis MN
| |
Collapse
|
25
|
Boucher-Routhier M, Thivierge JP. A deep generative adversarial network capturing complex spiral waves in disinhibited circuits of the cerebral cortex. BMC Neurosci 2023; 24:22. [PMID: 36964493 PMCID: PMC10039524 DOI: 10.1186/s12868-023-00792-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 03/17/2023] [Indexed: 03/26/2023] Open
Abstract
BACKGROUND In the cerebral cortex, disinhibited activity is characterized by propagating waves that spread across neural tissue. In this pathological state, a widely reported form of activity are spiral waves that travel in a circular pattern around a fixed spatial locus termed the center of mass. Spiral waves exhibit stereotypical activity and involve broad patterns of co-fluctuations, suggesting that they may be of lower complexity than healthy activity. RESULTS To evaluate this hypothesis, we performed dense multi-electrode recordings of cortical networks where disinhibition was induced by perfusing a pro-epileptiform solution containing 4-Aminopyridine as well as increased potassium and decreased magnesium. Spiral waves were identified based on a spatially delimited center of mass and a broad distribution of instantaneous phases across electrodes. Individual waves were decomposed into "snapshots" that captured instantaneous neural activation across the entire network. The complexity of these snapshots was examined using a measure termed the participation ratio. Contrary to our expectations, an eigenspectrum analysis of these snapshots revealed a broad distribution of eigenvalues and an increase in complexity compared to baseline networks. A deep generative adversarial network was trained to generate novel exemplars of snapshots that closely captured cortical spiral waves. These synthetic waves replicated key features of experimental data including a tight center of mass, a broad eigenvalue distribution, spatially-dependent correlations, and a high complexity. By adjusting the input to the model, new samples were generated that deviated in systematic ways from the experimental data, thus allowing the exploration of a broad range of states from healthy to pathologically disinhibited neural networks. CONCLUSIONS Together, results show that the complexity of population activity serves as a marker along a continuum from healthy to disinhibited brain states. The proposed generative adversarial network opens avenues for replicating the dynamics of cortical seizures and accelerating the design of optimal neurostimulation aimed at suppressing pathological brain activity.
Collapse
Affiliation(s)
- Megan Boucher-Routhier
- School of Psychology, University of Ottawa, 156 Jean-Jacques Lussier, Ottawa, ON, K1N 6N5, Canada
| | - Jean-Philippe Thivierge
- School of Psychology, University of Ottawa, 156 Jean-Jacques Lussier, Ottawa, ON, K1N 6N5, Canada.
- University of Ottawa Brain and Mind Research Institute, 451 Smyth Rd., Ottawa, ON, K1H 8M5, Canada.
| |
Collapse
|
26
|
Wood JL, Nee DE. Cingulo-Opercular Subnetworks Motivate Frontoparietal Subnetworks during Distinct Cognitive Control Demands. J Neurosci 2023; 43:1225-1237. [PMID: 36609452 PMCID: PMC9962782 DOI: 10.1523/jneurosci.1314-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 12/20/2022] [Accepted: 12/23/2022] [Indexed: 01/09/2023] Open
Abstract
Cognitive control is the ability to flexibly adapt behavior in a goal-directed manner when habit will not suffice. Control can be separated into distinct forms based on the timescale (present-future) and/or medium (external-internal) over which it operates. Both the frontoparietal network (FPN) and cingulo-opercular network (CON) are engaged during control, but their respective functions and interactions remain unclear. Here, we examined activations in the FPN and CON with fMRI in humans (male and female) during a task that manipulated control across timescales/mediums. The findings show that the CON can be distinguished into the following two separable subnetworks mirroring the FPN: a rostral/ventral subnetwork sensitive to future-oriented control involving internal representations, and a caudal/dorsal subnetwork sensitive to present-oriented control involving external representations. Relative to the FPN, activation in the CON was particularly pronounced during transitions into and out of particular control demands. Moreover, the relationship of each CON subnetwork to behavior was mediated by a respective FPN subnetwork. Such data are consistent with the idea that the CON motivates the FPN, which, in turn, drives behavior. Within the CON, the dorsomedial prefrontal cortex (dmPFC) mediated the relationship between the anterior insula and FPN, suggesting that the dmPFC acts as the crux that links the CON to the FPN. Collectively, these data indicate that parallel CON-FPN subnetworks mediate controlled behaviors at distinct timescales/mediums.SIGNIFICANCE STATEMENT The cingulo-opercular network (CON) and frontoparietal network (FPN) are engaged in diverse, demanding tasks. A functional model describing how areas within these networks can be distinguished, and also interact, would facilitate understanding of how the brain adapts to demanding situations. During a comprehensive control task, fMRI data revealed that the FPN and CON can be fractionated into subnetworks based on control demands that are either externally oriented for use in the present, or control demands that operate internally to guide future behavior. Moreover, we found evidence for a chain of relationships from the CON to FPN to behavior consistent with the idea that the CON drives the FPN to adapt behavior.
Collapse
Affiliation(s)
- Jessica L Wood
- Department of Psychology, Florida State University, Tallahassee, Florida 32306-4301
| | - Derek Evan Nee
- Department of Psychology, Florida State University, Tallahassee, Florida 32306-4301
| |
Collapse
|
27
|
Pinto L, Tank DW, Brody CD. Multiple timescales of sensory-evidence accumulation across the dorsal cortex. eLife 2022; 11:e70263. [PMID: 35708483 PMCID: PMC9203055 DOI: 10.7554/elife.70263] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 05/27/2022] [Indexed: 11/13/2022] Open
Abstract
Cortical areas seem to form a hierarchy of intrinsic timescales, but the relevance of this organization for cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of all tested areas affected the evidence-accumulation computation. Specifically, we observed distinct changes in the weighting of sensory evidence occurring during and before silencing, such that frontal inactivations led to stronger deficits on long timescales than posterior cortical ones. Inactivation of a subset of frontal areas also led to moderate effects on behavioral processes beyond evidence accumulation. Moreover, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows. Our findings suggest that the intrinsic timescale hierarchy of distributed cortical areas is an important component of evidence-accumulation mechanisms.
Collapse
Affiliation(s)
- Lucas Pinto
- Department of Neuroscience, Northwestern UniversityChicagoUnited States
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| | - David W Tank
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| | - Carlos D Brody
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| |
Collapse
|
28
|
Manea AMG, Zilverstand A, Ugurbil K, Heilbronner SR, Zimmermann J. Intrinsic timescales as an organizational principle of neural processing across the whole rhesus macaque brain. eLife 2022; 11:e75540. [PMID: 35234612 PMCID: PMC8923667 DOI: 10.7554/elife.75540] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Accepted: 02/28/2022] [Indexed: 11/13/2022] Open
Abstract
Hierarchical temporal dynamics are a fundamental computational property of the brain; however, there are no whole brain, noninvasive investigations into timescales of neural processing in animal models. To that end, we used the spatial resolution and sensitivity of ultrahigh field functional magnetic resonance imaging (fMRI) performed at 10.5 T to probe timescales across the whole macaque brain. We uncovered within-species consistency between timescales estimated from fMRI and electrophysiology. Crucially, we extended existing electrophysiological hierarchies to whole-brain topographies. Our results validate the complementary use of hemodynamic and electrophysiological intrinsic timescales, establishing a basis for future translational work. Further, with these results in hand, we were able to show that one facet of the high-dimensional functional connectivity (FC) topography of any region in the brain is closely related to hierarchical temporal dynamics. We demonstrated that intrinsic timescales are organized along spatial gradients that closely match FC gradient topographies across the whole brain. We conclude that intrinsic timescales are a unifying organizational principle of neural processing across the whole brain.
Collapse
Affiliation(s)
- Ana MG Manea
- Department of Neuroscience, University of MinnesotaMinneapolisUnited States
- Center for Magnetic Resonance Research, University of MinnesotaMinneapolisUnited States
| | - Anna Zilverstand
- Department of Psychiatry & Behavioral Sciences , University of MinnesotaMinneapolisUnited States
- Medical Discovery Team on Addiction, University of MinnesotaMinneapolisUnited States
| | - Kamil Ugurbil
- Center for Magnetic Resonance Research, University of MinnesotaMinneapolisUnited States
- Center for Neuroengineering, University of MinnesotaMinneapolisUnited States
- Department of Radiology, University of MinnesotaMinneapolisUnited States
| | - Sarah R Heilbronner
- Department of Neuroscience, University of MinnesotaMinneapolisUnited States
- Medical Discovery Team on Addiction, University of MinnesotaMinneapolisUnited States
- Center for Neuroengineering, University of MinnesotaMinneapolisUnited States
| | - Jan Zimmermann
- Department of Neuroscience, University of MinnesotaMinneapolisUnited States
- Center for Magnetic Resonance Research, University of MinnesotaMinneapolisUnited States
- Medical Discovery Team on Addiction, University of MinnesotaMinneapolisUnited States
- Center for Neuroengineering, University of MinnesotaMinneapolisUnited States
- Department of Biomedical Engineering, University of MinnesotaMinneapolisUnited States
| |
Collapse
|
29
|
Li S, Wang XJ. Hierarchical timescales in the neocortex: Mathematical mechanism and biological insights. Proc Natl Acad Sci U S A 2022; 119:e2110274119. [PMID: 35110401 PMCID: PMC8832993 DOI: 10.1073/pnas.2110274119] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 12/07/2021] [Indexed: 11/18/2022] Open
Abstract
A cardinal feature of the neocortex is the progressive increase of the spatial receptive fields along the cortical hierarchy. Recently, theoretical and experimental findings have shown that the temporal response windows also gradually enlarge, so that early sensory neural circuits operate on short timescales whereas higher-association areas are capable of integrating information over a long period of time. While an increased receptive field is accounted for by spatial summation of inputs from neurons in an upstream area, the emergence of timescale hierarchy cannot be readily explained, especially given the dense interareal cortical connectivity known in the modern connectome. To uncover the required neurobiological properties, we carried out a rigorous analysis of an anatomically based large-scale cortex model of macaque monkeys. Using a perturbation method, we show that the segregation of disparate timescales is defined in terms of the localization of eigenvectors of the connectivity matrix, which depends on three circuit properties: 1) a macroscopic gradient of synaptic excitation, 2) distinct electrophysiological properties between excitatory and inhibitory neuronal populations, and 3) a detailed balance between long-range excitatory inputs and local inhibitory inputs for each area-to-area pathway. Our work thus provides a quantitative understanding of the mechanism underlying the emergence of timescale hierarchy in large-scale primate cortical networks.
Collapse
Affiliation(s)
- Songting Li
- School of Mathematical Sciences, Shanghai Jiao Tong University, Shanghai 200240, China;
- Institute of Natural Sciences, Shanghai Jiao Tong University, Shanghai 200240, China
- Ministry of Education Key Laboratory of Scientific and Engineering Computing, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xiao-Jing Wang
- Center for Neural Science, New York University, New York, NY 10003
| |
Collapse
|
30
|
Cerebral cortical processing time is elongated in human brain evolution. Sci Rep 2022; 12:1103. [PMID: 35058509 PMCID: PMC8776799 DOI: 10.1038/s41598-022-05053-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 01/04/2022] [Indexed: 11/09/2022] Open
Abstract
An increase in number of neurons is presumed to underlie the enhancement of cognitive abilities in brain evolution. The evolution of human cognition is then expected to have accompanied a prolongation of net neural-processing time due to the accumulation of processing time of individual neurons over an expanded number of neurons. Here, we confirmed this prediction and quantified the amount of prolongation in vivo, using noninvasive measurements of brain responses to sounds in unanesthetized human and nonhuman primates. Latencies of the N1 component of auditory-evoked potentials recorded from the scalp were approximately 40, 50, 60, and 100 ms for the common marmoset, rhesus monkey, chimpanzee, and human, respectively. Importantly, the prominent increase in human N1 latency could not be explained by the physical lengthening of the auditory pathway, and therefore reflected an extended dwell time for auditory cortical processing. A longer time window for auditory cortical processing is advantageous for analyzing time-varying acoustic stimuli, such as those important for speech perception. A novel hypothesis concerning human brain evolution then emerges: the increase in cortical neuronal number widened the timescale of sensory cortical processing, the benefits of which outweighed the disadvantage of slow cognition and reaction.
Collapse
|
31
|
Wolff A, Berberian N, Golesorkhi M, Gomez-Pilar J, Zilio F, Northoff G. Intrinsic neural timescales: temporal integration and segregation. Trends Cogn Sci 2022; 26:159-173. [PMID: 34991988 DOI: 10.1016/j.tics.2021.11.007] [Citation(s) in RCA: 72] [Impact Index Per Article: 36.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 11/19/2021] [Accepted: 11/23/2021] [Indexed: 12/11/2022]
Abstract
We are continuously bombarded by external inputs of various timescales from the environment. How does the brain process this multitude of timescales? Recent resting state studies show a hierarchy of intrinsic neural timescales (INT) with a shorter duration in unimodal regions (e.g., visual cortex and auditory cortex) and a longer duration in transmodal regions (e.g., default mode network). This unimodal-transmodal hierarchy is present across acquisition modalities [electroencephalogram (EEG)/magnetoencephalogram (MEG) and fMRI] and can be found in different species and during a variety of different task states. Together, this suggests that the hierarchy of INT is central to the temporal integration (combining successive stimuli) and segregation (separating successive stimuli) of external inputs from the environment, leading to temporal segmentation and prediction in perception and cognition.
Collapse
Affiliation(s)
- Annemarie Wolff
- Mind, Brain Imaging, and Neuroethics Research Unit, Institute of Mental Health Research, The Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada
| | - Nareg Berberian
- Mind, Brain Imaging, and Neuroethics Research Unit, Institute of Mental Health Research, The Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada
| | - Mehrshad Golesorkhi
- Mind, Brain Imaging, and Neuroethics Research Unit, Institute of Mental Health Research, The Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada
| | - Javier Gomez-Pilar
- Biomedical Engineering Group, University of Valladolid, Paseo de Belén, 15, 47011 Valladolid, Spain; Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicia, (CIBER-BBN), Madrid, Spain
| | - Federico Zilio
- Department of Philosophy, Sociology, Education, and Applied Psychology, University of Padova, Padua, Italy
| | - Georg Northoff
- Mind, Brain Imaging, and Neuroethics Research Unit, Institute of Mental Health Research, The Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada; Centre for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou, China; Mental Health Centre, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China.
| |
Collapse
|
32
|
Timescales of Local and Cross-Area Interactions during Neuroprosthetic Learning. J Neurosci 2021; 41:10120-10129. [PMID: 34732522 DOI: 10.1523/jneurosci.1397-21.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Revised: 09/29/2021] [Accepted: 10/11/2021] [Indexed: 11/21/2022] Open
Abstract
How does the brain integrate signals with different timescales to drive purposeful actions? Brain-machine interfaces (BMIs) offer a powerful tool to causally test how distributed neural networks achieve specific neural patterns. During neuroprosthetic learning, actuator movements are causally linked to primary motor cortex (M1) neurons, i.e., "direct" neurons that project to the decoder and whose firing is required to successfully perform the task. However, it is unknown how such direct M1 neurons interact with both "indirect" local (in M1 but not part of the decoder) and across area neural populations (e.g., in premotor cortex/M2), all of which are embedded in complex biological recurrent networks. Here, we trained male rats to perform a M1-BMI task and simultaneously recorded the activity of indirect neurons in both M2 and M1. We found that both M2 and M1 indirect neuron populations could be used to predict the activity of the direct neurons (i.e., "BMI-potent activity"). Interestingly, compared with M1 indirect activity, M2 neural activity was correlated with BMI-potent activity across a longer set of time lags, and the timescale of population activity patterns evolved more slowly. M2 units also predicted the activity of both M1 direct and indirect neural populations, suggesting that M2 population dynamics provide a continuous modulatory influence on M1 activity as a whole, rather than a moment-by-moment influence solely on neurons most relevant to a task. Together, our results indicate that longer timescale M2 activity provides modulatory influence over extended time lags on shorter-timescale control signals in M1.SIGNIFICANCE STATEMENT A central question in the study of motor control is whether primary motor cortex (M1) and premotor cortex (M2) interact through task-specific subpopulations of neurons, or whether tasks engage broader correlated networks. Brain-machine interfaces (BMIs) are powerful tools to study cross-area interactions. Here, we performed simultaneous recordings of M1 and M2 in a BMI task using a subpopulation of M1 neurons (direct neurons). We found that activity outside of direct neurons in M1 and M2 was predictive of M1-BMI task activity, and that M2 activity evolved at slower timescales than M1. These findings suggest that M2 provides a continuous modulatory influence on M1 as a whole, supporting a model of interactions through broad correlated networks rather than task-specific neural subpopulations.
Collapse
|
33
|
Distinct timescales for the neuronal encoding of vocal signals in a high-order auditory area. Sci Rep 2021; 11:19672. [PMID: 34608248 PMCID: PMC8490347 DOI: 10.1038/s41598-021-99135-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 09/21/2021] [Indexed: 02/08/2023] Open
Abstract
The ability of the auditory system to selectively recognize natural sound categories while maintaining a certain degree of tolerance towards variations within these categories, which may have functional roles, is thought to be crucial for vocal communication. To date, it is still largely unknown how the balance between tolerance and sensitivity to variations in acoustic signals is coded at a neuronal level. Here, we investigate whether neurons in a high-order auditory area in zebra finches, a songbird species, are sensitive to natural variations in vocal signals by recording their responses to repeated exposures to identical and variant sound sequences. We used the songs of male birds which tend to be highly repetitive with only subtle variations between renditions. When playing these songs to both anesthetized and awake birds, we found that variations between songs did not affect the neuron firing rate but the temporal reliability of responses. This suggests that auditory processing operates on a range of distinct timescales, namely a short one to detect variations in vocal signals, and longer ones that allow the birds to tolerate variations in vocal signal structure and to encode the global context.
Collapse
|
34
|
Parr T, Da Costa L, Heins C, Ramstead MJD, Friston KJ. Memory and Markov Blankets. ENTROPY (BASEL, SWITZERLAND) 2021; 23:1105. [PMID: 34573730 PMCID: PMC8469145 DOI: 10.3390/e23091105] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 08/20/2021] [Accepted: 08/22/2021] [Indexed: 12/11/2022]
Abstract
In theoretical biology, we are often interested in random dynamical systems-like the brain-that appear to model their environments. This can be formalized by appealing to the existence of a (possibly non-equilibrium) steady state, whose density preserves a conditional independence between a biological entity and its surroundings. From this perspective, the conditioning set, or Markov blanket, induces a form of vicarious synchrony between creature and world-as if one were modelling the other. However, this results in an apparent paradox. If all conditional dependencies between a system and its surroundings depend upon the blanket, how do we account for the mnemonic capacity of living systems? It might appear that any shared dependence upon past blanket states violates the independence condition, as the variables on either side of the blanket now share information not available from the current blanket state. This paper aims to resolve this paradox, and to demonstrate that conditional independence does not preclude memory. Our argument rests upon drawing a distinction between the dependencies implied by a steady state density, and the density dynamics of the system conditioned upon its configuration at a previous time. The interesting question then becomes: What determines the length of time required for a stochastic system to 'forget' its initial conditions? We explore this question for an example system, whose steady state density possesses a Markov blanket, through simple numerical analyses. We conclude with a discussion of the relevance for memory in cognitive systems like us.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK; (L.D.C.); (M.J.D.R.); (K.J.F.)
| | - Lancelot Da Costa
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK; (L.D.C.); (M.J.D.R.); (K.J.F.)
- Department of Mathematics, Imperial College London, London SW7 2AZ, UK
| | - Conor Heins
- Department of Collective Behaviour, Max Planck Institute of Animal Behavior, D-78457 Konstanz, Germany;
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, D-78457 Konstanz, Germany
- Department of Biology, University of Konstanz, D-78457 Konstanz, Germany
- Nested Minds Network, London EC4A 3TW, UK
| | - Maxwell James D. Ramstead
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK; (L.D.C.); (M.J.D.R.); (K.J.F.)
- Nested Minds Network, London EC4A 3TW, UK
- Spatial Web Foundation, Los Angeles, CA 90016, USA
- Division of Social and Transcultural Psychiatry, Department of Psychiatry, McGill University, Montreal, QC H3A 1A1, Canada
| | - Karl J. Friston
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK; (L.D.C.); (M.J.D.R.); (K.J.F.)
| |
Collapse
|
35
|
Golesorkhi M, Gomez-Pilar J, Zilio F, Berberian N, Wolff A, Yagoub MCE, Northoff G. The brain and its time: intrinsic neural timescales are key for input processing. Commun Biol 2021; 4:970. [PMID: 34400800 PMCID: PMC8368044 DOI: 10.1038/s42003-021-02483-6] [Citation(s) in RCA: 58] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 07/19/2021] [Indexed: 02/07/2023] Open
Abstract
We process and integrate multiple timescales into one meaningful whole. Recent evidence suggests that the brain displays a complex multiscale temporal organization. Different regions exhibit different timescales as described by the concept of intrinsic neural timescales (INT); however, their function and neural mechanisms remains unclear. We review recent literature on INT and propose that they are key for input processing. Specifically, they are shared across different species, i.e., input sharing. This suggests a role of INT in encoding inputs through matching the inputs' stochastics with the ongoing temporal statistics of the brain's neural activity, i.e., input encoding. Following simulation and empirical data, we point out input integration versus segregation and input sampling as key temporal mechanisms of input processing. This deeply grounds the brain within its environmental and evolutionary context. It carries major implications in understanding mental features and psychiatric disorders, as well as going beyond the brain in integrating timescales into artificial intelligence.
Collapse
Affiliation(s)
- Mehrshad Golesorkhi
- grid.28046.380000 0001 2182 2255School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, Canada ,grid.28046.380000 0001 2182 2255Mind, Brain Imaging and Neuroethics Research Unit, Institute of Mental Health, Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada
| | - Javier Gomez-Pilar
- grid.5239.d0000 0001 2286 5329Biomedical Engineering Group, University of Valladolid, Valladolid, Spain ,grid.413448.e0000 0000 9314 1427Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina, (CIBER-BBN), Madrid, Spain
| | - Federico Zilio
- grid.5608.b0000 0004 1757 3470Department of Philosophy, Sociology, Education and Applied Psychology, University of Padova, Padua, Italy
| | - Nareg Berberian
- grid.28046.380000 0001 2182 2255Mind, Brain Imaging and Neuroethics Research Unit, Institute of Mental Health, Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada
| | - Annemarie Wolff
- grid.28046.380000 0001 2182 2255Mind, Brain Imaging and Neuroethics Research Unit, Institute of Mental Health, Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada
| | - Mustapha C. E. Yagoub
- grid.28046.380000 0001 2182 2255School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, Canada
| | - Georg Northoff
- grid.28046.380000 0001 2182 2255Mind, Brain Imaging and Neuroethics Research Unit, Institute of Mental Health, Royal Ottawa Mental Health Centre and University of Ottawa, Ottawa, Canada ,grid.410595.c0000 0001 2230 9154Centre for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou, China ,grid.13402.340000 0004 1759 700XMental Health Centre, Zhejiang University School of Medicine, Hangzhou, Zhejiang China
| |
Collapse
|
36
|
Hunt LT. Frontal circuit specialisations for decision making. Eur J Neurosci 2021; 53:3654-3671. [PMID: 33864305 DOI: 10.1111/ejn.15236] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Revised: 03/15/2021] [Accepted: 04/04/2021] [Indexed: 11/29/2022]
Abstract
There is widespread consensus that distributed circuits across prefrontal and anterior cingulate cortex (PFC/ACC) are critical for reward-based decision making. The circuit specialisations of these areas in primates were likely shaped by their foraging niche, in which decision making is typically sequential, attention-guided and temporally extended. Here, I argue that in humans and other primates, PFC/ACC circuits are functionally specialised in two ways. First, microcircuits found across PFC/ACC are highly recurrent in nature and have synaptic properties that support persistent activity across temporally extended cognitive tasks. These properties provide the basis of a computational account of time-varying neural activity within PFC/ACC as a decision is being made. Second, the macrocircuit connections (to other brain areas) differ between distinct PFC/ACC cytoarchitectonic subregions. This variation in macrocircuit connections explains why PFC/ACC subregions make unique contributions to reward-based decision tasks and how these contributions are shaped by attention. They predict dissociable neural representations to emerge in orbitofrontal, anterior cingulate and dorsolateral prefrontal cortex during sequential attention-guided choice, as recently confirmed in neurophysiological recordings.
Collapse
Affiliation(s)
- Laurence T Hunt
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
37
|
Mair RG, Francoeur MJ, Gibson BM. Central Thalamic-Medial Prefrontal Control of Adaptive Responding in the Rat: Many Players in the Chamber. Front Behav Neurosci 2021; 15:642204. [PMID: 33897387 PMCID: PMC8060444 DOI: 10.3389/fnbeh.2021.642204] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Accepted: 03/08/2021] [Indexed: 11/13/2022] Open
Abstract
The medial prefrontal cortex (mPFC) has robust afferent and efferent connections with multiple nuclei clustered in the central thalamus. These nuclei are elements in large-scale networks linking mPFC with the hippocampus, basal ganglia, amygdala, other cortical areas, and visceral and arousal systems in the brainstem that give rise to adaptive goal-directed behavior. Lesions of the mediodorsal nucleus (MD), the main source of thalamic input to middle layers of PFC, have limited effects on delayed conditional discriminations, like DMTP and DNMTP, that depend on mPFC. Recent evidence suggests that MD sustains and amplifies neuronal responses in mPFC that represent salient task-related information and is important for detecting and encoding contingencies between actions and their consequences. Lesions of rostral intralaminar (rIL) and ventromedial (VM) nuclei produce delay-independent impairments of egocentric DMTP and DNMTP that resemble effects of mPFC lesions on response speed and accuracy: results consistent with projections of rIL to striatum and VM to motor cortices. The ventral midline and anterior thalamic nuclei affect allocentric spatial cognition and memory consistent with their connections to mPFC and hippocampus. The dorsal midline nuclei spare DMTP and DNMTP. They have been implicated in behavioral-state control and response to salient stimuli in associative learning. mPFC functions are served during DNMTP by discrete populations of neurons with responses related to motor preparation, movements, lever press responses, reinforcement anticipation, reinforcement delivery, and memory delay. Population analyses show that different responses are timed so that they effectively tile the temporal interval from when DNMTP trials are initiated until the end. Event-related responses of MD neurons during DNMTP are predominantly related to movement and reinforcement, information important for DNMTP choice. These responses closely mirror the activity of mPFC neurons with similar responses. Pharmacological inactivation of MD and adjacent rIL affects the expression of diverse action- and outcome-related responses of mPFC neurons. Lesions of MD before training are associated with a shift away from movement-related responses in mPFC important for DNMTP choice. These results suggest that MD has short-term effects on the expression of event-related activity in mPFC and long-term effects that tune mPFC neurons to respond to task-specific information.
Collapse
Affiliation(s)
- Robert G Mair
- Department of Psychology, University of New Hampshire, Durham, NH, United States
| | - Miranda J Francoeur
- Department of Psychology, University of New Hampshire, Durham, NH, United States.,Neural Engineering and Translation Lab, University of California, San Diego, San Diego, CA, United States
| | - Brett M Gibson
- Department of Psychology, University of New Hampshire, Durham, NH, United States
| |
Collapse
|