1
|
Comrie AE, Monroe EJ, Kahn AE, Denovellis EL, Joshi A, Guidera JA, Krausz TA, Berke JD, Daw ND, Frank LM. Hippocampal representations of alternative possibilities are flexibly generated to meet cognitive demands. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.09.23.613567. [PMID: 39386651 PMCID: PMC11463554 DOI: 10.1101/2024.09.23.613567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 10/12/2024]
Abstract
The cognitive ability to go beyond the present to consider alternative possibilities, including potential futures and counterfactual pasts, can support adaptive decision making. Complex and changing real-world environments, however, have many possible alternatives. Whether and how the brain can select among them to represent alternatives that meet current cognitive needs remains unknown. We therefore examined neural representations of alternative spatial locations in the rat hippocampus during navigation in a complex patch foraging environment with changing reward probabilities. We found representations of multiple alternatives along paths ahead and behind the animal, including in distant alternative patches. Critically, these representations were modulated in distinct patterns across successive trials: alternative paths were represented proportionate to their evolving relative value and predicted subsequent decisions, whereas distant alternatives were prevalent during value updating. These results demonstrate that the brain modulates the generation of alternative possibilities in patterns that meet changing cognitive needs for adaptive behavior.
Collapse
|
2
|
Liu K, Sibille J, Dragoi G. Nested compressed co-representations of multiple sequential experiences during sleep. Nat Neurosci 2024; 27:1816-1828. [PMID: 39030341 DOI: 10.1038/s41593-024-01703-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 06/14/2024] [Indexed: 07/21/2024]
Abstract
Animals encounter and remember multiple experiences daily. During sleep, hippocampal neuronal ensembles replay past experiences and preplay future ones. Although most previous studies investigated p/replay of a single experience, it remains unclear how the hippocampus represents many experiences without major interference during sleep. By monitoring hippocampal neuronal ensembles as rats encountered 15 distinct linear track experiences, we uncovered principles for efficient multi-experience compressed p/replay representation. First, we found a serial position effect whereby the earliest and the most recent experiences had the strongest representations. Second, distinct experiences were co-represented in a multiplexed, flickering manner during nested p/replay events, which greatly enhanced the network's representational capacity. Third, spatially contiguous and disjunct track pairs were bound together into contiguous conjunctive representations during sleep. Finally, sequences spanning day-long multi-track experiences were p/replayed at hyper-compressed ratios during sleep. These coding schemes efficiently parallelize, bind and compress multiple sequential representations with reduced interference and enhanced capacity during sleep.
Collapse
Affiliation(s)
- Kefei Liu
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Bioscience and Biomedical Engineering Thrust, Systems Hub, Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
| | - Jeremie Sibille
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - George Dragoi
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA.
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, USA.
- Wu Tsai Institute, Yale University, New Haven, CT, USA.
| |
Collapse
|
3
|
Costa RM. Silence between words: Is solitude important for relatedness? PROGRESS IN BRAIN RESEARCH 2024; 287:153-190. [PMID: 39097352 DOI: 10.1016/bs.pbr.2024.05.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/05/2024]
Abstract
Chronic loneliness is a risk factor for physical and health problems, in part due to dysfunction of the hypothalamic-pituitary-adrenal (HPA) axis and sympathetic nervous system. In contrast, temporary moments of positive solitude (passing good times alone and not feeling lonely) appear to have positive effects on mental health, social life, and creativity, and seems to be a buffer against loneliness. Herein, three ways of how solitude may have positive effects on health and relatedness are discussed, namely effects on enhancement of mind-wandering, interoceptive awareness, and spirituality. Solitude may facilitate (1) activation of the default mode network (DMN) underlying mind-wandering including daydreaming about other people; (2) activation of brain areas supporting interoceptive awareness; (3) deactivation of prefrontal cortex, or deactivation and decreased connectivity of the DMN, giving raise to susceptibility to spiritual experiences. The capacity to handle and enjoy solitude is a developmental process that may be difficult for many persons. Craving for social connections and external stimulation with digital technologies (e.g., internet, smartphones, social media) might be interfering with the development of the capacity for solitude and thereby increasing loneliness; this might be partly due to impaired interoceptive awareness and impaired functional mind-wandering (common in solitude). Congruently, overuse of digital technologies was associated with reduced activity, and reduced gray matter volume and density, in brain areas supporting interoceptive awareness, as well as with decreased connectivity of the DMN supporting creative insights. Solitude has been a relatively dismissed topic in neuroscience and health sciences, but a growing number of studies is highlighting its importance for well-being.
Collapse
Affiliation(s)
- Rui Miguel Costa
- William James Center for Research, Ispa-Instituto Universitário, Lisbon, Portugal.
| |
Collapse
|
4
|
Zhou D, Bornstein AM. Expanding horizons in reinforcement learning for curious exploration and creative planning. Behav Brain Sci 2024; 47:e118. [PMID: 38770877 DOI: 10.1017/s0140525x23003394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Curiosity and creativity are expressions of the trade-off between leveraging that with which we are familiar or seeking out novelty. Through the computational lens of reinforcement learning, we describe how formulating the value of information seeking and generation via their complementary effects on planning horizons formally captures a range of solutions to striking this balance.
Collapse
Affiliation(s)
- Dale Zhou
- Neurobiology and Behavior, 519 Biological Sciences Quad, University of California, Irvine, CA, USA ://dalezhou.com
- Center for the Neurobiology of Learning and Memory, Qureshey, Research Laboratory, University of California, Irvine, CA, USA ://aaron.bornstein.org/
| | - Aaron M Bornstein
- Center for the Neurobiology of Learning and Memory, Qureshey, Research Laboratory, University of California, Irvine, CA, USA ://aaron.bornstein.org/
- Department of Cognitive Sciences, 2318 Social & Behavioral Sciences Gateway, University of California, Irvine, CA, USA
| |
Collapse
|
5
|
Rvachev MM. An operating principle of the cerebral cortex, and a cellular mechanism for attentional trial-and-error pattern learning and useful classification extraction. Front Neural Circuits 2024; 18:1280604. [PMID: 38505865 PMCID: PMC10950307 DOI: 10.3389/fncir.2024.1280604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Accepted: 02/13/2024] [Indexed: 03/21/2024] Open
Abstract
A feature of the brains of intelligent animals is the ability to learn to respond to an ensemble of active neuronal inputs with a behaviorally appropriate ensemble of active neuronal outputs. Previously, a hypothesis was proposed on how this mechanism is implemented at the cellular level within the neocortical pyramidal neuron: the apical tuft or perisomatic inputs initiate "guess" neuron firings, while the basal dendrites identify input patterns based on excited synaptic clusters, with the cluster excitation strength adjusted based on reward feedback. This simple mechanism allows neurons to learn to classify their inputs in a surprisingly intelligent manner. Here, we revise and extend this hypothesis. We modify synaptic plasticity rules to align with behavioral time scale synaptic plasticity (BTSP) observed in hippocampal area CA1, making the framework more biophysically and behaviorally plausible. The neurons for the guess firings are selected in a voluntary manner via feedback connections to apical tufts in the neocortical layer 1, leading to dendritic Ca2+ spikes with burst firing, which are postulated to be neural correlates of attentional, aware processing. Once learned, the neuronal input classification is executed without voluntary or conscious control, enabling hierarchical incremental learning of classifications that is effective in our inherently classifiable world. In addition to voluntary, we propose that pyramidal neuron burst firing can be involuntary, also initiated via apical tuft inputs, drawing attention toward important cues such as novelty and noxious stimuli. We classify the excitations of neocortical pyramidal neurons into four categories based on their excitation pathway: attentional versus automatic and voluntary/acquired versus involuntary. Additionally, we hypothesize that dendrites within pyramidal neuron minicolumn bundles are coupled via depolarization cross-induction, enabling minicolumn functions such as the creation of powerful hierarchical "hyperneurons" and the internal representation of the external world. We suggest building blocks to extend the microcircuit theory to network-level processing, which, interestingly, yields variants resembling the artificial neural networks currently in use. On a more speculative note, we conjecture that principles of intelligence in universes governed by certain types of physical laws might resemble ours.
Collapse
|
6
|
Kabrel M, Tulver K, Aru J. The journey within: mental navigation as a novel framework for understanding psychotherapeutic transformation. BMC Psychiatry 2024; 24:91. [PMID: 38302927 PMCID: PMC10835954 DOI: 10.1186/s12888-024-05522-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Accepted: 01/15/2024] [Indexed: 02/03/2024] Open
Abstract
BACKGROUND Despite the demonstrated efficacy of psychotherapy, the precise mechanisms that drive therapeutic transformations have posed a challenge and still remain unresolved. Here, we suggest a potential solution to this problem by introducing a framework based on the concept of mental navigation. It refers to our ability to navigate our cognitive space of thoughts, ideas, concepts, and memories, similar to how we navigate physical space. We start by analyzing the neural, cognitive, and experiential constituents intrinsic to mental navigation. Subsequently, we posit that the metaphoric spatial language we employ to articulate introspective experiences (e.g., "unexplored territory" or "going in circles") serves as a robust marker of mental navigation. METHODS Using large text corpora, we compared the utilization of spatial language between transcripts of psychotherapy sessions (≈ 12 M. words), casual everyday conversations (≈ 12 M. words), and fictional dialogues in movies (≈ 14 M. words). We also examined 110 psychotherapy transcripts qualitatively to discern patterns and dynamics associated with mental navigation. RESULTS We found a notable increase in the utilization of spatial metaphors during psychotherapy compared to casual everyday dialogues (U = 192.0, p = .001, d = 0.549) and fictional conversations (U = 211, p < .001, d = 0.792). In turn, analyzing the usage of non-spatial metaphors, we did not find significant differences between the three datasets (H = 0.682, p = 0.710). The qualitative analysis highlighted specific examples of mental navigation at play. CONCLUSION Mental navigation might underlie the psychotherapy process and serve as a robust framework for understanding the transformative changes it brings about.
Collapse
Affiliation(s)
- Mykyta Kabrel
- Institute of Philosophy and Semiotics, University of Tartu, Tartu, Estonia.
| | - Kadi Tulver
- Institute of Computer Science, University of Tartu, Tartu, Estonia
| | - Jaan Aru
- Institute of Computer Science, University of Tartu, Tartu, Estonia
| |
Collapse
|
7
|
Dragoi G. The generative grammar of the brain: a critique of internally generated representations. Nat Rev Neurosci 2024; 25:60-75. [PMID: 38036709 DOI: 10.1038/s41583-023-00763-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/18/2023] [Indexed: 12/02/2023]
Abstract
The past decade of progress in neurobiology has uncovered important organizational principles for network preconfiguration and neuronal selection that suggest a generative grammar exists in the brain. In this Perspective, I discuss the competence of the hippocampal neural network to generically express temporally compressed sequences of neuronal firing that represent novel experiences, which is envisioned as a form of generative neural syntax supporting a neurobiological perspective on brain function. I compare this neural competence with the hippocampal network performance that represents specific experiences with higher fidelity after new learning during replay, which is envisioned as a form of neural semantic that supports a complementary neuropsychological perspective. I also demonstrate how the syntax of network competence emerges a priori during early postnatal life and is followed by the later development of network performance that enables rapid encoding and memory consolidation. Thus, I propose that this generative grammar of the brain is essential for internally generated representations, which are crucial for the cognitive processes underlying learning and memory, prospection, and inference, which ultimately underlie our reason and representation of the world.
Collapse
Affiliation(s)
- George Dragoi
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA.
- Department of Neuroscience, Yale University School of Medicine, New Haven, CT, USA.
- Wu Tsai Institute, Yale University, New Haven, CT, USA.
| |
Collapse
|
8
|
Friedenberger Z, Harkin E, Tóth K, Naud R. Silences, spikes and bursts: Three-part knot of the neural code. J Physiol 2023; 601:5165-5193. [PMID: 37889516 DOI: 10.1113/jp281510] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 09/28/2023] [Indexed: 10/28/2023] Open
Abstract
When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.
Collapse
Affiliation(s)
- Zachary Friedenberger
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Centre for Neural Dynamics and Artifical Intelligence, Department of Physics, University of Ottawa, Ottawa, Ontario, Ottawa
| | - Emerson Harkin
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Katalin Tóth
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Richard Naud
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Centre for Neural Dynamics and Artifical Intelligence, Department of Physics, University of Ottawa, Ottawa, Ontario, Ottawa
| |
Collapse
|
9
|
Kucyi A, Kam JWY, Andrews-Hanna JR, Christoff K, Whitfield-Gabrieli S. Recent advances in the neuroscience of spontaneous and off-task thought: implications for mental health. NATURE MENTAL HEALTH 2023; 1:827-840. [PMID: 37974566 PMCID: PMC10653280 DOI: 10.1038/s44220-023-00133-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 08/25/2023] [Indexed: 11/19/2023]
Abstract
People spend a remarkable 30-50% of awake life thinking about something other than what they are currently doing. These experiences of being "off-task" can be described as spontaneous thought when mental dynamics are relatively flexible. Here we review recent neuroscience developments in this area and consider implications for mental wellbeing and illness. We provide updated overviews of the roles of the default mode network and large-scale network dynamics, and we discuss emerging candidate mechanisms involving hippocampal memory (sharp-wave ripples, replay) and neuromodulatory (noradrenergic and serotonergic) systems. We explore how distinct brain states can be associated with or give rise to adaptive and maladaptive forms of thought linked to distinguishable mental health outcomes. We conclude by outlining new directions in the neuroscience of spontaneous and off-task thought that may clarify mechanisms, lead to personalized biomarkers, and facilitate therapy developments toward the goals of better understanding and improving mental health.
Collapse
Affiliation(s)
- Aaron Kucyi
- Department of Psychological and Brain Sciences, Drexel University
| | - Julia W. Y. Kam
- Department of Psychology and Hotchkiss Brain Institute, University of Calgary
| | | | | | | |
Collapse
|
10
|
Brodt S, Inostroza M, Niethard N, Born J. Sleep-A brain-state serving systems memory consolidation. Neuron 2023; 111:1050-1075. [PMID: 37023710 DOI: 10.1016/j.neuron.2023.03.005] [Citation(s) in RCA: 49] [Impact Index Per Article: 49.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 02/23/2023] [Accepted: 03/06/2023] [Indexed: 04/08/2023]
Abstract
Although long-term memory consolidation is supported by sleep, it is unclear how it differs from that during wakefulness. Our review, focusing on recent advances in the field, identifies the repeated replay of neuronal firing patterns as a basic mechanism triggering consolidation during sleep and wakefulness. During sleep, memory replay occurs during slow-wave sleep (SWS) in hippocampal assemblies together with ripples, thalamic spindles, neocortical slow oscillations, and noradrenergic activity. Here, hippocampal replay likely favors the transformation of hippocampus-dependent episodic memory into schema-like neocortical memory. REM sleep following SWS might balance local synaptic rescaling accompanying memory transformation with a sleep-dependent homeostatic process of global synaptic renormalization. Sleep-dependent memory transformation is intensified during early development despite the immaturity of the hippocampus. Overall, beyond its greater efficacy, sleep consolidation differs from wake consolidation mainly in that it is supported, rather than impaired, by spontaneous hippocampal replay activity possibly gating memory formation in neocortex.
Collapse
Affiliation(s)
- Svenja Brodt
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany; Max-Planck-Institute for Biological Cybernetics, Tübingen, Germany
| | - Marion Inostroza
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Niels Niethard
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Jan Born
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany; Werner Reichert Center for Integrative Neuroscience, University of Tübingen, Tübingen, Germany.
| |
Collapse
|