1
|
Nishioka M, Hata T. Cholinergic interneurons in the dorsal striatum play an important role in the acquisition of duration memory. Eur J Neurosci 2024; 59:3061-3073. [PMID: 38576223 DOI: 10.1111/ejn.16337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 02/15/2024] [Accepted: 03/09/2024] [Indexed: 04/06/2024]
Abstract
The present study aimed to examine the effect of cholinergic interneuron lesions in the dorsal striatum on duration-memory formation. Cholinergic interneurons in the dorsal striatum may be involved in the formation of duration memory since they are among the main inputs to the dorsal striatal muscarinic acetylcholine-1 receptors, which play a role in the consolidation of duration memory. Rats were sufficiently trained using a peak-interval 20 s procedure and then infused with anti-choline acetyltransferase-saporin into the dorsal striatum to cause selective ablation of cholinergic interneurons. To make the rats acquire new duration-memories, we trained them with a peak interval 40 s after lesion. Before lesion, the peak times (an index of duration memory) for sham-lesioned and lesioned groups were similar at approximately 20 s. In the peak interval 40 s session, the peak times for the sham-lesioned and lesioned groups were approximately 30 and 20 s, respectively. After additional peak interval 40 s sessions, the peak times of both groups were shifted to approximately 40 s. Those results suggest that the cholinergic interneuron lesion delayed new duration-memory acquisition. Subsequent experiments showed that cholinergic interneuron lesions did not retard the shift of peak time to the original target time (20 s). Following experiment without changing the target time after lesion showed that cholinergic interneuron lesions did not change their peak times. Our findings suggest that cholinergic interneurons in the dorsal striatum are involved in new duration-memory acquisition but not in the utilization of already acquired duration memory and interval timing.
Collapse
Affiliation(s)
- Masahiko Nishioka
- Graduate School of Psychology, Doshisha University, Kyotanabe, Kyoto, 610-0394, Japan
- Japan Society for the Promotion of Science, Tokyo, Japan
| | - Toshimichi Hata
- Faculty of Psychology, Doshisha University, Kyotanabe, Kyoto, 610-0394, Japan
| |
Collapse
|
2
|
Shintaki R, Tanaka D, Suzuki S, Yoshimoto T, Sadato N, Chikazoe J, Jimura K. Continuous decision to wait for a future reward is guided by fronto-hippocampal anticipatory dynamics. Cereb Cortex 2024; 34:bhae217. [PMID: 38798003 DOI: 10.1093/cercor/bhae217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 05/02/2024] [Accepted: 05/08/2024] [Indexed: 05/29/2024] Open
Abstract
Deciding whether to wait for a future reward is crucial for surviving in an uncertain world. While seeking rewards, agents anticipate a reward in the present environment and constantly face a trade-off between staying in their environment or leaving it. It remains unclear, however, how humans make continuous decisions in such situations. Here, we show that anticipatory activity in the anterior prefrontal cortex, ventrolateral prefrontal cortex, and hippocampus underpins continuous stay-leave decision-making. Participants awaited real liquid rewards available after tens of seconds, and their continuous decision was tracked by dynamic brain activity associated with the anticipation of a reward. Participants stopped waiting more frequently and sooner after they experienced longer delays and received smaller rewards. When the dynamic anticipatory brain activity was enhanced in the anterior prefrontal cortex, participants remained in their current environment, but when this activity diminished, they left the environment. Moreover, while experiencing a delayed reward in a novel environment, the ventrolateral prefrontal cortex and hippocampus showed anticipatory activity. Finally, the activity in the anterior prefrontal cortex and ventrolateral prefrontal cortex was enhanced in participants adopting a leave strategy, whereas those remaining stationary showed enhanced hippocampal activity. Our results suggest that fronto-hippocampal anticipatory dynamics underlie continuous decision-making while anticipating a future reward.
Collapse
Affiliation(s)
- Reiko Shintaki
- Department of Biosciences and Informatics, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama, 223-8522, Japan
| | - Daiki Tanaka
- Department of Biosciences and Informatics, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama, 223-8522, Japan
| | - Shinsuke Suzuki
- Centre for Brain, Mind and Markets, The University of Melbourne, Grattan Street, Parkville, Victoria, 3010, Australia
- Faculty of Social Data Science and HIAS Brain Research Center, Hitotsubashi University, 2-1 Naka, Kunitachi, 186-8601, Japan
| | - Takaaki Yoshimoto
- Research Organization of Science and Technology, Ritsumeikan University, 1-1-1, Nojihigashi, Kusatsu, 525-8577, Japan
- Section of Brain Function Information, Supportive Center for Brain Research, National Institute for Physiological Sciences, 38 Nishigonaka, Myodaiji, Okazaki, 444-8585, Japan
| | - Norihiro Sadato
- Research Organization of Science and Technology, Ritsumeikan University, 1-1-1, Nojihigashi, Kusatsu, 525-8577, Japan
- Section of Brain Function Information, Supportive Center for Brain Research, National Institute for Physiological Sciences, 38 Nishigonaka, Myodaiji, Okazaki, 444-8585, Japan
| | - Junichi Chikazoe
- Section of Brain Function Information, Supportive Center for Brain Research, National Institute for Physiological Sciences, 38 Nishigonaka, Myodaiji, Okazaki, 444-8585, Japan
- Araya, Inc., 1-11 Kanda Sakuma-cho, Chiyoda, Tokyo, 101-0025, Japan
| | - Koji Jimura
- Department of Informatics, Gunma University, 4-2 Aramaki-machi, Maebashi, 371-8510, Japan
| |
Collapse
|
3
|
Rolando F, Kononowicz TW, Duhamel JR, Doyère V, Wirth S. Distinct neural adaptations to time demand in the striatum and the hippocampus. Curr Biol 2024; 34:156-170.e7. [PMID: 38141617 DOI: 10.1016/j.cub.2023.11.066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 10/18/2023] [Accepted: 11/30/2023] [Indexed: 12/25/2023]
Abstract
How do neural codes adjust to track time across a range of resolutions, from milliseconds to multi-seconds, as a function of the temporal frequency at which events occur? To address this question, we studied time-modulated cells in the striatum and the hippocampus, while macaques categorized three nested intervals within the sub-second or the supra-second range (up to 1, 2, 4, or 8 s), thereby modifying the temporal resolution needed to solve the task. Time-modulated cells carried more information for intervals with explicit timing demand, than for any other interval. The striatum, particularly the caudate, supported the most accurate temporal prediction throughout all time ranges. Strikingly, its temporal readout adjusted non-linearly to the time range, suggesting that the striatal resolution shifted from a precise millisecond to a coarse multi-second range as a function of demand. This is in line with monkey's behavioral latencies, which indicated that they tracked time until 2 s but employed a coarse categorization strategy for durations beyond. By contrast, the hippocampus discriminated only the beginning from the end of intervals, regardless of the range. We propose that the hippocampus may provide an overall poor signal marking an event's beginning, whereas the striatum optimizes neural resources to process time throughout an interval adapting to the ongoing timing necessity.
Collapse
Affiliation(s)
- Felipe Rolando
- Institut des Sciences Cognitives Marc Jeannerod, CNRS, Université Lyon 1, 67 boulevard Pinel, 69500 Bron, France
| | - Tadeusz W Kononowicz
- Institut des Sciences Cognitives Marc Jeannerod, CNRS, Université Lyon 1, 67 boulevard Pinel, 69500 Bron, France; Université Paris-Saclay, CNRS, Institut des Neurosciences Paris-Saclay (NeuroPSI), 91400 Saclay, France; Institute of Psychology, The Polish Academy of Sciences, ul. Jaracza 1, 00-378 Warsaw, Poland
| | - Jean-René Duhamel
- Institut des Sciences Cognitives Marc Jeannerod, CNRS, Université Lyon 1, 67 boulevard Pinel, 69500 Bron, France
| | - Valérie Doyère
- Université Paris-Saclay, CNRS, Institut des Neurosciences Paris-Saclay (NeuroPSI), 91400 Saclay, France
| | - Sylvia Wirth
- Institut des Sciences Cognitives Marc Jeannerod, CNRS, Université Lyon 1, 67 boulevard Pinel, 69500 Bron, France.
| |
Collapse
|
4
|
Lin D, Huang AZ, Richards BA. Temporal encoding in deep reinforcement learning agents. Sci Rep 2023; 13:22335. [PMID: 38102369 PMCID: PMC10724179 DOI: 10.1038/s41598-023-49847-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 12/12/2023] [Indexed: 12/17/2023] Open
Abstract
Neuroscientists have observed both cells in the brain that fire at specific points in time, known as "time cells", and cells whose activity steadily increases or decreases over time, known as "ramping cells". It is speculated that time and ramping cells support temporal computations in the brain and carry mnemonic information. However, due to the limitations in animal experiments, it is difficult to determine how these cells really contribute to behavior. Here, we show that time cells and ramping cells naturally emerge in the recurrent neural networks of deep reinforcement learning models performing simulated interval timing and working memory tasks, which have learned to estimate expected rewards in the future. We show that these cells do indeed carry information about time and items stored in working memory, but they contribute to behavior in large part by providing a dynamic representation on which policy can be computed. Moreover, the information that they do carry depends on both the task demands and the variables provided to the models. Our results suggest that time cells and ramping cells could contribute to temporal and mnemonic calculations, but the way in which they do so may be complex and unintuitive to human observers.
Collapse
Affiliation(s)
- Dongyan Lin
- Integrated Program in Neuroscience, McGill University, Montreal, QC, H3A 0G4, Canada.
- Mila, Montreal, QC, H2S 3H1, Canada.
| | - Ann Zixiang Huang
- Mila, Montreal, QC, H2S 3H1, Canada
- School of Computer Science, McGill University, Montreal, QC, H3A 0G4, Canada
| | - Blake Aaron Richards
- Integrated Program in Neuroscience, McGill University, Montreal, QC, H3A 0G4, Canada
- Mila, Montreal, QC, H2S 3H1, Canada
- School of Computer Science, McGill University, Montreal, QC, H3A 0G4, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC, H3A 0G4, Canada
- Learning in Machines and Brains Program, Canadian Institute for Advanced Research, Toronto, ON, M5G 1M1, Canada
| |
Collapse
|
5
|
Yawata Y, Shikano Y, Ogasawara J, Makino K, Kashima T, Ihara K, Yoshimoto A, Morikawa S, Yagishita S, Tanaka KF, Ikegaya Y. Mesolimbic dopamine release precedes actively sought aversive stimuli in mice. Nat Commun 2023; 14:2433. [PMID: 37106002 PMCID: PMC10140067 DOI: 10.1038/s41467-023-38130-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 04/17/2023] [Indexed: 04/29/2023] Open
Abstract
In some models, animals approach aversive stimuli more than those housed in an enriched environment. Here, we found that male mice in an impoverished and unstimulating (i.e., boring) chamber without toys sought aversive air puffs more often than those in an enriched chamber. Using this animal model, we identified the insular cortex as a regulator of aversion-seeking behavior. Activation and inhibition of the insular cortex increased and decreased the frequencies of air-puff self-stimulation, respectively, and the firing patterns of insular neuron ensembles predicted the self-stimulation timing. Dopamine levels in the ventrolateral striatum decreased with passive air puffs but increased with actively sought puffs. Around 20% of mice developed intense self-stimulation despite being offered toys, which was prevented by administering opioid receptor antagonists. This study establishes a basis for comprehending the neural underpinnings of usually avoided stimulus-seeking behaviors.
Collapse
Affiliation(s)
- Yosuke Yawata
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Yu Shikano
- Division of Brain Science, Keio University School of Medicine, Tokyo, 160-8582, Japan
| | - Jun Ogasawara
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Kenichi Makino
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Tetsuhiko Kashima
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Keiko Ihara
- Division of Brain Science, Keio University School of Medicine, Tokyo, 160-8582, Japan
| | - Airi Yoshimoto
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Shota Morikawa
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Sho Yagishita
- Center for Disease Biology and Integrative Medicine, Faculty of Medicine, The University of Tokyo, Tokyo, 113-0033, Japan
| | - Kenji F Tanaka
- Division of Brain Science, Keio University School of Medicine, Tokyo, 160-8582, Japan
| | - Yuji Ikegaya
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan.
- Institute for AI and Beyond, The University of Tokyo, Tokyo, 113-0033, Japan.
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka, 565-0871, Japan.
| |
Collapse
|
6
|
Ren P, Hou G, Ma M, Zhuang Y, Huang J, Tan M, Wu D, Luo G, Zhang Z, Rong H. Enhanced putamen functional connectivity underlies altered risky decision-making in age-related cognitive decline. Sci Rep 2023; 13:6619. [PMID: 37095127 PMCID: PMC10126002 DOI: 10.1038/s41598-023-33634-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 04/16/2023] [Indexed: 04/26/2023] Open
Abstract
Risky decision-making is critical to survival and development, which has been compromised in elderly populations. However, the neural substrates of altered financial risk-taking behavior in aging are still under-investigated. Here we examined the intrinsic putamen network in modulating risk-taking behaviors of Balloon Analogue Risk Task in healthy young and older adults using resting-state fMRI. Compared with the young group, the elderly group showed significantly different task performance. Based on the task performance, older adults were further subdivided into two subgroups, showing young-like and over-conservative risk behaviors, regardless of cognitive decline. Compared with young adults, the intrinsic pattern of putamen connectivity was significantly different in over-conservative older adults, but not in young-like older adults. Notably, age-effects on risk behaviors were mediated via the putamen functional connectivity. In addition, the putamen gray matter volume showed significantly different relationships with risk behaviors and functional connectivity in over-conservative older adults. Our findings suggest that reward-based risky behaviors might be a sensitive indicator of brain aging, highlighting the critical role of the putamen network in maintaining optimal risky decision-making in age-related cognitive decline.
Collapse
Affiliation(s)
- Ping Ren
- Department of Geriatric Psychiatry, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China.
| | - Gangqiang Hou
- Department of Radiology, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China
| | - Manxiu Ma
- Queensland Brain Institute, University of Queensland, St. Lucia, QLD, Australia
| | - Yuchuan Zhuang
- Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY, USA
| | - Jiayin Huang
- Department of Geriatric Psychiatry, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China
| | - Meiling Tan
- Department of Geriatric Psychiatry, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China
| | - Donghui Wu
- Department of Geriatric Psychiatry, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China
| | - Guozhi Luo
- Department of Geriatric Psychiatry, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China
| | - Zhiguo Zhang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China
| | - Han Rong
- Department of Psychiatry, Shenzhen Mental Health Center/Shenzhen Kangning Hospital, Shenzhen, Guangdong, China.
| |
Collapse
|
7
|
Teghil A, Bonavita A, Procida F, Giove F, Boccia M. Intrinsic hippocampal connectivity is associated with individual differences in retrospective duration processing. Brain Struct Funct 2023; 228:687-695. [PMID: 36695891 PMCID: PMC9944733 DOI: 10.1007/s00429-023-02612-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Accepted: 01/13/2023] [Indexed: 01/26/2023]
Abstract
The estimation of incidentally encoded durations of time intervals (retrospective duration processing) is thought to rely on the retrieval of contextual information associated with a sequence of events, automatically encoded in medial temporal lobe regions. "Time cells" have been described in the hippocampus (HC), encoding the temporal progression of events and their duration. However, whether the HC supports explicit retrospective duration judgments in humans, and which neural dynamics are involved, is still poorly understood. Here we used resting-state fMRI to test the relation between variations in intrinsic connectivity patterns of the HC, and individual differences in retrospective duration processing, assessed using a novel task involving the presentation of ecological stimuli. Results showed that retrospective duration discrimination performance predicted variations in the intrinsic connectivity of the bilateral HC with the right precentral gyrus; follow-up exploratory analyses suggested a role of the CA1 and CA4/DG subfields in driving the observed pattern. Findings provide insights on neural networks associated with implicit processing of durations in the second range.
Collapse
Affiliation(s)
- Alice Teghil
- Department of Psychology, "Sapienza" University of Rome, Via dei Marsi 78, 00185, Rome, Italy. .,Cognitive and Motor Rehabilitation and Neuroimaging Unit, IRCCS Fondazione Santa Lucia, Rome, Italy.
| | - Alessia Bonavita
- Department of Psychology, “Sapienza” University of Rome, Via dei Marsi 78, 00185 Rome, Italy ,Cognitive and Motor Rehabilitation and Neuroimaging Unit, IRCCS Fondazione Santa Lucia, Rome, Italy ,PhD Program in Behavioral Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Federica Procida
- Department of Psychology, “Sapienza” University of Rome, Via dei Marsi 78, 00185 Rome, Italy
| | - Federico Giove
- Cognitive and Motor Rehabilitation and Neuroimaging Unit, IRCCS Fondazione Santa Lucia, Rome, Italy ,MARBILab, Museo Storico della Fisica e Centro Studi e Ricerche Enrico Fermi, 00184 Rome, Italy
| | - Maddalena Boccia
- Department of Psychology, “Sapienza” University of Rome, Via dei Marsi 78, 00185 Rome, Italy ,Cognitive and Motor Rehabilitation and Neuroimaging Unit, IRCCS Fondazione Santa Lucia, Rome, Italy
| |
Collapse
|
8
|
De Corte BJ, Akdoğan B, Balsam PD. Temporal scaling and computing time in neural circuits: Should we stop watching the clock and look for its gears? Front Behav Neurosci 2022; 16:1022713. [PMID: 36570701 PMCID: PMC9773401 DOI: 10.3389/fnbeh.2022.1022713] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 10/31/2022] [Indexed: 12/13/2022] Open
Abstract
Timing underlies a variety of functions, from walking to perceiving causality. Neural timing models typically fall into one of two categories-"ramping" and "population-clock" theories. According to ramping models, individual neurons track time by gradually increasing or decreasing their activity as an event approaches. To time different intervals, ramping neurons adjust their slopes, ramping steeply for short intervals and vice versa. In contrast, according to "population-clock" models, multiple neurons track time as a group, and each neuron can fire nonlinearly. As each neuron changes its rate at each point in time, a distinct pattern of activity emerges across the population. To time different intervals, the brain learns the population patterns that coincide with key events. Both model categories have empirical support. However, they often differ in plausibility when applied to certain behavioral effects. Specifically, behavioral data indicate that the timing system has a rich computational capacity, allowing observers to spontaneously compute novel intervals from previously learned ones. In population-clock theories, population patterns map to time arbitrarily, making it difficult to explain how different patterns can be computationally combined. Ramping models are viewed as more plausible, assuming upstream circuits can set the slope of ramping neurons according to a given computation. Critically, recent studies suggest that neurons with nonlinear firing profiles often scale to time different intervals-compressing for shorter intervals and stretching for longer ones. This "temporal scaling" effect has led to a hybrid-theory where, like a population-clock model, population patterns encode time, yet like a ramping neuron adjusting its slope, the speed of each neuron's firing adapts to different intervals. Here, we argue that these "relative" population-clock models are as computationally plausible as ramping theories, viewing population-speed and ramp-slope adjustments as equivalent. Therefore, we view identifying these "speed-control" circuits as a key direction for evaluating how the timing system performs computations. Furthermore, temporal scaling highlights that a key distinction between different neural models is whether they propose an absolute or relative time-representation. However, we note that several behavioral studies suggest the brain processes both scales, cautioning against a dichotomy.
Collapse
Affiliation(s)
- Benjamin J. De Corte
- Department of Psychology, Columbia University, New York, NY, United States
- Division of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, United States
| | - Başak Akdoğan
- Department of Psychology, Columbia University, New York, NY, United States
- Division of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, United States
| | - Peter D. Balsam
- Department of Psychology, Columbia University, New York, NY, United States
- Division of Developmental Neuroscience, New York State Psychiatric Institute, New York, NY, United States
- Department of Neuroscience and Behavior, Barnard College, New York, NY, United States
| |
Collapse
|
9
|
Polti I, Nau M, Kaplan R, van Wassenhove V, Doeller CF. Rapid encoding of task regularities in the human hippocampus guides sensorimotor timing. eLife 2022; 11:e79027. [PMID: 36317500 PMCID: PMC9625083 DOI: 10.7554/elife.79027] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 10/02/2022] [Indexed: 11/17/2022] Open
Abstract
The brain encodes the statistical regularities of the environment in a task-specific yet flexible and generalizable format. Here, we seek to understand this process by bridging two parallel lines of research, one centered on sensorimotor timing, and the other on cognitive mapping in the hippocampal system. By combining functional magnetic resonance imaging (fMRI) with a fast-paced time-to-contact (TTC) estimation task, we found that the hippocampus signaled behavioral feedback received in each trial as well as performance improvements across trials along with reward-processing regions. Critically, it signaled performance improvements independent from the tested intervals, and its activity accounted for the trial-wise regression-to-the-mean biases in TTC estimation. This is in line with the idea that the hippocampus supports the rapid encoding of temporal context even on short time scales in a behavior-dependent manner. Our results emphasize the central role of the hippocampus in statistical learning and position it at the core of a brain-wide network updating sensorimotor representations in real time for flexible behavior.
Collapse
Affiliation(s)
- Ignacio Polti
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Jebsen Centre for Alzheimer’s Disease, Norwegian University of Science and TechnologyTrondheimNorway
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Matthias Nau
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Jebsen Centre for Alzheimer’s Disease, Norwegian University of Science and TechnologyTrondheimNorway
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Raphael Kaplan
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Jebsen Centre for Alzheimer’s Disease, Norwegian University of Science and TechnologyTrondheimNorway
- Department of Basic Psychology, Clinical Psychology, and Psychobiology, Universitat Jaume ICastellón de la PlanaSpain
| | - Virginie van Wassenhove
- CEA DRF/Joliot, NeuroSpin; INSERM, Cognitive Neuroimaging Unit; CNRS, Université Paris-SaclayGif-Sur-YvetteFrance
| | - Christian F Doeller
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Jebsen Centre for Alzheimer’s Disease, Norwegian University of Science and TechnologyTrondheimNorway
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Wilhelm Wundt Institute of Psychology, Leipzig UniversityLeipzigGermany
| |
Collapse
|
10
|
De Corte BJ, Farley SJ, Heslin KA, Parker KL, Freeman JH. The dorsal hippocampus' role in context-based timing in rodents. Neurobiol Learn Mem 2022; 194:107673. [PMID: 35985617 DOI: 10.1016/j.nlm.2022.107673] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 08/05/2022] [Accepted: 08/11/2022] [Indexed: 01/13/2023]
Abstract
To act proactively, we must predict when future events will occur. Individuals generate temporal predictions using cues that indicate an event will happen after a certain duration elapses. Neural models of timing focus on how the brain represents these cue-duration associations. However, these models often overlook the fact that situational factors frequently modulate temporal expectations. For example, in realistic environments, the intervals associated with different cues will often covary due to a common underlying cause. According to the 'common cause hypothesis,' observers anticipate this covariance such that, when one cue's interval changes, temporal expectations for other cues shift in the same direction. Furthermore, as conditions will often differ across environments, the same cue can mean different things in different contexts. Therefore, updates to temporal expectations should be context-specific. Behavioral work supports these predictions, yet their underlying neural mechanisms are unclear. Here, we asked whether the dorsal hippocampus mediates context-based timing, given its broad role in context-conditioning. Specifically, we trained rats with either hippocampal or sham lesions that two cues predicted reward after either a short or long duration elapsed (e.g., tone-8 s/light-16 s). Then, we moved rats to a new context and extended the long cue's interval (e.g., light-32 s). This caused rats to respond later to the short cue, despite never being trained to do so. Importantly, when returned to the initial training context, sham rats shifted back toward both cues' original intervals. In contrast, lesion rats continued to respond at the long cue's newer interval. Surprisingly, they still showed contextual modulation for the short cue, responding earlier like shams. These data suggest the hippocampus only mediates context-based timing if a cue is explicitly paired and/or rewarded across distinct contexts. Furthermore, as lesions did not impact timing measures at baseline or acquisition for the long cue's new interval, our data suggests that the hippocampus only modulates timing when context is relevant.
Collapse
Affiliation(s)
- Benjamin J De Corte
- Department of Psychiatry, Columbia University, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA
| | - Sean J Farley
- Department of Psychological and Brain Sciences, The University of Iowa, Iowa City, IA, USA
| | - Kelsey A Heslin
- Department of Neuroscience and the Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Krystal L Parker
- Department of Psychiatry, The University of Iowa, Iowa City, IA, USA
| | - John H Freeman
- Department of Psychological and Brain Sciences, The University of Iowa, Iowa City, IA, USA.
| |
Collapse
|
11
|
Tsao A, Yousefzadeh SA, Meck WH, Moser MB, Moser EI. The neural bases for timing of durations. Nat Rev Neurosci 2022; 23:646-665. [PMID: 36097049 DOI: 10.1038/s41583-022-00623-3] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/19/2022] [Indexed: 11/10/2022]
Abstract
Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.
Collapse
Affiliation(s)
- Albert Tsao
- Department of Biology, Stanford University, Stanford, CA, USA.
| | | | - Warren H Meck
- Department of Psychology and Neuroscience, Duke University, Durham, NC, USA
| | - May-Britt Moser
- Centre for Neural Computation, Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, Norway
| | - Edvard I Moser
- Centre for Neural Computation, Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, Norway.
| |
Collapse
|
12
|
Khalighinejad N, Manohar S, Husain M, Rushworth MFS. Complementary roles of serotonergic and cholinergic systems in decisions about when to act. Curr Biol 2022; 32:1150-1162.e7. [PMID: 35150603 PMCID: PMC8926843 DOI: 10.1016/j.cub.2022.01.042] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2021] [Revised: 11/15/2021] [Accepted: 01/17/2022] [Indexed: 11/23/2022]
Abstract
Decision-making not only involves deciding about which action to choose but when and whether to initiate an action in the first place. Macaque monkeys tracked number of dots on a screen and could choose when to make a response. The longer the animals waited before responding, the more dots appeared on the screen and the higher the probability of reward. Monkeys waited longer before making a response when a trial’s value was less than the environment’s average value. Recordings of brain activity with fMRI revealed that activity in dorsal raphe nucleus (DRN)—a key source of serotonin (5-HT)—tracked average value of the environment. By contrast, activity in the basal forebrain (BF)—an important source of acetylcholine (ACh)—was related to decision time to act as a function of immediate and recent past context. Interactions between DRN and BF and the anterior cingulate cortex (ACC), another region with action initiation-related activity, occurred as a function of the decision time to act. Next, we performed two psychopharmacological studies. Manipulating systemic 5-HT by citalopram prolonged the time macaques waited to respond for a given opportunity. This effect was more evident during blocks with long inter-trial intervals (ITIs) where good opportunities were sparse. Manipulating systemic acetylcholine (ACh) by rivastigmine reduced the time macaques waited to respond given the immediate and recent past context, a pattern opposite to the effect observed with 5-HT. These findings suggest complementary roles for serotonin/DRN and acetylcholine/BF in decisions about when to initiate an action. Both immediate context and wider environment influence decisions about when to act DRN and 5-HT mediate the influence of wider environment BF and ACh mediate the influence of immediate context
Collapse
Affiliation(s)
- Nima Khalighinejad
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Sanjay Manohar
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Masud Husain
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Matthew F S Rushworth
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| |
Collapse
|
13
|
Ross TW, Easton A. The Hippocampal Horizon: Constructing and Segmenting Experience for Episodic Memory. Neurosci Biobehav Rev 2021; 132:181-196. [PMID: 34826509 DOI: 10.1016/j.neubiorev.2021.11.038] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 11/19/2021] [Accepted: 11/22/2021] [Indexed: 12/29/2022]
Abstract
How do we recollect specific events that have occurred during continuous ongoing experience? There is converging evidence from non-human animals that spatially modulated cellular activity of the hippocampal formation supports the construction of ongoing events. On the other hand, recent human oriented event cognition models have outlined that our experience is segmented into discrete units, and that such segmentation can operate on shorter or longer timescales. Here, we describe a unification of how these dynamic physiological mechanisms of the hippocampus relate to ongoing externally and internally driven event segmentation, facilitating the demarcation of specific moments during experience. Our cross-species interdisciplinary approach offers a novel perspective in the way we construct and remember specific events, leading to the generation of many new hypotheses for future research.
Collapse
Affiliation(s)
- T W Ross
- Department of Psychology, Durham University, South Road, Durham, DH1 3LE, United Kingdom; Centre for Learning and Memory Processes, Durham University, United Kingdom.
| | - A Easton
- Department of Psychology, Durham University, South Road, Durham, DH1 3LE, United Kingdom; Centre for Learning and Memory Processes, Durham University, United Kingdom
| |
Collapse
|