1
|
Kao AB, Banerjee SC, Francisco FA, Berdahl AM. Timing decisions as the next frontier for collective intelligence. Trends Ecol Evol 2024; 39:904-912. [PMID: 38964933 DOI: 10.1016/j.tree.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 06/04/2024] [Accepted: 06/06/2024] [Indexed: 07/06/2024]
Abstract
The past decade has witnessed a growing interest in collective decision making, particularly the idea that groups can make more accurate decisions compared with individuals. However, nearly all research to date has focused on spatial decisions (e.g., food patches). Here, we highlight the equally important, but severely understudied, realm of temporal collective decision making (i.e., decisions about when to perform an action). We illustrate differences between temporal and spatial decisions, including the irreversibility of time, cost asymmetries, the speed-accuracy tradeoff, and game theoretic dynamics. Given these fundamental differences, temporal collective decision making likely requires different mechanisms to generate collective intelligence. Research focused on temporal decisions should lead to an expanded understanding of the adaptiveness and constraints of living in groups.
Collapse
Affiliation(s)
- Albert B Kao
- Department of Biology, University of Massachusetts Boston, Boston, MA 02125, USA.
| | | | - Fritz A Francisco
- Department of Biology, University of Massachusetts Boston, Boston, MA 02125, USA.
| | - Andrew M Berdahl
- School of Aquatic and Fishery Sciences, University of Washington, Seattle, WA 98195, USA.
| |
Collapse
|
2
|
Martel AC, Apicella P. Insights into the interaction between time and reward prediction on the activity of striatal tonically active neurons: A pilot study in rhesus monkeys. Physiol Rep 2024; 12:e70037. [PMID: 39245818 PMCID: PMC11381318 DOI: 10.14814/phy2.70037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 08/21/2024] [Accepted: 08/26/2024] [Indexed: 09/10/2024] Open
Abstract
Prior studies have documented the role of the striatum and its dopaminergic input in time processing, but the contribution of local striatal cholinergic innervation has not been specifically investigated. To address this issue, we recorded the activity of tonically active neurons (TANs), thought to be cholinergic interneurons in the striatum, in two male macaques performing self-initiated movements after specified intervals in the seconds range have elapsed. The behavioral data showed that movement timing was adjusted according to the temporal requirements. About one-third of all recorded TANs displayed brief depressions in firing in response to the cue that indicates the interval duration, and the strength of these modulations was, in some instances, related to the timing of movement. The rewarding outcome of actions also impacted TAN activity, as reflected by stronger responses to the cue paralleled by weaker responses to reward when monkeys performed correctly timed movements over consecutive trials. It therefore appears that TAN responses may act as a start signal for keeping track of time and reward prediction could be incorporated in this signaling function. We conclude that the role of the striatal cholinergic TAN system in time processing is embedded in predicting rewarding outcomes during timing behavior.
Collapse
Affiliation(s)
- A C Martel
- Institut de Neurosciences de la Timone, UMR 7289, Aix Marseille Université, CNRS, Marseille, France
| | - P Apicella
- Institut de Neurosciences de la Timone, UMR 7289, Aix Marseille Université, CNRS, Marseille, France
| |
Collapse
|
3
|
Qu W, Yang Y, Zhou M, Fan W. Impact of self-control and time perception on intertemporal choices in gain and loss situations. Front Psychol 2024; 14:1324146. [PMID: 38406261 PMCID: PMC10884325 DOI: 10.3389/fpsyg.2023.1324146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 12/26/2023] [Indexed: 02/27/2024] Open
Abstract
Individuals frequently encounter dilemmas in which they must choose between smaller, immediate gains and larger, delayed rewards; this phenomenon is known as intertemporal choice. The present study analyzed the interplay of trait and state self-control and time perception tendencies (time overestimation vs. time underestimation) and how it influences the rates of selecting immediate options in both gain and loss situations by conducting an intertemporal choice task. Experiment 1 was used to explore the impact of trait self-control and time perception on intertemporal choices within gain and loss situations. In Experiment 2, the e-crossing task was used to induce self-control resource depletion in participants and to investigate the impact of self-control resources and time perception on intertemporal choices in gain and loss situations. The results indicate that (1) compared with the high-self-control group, the low-self-control group exhibited a greater tendency to choose immediate options. Additionally, the high time estimation group was more likely to opt for immediate choices than the low time estimation group was. Furthermore, participants were more likely to select immediate options in the loss situation than in the gain situation. (2) In the gain situation, the high time estimation group was more likely to choose immediate options than was the low time estimation group. However, in the loss situation, the difference between the two groups was nonsignificant. (3) Time perception and gain-loss situations exerted a moderating mediating effect on the impact of self-control resources on intertemporal choices. These findings shed light on the influence of both self-control abilities and self-control resources on intertemporal choices. They provide valuable insights into intertemporal decision behaviors across diverse contexts and indicate the need for rational analysis based on one's current state to mitigate cognitive biases to ensure individuals can maximize benefits in their daily lives.
Collapse
Affiliation(s)
- Weiguo Qu
- Cognition and Human Behavior Key Laboratory of Hunan Province, Hunan Normal University, Changsha, China
- Department of Psychology, School of Education Science, Hunan Normal University, Changsha, China
| | - Ying Yang
- Cognition and Human Behavior Key Laboratory of Hunan Province, Hunan Normal University, Changsha, China
- Department of Psychology, School of Education Science, Hunan Normal University, Changsha, China
| | - Mengjie Zhou
- Cognition and Human Behavior Key Laboratory of Hunan Province, Hunan Normal University, Changsha, China
- Department of Psychology, School of Education Science, Hunan Normal University, Changsha, China
| | - Wei Fan
- Cognition and Human Behavior Key Laboratory of Hunan Province, Hunan Normal University, Changsha, China
- Department of Psychology, School of Education Science, Hunan Normal University, Changsha, China
- Institute of Interdisciplinary Studies, Hunan Normal University, Changsha, China
| |
Collapse
|
4
|
Jeong H, Taylor A, Floeder JR, Lohmann M, Mihalas S, Wu B, Zhou M, Burke DA, Namboodiri VMK. Mesolimbic dopamine release conveys causal associations. Science 2022; 378:eabq6740. [PMID: 36480599 PMCID: PMC9910357 DOI: 10.1126/science.abq6740] [Citation(s) in RCA: 57] [Impact Index Per Article: 28.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Learning to predict rewards based on environmental cues is essential for survival. It is believed that animals learn to predict rewards by updating predictions whenever the outcome deviates from expectations, and that such reward prediction errors (RPEs) are signaled by the mesolimbic dopamine system-a key controller of learning. However, instead of learning prospective predictions from RPEs, animals can infer predictions by learning the retrospective cause of rewards. Hence, whether mesolimbic dopamine instead conveys a causal associative signal that sometimes resembles RPE remains unknown. We developed an algorithm for retrospective causal learning and found that mesolimbic dopamine release conveys causal associations but not RPE, thereby challenging the dominant theory of reward learning. Our results reshape the conceptual and biological framework for associative learning.
Collapse
Affiliation(s)
- Huijeong Jeong
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Annie Taylor
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Joseph R Floeder
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | | | - Stefan Mihalas
- Allen Institute for Brain Science, Seattle, WA, USA
- Department of Applied Mathematics, University of Washington, Seattle, WA, USA
| | - Brenda Wu
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Mingkang Zhou
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Dennis A Burke
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Vijay Mohan K Namboodiri
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
- Weill Institute for Neuroscience, Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| |
Collapse
|
5
|
Chinoy RB, Tanwar A, Buonomano DV. A Recurrent Neural Network Model Accounts for Both Timing and Working Memory Components of an Interval Discrimination Task. TIMING & TIME PERCEPTION 2022. [DOI: 10.1163/22134468-bja10058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Abstract
Interval discrimination is of fundamental importance to many forms of sensory processing, including speech and music. Standard interval discrimination tasks require comparing two intervals separated in time, and thus include both working memory (WM) and timing components. Models of interval discrimination invoke separate circuits for the timing and WM components. Here we examine if, in principle, the same recurrent neural network can implement both. Using human psychophysics, we first explored the role of the WM component by varying the interstimulus delay. Consistent with previous studies, discrimination was significantly worse for a 250 ms delay, compared to 750 and 1500 ms delays, suggesting that the first interval is stably stored in WM for longer delays. We next successfully trained a recurrent neural network (RNN) on the task, demonstrating that the same network can implement both the timing and WM components. Many units in the RNN were tuned to specific intervals during the sensory epoch, and others encoded the first interval during the delay period. Overall, the encoding strategy was consistent with the notion of mixed selectivity. Units generally encoded more interval information during the sensory epoch than in the delay period, reflecting categorical encoding of short versus long in WM, rather than encoding of the specific interval. Our results demonstrate that, in contrast to standard models of interval discrimination that invoke a separate memory module, the same network can, in principle, solve the timing, WM, and comparison components of an interval discrimination task.
Collapse
Affiliation(s)
- Rehan B. Chinoy
- Departments of Neurobiology and Psychology, Brain Research Institute, and Integrative Center for Learning and Memory, University of California, Los Angeles, CA 90095–1763, USA
| | - Ashita Tanwar
- Departments of Neurobiology and Psychology, Brain Research Institute, and Integrative Center for Learning and Memory, University of California, Los Angeles, CA 90095–1763, USA
| | - Dean V. Buonomano
- Departments of Neurobiology and Psychology, Brain Research Institute, and Integrative Center for Learning and Memory, University of California, Los Angeles, CA 90095–1763, USA
| |
Collapse
|
6
|
Zhou S, Buonomano DV. Neural population clocks: Encoding time in dynamic patterns of neural activity. Behav Neurosci 2022; 136:374-382. [PMID: 35446093 PMCID: PMC9561006 DOI: 10.1037/bne0000515] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The ability to predict and prepare for near- and far-future events is among the most fundamental computations the brain performs. Because of the importance of time for prediction and sensorimotor processing, the brain has evolved multiple mechanisms to tell and encode time across scales ranging from microseconds to days and beyond. Converging experimental and computational data indicate that, on the scale of seconds, timing relies on diverse neural mechanisms distributed across different brain areas. Among the different encoding mechanisms on the scale of seconds, we distinguish between neural population clocks and ramping activity as distinct strategies to encode time. One instance of neural population clocks, neural sequences, represents in some ways an optimal and flexible dynamic regime for the encoding of time. Specifically, neural sequences comprise a high-dimensional representation that can be used by downstream areas to flexibly generate arbitrarily simple and complex output patterns using biologically plausible learning rules. We propose that high-level integration areas may use high-dimensional dynamics such as neural sequences to encode time, providing downstream areas information to build low-dimensional ramp-like activity that can drive movements and temporal expectation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
- Shanglin Zhou
- Department of Neurobiology, University of California, Los Angeles, CA 90095, USA
| | - Dean V. Buonomano
- Department of Neurobiology, University of California, Los Angeles, CA 90095, USA
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| |
Collapse
|
7
|
Martinez MC, Zold CL, Coletti MA, Murer MG, Belluscio MA. Dorsal striatum coding for the timely execution of action sequences. eLife 2022; 11:74929. [PMID: 36426715 PMCID: PMC9699698 DOI: 10.7554/elife.74929] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Accepted: 10/27/2022] [Indexed: 11/27/2022] Open
Abstract
The automatic initiation of actions can be highly functional. But occasionally these actions cannot be withheld and are released at inappropriate times, impulsively. Striatal activity has been shown to participate in the timing of action sequence initiation and it has been linked to impulsivity. Using a self-initiated task, we trained adult male rats to withhold a rewarded action sequence until a waiting time interval has elapsed. By analyzing neuronal activity we show that the striatal response preceding the initiation of the learned sequence is strongly modulated by the time subjects wait before eliciting the sequence. Interestingly, the modulation is steeper in adolescent rats, which show a strong prevalence of impulsive responses compared to adults. We hypothesize this anticipatory striatal activity reflects the animals’ subjective reward expectation, based on the elapsed waiting time, while the steeper waiting modulation in adolescence reflects age-related differences in temporal discounting, internal urgency states, or explore–exploit balance.
Collapse
Affiliation(s)
- Maria Cecilia Martinez
- Universidad de Buenos Aires, Facultad de Ciencias Exactas y Naturales, Departamento de Fisiología, Biología Molecular y Celular “Dr. Héctor Maldonado”Buenos AiresArgentina,Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina
| | - Camila Lidia Zold
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| | - Marcos Antonio Coletti
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| | - Mario Gustavo Murer
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| | - Mariano Andrés Belluscio
- Universidad de Buenos Aires - CONICET, Instituto de Fisiología y Biofísica “Dr. Bernardo Houssay” (IFIBIO-Houssay), Grupo de Neurociencia de SistemasBuenos AiresArgentina,Universidad de Buenos Aires, Facultad de Ciencias Médicas, Departamento de FisiologíaBuenos AiresArgentina
| |
Collapse
|
8
|
Fung BJ, Sutlief E, Hussain Shuler MG. Dopamine and the interdependency of time perception and reward. Neurosci Biobehav Rev 2021; 125:380-391. [PMID: 33652021 PMCID: PMC9062982 DOI: 10.1016/j.neubiorev.2021.02.030] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 02/16/2021] [Accepted: 02/19/2021] [Indexed: 01/14/2023]
Abstract
Time is a fundamental dimension of our perception of the world and is therefore of critical importance to the organization of human behavior. A corpus of work - including recent optogenetic evidence - implicates striatal dopamine as a crucial factor influencing the perception of time. Another stream of literature implicates dopamine in reward and motivation processes. However, these two domains of research have remained largely separated, despite neurobiological overlap and the apothegmatic notion that "time flies when you're having fun". This article constitutes a review of the literature linking time perception and reward, including neurobiological and behavioral studies. Together, these provide compelling support for the idea that time perception and reward processing interact via a common dopaminergic mechanism.
Collapse
Affiliation(s)
- Bowen J Fung
- The Behavioural Insights Team, Suite 3, Level 13/9 Hunter St, Sydney NSW 2000, Australia.
| | - Elissa Sutlief
- The Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University School of Medicine, Woods Basic Science Building Rm914, 725 N. Wolfe Street, Baltimore, MD 21205, USA
| | - Marshall G Hussain Shuler
- The Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University School of Medicine, Woods Basic Science Building Rm914, 725 N. Wolfe Street, Baltimore, MD 21205, USA; Kavli Neuroscience Discovery Institute, The Johns Hopkins University School of Medicine, 725 N Wolfe Street, Baltimore, MD 21205, USA.
| |
Collapse
|
9
|
Sosa JLR, Buonomano D, Izquierdo A. The orbitofrontal cortex in temporal cognition. Behav Neurosci 2021; 135:154-164. [PMID: 34060872 DOI: 10.1037/bne0000430] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
One of the most important factors in decision-making is estimating the value of available options. Subregions of the prefrontal cortex, including the orbitofrontal cortex (OFC), have been deemed essential for this process. Value computations require a complex integration across numerous dimensions, including, reward magnitude, effort, internal state, and time. The importance of the temporal dimension is well illustrated by temporal discounting tasks, in which subjects select between smaller-sooner versus larger-later rewards. The specific role of OFC in telling time and integrating temporal information into decision-making remains unclear. Based on the current literature, in this review we reevaluate current theories of OFC function, accounting for the influence of time. Incorporating temporal information into value estimation and decision-making requires distinct, yet interrelated, forms of temporal information including the ability to tell time, represent time, create temporal expectations, and the ability to use this information for optimal decision-making in a wide range of tasks, including temporal discounting and wagering. We use the term "temporal cognition" to refer to the integrated use of these different aspects of temporal information. We suggest that the OFC may be a critical site for the integration of reward magnitude and delay, and thus important for temporal cognition. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
Affiliation(s)
| | - Dean Buonomano
- Department of Psychology, University of California-Los Angeles
| | | |
Collapse
|
10
|
Garman TS, Setlow B, Orsini CA. Effects of a high-fat diet on impulsive choice in rats. Physiol Behav 2021; 229:113260. [PMID: 33227243 DOI: 10.1016/j.physbeh.2020.113260] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 11/18/2020] [Indexed: 12/21/2022]
Abstract
INTRODUCTION Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice. METHODS Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward. RESULTS There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward. CONCLUSIONS These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.
Collapse
Affiliation(s)
| | - Barry Setlow
- Department of Neuroscience; Department of Psychiatry; McKnight Brain Institute; Center for Addiction Research and Education, University of Florida, Gainesville, FL 32610
| | - Caitlin A Orsini
- Department of Psychiatry; McKnight Brain Institute; Department of Psychology, Waggoner Center for Alcoholism and Addiction Research, The University of Texas at Austin, Austin, TX 78712.
| |
Collapse
|
11
|
Croote DE, Lai B, Hu J, Baxter MG, Montagrin A, Schiller D. Delay discounting decisions are linked to temporal distance representations of world events across cultures. Sci Rep 2020; 10:12913. [PMID: 32737357 PMCID: PMC7395128 DOI: 10.1038/s41598-020-69700-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2020] [Accepted: 07/15/2020] [Indexed: 12/04/2022] Open
Abstract
Delay discounting describes the phenomenon whereby the subjective value of a reward declines as the time until its receipt increases. Individuals differ in the subjective value that they assign to future rewards, yet, the components feeding into this appraisal of value remain unclear. We examined whether temporal psychological distance, i.e. the closeness one feels to the past and future, is one such component. English speakers in the USA and Mandarin speakers in China completed a delay discounting task and organized past and future world events on a canvas according to their representation of the event’s temporal position relative to themselves. Previous work has identified linguistic and cultural differences in time conception between these populations, thus, we hypothesized that this sample would display the variability necessary to probe whether temporal psychological distance plays a role in reward valuation. We found that English speakers employed horizontal, linear representations of world events, while Mandarin speakers used more two-dimensional, circular representations. Across cultures, individuals who represented the future as more distant discounted future rewards more strongly. Distance representations of past events, however, were associated with discounting behaviors selectively in Mandarin speakers. This suggests that temporal psychological distance plays a fundamental role in farsighted decision-making.
Collapse
Affiliation(s)
- Denise E Croote
- The Nash Family Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA.,Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA
| | - Baojun Lai
- School of Psychology and Center for Studies of Psychological Application, South China Normal University, Guangzhou, 510631, China
| | - Jingchu Hu
- School of Psychology and Center for Studies of Psychological Application, South China Normal University, Guangzhou, 510631, China
| | - Mark G Baxter
- The Nash Family Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA
| | - Alison Montagrin
- The Nash Family Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA. .,Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA.
| | - Daniela Schiller
- The Nash Family Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA. .,Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA.
| |
Collapse
|
12
|
Stam CH, van der Veen FM, Franken IHA. Individual differences in time estimation are associated with delay discounting and alcohol use. CURRENT PSYCHOLOGY 2020. [DOI: 10.1007/s12144-020-00899-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
13
|
Kane GA, Bornstein AM, Shenhav A, Wilson RC, Daw ND, Cohen JD. Rats exhibit similar biases in foraging and intertemporal choice tasks. eLife 2019; 8:48429. [PMID: 31532391 PMCID: PMC6794087 DOI: 10.7554/elife.48429] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Accepted: 09/17/2019] [Indexed: 12/05/2022] Open
Abstract
Animals, including humans, consistently exhibit myopia in two different contexts: foraging, in which they harvest locally beyond what is predicted by optimal foraging theory, and intertemporal choice, in which they exhibit a preference for immediate vs. delayed rewards beyond what is predicted by rational (exponential) discounting. Despite the similarity in behavior between these two contexts, previous efforts to reconcile these observations in terms of a consistent pattern of time preferences have failed. Here, via extensive behavioral testing and quantitative modeling, we show that rats exhibit similar time preferences in both contexts: they prefer immediate vs. delayed rewards and they are sensitive to opportunity costs of delays to future decisions. Further, a quasi-hyperbolic discounting model, a form of hyperbolic discounting with separate components for short- and long-term rewards, explains individual rats’ time preferences across both contexts, providing evidence for a common mechanism for myopic behavior in foraging and intertemporal choice. Often decisions have to be made on whether to stick with a resource or leave it behind to search for a better alternative. Should you book that hotel room or continue looking at others? Is it time to start searching for a new job, or even for a new partner? Animals face similar 'stick or twist' decisions when foraging for food. Knowing how to maximize the amount of food you obtain is key to survival. Studies have shown that most animals tend to stick with a food source for a little too long, a phenomenon known as 'overharvesting'. To find out why, Kane et al. designed carefully controlled experiments to compare foraging behavior in rats to another form of decision-making, known as intertemporal choice. The latter involves choosing between a small reward now versus a larger reward later. Given this choice, most rats opt to receive a smaller reward now rather than wait for the larger reward. This suggests that rats value rewards available in the future less than rewards they can get immediately. Kane et al. showed that this preference for short-term rewards can also explain why rats overharvest in foraging scenarios. By leaving one food source to go in search of another, rats must put up with a delay before they can access the new food supply. This delay, due to the time required to travel and search, reduces the value of the future reward. As a result, rats are more likely to stick with their current food source, even though leaving it would yield a greater reward in the long run. These findings in rats raise important questions about the mechanisms that lead to biases in thinking, and how factors like changes in the environment or specific disease states can influence these biases.
Collapse
Affiliation(s)
- Gary A Kane
- Department of Psychology, Princeton Neuroscience Institute, Princeton University, Princeton, United States.,Rowland Institute at Harvard, Harvard University, Cambridge, United States
| | - Aaron M Bornstein
- Department of Psychology, Princeton Neuroscience Institute, Princeton University, Princeton, United States.,Department of Cognitive Sciences, Center for the Neurobiology of Learning and Memory, University of California, Irvine, Irvine, United States
| | - Amitai Shenhav
- Department of Cognitive, Linguistic and Psychological Sciences, Carney Institute for Brain Science, Brown University, Providence, United States
| | - Robert C Wilson
- Department of Psychology, Cognitive Science Program, University of Arizona, Tucson, United States
| | - Nathaniel D Daw
- Department of Psychology, Princeton Neuroscience Institute, Princeton University, Princeton, United States
| | - Jonathan D Cohen
- Department of Psychology, Princeton Neuroscience Institute, Princeton University, Princeton, United States
| |
Collapse
|
14
|
Temporal and spatial discounting are distinct in humans. Cognition 2019; 190:212-220. [DOI: 10.1016/j.cognition.2019.04.030] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2018] [Revised: 04/25/2019] [Accepted: 04/27/2019] [Indexed: 11/22/2022]
|
15
|
Namboodiri VMK, Otis JM, van Heeswijk K, Voets ES, Alghorazi RA, Rodriguez-Romaguera J, Mihalas S, Stuber GD. Single-cell activity tracking reveals that orbitofrontal neurons acquire and maintain a long-term memory to guide behavioral adaptation. Nat Neurosci 2019; 22:1110-1121. [PMID: 31160741 PMCID: PMC7002110 DOI: 10.1038/s41593-019-0408-1] [Citation(s) in RCA: 85] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2018] [Accepted: 04/17/2019] [Indexed: 11/29/2022]
Abstract
Learning to predict rewards based on environmental cues is essential for survival. The orbitofrontal cortex (OFC) contributes to such learning by conveying reward-related information to brain areas such as the ventral tegmental area (VTA). Despite this, how cue-reward memory representations form in individual OFC neurons and are modified based on new information is unknown. To address this, using in vivo two-photon calcium imaging in mice, we tracked the response evolution of thousands of OFC output neurons, including those projecting to VTA, through multiple days and stages of cue-reward learning. Collectively, we show that OFC contains several functional clusters of neurons distinctly encoding cue-reward memory representations, with only select responses routed downstream to VTA. Unexpectedly, these representations were stably maintained by the same neurons even after extinction of the cue-reward pairing, and supported behavioral learning and memory. Thus, OFC neuronal activity represents a long-term cue-reward associative memory to support behavioral adaptation.
Collapse
Affiliation(s)
- Vijay Mohan K Namboodiri
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Center for the Neurobiology of Addiction, Pain, and Emotion, Department of Anesthesiology and Pain Medicine, Department of Pharmacology, University of Washington, Seattle, WA, USA
| | - James M Otis
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, USA
| | - Kay van Heeswijk
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Arts-Klinisch Onderzoeker, Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, the Netherlands
| | - Elisa S Voets
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Rizk A Alghorazi
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | | | - Garret D Stuber
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
- Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
- Neuroscience Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
- Department of Cell Biology and Physiology, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
- Center for the Neurobiology of Addiction, Pain, and Emotion, Department of Anesthesiology and Pain Medicine, Department of Pharmacology, University of Washington, Seattle, WA, USA.
| |
Collapse
|
16
|
Abstract
During foraging, animals decide how long to stay at a patch and harvest reward, and then, they move with certain vigor to another location. How does the brain decide when to leave, and how does it determine the speed of the ensuing movement? Here, we considered the possibility that both the decision-making and the motor control problems aimed to maximize a single normative utility: the sum of all rewards acquired minus all efforts expended divided by total time. This optimization could be achieved if the brain compared a local measure of utility with its history. To test the theory, we examined behavior of people as they gazed at images: they chose how long to look at the image (harvesting information) and then moved their eyes to another image, controlling saccade speed. We varied reward via image content and effort via image eccentricity, and then, we measured how these changes affected decision making (gaze duration) and motor control (saccade speed). After a history of low rewards, people increased gaze duration and decreased saccade speed. In anticipation of future effort, they lowered saccade speed and increased gaze duration. After a history of high effort, they elevated their saccade speed and increased gaze duration. Therefore, the theory presented a principled way with which the brain may control two aspects of behavior: movement speed and harvest duration. Our experiments confirmed many (but not all) of the predictions, suggesting that harvest duration and movement speed, fundamental aspects of behavior during foraging, may be governed by a shared principle of control.
Collapse
|
17
|
Solomon RB, Conover K, Shizgal P. Valuation of opportunity costs by rats working for rewarding electrical brain stimulation. PLoS One 2017; 12:e0182120. [PMID: 28841663 PMCID: PMC5571941 DOI: 10.1371/journal.pone.0182120] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2017] [Accepted: 07/12/2017] [Indexed: 11/29/2022] Open
Abstract
Pursuit of one goal typically precludes simultaneous pursuit of another. Thus, each exclusive activity entails an “opportunity cost:” the forgone benefits from the next-best activity eschewed. The present experiment estimates, in laboratory rats, the function that maps objective opportunity costs into subjective ones. In an operant chamber, rewarding electrical brain stimulation was delivered when the cumulative time a lever had been depressed reached a criterion duration. The value of the activities forgone during this duration is the opportunity cost of the electrical reward. We determined which of four functions best describes how objective opportunity costs, expressed as the required duration of lever depression, are translated into their subjective equivalents. The simplest account is the identity function, which equates subjective and objective opportunity costs. A variant of this function called the “sigmoidal-slope function,” converges on the identity function at longer durations but deviates from it at shorter durations. The sigmoidal-slope function has the form of a hockey stick. The flat “blade” denotes a range over which opportunity costs are subjectively equivalent; these durations are too short to allow substitution of more beneficial activities. The blade extends into an upward-curving portion over which costs become discriminable and finally into the straight “handle,” over which objective and subjective costs match. The two remaining functions are based on hyperbolic and exponential temporal discounting, respectively. The results are best described by the sigmoidal-slope function. That this is so suggests that different principles of intertemporal choice are involved in the evaluation of time spent working for a reward or waiting for its delivery. The subjective opportunity-cost function plays a key role in the evaluation and selection of goals. An accurate description of its form and parameters is essential to successful modeling and prediction of instrumental performance and reward-related decision making.
Collapse
Affiliation(s)
- Rebecca Brana Solomon
- Centre for Studies in Behavioural Neurobiology / Groupe de recherche en neurobiologie comportementale, Department of Psychology, Concordia University, Montréal, Québec, Canada
| | - Kent Conover
- Centre for Studies in Behavioural Neurobiology / Groupe de recherche en neurobiologie comportementale, Department of Psychology, Concordia University, Montréal, Québec, Canada
| | - Peter Shizgal
- Centre for Studies in Behavioural Neurobiology / Groupe de recherche en neurobiologie comportementale, Department of Psychology, Concordia University, Montréal, Québec, Canada
- * E-mail:
| |
Collapse
|
18
|
Nigg JT. Annual Research Review: On the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. J Child Psychol Psychiatry 2017; 58:361-383. [PMID: 28035675 PMCID: PMC5367959 DOI: 10.1111/jcpp.12675] [Citation(s) in RCA: 723] [Impact Index Per Article: 103.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/14/2016] [Indexed: 01/08/2023]
Abstract
BACKGROUND Self-regulation (SR) is central to developmental psychopathology, but progress has been impeded by varying terminology and meanings across fields and literatures. METHODS The present review attempts to move that discussion forward by noting key sources of prior confusion such as measurement-concept confounding, and then arguing the following major points. RESULTS First, the field needs a domain-general construct of SR that encompasses SR of action, emotion, and cognition and involves both top-down and bottom-up regulatory processes. This does not assume a shared core process across emotion, action, and cognition, but is intended to provide clarity on the extent of various claims about kinds of SR. Second, top-down aspects of SR need to be integrated. These include (a) basic processes that develop early and address immediate conflict signals, such as cognitive control and effortful control (EC), and (b) complex cognition and strategies for addressing future conflict, represented by the regulatory application of complex aspects of executive functioning. Executive function (EF) and cognitive control are not identical to SR because they can be used for other activities, but account for top-down aspects of SR at the cognitive level. Third, impulsivity, risk-taking, and disinhibition are distinct although overlapping; a taxonomy of the kinds of breakdowns of SR associated with psychopathology requires their differentiation. Fourth, different aspects of the SR universe can be organized hierarchically in relation to granularity, development, and time. Low-level components assemble into high-level components. This hierarchical perspective is consistent across literatures. CONCLUSIONS It is hoped that the framework outlined here will facilitate integration and cross-talk among investigators working from different perspectives, and facilitate individual differences research on how SR relates to developmental psychopathology.
Collapse
Affiliation(s)
- Joel T Nigg
- Department of Psychiatry, Oregon Health and Science University, Portland, OR, USA
| |
Collapse
|
19
|
Interactive roles of the cerebellum and striatum in sub-second and supra-second timing: Support for an initiation, continuation, adjustment, and termination (ICAT) model of temporal processing. Neurosci Biobehav Rev 2016; 71:739-755. [PMID: 27773690 DOI: 10.1016/j.neubiorev.2016.10.015] [Citation(s) in RCA: 59] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2016] [Revised: 10/06/2016] [Accepted: 10/19/2016] [Indexed: 12/29/2022]
|
20
|
Namboodiri VM, Hussain Shuler MG. The hunt for the perfect discounting function and a reckoning of time perception. Curr Opin Neurobiol 2016; 40:135-141. [PMID: 27479656 PMCID: PMC5056825 DOI: 10.1016/j.conb.2016.06.019] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2016] [Revised: 06/12/2016] [Accepted: 06/22/2016] [Indexed: 11/26/2022]
Abstract
Making decisions that factor the cost of time is fundamental to survival. Yet, while it is readily appreciated that our perception of time is intimately involved in this process, theories regarding intertemporal decision-making and theories regarding time perception are treated, largely, independently. Even within these respective domains, models providing good fits to data fail to provide insight as to why, from a normative sense, those fits should take their apparent form. Conversely, normative models that proffer a rationalization for why an agent should weigh options in a particular way, or to perceive time in a particular way, fail to account for the full body of well-established experimental evidence. Here we review select, yet key advances in our understanding, identifying conceptual breakthroughs in the fields of intertemporal decision-making and in time perception, as well as their limits and failings in the face of hard-won experimental observation. On this background of accrued knowledge, a new conception unifying the domains of decision-making and time perception is put forward (Training-Integrated Maximization of Reinforcement Rate, TIMERR) to provide a better fit to observations and a more parsimonious reckoning of why we make choices, and thereby perceive time, the way we do.
Collapse
Affiliation(s)
- Vijay Mk Namboodiri
- Department of Psychiatry and Neuroscience Center, University of North Carolina at Chapel Hill, 4109D Neuroscience Research Building, 115 Mason Farm Road, Chapel Hill, NC 27599, USA
| | - Marshall G Hussain Shuler
- Department of Neuroscience, Johns Hopkins University, Woods Basic Science Building, Rm 914, 725 North Wolfe Street, Baltimore, MD 21205, USA.
| |
Collapse
|
21
|
Rationalizing spatial exploration patterns of wild animals and humans through a temporal discounting framework. Proc Natl Acad Sci U S A 2016; 113:8747-52. [PMID: 27385831 DOI: 10.1073/pnas.1601664113] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023] Open
Abstract
Understanding the exploration patterns of foragers in the wild provides fundamental insight into animal behavior. Recent experimental evidence has demonstrated that path lengths (distances between consecutive turns) taken by foragers are well fitted by a power law distribution. Numerous theoretical contributions have posited that "Lévy random walks"-which can produce power law path length distributions-are optimal for memoryless agents searching a sparse reward landscape. It is unclear, however, whether such a strategy is efficient for cognitively complex agents, from wild animals to humans. Here, we developed a model to explain the emergence of apparent power law path length distributions in animals that can learn about their environments. In our model, the agent's goal during search is to build an internal model of the distribution of rewards in space that takes into account the cost of time to reach distant locations (i.e., temporally discounting rewards). For an agent with such a goal, we find that an optimal model of exploration in fact produces hyperbolic path lengths, which are well approximated by power laws. We then provide support for our model by showing that humans in a laboratory spatial exploration task search space systematically and modify their search patterns under a cost of time. In addition, we find that path length distributions in a large dataset obtained from free-ranging marine vertebrates are well described by our hyperbolic model. Thus, we provide a general theoretical framework for understanding spatial exploration patterns of cognitively complex foragers.
Collapse
|
22
|
Carter EC, Redish AD. Rats value time differently on equivalent foraging and delay-discounting tasks. J Exp Psychol Gen 2016; 145:1093-101. [PMID: 27359127 DOI: 10.1037/xge0000196] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
All organisms have to consider consequences that vary through time. Theories explaining how animals handle intertemporal choice include delay-discounting models, in which the value of future rewards is discounted by the delay until receipt, and foraging models, which predict that decision-makers maximize rate of reward. We measured the behavior of rats on a 2-option delay-discounting task and a stay/go foraging task that were equivalent for rate of reward and physical demand. Despite the highly shared features of the tasks, rats were willing to wait much longer on the foraging task than on the delay-discounting task. Moreover, choice performance by rats was less optimal in terms of total reward received on the foraging task compared to the delay-discounting task. We applied a suite of intertemporal choice models to the data but found that we needed a novel model incorporating interactions of decision-making systems to successfully explain behavior. Our findings (a) highlight the importance of factors that historically have been seen as irrelevant and (b) indicate the inadequacy of current general theories of intertemporal choice. (PsycINFO Database Record
Collapse
Affiliation(s)
- Evan C Carter
- Department of Ecology, Evolution and Behavior, University of Minnesota
| | | |
Collapse
|
23
|
Abstract
While many high-level cortical areas have been implicated in timing, timing activity has also been observed even in the earliest cortical stages of the visual system over the past decade. This activity has been formally modeled as one arising from a reinforcement signal, leading to testable hypotheses with recent experimental support, demonstrating the necessity and sufficiency of that reinforcement signal. As observed in other cortical areas implicated in timing, interval timing activity within the visual cortex abides by the temporal scalar property. Finally, perturbations of the visual cortex during interval timing results in lawful shifts in timing. These and related observations advance the notion that visual cortex is a substrate for learning and expressing visually-associated temporal expectations governing behaviorally-relevant actions.
Collapse
Affiliation(s)
- Marshall G Hussain Shuler
- Department of Neuroscience, Johns Hopkins University, Woods Basic Science Building, Rm 914, 725 North Wolfe Street, Baltimore MD, 21205 USA, 1 617-694-6111
| |
Collapse
|
24
|
Namboodiri VMK, Mihalas S, Hussain Shuler MG. Analytical Calculation of Errors in Time and Value Perception Due to a Subjective Time Accumulator: A Mechanistic Model and the Generation of Weber’s Law. Neural Comput 2016; 28:89-117. [DOI: 10.1162/neco_a_00792] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
It has been previously shown (Namboodiri, Mihalas, Marton, & Hussain Shuler, 2014 ) that an evolutionary theory of decision making and time perception is capable of explaining numerous behavioral observations regarding how humans and animals decide between differently delayed rewards of differing magnitudes and how they perceive time. An implementation of this theory using a stochastic drift-diffusion accumulator model (Namboodiri, Mihalas, & Hussain Shuler, 2014a ) showed that errors in time perception and decision making approximately obey Weber’s law for a range of parameters. However, prior calculations did not have a clear mechanistic underpinning. Further, these calculations were only approximate, with the range of parameters being limited. In this letter, we provide a full analytical treatment of such an accumulator model, along with a mechanistic implementation, to calculate the expression of these errors for the entirety of the parameter space. In our mechanistic model, Weber’s law results from synaptic facilitation and depression within the feedback synapses of the accumulator. Our theory also makes the prediction that the steepness of temporal discounting can be affected by requiring the precise timing of temporal intervals. Thus, by presenting exact quantitative calculations, this work provides falsifiable predictions for future experimental testing.
Collapse
Affiliation(s)
| | - Stefan Mihalas
- Allen Institute for Brain Science, Seattle, WA 98103, U.S.A
| | | |
Collapse
|
25
|
Theta Oscillations in Visual Cortex Emerge with Experience to Convey Expected Reward Time and Experienced Reward Rate. J Neurosci 2015; 35:9603-14. [PMID: 26134643 DOI: 10.1523/jneurosci.0296-15.2015] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The primary visual cortex (V1) is widely regarded as faithfully conveying the physical properties of visual stimuli. Thus, experience-induced changes in V1 are often interpreted as improving visual perception (i.e., perceptual learning). Here we describe how, with experience, cue-evoked oscillations emerge in V1 to convey expected reward time as well as to relate experienced reward rate. We show, in chronic multisite local field potential recordings from rat V1, that repeated presentation of visual cues induces the emergence of visually evoked oscillatory activity. Early in training, the visually evoked oscillations relate to the physical parameters of the stimuli. However, with training, the oscillations evolve to relate the time in which those stimuli foretell expected reward. Moreover, the oscillation prevalence reflects the reward rate recently experienced by the animal. Thus, training induces experience-dependent changes in V1 activity that relate to what those stimuli have come to signify behaviorally: when to expect future reward and at what rate.
Collapse
|
26
|
Abstract
The ability to time intervals confers organisms, including humans, with many remarkable capabilities. A common method for studying interval timing is classification, in which a subject must indicate whether a given probe duration is nearer a previously learned short or long reference interval. This task is designed to reveal the probe duration that is equally likely to be labeled as short or long, known as the temporal bisection point. Studies have found that this bisection point is influenced by a variety of factors including the ratio of the target intervals, the spacing of the probe durations, the modalities of the stimuli, the attentional load, and the inter-trial duration. While several of these factors are thought to be mediated by memory effects, the prototypical classification task affords no opportunity to measure these memory effects directly. Here, we present a novel bisection task, termed the “Bisection by Classification and Production” (BiCaP) task, in which classification trials are interleaved with trials in which subjects must produce either the short or long referents or their midpoint. Using this method, we found a significant correlation between the means of the remembered referents and the bisection points for both classification and production trials. We then cross-validated the bisection points for production and classification trials by showing that they were not statistically differentiable. In addition to these population-level effects, we found within-subject evidence for co-variation across a session between the production bisection points and the means of the remembered referents. Finally, by using two sets of referent durations, we showed that only memory bias-corrected measures were consistent with a previously reported effect in which the ratio of the referents affects the location of the bisection point. These results suggest that memory effects should be considered in temporal tasks.
Collapse
Affiliation(s)
- Joshua M Levy
- Department of Neuroscience, Johns Hopkins University Baltimore, MD, USA
| | | | | |
Collapse
|
27
|
Namboodiri VMK, Huertas MA, Monk KJ, Shouval HZ, Hussain Shuler MG. Visually cued action timing in the primary visual cortex. Neuron 2015; 86:319-30. [PMID: 25819611 DOI: 10.1016/j.neuron.2015.02.043] [Citation(s) in RCA: 49] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2014] [Revised: 12/04/2014] [Accepted: 02/20/2015] [Indexed: 12/22/2022]
Abstract
Most behaviors are generated in three steps: sensing the external world, processing that information to instruct decision-making, and producing a motor action. Sensory areas, especially primary sensory cortices, have long been held to be involved only in the first step of this sequence. Here, we develop a visually cued interval timing task that requires rats to decide when to perform an action following a brief visual stimulus. Using single-unit recordings and optogenetics in this task, we show that activity generated by the primary visual cortex (V1) embodies the target interval and may instruct the decision to time the action on a trial-by-trial basis. A spiking neuronal model of local recurrent connections in V1 produces neural responses that predict and drive the timing of future actions, rationalizing our observations. Our data demonstrate that the primary visual cortex may contribute to the instruction of visually cued timed actions.
Collapse
Affiliation(s)
- Vijay Mohan K Namboodiri
- The Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University, Baltimore, MD 21205, USA
| | - Marco A Huertas
- Department of Neurobiology and Anatomy, University of Texas - Houston, Houston, TX 77030, USA
| | - Kevin J Monk
- The Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University, Baltimore, MD 21205, USA
| | - Harel Z Shouval
- Department of Neurobiology and Anatomy, University of Texas - Houston, Houston, TX 77030, USA
| | - Marshall G Hussain Shuler
- The Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University, Baltimore, MD 21205, USA.
| |
Collapse
|
28
|
Namboodiri VMK, Mihalas S, Hussain Shuler MG. A temporal basis for Weber's law in value perception. Front Integr Neurosci 2014; 8:79. [PMID: 25352791 PMCID: PMC4196632 DOI: 10.3389/fnint.2014.00079] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2014] [Accepted: 09/22/2014] [Indexed: 01/08/2023] Open
Abstract
Weber's law—the observation that the ability to perceive changes in magnitudes of stimuli is proportional to the magnitude—is a widely observed psychophysical phenomenon. It is also believed to underlie the perception of reward magnitudes and the passage of time. Since many ecological theories state that animals attempt to maximize reward rates, errors in the perception of reward magnitudes and delays must affect decision-making. Using an ecological theory of decision-making (TIMERR), we analyze the effect of multiple sources of noise (sensory noise, time estimation noise, and integration noise) on reward magnitude and subjective value perception. We show that the precision of reward magnitude perception is correlated with the precision of time perception and that Weber's law in time estimation can lead to Weber's law in value perception. The strength of this correlation is predicted to depend on the reward history of the animal. Subsequently, we show that sensory integration noise (either alone or in combination with time estimation noise) also leads to Weber's law in reward magnitude perception in an accumulator model, if it has balanced Poisson feedback. We then demonstrate that the noise in subjective value of a delayed reward, due to the combined effect of noise in both the perception of reward magnitude and delay, also abides by Weber's law. Thus, in our theory we prove analytically that the perception of reward magnitude, time, and subjective value change all approximately obey Weber's law.
Collapse
|