51
|
Bulley A, Henry J, Suddendorf T. Prospection and the Present Moment: The Role of Episodic Foresight in Intertemporal Choices between Immediate and Delayed Rewards. REVIEW OF GENERAL PSYCHOLOGY 2016. [DOI: 10.1037/gpr0000061] [Citation(s) in RCA: 88] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
Humans are capable of imagining future rewards and the contexts in which they may be obtained. Functionally, intertemporal choices between smaller but immediate and larger but delayed rewards may be made without such episodic foresight. However, we propose that explicit simulations of this sort enable more flexible and adaptive intertemporal decision-making. Emotions triggered through the simulation of future situations can motivate people to forego immediate pleasures in the pursuit of long-term rewards. However, we stress that the most adaptive option need not always be a larger later reward. When the future is anticipated to be uncertain, for instance, it may make sense for preferences to shift toward more immediate rewards, instead. Imagining potential future scenarios and assessment of their likelihood and affective consequences allows humans to determine when it is more adaptive to delay gratification in pursuit of a larger later reward, and when the better strategy is to indulge in a present temptation. We discuss clinical studies that highlight when and how the effect of episodic foresight on intertemporal decision-making can be altered, and consider the relevance of this perspective to understanding the nature of self-control.
Collapse
Affiliation(s)
- Adam Bulley
- School of Psychology, The University of Queensland
| | - Julie Henry
- School of Psychology, The University of Queensland
| | | |
Collapse
|
52
|
Klein SB. Autonoetic consciousness: Reconsidering the role of episodic memory in future-oriented self-projection. Q J Exp Psychol (Hove) 2016; 69:381-401. [DOI: 10.1080/17470218.2015.1007150] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Following the seminal work of Ingvar (1985. “Memory for the future”: An essay on the temporal organization of conscious awareness. Human Neurobiology, 4, 127–136), Suddendorf (1994. The discovery of the fourth dimension: Mental time travel and human evolution. Master's thesis. University of Waikato, Hamilton, New Zealand), and Tulving (1985. Memory and consciousness. Canadian Psychology/PsychologieCanadienne, 26, 1–12), exploration of the ability to anticipate and prepare for future contingencies that cannot be known with certainty has grown into a thriving research enterprise. A fundamental tenet of this line of inquiry is that future-oriented mental time travel, in most of its presentations, is underwritten by a property or an extension of episodic recollection. However, a careful conceptual analysis of exactly how episodic memory functions in this capacity has yet to be undertaken. In this paper I conduct such an analysis. Based on conceptual, phenomenological, and empirical considerations, I conclude that the autonoetic component of episodic memory, not episodic memory per se, is the causally determinative factor enabling an individual to project him or herself into a personal future.
Collapse
Affiliation(s)
- Stanley B. Klein
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA, USA
| |
Collapse
|
53
|
How does the hippocampus shape decisions? Neurobiol Learn Mem 2015; 125:93-7. [DOI: 10.1016/j.nlm.2015.08.005] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2015] [Revised: 07/30/2015] [Accepted: 08/11/2015] [Indexed: 11/20/2022]
|
54
|
Abstract
The lesion-deficit model dominates neuropsychology. This is unsurprising given powerful demonstrations that focal brain lesions can affect specific aspects of cognition. Nowhere is this more evident than in patients with bilateral hippocampal damage. In the past 60 years, the amnesia and other impairments exhibited by these patients have helped to delineate the functions of the hippocampus and shape the field of memory. We do not question the value of this approach. However, less prominent are the cognitive processes that remain intact following hippocampal lesions. Here, we collate the piecemeal reports of preservation of function following focal bilateral hippocampal damage, highlighting a wealth of information often veiled by the field's focus on deficits. We consider how a systematic understanding of what is preserved as well as what is lost could add an important layer of precision to models of memory and the hippocampus.
Collapse
Affiliation(s)
- Ian A Clark
- Wellcome Trust Center for Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom; ,
| | - Eleanor A Maguire
- Wellcome Trust Center for Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom; ,
| |
Collapse
|
55
|
Abela AR, Duan Y, Chudasama Y. Hippocampal interplay with the nucleus accumbens is critical for decisions about time. Eur J Neurosci 2015; 42:2224-33. [PMID: 26121594 PMCID: PMC5233438 DOI: 10.1111/ejn.13009] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2015] [Revised: 06/02/2015] [Accepted: 06/23/2015] [Indexed: 11/29/2022]
Abstract
Human cognition depends upon the capacity to make decisions in the present that bear upon outcomes in the future. The nucleus accumbens, a recipient of direct projections from both the hippocampus and orbitofrontal cortex, is known to contribute to these aspects of decision-making. Here we demonstrate that interaction of the nucleus accumbens with the hippocampus, but not the orbitofrontal cortex, is critical in shaping decisions that involve time trade-offs. Compared with controls, rats with a disrupted hippocampal-accumbens interaction were strongly biased toward choosing stimuli that led to small and immediate food rewards over large and delayed ones. We show that this pattern of behavior cannot be ascribed to the impaired representation of stimulus value, the incapacity to wait, or a general disruption of decision-making. These results identify a hippocampal-accumbens circuit that may underlie a range of problems in which daily decisions are marked by a shift toward immediate gratification.
Collapse
Affiliation(s)
- Andrew R Abela
- Department of Psychology, McGill University, Montreal, QC, H3A 1B1, Canada
| | - Yiran Duan
- Department of Psychology, McGill University, Montreal, QC, H3A 1B1, Canada
| | - Yogita Chudasama
- Department of Psychology, McGill University, Montreal, QC, H3A 1B1, Canada
| |
Collapse
|
56
|
Wiehler A, Bromberg U, Peters J. The Role of Prospection in Steep Temporal Reward Discounting in Gambling Addiction. Front Psychiatry 2015; 6:112. [PMID: 26379558 PMCID: PMC4548081 DOI: 10.3389/fpsyt.2015.00112] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/08/2015] [Accepted: 07/24/2015] [Indexed: 12/18/2022] Open
Abstract
Addiction and pathological gambling (PG) have been consistently associated with high impulsivity and a steep devaluation of delayed rewards, a process that is known as temporal discounting (TD). Recent studies indicated that enhanced episodic future thinking (EFT) results in less impulsive TD in healthy controls (HCs). In a separate line of research, it has been suggested that non-linearities in time perception might contribute to reward devaluation during inter-temporal choice. Therefore, in addition to deficits in valuation processes and executive control, impairments in EFT and non-linearities in time perception have been hypothesized to contribute to steep TD in addiction. In this study, we explore such a potential association of impairments in EFT and time perception with steep TD in PG. We investigated 20 PGs and 20 matched HCs. TD was assessed via a standard computerized binary choice task. EFT was measured using a variation of the Autobiographical Memory Interview by Levine et al. (1). Time perception was assessed with a novel task, utilizing a non-linear rating procedure via circle-size adjustments. Groups did not differ in baseline EFT. In both groups, a power law accounted time perception best, and the degree of non-linearity in time perception correlated with discounting across groups. A multiple regression analysis across all predictors and covariates revealed that only group status (PG/HC) and depression were significantly associated with discounting behavior such that PG increased TD and depression attenuated TD. Our findings speak against the idea that steep TD in PG is due to a skewed perception of time or impairments in EFT, at least under the present task conditions. The lack of overall group differences in EFT does not rule out the possibility of more complex interactions of EFT and decision-making. These interactions might be diminished in pathological gambling or addiction more generally, when other task configurations are used.
Collapse
Affiliation(s)
- Antonius Wiehler
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Uli Bromberg
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Jan Peters
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
57
|
Bellagamba F, Addessi E, Focaroli V, Pecora G, Maggiorelli V, Pace B, Paglieri F. False belief understanding and "cool" inhibitory control in 3-and 4-years-old Italian children. Front Psychol 2015; 6:872. [PMID: 26175700 PMCID: PMC4483514 DOI: 10.3389/fpsyg.2015.00872] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2015] [Accepted: 06/12/2015] [Indexed: 12/04/2022] Open
Abstract
During preschool years, major developments occur in both executive function and theory of mind (ToM), and several studies have demonstrated a correlation between these processes. Research on the development of inhibitory control (IC) has distinguished between more cognitive, “cool” aspects of self-control, measured by conflict tasks, that require inhibiting an habitual response to generate an arbitrary one, and “hot,” affective aspects, such as affective decision making, measured by delay tasks, that require inhibition of a prepotent response. The aim of this study was to investigate the relations between 3- and 4-year-olds’ performance on a task measuring false belief understanding, the most widely used index of ToM in preschoolers, and three tasks measuring cognitive versus affective aspects of IC. To this end, we tested 101 Italian preschool children in four tasks: (a) the Unexpected Content False Belief task, (b) the Conflict task (a simplified version of the Day–Night Stroop task), (c) the Delay task, and (d) the Delay Choice task. Children’s receptive vocabulary was assessed by the Peabody Picture Vocabulary test. Children’s performance in the False Belief task was significantly related only to performance in the Conflict task, controlling for vocabulary and age. Importantly, children’s performance in the Conflict task did not significantly correlate with their performance in the Delay task or in the Delay Choice task, suggesting that these tasks measure different components of IC. The dissociation between the Conflict and the Delay tasks may indicate that monitoring and regulating a cool process (as flexible categorization) may involve different abilities than monitoring and regulating a hot process (not touching an available and highly attractive stimulus or choosing between a smaller immediate option and a larger delayed one). Moreover, our findings support the view that “cool” aspects of IC and ToM are interrelated, extending to an Italian sample of children previous findings on an association between self-control and ToM.
Collapse
Affiliation(s)
- Francesca Bellagamba
- Dipartimento di Psicologia Dinamica e Clinica, Sapienza Università di Roma Rome, Italy
| | - Elsa Addessi
- Istituto di Scienze e Tecnologie della Cognizione, Consiglio Nazionale delle Ricerche Roma, Italy
| | - Valentina Focaroli
- Dipartimento di Psicologia Dinamica e Clinica, Sapienza Università di Roma Rome, Italy ; Università Campus Bio-Medico Roma, Italy
| | - Giulia Pecora
- Dipartimento di Psicologia dei Processi di Sviluppo e Socializzazione, Sapienza Università di Roma Rome, Italy
| | - Valentina Maggiorelli
- Dipartimento di Psicologia Dinamica e Clinica, Sapienza Università di Roma Rome, Italy
| | - Beatrice Pace
- Dipartimento di Psicologia Dinamica e Clinica, Sapienza Università di Roma Rome, Italy
| | - Fabio Paglieri
- Istituto di Scienze e Tecnologie della Cognizione, Consiglio Nazionale delle Ricerche Roma, Italy
| |
Collapse
|
58
|
Osvath M, Martin-Ordas G. The future of future-oriented cognition in non-humans: theory and the empirical case of the great apes. Philos Trans R Soc Lond B Biol Sci 2015; 369:rstb.2013.0486. [PMID: 25267827 DOI: 10.1098/rstb.2013.0486] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
One of the most contested areas in the field of animal cognition is non-human future-oriented cognition. We critically examine key underlying assumptions in the debate, which is mainly preoccupied with certain dichotomous positions, the most prevalent being whether or not 'real' future orientation is uniquely human. We argue that future orientation is a theoretical construct threatening to lead research astray. Cognitive operations occur in the present moment and can be influenced only by prior causation and the environment, at the same time that most appear directed towards future outcomes. Regarding the current debate, future orientation becomes a question of where on various continua cognition becomes 'truly' future-oriented. We question both the assumption that episodic cognition is the most important process in future-oriented cognition and the assumption that future-oriented cognition is uniquely human. We review the studies on future-oriented cognition in the great apes to find little doubt that our closest relatives possess such ability. We conclude by urging that future-oriented cognition not be viewed as expression of some select set of skills. Instead, research into future-oriented cognition should be approached more like research into social and physical cognition.
Collapse
|
59
|
Samanez-Larkin GR, Knutson B. Decision making in the ageing brain: changes in affective and motivational circuits. Nat Rev Neurosci 2015; 16:278-89. [PMID: 25873038 DOI: 10.1038/nrn3917] [Citation(s) in RCA: 176] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
As the global population ages, older decision makers will be required to take greater responsibility for their own physical, psychological and financial well-being. With this in mind, researchers have begun to examine the effects of ageing on decision making and associated neural circuits. A new 'affect-integration-motivation' (AIM) framework may help to clarify how affective and motivational circuits support decision making. Recent research has shed light on whether and how ageing influences these circuits, providing an interdisciplinary account of how ageing can alter decision making.
Collapse
Affiliation(s)
- Gregory R Samanez-Larkin
- 1] Department of Psychology, 2 Hillhouse Avenue, Yale University, New Haven, Connecticut 06520, USA. [2]
| | - Brian Knutson
- 1] Department of Psychology, Building 420, Jordan Hall, Stanford University, Stanford, California 94305, USA. [2]
| |
Collapse
|
60
|
O'Connell G, Christakou A, Chakrabarti B. The role of simulation in intertemporal choices. Front Neurosci 2015; 9:94. [PMID: 25873852 PMCID: PMC4379903 DOI: 10.3389/fnins.2015.00094] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2014] [Accepted: 03/05/2015] [Indexed: 11/13/2022] Open
Abstract
One route to understanding the thoughts and feelings of others is by mentally putting one's self in their shoes and seeing the world from their perspective, i.e., by simulation. Simulation is potentially used not only for inferring how others feel, but also for predicting how we ourselves will feel in the future. For instance, one might judge the worth of a future reward by simulating how much it will eventually be enjoyed. In intertemporal choices between smaller immediate and larger delayed rewards, it is observed that as the length of delay increases, delayed rewards lose subjective value; a phenomenon known as temporal discounting. In this article, we develop a theoretical framework for the proposition that simulation mechanisms involved in empathizing with others also underlie intertemporal choices. This framework yields a testable psychological account of temporal discounting based on simulation. Such an account, if experimentally validated, could have important implications for how simulation mechanisms are investigated, and makes predictions about special populations characterized by putative deficits in simulating others.
Collapse
Affiliation(s)
- Garret O'Connell
- Centre for Integrative Neuroscience and Neurodynamics, School of Psychology and Clinical Language Sciences, University of Reading Reading, UK
| | - Anastasia Christakou
- Centre for Integrative Neuroscience and Neurodynamics, School of Psychology and Clinical Language Sciences, University of Reading Reading, UK
| | - Bhismadev Chakrabarti
- Centre for Integrative Neuroscience and Neurodynamics, School of Psychology and Clinical Language Sciences, University of Reading Reading, UK
| |
Collapse
|
61
|
Kwan D, Craver CF, Green L, Myerson J, Gao F, Black SE, Rosenbaum RS. Cueing the personal future to reduce discounting in intertemporal choice: Is episodic prospection necessary? Hippocampus 2015; 25:432-43. [PMID: 25676022 DOI: 10.1002/hipo.22431] [Citation(s) in RCA: 56] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/05/2015] [Indexed: 11/10/2022]
Abstract
How does the ability to imagine detailed future experiences (i.e., episodic prospection) contribute to choices between immediate and delayed rewards? Individuals with amnesia do not show abnormally steep discounting in intertemporal choice, suggesting that neither medial temporal lobe (MTL) integrity nor episodic prospection is required for the valuation of future rewards (Kwan et al. (), Hippocampus, 22:1215-1219; Kwan et al. (2013), J Exp Psychol, 142:1355-1369 2013). However, hippocampally mediated episodic prospection in healthy adults reduces the discounting of future rewards (Peters and Büchel (2010), Neuron, 66:138-148; Benoit et al. (2011), J Neurosci, 31:6771-6779), raising the possibility that MTL damage causes more subtle impairments to this form of decision-making than noted in previous patient studies. Intertemporal choice appears normal in amnesic populations, yet they may be unable to use episodic prospection to adaptively modulate the value assigned to future rewards. To investigate how the extended hippocampal system, including the hippocampus and related MTL structures, contributes to the valuation of future rewards, we compared the performance of six amnesic cases with impaired episodic prospection to that of 20 control participants on two versions of an intertemporal choice task: a standard discounting task, and a cued version in which cues prompted them to imagine specific personal future events temporally contiguous with the receipt of delayed rewards. Amnesic individuals' intertemporal choices in the standard condition were indistinguishable from those of controls, replicating previous findings. Surprisingly, performance of the amnesic cases in the cued condition indicates that amnesia does not preclude flexible modulation of choices in response to future event cues, even in the absence of episodic prospection. Cueing the personal future to modulate decisions appears to constitute a less demanding or a qualitatively different (e.g., personal semantic) form of prospection that is not as sensitive to MTL damage as prospective narrative generation.
Collapse
Affiliation(s)
- Donna Kwan
- Department of Psychology, York University, Toronto, Ontario, Canada
| | | | | | | | | | | | | |
Collapse
|
62
|
The Role of Context in Understanding Similarities and Differences in Remembering and Episodic Future Thinking. PSYCHOLOGY OF LEARNING AND MOTIVATION 2015. [DOI: 10.1016/bs.plm.2015.03.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
|
63
|
Bett D, Murdoch LH, Wood ER, Dudchenko PA. Hippocampus, delay discounting, and vicarious trial-and-error. Hippocampus 2014; 25:643-54. [PMID: 25483408 DOI: 10.1002/hipo.22400] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/03/2014] [Indexed: 11/06/2022]
Abstract
In decision-making, an immediate reward is usually preferred to a delayed reward, even if the latter is larger. We tested whether the hippocampus is necessary for this form of temporal discounting, and for vicarious trial-and-error at the decision point. Rats were trained on a recently developed, adjustable delay-discounting task (Papale et al. (2012) Cogn Affect Behav Neurosci 12:513-526), which featured a choice between a small, nearly immediate reward, and a larger, delayed reward. Rats then received either hippocampus or sham lesions. Animals with hippocampus lesions adjusted the delay for the larger reward to a level similar to that of sham-lesioned animals, suggesting a similar valuation capacity. However, the hippocampus lesion group spent significantly longer investigating the small and large rewards in the first part of the sessions, and were less sensitive to changes in the amount of reward in the large reward maze arm. Both sham- and hippocampus-lesioned rats showed a greater amount of vicarious trial-and-error on trials in which the delay was adjusted. In a nonadjusting version of the delay discounting task, animals with hippocampus lesions showed more variability in their preference for a larger reward that was delayed by 10 s compared with sham-lesioned animals. To verify the lesion behaviorally, rat were subsequently trained on a water maze task, and rats with hippocampus lesions were significantly impaired compared with sham-lesioned animals. The findings on the delay discounting tasks suggest that damage to the hippocampus may impair the detection of reward magnitude.
Collapse
Affiliation(s)
- David Bett
- University of Edinburgh, Centre for Cognitive and Neural Systems, School of Biomedical Sciences, 10020, George Square, Edinburgh, EH8 9JZ, United Kingdom
| | | | | | | |
Collapse
|
64
|
Palombo DJ, Keane MM, Verfaellie M. The medial temporal lobes are critical for reward-based decision making under conditions that promote episodic future thinking. Hippocampus 2014; 25:345-53. [PMID: 25284804 DOI: 10.1002/hipo.22376] [Citation(s) in RCA: 91] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/03/2014] [Indexed: 11/07/2022]
Abstract
In the present study, we investigated the effect of medial temporal lobe (MTL) damage on human decision making in the context of reward-based intertemporal choice. During intertemporal choice, humans typically devalue (or discount) a future reward to account for its delayed arrival (e.g., preferring $30 now over $42 in 2 months), but this effect is attenuated when participants engage in episodic future thinking, i.e., project themselves into the future to imagine a specific event. We hypothesized that this attenuation would be selectively impaired in amnesic patients, who have deficits in episodic future thinking. Replicating previous work, in a standard intertemporal choice task, amnesic patients showed temporal discounting indices similar to healthy controls. Consistent with our hypothesis, while healthy controls demonstrated attenuated temporal discounting in a condition that required participants first to engage in episodic future thinking (e.g., to imagine spending $42 at a theatre in 2 months), amnesic patients failed to demonstrate this effect. Moreover, as expected, amnesic patients' narratives were less episodically rich than those of controls. These findings extend the range of tasks that are shown to be MTL dependent to include not only memory-based decision-making tasks but also future-oriented ones.
Collapse
Affiliation(s)
- Daniela J Palombo
- VA Boston Healthcare System, Boston, Massachusetts; Boston University School of Medicine, Boston, Massachusetts, 02130
| | | | | |
Collapse
|
65
|
Mechanisms of remembering the past and imagining the future – New data from autobiographical memory tasks in a lifespan approach. Conscious Cogn 2014; 29:76-89. [DOI: 10.1016/j.concog.2014.07.011] [Citation(s) in RCA: 50] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2014] [Revised: 07/06/2014] [Accepted: 07/08/2014] [Indexed: 11/22/2022]
|
66
|
Christakou A. Present simple and continuous: emergence of self-regulation and contextual sophistication in adolescent decision-making. Neuropsychologia 2014; 65:302-12. [PMID: 25220166 DOI: 10.1016/j.neuropsychologia.2014.09.008] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2014] [Revised: 08/11/2014] [Accepted: 09/02/2014] [Indexed: 11/28/2022]
Abstract
Sophisticated, intentional decision-making is a hallmark of mature, self-aware behaviour. Although neural, psychological, interpersonal, and socioeconomic elements that contribute to such adaptive, foresighted behaviour mature and/or change throughout the life-span, here we concentrate on relevant maturational processes that take place during adolescence, a period of disproportionate developmental opportunity and risk. A brief, eclectic overview is presented of recent evidence, new challenges, and current thinking on the fundamental mechanisms that mature throughout adolescence to support adaptive, self-controlled decision-making. This is followed by a proposal for the putative contribution of frontostriatal mechanisms to the moment-to-moment assembly of evaluative heuristics that mediate increased decision-making sophistication, promoting the maturation of self-regulated behaviour through adolescence and young adulthood.
Collapse
Affiliation(s)
- Anastasia Christakou
- Centre for Integrative Neuroscience and Neurodynamics, School of Psychology and Clinical Language Sciences, University of Reading, RG6 6AL, United Kingdom.
| |
Collapse
|
67
|
Gilboa A, Sekeres M, Moscovitch M, Winocur G. Higher-order conditioning is impaired by hippocampal lesions. Curr Biol 2014; 24:2202-2207. [PMID: 25201688 DOI: 10.1016/j.cub.2014.07.078] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2014] [Revised: 07/20/2014] [Accepted: 07/30/2014] [Indexed: 10/24/2022]
Abstract
Behavior in the real world is rarely motivated by primary conditioned stimuli that have been directly associated with potent unconditioned reinforcers. Instead, motivation and choice behavior are driven by complex chains of higher-order associations that are only indirectly linked to intrinsic reward and often exert their influence outside awareness. Second-order conditioning (SOC) [1] is a basic associative-learning mechanism whereby stimuli acquire motivational salience by proxy, in the absence of primary incentives [2, 3]. Memory-systems theories consider first-order conditioning (FOC) and SOC to be prime examples of hippocampal-independent nondeclarative memory [4, 5]. Accordingly, neurobiological models of SOC focus almost exclusively on nondeclarative neural systems that support motivational salience and reward value. Transfer of value from a conditioned stimulus to a neutral stimulus is thought to require the basolateral amygdala [6, 7] and the ventral striatum [2, 3], but not the hippocampus. We developed a new paradigm to measure appetitive SOC of tones in rats. Hippocampal lesions severely impaired both acquisition and expression of SOC despite normal FOC. Unlike controls, rats with hippocampal lesions could not discriminate between positive and negative secondary conditioned tones, although they exhibited general familiarity with previously presented tones compared with new tones. Importantly, normal rats' behavior, in contrast to that of hippocampal groups, also revealed different confidence levels as indexed by effort, a central characteristic of hippocampal relational memory. The results indicate, contrary to current systems models, that representations of intrinsic relationships between reward value, stimulus identity, and motivation require hippocampal mediation when these relationships are of a higher order.
Collapse
Affiliation(s)
- Asaf Gilboa
- Rotman Research Institute, Baycrest Centre, 3560 Bathurst Street, Toronto, Ontario M6A 2E1, Canada; Department of Psychology, University of Toronto, 100 St. George Street, Toronto, Ontario M5S 3G3, Canada.
| | - Melanie Sekeres
- Rotman Research Institute, Baycrest Centre, 3560 Bathurst Street, Toronto, Ontario M6A 2E1, Canada
| | - Morris Moscovitch
- Rotman Research Institute, Baycrest Centre, 3560 Bathurst Street, Toronto, Ontario M6A 2E1, Canada; Department of Psychology, University of Toronto, 100 St. George Street, Toronto, Ontario M5S 3G3, Canada
| | - Gordon Winocur
- Rotman Research Institute, Baycrest Centre, 3560 Bathurst Street, Toronto, Ontario M6A 2E1, Canada; Department of Psychology, University of Toronto, 100 St. George Street, Toronto, Ontario M5S 3G3, Canada; Department of Psychology, Trent University, 1600 West Bank Drive, Peterborough, Ontario K9J 7B8, Canada
| |
Collapse
|
68
|
Marchetti G. Attention and working memory: two basic mechanisms for constructing temporal experiences. Front Psychol 2014; 5:880. [PMID: 25177305 PMCID: PMC4132481 DOI: 10.3389/fpsyg.2014.00880] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2014] [Accepted: 07/24/2014] [Indexed: 12/20/2022] Open
Abstract
Various kinds of observations show that the ability of human beings to both consciously relive past events – episodic memory – and conceive future events, entails an active process of construction. This construction process also underpins many other important aspects of conscious human life, such as perceptions, language, and conscious thinking. This article provides an explanation of what makes the constructive process possible and how it works. The process mainly relies on attentional activity, which has a discrete and periodic nature, and working memory, which allows for the combination of discrete attentional operations. An explanation is also provided of how past and future events are constructed.
Collapse
|
69
|
Redshaw J. Does metarepresentation make human mental time travel unique? WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2014; 5:519-531. [PMID: 26308742 DOI: 10.1002/wcs.1308] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2014] [Revised: 06/25/2014] [Accepted: 07/16/2014] [Indexed: 01/26/2023]
Abstract
UNLABELLED Recent neurological evidence suggests that rats can mentally represent novel spatial trajectories and then are more likely to follow these paths in the future. Consequently, it has been proposed that human and nonhuman mental time travel capacities may differ in degree rather than kind. As of yet, however, there is no evidence for the crucial and qualitatively distinct component of metarepresentation in any nonhuman animal, not even our closest great ape relatives. Metarepresentation allows humans to represent the relationship between current reality and mere representations of reality-including those of the future. Drawing on parallels with dreaming and mind-wandering, I outline the future-oriented benefits associated with uncontextualized (non-metarepresentational) representations of past and novel events, but propose that further, immense benefits flowed from the addition of metarepresentational insight. I critique previous behavioral paradigms used to assess mental time travel in animals and suggest how future-oriented metarepresentation might possibly be demonstrated nonverbally. WIREs Cogn Sci 2014, 5:519-531. doi: 10.1002/wcs.1308 For further resources related to this article, please visit the WIREs website. CONFLICT OF INTEREST The author has declared no conflicts of interest for this article.
Collapse
Affiliation(s)
- Jonathan Redshaw
- School of Psychology, University of Queensland, St Lucia, QLD, Australia
| |
Collapse
|
70
|
Craver CF, Cova F, Green L, Myerson J, Rosenbaum RS, Kwan D, Bourgeois-Gironde S. An Allais paradox without mental time travel. Hippocampus 2014; 24:1375-80. [PMID: 24976273 DOI: 10.1002/hipo.22318] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/16/2014] [Indexed: 11/12/2022]
Abstract
The capacity to anticipate future experiences of regret has been hypothesized to explain otherwise irrational aspects of human decision-making, including the certainty effect (Kahneman and Tversky (1979) Econometrica 47:263-291) and the common ratio effect (Allais (1953) Econometrica 21:503-546). The anticipated regret hypothesis predicts that individuals incapable of episodically imagining their personal futures, as has been reported for people with extensive damage to medial temporal lobe structures and resulting deficits in episodic thought, should be immune to these effects. We report that K.C., who has extensive bilateral damage to his hippocampus and adjacent medial temporal lobe structures and nearly complete deficits in his ability to episodically imagine his personal future, nonetheless displays both the certainty and the common ratio effects. These results suggest that the episodic anticipation of future regret does not explain the general human tendency to display the certainty and common ratio effects.
Collapse
Affiliation(s)
- Carl F Craver
- Department of Philosophy, Washington University in St. Louis
| | | | | | | | | | | | | |
Collapse
|
71
|
Rosenbaum RS, Gilboa A, Moscovitch M. Case studies continue to illuminate the cognitive neuroscience of memory. Ann N Y Acad Sci 2014; 1316:105-33. [DOI: 10.1111/nyas.12467] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Affiliation(s)
- R. Shayna Rosenbaum
- Department of Psychology; York University; Toronto Ontario Canada
- Rotman Research Institute; Baycrest; Toronto Ontario Canada
- Canadian Partnership in Stroke Recovery, Baycrest; Toronto Ontario Canada
| | - Asaf Gilboa
- Rotman Research Institute; Baycrest; Toronto Ontario Canada
- Canadian Partnership in Stroke Recovery, Baycrest; Toronto Ontario Canada
- Department of Psychology; University of Toronto; Toronto Ontario Canada
| | - Morris Moscovitch
- Rotman Research Institute; Baycrest; Toronto Ontario Canada
- Department of Psychology; University of Toronto; Toronto Ontario Canada
- Department of Psychology, Baycrest; Toronto Ontario Canada
| |
Collapse
|
72
|
Craver CF, Kwan D, Steindam C, Rosenbaum RS. Individuals with episodic amnesia are not stuck in time. Neuropsychologia 2014; 57:191-5. [PMID: 24680757 DOI: 10.1016/j.neuropsychologia.2014.03.004] [Citation(s) in RCA: 60] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2014] [Revised: 03/10/2014] [Accepted: 03/12/2014] [Indexed: 11/27/2022]
Abstract
The metaphor that individuals with episodic amnesia due to hippocampal damage are "stuck in time" persists in science, philosophy, and everyday life despite mounting evidence that episodic amnesia can spare many central aspects of temporal consciousness. Here we describe some of this evidence, focusing specifically on KC, one of the most thoroughly documented and severe cases of episodic amnesia on record. KC understands the concept of time, knows that it passes, and can orient himself with respect to his personal past and future. He expresses typical attitudes toward his past and future, and he is able to make future-regarding decisions. Theories claiming that the hippocampus plays an essential role in temporal consciousness need to be revised in light of these findings.
Collapse
Affiliation(s)
- Carl F Craver
- Philosophy-Neuroscience-Psychology Program, Washington University, 1 Brookings Drive St. Louis, St. Louis, MO 63130, USA.
| | - Donna Kwan
- Department of Psychology, York University, Toronto, ON, Canada M3J 1P3
| | - Chloe Steindam
- Philosophy-Neuroscience-Psychology Program, Washington University, 1 Brookings Drive St. Louis, St. Louis, MO 63130, USA
| | - R Shayna Rosenbaum
- Department of Psychology, York University, Toronto, ON, Canada M3J 1P3; Rotman Research Institute, Baycrest, Toronto, ON, Canada M6A 2E1
| |
Collapse
|
73
|
Abela AR, Chudasama Y. Noradrenergic α2A-receptor stimulation in the ventral hippocampus reduces impulsive decision-making. Psychopharmacology (Berl) 2014; 231:521-31. [PMID: 24062084 DOI: 10.1007/s00213-013-3262-y] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/17/2013] [Accepted: 08/19/2013] [Indexed: 10/26/2022]
Abstract
RATIONALE Guanfacine, an α2A-adrenergic receptor agonist, is currently in use for treatment of a variety of psychiatric disorders that are associated with impulsive decision-making (e.g., attention-deficit hyperactivity disorder; ADHD). In animals and humans, the behavioral effects of adrenergic agents are presumed to involve neuromodulation of the prefrontal cortex, consistent with the demonstrated actions of dopaminergic agents. However, recent experimental work has shown that the ventral hippocampus (vHC) contributes to decision-making and impulse control, raising the possibility that the hippocampus may be an important site of action for these drugs. OBJECTIVE The purpose of this study was to examine the effect of local vHC infusions of guanfacine and other neuropharmacological agents on behavioral decisions that involve a trade-off between reward size and delay. METHODS Different cohorts of rats were implanted with bilateral guide cannulae targeting the vHC. We examined the animals' behavior in a touchscreen version of a delay discounting task following intra-vHC infusions of: (a) guanfacine (α2A-adrenergic receptor agonist), (b) SCH 23390 (dopamine D1 receptor antagonist), and (c) muscimol/baclofen (GABAA/B agonists). RESULTS Guanfacine led to a dose-dependent reduction in impulsive decision-making, increasing the animals' tolerance for delay in exchange for a larger reward. By contrast, infusion of SCH 23390 had no behavioral effects. Consistent with previous lesion studies, reversible pharmacological inactivation with muscimol/baclofen increased impulsive decision-making. CONCLUSIONS These data provide the first evidence that guanfacine, a commonly used treatment for ADHD, may derive its clinical benefits through hippocampal stimulation, via α2A-adrenergic receptors.
Collapse
Affiliation(s)
- Andrew R Abela
- Department of Psychology, McGill University, Montreal, QC, H3A 1B1, Canada
| | | |
Collapse
|
74
|
Lebreton M, Bertoux M, Boutet C, Lehericy S, Dubois B, Fossati P, Pessiglione M. A critical role for the hippocampus in the valuation of imagined outcomes. PLoS Biol 2013; 11:e1001684. [PMID: 24167442 PMCID: PMC3805472 DOI: 10.1371/journal.pbio.1001684] [Citation(s) in RCA: 68] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2013] [Accepted: 09/10/2013] [Indexed: 11/18/2022] Open
Abstract
Converging evidence from neuroimaging and clinical data demonstrates the important involvement of the hippocampus in finding the motivation to pursue goals that we need to imagine because they are not within sight. Many choice situations require imagining potential outcomes, a capacity that was shown to involve memory brain regions such as the hippocampus. We reasoned that the quality of hippocampus-mediated simulation might therefore condition the subjective value assigned to imagined outcomes. We developed a novel paradigm to assess the impact of hippocampus structure and function on the propensity to favor imagined outcomes in the context of intertemporal choices. The ecological condition opposed immediate options presented as pictures (hence directly observable) to delayed options presented as texts (hence requiring mental stimulation). To avoid confounding simulation process with delay discounting, we compared this ecological condition to control conditions using the same temporal labels while keeping constant the presentation mode. Behavioral data showed that participants who imagined future options with greater details rated them as more likeable. Functional MRI data confirmed that hippocampus activity could account for subjects assigning higher values to simulated options. Structural MRI data suggested that grey matter density was a significant predictor of hippocampus activation, and therefore of the propensity to favor simulated options. Conversely, patients with hippocampus atrophy due to Alzheimer's disease, but not patients with Fronto-Temporal Dementia, were less inclined to favor options that required mental simulation. We conclude that hippocampus-mediated simulation plays a critical role in providing the motivation to pursue goals that are not present to our senses. Economic theory assumes that we assign some sort of value to options that are presented to us in order to choose between them. In neuroscience, evidence suggests that memory brain regions, such as the hippocampus, are involved in imagining novel situations. We therefore hypothesized that the hippocampus might be critical for evaluating outcomes that we need to imagine. This is typically the case in intertemporal choices, where immediate rewards are considered against future gratifications (e.g., a beer now or a bottle of champagne a week from now). Previous investigations have implicated the dorsal prefrontal cortex brain region in resisting immediate rewards. Here we manipulated the mode of presentation (text or picture), such that options were represented either in simulation or in perception systems. Functional neuroimaging data confirmed that hippocampal activity lends a preference to choosing simulated options (irrespective of time), whereas dorsal prefrontal cortex brain activity supports the preference for delayed options (irrespective of presentation mode). Structural neuroimaging in healthy subjects and in patients with brain atrophy, due to Alzheimer's disease (with hippocampal damage) or Fronto-Temporal Dementia (with damage to the prefrontal cortex), further demonstrated the critical implication of the hippocampus. Individuals with higher neuronal density in the hippocampus, but not in the dorsal prefrontal cortex, were more likely to choose future rewards that have to be mentally simulated.
Collapse
Affiliation(s)
- Maël Lebreton
- Motivation, Brain and Behavior (MBB) Team, Institut du Cerveau et de la Moelle Epinière (ICM), Paris, France
- Service de Neuroradiologie, Hôpital Pitie-Salpetriere, Centre de NeuroImagerie de Recherche (CENIR), Institut du Cerveau et de la Moelle épinière (ICM), Paris, France
- INSERM UMRS 975, CNRS UMR 7225, Université Pierre et Marie Curie (UPMC – Paris 6), Paris, France
| | - Maxime Bertoux
- Institut de la Mémoire et de la Maladie d'Alzheimer, Hôpital Pitié-Salpêtrière, Paris, France
| | - Claire Boutet
- Service de Neuroradiologie, Hôpital Pitie-Salpetriere, Centre de NeuroImagerie de Recherche (CENIR), Institut du Cerveau et de la Moelle épinière (ICM), Paris, France
- INSERM UMRS 975, CNRS UMR 7225, Université Pierre et Marie Curie (UPMC – Paris 6), Paris, France
| | - Stéphane Lehericy
- Service de Neuroradiologie, Hôpital Pitie-Salpetriere, Centre de NeuroImagerie de Recherche (CENIR), Institut du Cerveau et de la Moelle épinière (ICM), Paris, France
- INSERM UMRS 975, CNRS UMR 7225, Université Pierre et Marie Curie (UPMC – Paris 6), Paris, France
| | - Bruno Dubois
- INSERM UMRS 975, CNRS UMR 7225, Université Pierre et Marie Curie (UPMC – Paris 6), Paris, France
- Institut de la Mémoire et de la Maladie d'Alzheimer, Hôpital Pitié-Salpêtrière, Paris, France
| | - Philippe Fossati
- INSERM UMRS 975, CNRS UMR 7225, Université Pierre et Marie Curie (UPMC – Paris 6), Paris, France
- Centre Emotion, CNRS USR 3246, Hôpital Pitié-Salpêtrière, Paris, France
| | - Mathias Pessiglione
- Motivation, Brain and Behavior (MBB) Team, Institut du Cerveau et de la Moelle Epinière (ICM), Paris, France
- Service de Neuroradiologie, Hôpital Pitie-Salpetriere, Centre de NeuroImagerie de Recherche (CENIR), Institut du Cerveau et de la Moelle épinière (ICM), Paris, France
- INSERM UMRS 975, CNRS UMR 7225, Université Pierre et Marie Curie (UPMC – Paris 6), Paris, France
- * E-mail:
| |
Collapse
|
75
|
Abela AR, Chudasama Y. Dissociable contributions of the ventral hippocampus and orbitofrontal cortex to decision-making with a delayed or uncertain outcome. Eur J Neurosci 2012. [PMID: 23190048 DOI: 10.1111/ejn.12071] [Citation(s) in RCA: 67] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
In this study, we examined how risk and delay influence rats' decision-making, and the role of the ventral hippocampus (VHC) and orbitofrontal cortex (OFC) in the valuation of these two factors. We used a touchscreen testing method in which rats with VHC lesions, OFC lesions and sham control surgery made choices in two decision-making tasks. In the delay discounting task, rats chose between two visual stimuli, one of which indicated a small, immediate reward, and the other of which indicated a large, delayed reward. In the probability discounting task, two stimuli indicated, instead, a small, certain reward or a large, uncertain reward. The two lesion groups showed a double dissociation with respect to the two tasks. Rats with VHC lesions were intolerant of delay, and were strongly biased towards the small, immediate reward. However, the same rats were indistinguishable from sham controls in the probability discounting task. The opposite pattern was observed for rats with OFC lesions; they performed normally in the delay discounting task, but showed a reduced tolerance for uncertainty as compared with sham-operated controls. These data support the conclusion that the VHC and OFC contribute differentially to decision-making that involves delayed or uncertain outcomes. This provides a means for understanding the neural basis of a range of neurological and psychiatric patients who show impaired decision-making and executive dysfunction.
Collapse
Affiliation(s)
- Andrew R Abela
- Department of Psychology, McGill University, Montreal, QC, Canada
| | | |
Collapse
|
76
|
Schacter DL, Addis DR, Hassabis D, Martin VC, Spreng RN, Szpunar KK. The future of memory: remembering, imagining, and the brain. Neuron 2012; 76:677-94. [PMID: 23177955 PMCID: PMC3815616 DOI: 10.1016/j.neuron.2012.11.001] [Citation(s) in RCA: 703] [Impact Index Per Article: 58.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/02/2012] [Indexed: 11/30/2022]
Abstract
During the past few years, there has been a dramatic increase in research examining the role of memory in imagination and future thinking. This work has revealed striking similarities between remembering the past and imagining or simulating the future, including the finding that a common brain network underlies both memory and imagination. Here, we discuss a number of key points that have emerged during recent years, focusing in particular on the importance of distinguishing between temporal and nontemporal factors in analyses of memory and imagination, the nature of differences between remembering the past and imagining the future, the identification of component processes that comprise the default network supporting memory-based simulations, and the finding that this network can couple flexibly with other networks to support complex goal-directed simulations. This growing area of research has broadened our conception of memory by highlighting the many ways in which memory supports adaptive functioning.
Collapse
Affiliation(s)
- Daniel L Schacter
- Department of Psychology, Harvard University, Cambridge, MA 02138, USA.
| | | | | | | | | | | |
Collapse
|
77
|
Klein SB. The complex act of projecting oneself into the future. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2012; 4:63-79. [PMID: 26304175 DOI: 10.1002/wcs.1210] [Citation(s) in RCA: 79] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Research on future-oriented mental time travel (FMTT) is highly active yet somewhat unruly. I believe this is due, in large part, to the complexity of both the tasks used to test FMTT and the concepts involved. Extraordinary care is a necessity when grappling with such complex and perplexing metaphysical constructs as self and time and their co-instantiation in memory. In this review, I first discuss the relation between future mental time travel and types of memory (episodic and semantic). I then examine the nature of both the types of self-knowledge assumed to be projected into the future and the types of temporalities that constitute projective temporal experience. Finally, I argue that a person lacking episodic memory should nonetheless be able to imagine a personal future by virtue of (1) the fact that semantic, as well as episodic, memory can be self-referential, (2) autonoetic awareness is not a prerequisite for FMTT, and (3) semantic memory does, in fact, enable certain forms of personally oriented FMTT. WIREs Cogn Sci 2013, 4:63-79. doi: 10.1002/wcs.1210 For further resources related to this article, please visit the WIREs website.
Collapse
Affiliation(s)
- Stanley B Klein
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, USA
| |
Collapse
|
78
|
Craver CF. A Preliminary Case for Amnesic Selves: Toward a Clinical Moral Psychology. SOCIAL COGNITION 2012. [DOI: 10.1521/soco.2012.30.4.449] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
|
79
|
Abstract
Although delay discounting, the attenuation of the value of future rewards, is a robust finding, the mechanism of discounting is not known. We propose a potential mechanism for delay discounting such that discounting emerges from a search process that is trying to determine what rewards will be available in the future. In this theory, the delay dependence of the discounting of future expected rewards arises from three assumptions. First, that the evaluation of outcomes involves a search process. Second, that the value is assigned to an outcome proportionally to how easy it is to find. Third, that outcomes that are less delayed are typically easier for the search process to find. By relaxing this third assumption (e.g. by assuming that episodically-cued outcomes are easier to find), our model suggests that it is possible to dissociate discounting from delay. Our theory thereby explains the empirical result that discounting is slower to episodically-imagined outcomes, because these outcomes are easier for the search process to find. Additionally, the theory explains why improving cognitive resources such as working memory slows discounting, by improving searches and thereby making rewards easier to find. The three assumptions outlined here are likely to be instantiated during deliberative decision-making, but are unlikely in habitual decision-making. We model two simple implementations of this theory and show that they unify empirical results about the role of cognitive function in delay discounting, and make new neural, behavioral, and pharmacological predictions.
Collapse
Affiliation(s)
- Zeb Kurth-Nelson
- Wellcome Trust Centre for Neuroimaging, University College London, London, UK
| | | | | |
Collapse
|