1
|
Killeen PR. Hyperbolae. J Exp Anal Behav 2024; 122:72-86. [PMID: 38785258 DOI: 10.1002/jeab.916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 04/16/2024] [Indexed: 05/25/2024]
Abstract
Hyperbolic relations between independent and dependent variables are ubiquitous in the experimental analysis of behavior, mentioned in over 150 articles in the Journal of the Experimental Analysis of Behavior. There are two principal forms of hyperbolae: The first describes the relation between response rate and reinforcement rate on variable-interval schedules of reinforcement; it rises asymptotically toward a maximum. The second describes the relation between the current equivalent value of an incentive and its delay or (im)probability; it falls from a maximum toward an asymptote of 0. Where do these come from? What do their parameters mean? How are they related? This article answers the first two questions and addresses the last.
Collapse
Affiliation(s)
- Peter R Killeen
- Department of Psychology, Arizona State University, Tempe, AZ, USA
| |
Collapse
|
2
|
González-Barriga F, Orduña V. Spontaneously hypertensive rats show higher impulsive action, but equal impulsive choice with both positive and aversive consequences. Behav Brain Res 2022; 427:113858. [PMID: 35339564 DOI: 10.1016/j.bbr.2022.113858] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Revised: 02/16/2022] [Accepted: 03/19/2022] [Indexed: 11/02/2022]
Abstract
Both positive and aversive delayed consequences play an important role in decision making. However, most of research has studied the temporal discounting of the positive consequences, while the study of the aversives is scarce in general and null in some areas. This is the case of research on impulsivity in spontaneously hypertensive rats (SHR), an animal model of ADHD. To evaluate SHRs' sensitivity to aversive delayed consequences, we employed a choice procedure in which subjects chose between a smaller-amount alternative and a larger-amount alternative plus a shock; when preference for the smaller-amount alternative stabilized, five different delays to the shock were presented with the objective of analyzing the recovery of preference for the larger-amount alternative, which is related to the sensitivity to the delayed aversive consequence. To analyze the sensitivity to delayed positive consequences we employed a procedure that evaluated the preference between a smaller-amount alternative and a larger-amount alternative as a function of the delay to the later. Finally, to evaluate impulsive action we employed a DRL 10s schedule. In all tasks, Wistar rats were evaluated as control strain. The results indicated that choice impulsivity was equivalent between strains, both for positive and for aversive consequences. In contrast, we found a higher level of impulsive action in SHR.
Collapse
Affiliation(s)
| | - Vladimir Orduña
- Facultad de Psicología, Universidad Nacional Autónoma de México, México D.F. 04510, México.
| |
Collapse
|
3
|
Killeen PR. Moles and Molecules. J Exp Anal Behav 2021; 115:584-595. [PMID: 33428792 DOI: 10.1002/jeab.667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 11/18/2020] [Accepted: 11/19/2020] [Indexed: 11/06/2022]
|
4
|
Killeen PR. Addendum to Killeen's (2019) Bidding for Delayed Rewards. J Exp Anal Behav 2020; 113:680-689. [DOI: 10.1002/jeab.600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2019] [Revised: 03/20/2020] [Accepted: 03/29/2020] [Indexed: 11/06/2022]
|
5
|
Scholten H, Scheres A, de Water E, Graf U, Granic I, Luijten M. Behavioral trainings and manipulations to reduce delay discounting: A systematic review. Psychon Bull Rev 2019; 26:1803-1849. [PMID: 31270766 PMCID: PMC6863952 DOI: 10.3758/s13423-019-01629-2] [Citation(s) in RCA: 54] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In everyday decision-making, individuals make trade-offs between short-term and long-term benefits or costs. Depending on many factors, individuals may choose to wait for larger delayed reward, yet in other situations they may prefer the smaller, immediate reward. In addition to within-subject variation in the short-term versus long-term reward trade-off, there are also interindividual differences in delay discounting (DD), which have been shown to be quite stable. The extent to which individuals discount the value of delayed rewards turns out to be associated with important health and disorder-related outcomes: the more discounting, the more unhealthy or problematic choices. This has led to the hypothesis that DD can be conceptualized as trans-disease process. The current systematic review presents an overview of behavioral trainings and manipulations that have been developed to reduce DD in human participants aged 12 years or older. Manipulation studies mostly contain one session and measure DD directly after the manipulation. Training studies add a multiple session training component that is not per se related to DD, in between two DD task measurements. Ninety-eight studies (151 experiments) were identified that tested behavioral trainings and manipulations to decrease DD. Overall, results indicated that DD can be decreased, showing that DD is profoundly context dependent and changeable. Most promising avenues to pursue in future research seem to be acceptance-based/mindfulness-based trainings, and even more so manipulations involving a future orientation. Limitations and recommendations are discussed to identify the mechanistic processes that allow for changes in discount rate and behavior accordingly.
Collapse
Affiliation(s)
- Hanneke Scholten
- Behavioural Science Institute, Radboud University, P.O. Box 9104, 6500, HE, Nijmegen, The Netherlands.
| | - Anouk Scheres
- Behavioural Science Institute, Radboud University, P.O. Box 9104, 6500, HE, Nijmegen, The Netherlands
| | - Erik de Water
- Behavioural Science Institute, Radboud University, P.O. Box 9104, 6500, HE, Nijmegen, The Netherlands
- Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Uta Graf
- Behavioural Science Institute, Radboud University, P.O. Box 9104, 6500, HE, Nijmegen, The Netherlands
| | - Isabela Granic
- Behavioural Science Institute, Radboud University, P.O. Box 9104, 6500, HE, Nijmegen, The Netherlands
| | - Maartje Luijten
- Behavioural Science Institute, Radboud University, P.O. Box 9104, 6500, HE, Nijmegen, The Netherlands
| |
Collapse
|
6
|
Abstract
Although steep delay discounting is associated with various behavioral problems, perhaps most prominently substance abuse, we argue that it is best not conceived of as a character flaw such as impulsivity. Such a view, although part of a centuries-old tradition, does not distinguish between actions whose outcomes involve gains and losses, or between delayed outcomes and probabilistic outcomes, nor does it acknowledge that how steeply an individual discounts one of these kinds of outcome appears to be independent of how steeply they discount other kinds. Therefore, we advocate an approach that does not require making judgments about the character of the individuals involved. We show that when drug-dependent individuals are compared with controls, a substantial number of the drug-dependent individuals discount delayed monetary rewards less steeply than the average (median) member of the control group. Moreover, a substantial number of the controls discount more steeply than the average drug-dependent individual. Finally, we point out that many everyday choice situations differ from those studied in most discounting experiments in that they involve both gains and losses as well as qualitatively different outcomes that may be both delayed and probabilistic. Past research on discounting that focused on simple choice situations has provided a solid foundation, but research on more complicated situations is now needed. We believe that the principles revealed by such research will both inform the choices of treatment providers and improve our understanding of the complicated decisions that people face every day.
Collapse
Affiliation(s)
- Leonard Green
- Department of Psychological & Brain Sciences, Washington University in St. Louis, Campus Box 1125, St. Louis, MO 63130 USA
| | - Joel Myerson
- Department of Psychological & Brain Sciences, Washington University in St. Louis, Campus Box 1125, St. Louis, MO 63130 USA
| |
Collapse
|
7
|
Houston AJH, Houston AI. The overall discount rate. Behav Processes 2019; 167:103856. [PMID: 31059766 DOI: 10.1016/j.beproc.2019.05.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2018] [Revised: 04/07/2019] [Accepted: 05/02/2019] [Indexed: 11/19/2022]
Abstract
Discounting refers to the way in which the value of an outcome depends on the delay until it is obtained. If an organism's discount function is known, then its rate of discounting at any delay can be found. If the function is not known, the normalised area under an estimate of the discount function has been used as a measure that summarises the strength of discounting over a range of delays. We propose a new measure of the strength of discounting: the overall discount rate W, which is the drop in value from the start to the end of the value curve divided by the area under this curve. We show that our measure has various advantages over the normalised area, namely it can be linked to the instantaneous rate of discounting and it respects the special nature of exponential discounting. It does not give a unique value to each curve, but we prove that this is incompatible with the requirement that similar discount functions be assigned similar values, and so this is not a defect of the measure.
Collapse
Affiliation(s)
| | - Alasdair I Houston
- School of Biological Sciences, Bristol Life Sciences Building, University of Bristol, Tyndall Avenue, Bristol, BS8 1TQ, UK.
| |
Collapse
|
8
|
Models of attention-deficit hyperactivity disorder. Behav Processes 2019; 162:205-214. [DOI: 10.1016/j.beproc.2019.01.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2018] [Revised: 01/16/2019] [Accepted: 01/16/2019] [Indexed: 12/25/2022]
|
9
|
Conditioned Inhibition and its Relationship to Impulsivity: Empirical and Theoretical Considerations. PSYCHOLOGICAL RECORD 2018. [DOI: 10.1007/s40732-018-0325-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
10
|
Delay Gradients for Spout-Licking and Magazine-Entering Induced by a Periodic Food Schedule. PSYCHOLOGICAL RECORD 2018. [DOI: 10.1007/s40732-018-0275-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
11
|
Abstract
Impulsivity has traditionally been thought to involve various behavioral traits that can be measured using different laboratory protocols. Whereas some authors regard different measures of impulsivity as reflecting fundamentally distinct and unrelated behavioral tendencies (fragmentation approach), others regard those different indexes as analogue forms of the same behavioral tendency, only superficially different (unification approach). Unifying accounts range from mere intuitions to more sophisticated theoretical systems. Some of the more complete attempts at unifying are intriguing but have validity weaknesses. We propose a new unifying attempt based on theoretical points posed by other authors and supplemented by theory and research on associative learning. We then apply these assumptions to characterize the paradigms used to study impulsivity in laboratory settings and evaluate their scope as an attempt at unification. We argue that our approach possesses a good balance of parsimony and empirical and theoretical grounding, as well as a more encompassing scope, and is more suitable for experimental testing than previous theoretical frameworks. In addition, the proposed approach is capable of generating a new definition of impulsivity and outlines a hypothesis of how self-control can be developed. Finally, we examine the fragmentation approach from a different perspective, emphasizing the importance of finding similarities among seemingly different phenomena.
Collapse
|
12
|
Lopez-Guzman S, Konova AB, Louie K, Glimcher PW. Risk preferences impose a hidden distortion on measures of choice impulsivity. PLoS One 2018; 13:e0191357. [PMID: 29373590 PMCID: PMC5786295 DOI: 10.1371/journal.pone.0191357] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2017] [Accepted: 01/03/2018] [Indexed: 12/31/2022] Open
Abstract
Measuring temporal discounting through the use of intertemporal choice tasks is now the gold standard method for quantifying human choice impulsivity (impatience) in neuroscience, psychology, behavioral economics, public health and computational psychiatry. A recent area of growing interest is individual differences in discounting levels, as these may predispose to (or protect from) mental health disorders, addictive behaviors, and other diseases. At the same time, more and more studies have been dedicated to the quantification of individual attitudes towards risk, which have been measured in many clinical and non-clinical populations using closely related techniques. Economists have pointed to interactions between measurements of time preferences and risk preferences that may distort estimations of the discount rate. However, although becoming standard practice in economics, discount rates and risk preferences are rarely measured simultaneously in the same subjects in other fields, and the magnitude of the imposed distortion is unknown in the assessment of individual differences. Here, we show that standard models of temporal discounting —such as a hyperbolic discounting model widely present in the literature which fails to account for risk attitudes in the estimation of discount rates— result in a large and systematic pattern of bias in estimated discounting parameters. This can lead to the spurious attribution of differences in impulsivity between individuals when in fact differences in risk attitudes account for observed behavioral differences. We advance a model which, when applied to standard choice tasks typically used in psychology and neuroscience, provides both a better fit to the data and successfully de-correlates risk and impulsivity parameters. This results in measures that are more accurate and thus of greater utility to the many fields interested in individual differences in impulsivity.
Collapse
Affiliation(s)
- Silvia Lopez-Guzman
- Center for Neural Science, New York University, New York, United States of America
- * E-mail:
| | - Anna B. Konova
- Center for Neural Science, New York University, New York, United States of America
| | - Kenway Louie
- Center for Neural Science, New York University, New York, United States of America
| | - Paul W. Glimcher
- Center for Neural Science, New York University, New York, United States of America
- Institute for the Study of Decision Making, New York University, New York, United States of America
| |
Collapse
|
13
|
Paglieri F. Social choice for one: On the rationality of intertemporal decisions. Behav Processes 2016; 127:97-108. [PMID: 27118422 DOI: 10.1016/j.beproc.2016.04.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2015] [Revised: 04/14/2016] [Accepted: 04/18/2016] [Indexed: 10/21/2022]
Abstract
When faced with an intertemporal choice between a smaller short-term reward and a larger long-term prize, is opting for the latter always indicative of delay tolerance? And is delay tolerance always to be regarded as a manifestation of self-control, and thus as a rational solution to intertemporal dilemmas? I argue in favor of a negative answer to both questions, based on evidence collected in the delay discounting literature. This highlights the need for a nuanced understanding of rationality in intertemporal choice, to capture also situations in which waiting is not the optimal strategy. This paper suggests that such an understanding is fostered by adopting social choice theory as a promising framework to model intertemporal decision making. Some preliminary results of this approach are discussed, and its potential is compared with a much more studied formal model for intertemporal choice, i.e. game theory.
Collapse
Affiliation(s)
- Fabio Paglieri
- Goal-Oriented Agents Lab (GOAL), ISTC-CNR, Via San Martino della Battaglia 44, 00185 Roma, Italy.
| |
Collapse
|