Toward a Unifying Account of Impulsivity and the Development of Self-Control

Differences in Discounting Behavior and Brain Responses for Food and Money Reward

Most neuroeconomic research seeks to understand how value influences decision-making. The influence of reward type is less well understood. We used functional magnetic resonance imaging (fMRI) to investigate delay discounting of primary (i.e., food) and secondary rewards (i.e., money) in 28 healthy, normal-weighted participants (mean age = 26.77; 18 females). To decipher differences in discounting behavior between reward types, we compared how well-different option-based statistical models (exponential, hyperbolic discounting) and attribute-wise heuristic choice models (intertemporal choice heuristic, dual reasoning and implicit framework theory, trade-off model) captured the reward-specific discounting behavior. Contrary to our hypothesis of different strategies for different rewards, we observed comparable discounting behavior for money and food (i.e., exponential discounting). Higher k values for food discounting suggest that individuals decide more impulsive if confronted with food. The fMRI revealed that money discounting was associated with enhanced activity in the right dorsolateral prefrontal cortex, involved in executive control; the right dorsal striatum, associated with reward processing; and the left hippocampus, involved in memory encoding/retrieval. Food discounting, instead, was associated with higher activity in the left temporoparietal junction suggesting social reinforcement of food decisions. Although our findings do not confirm our hypothesis of different discounting strategies for different reward types, they are in line with the notion that reward types have a significant influence on impulsivity with primary rewards leading to more impulsive choices.

Assessment of the inbred C57BL/6 and outbred CD1 mouse strains using a progressive ratio schedule during development

Inbred strains have a genetic similarity of at least 98.6% compared to their outbred counterparts. Several studies have shown that inbred C57BL/6 mice and outbred ICR (CD1) mice differ in locomotion, cognitive flexibility, and aggression. However, their performance in operant paradigms is not well understood. A progressive ratio (PR) schedule of reinforcement is a method of quantitative estimation of the incentive state of an animal for a reward by increasing response requirements for reinforcer delivery, which is relevant to assess the breakpoint (amount of response effort an animal is willing to invest for a single unit of reward). This study tested male and female C57BL/6 and CD1 mice with an open field to analyze locomotion. Then, we used conditioning chambers with a PR3 schedule for ten consecutive days (P30-P40). PR performance was measured with the breakpoint, and the mathematical principles of reinforcement (MPR) were used to estimate motivation, impulsivity, and motor skills to manipulate the operandum. We found that CD1 mice showed higher locomotor activity than C57BL/6 independently of sex. CD1 mice had a higher breakpoint. However, male CD1 mice gradually increased breakpoint until the last session. In the MPR model, CD1 mice showed decreased fixed paused parameter (impulsivity) than C57BL/6, independent of sex. Our data suggest that the higher breakpoint in CD1 strain may partially be related to impulsivity. Therefore, the MPR model can help identify factors that affect performances, such as motivation, impulsivity, and motor skills during a PR in adolescent CD1 and C57BL/6 mice. These findings are essential to characterize the differences in the behavioral performance between C57BL/6 and CD1 strains and their potential as animal models.

The Role of the Lateral Habenula in Inhibitory Learning from Reward Omission

The lateral habenula (LHb) is a phylogenetically primitive brain structure that plays a key role in learning to inhibit distinct responses to specific stimuli. This structure is activated by primary aversive stimuli, cues predicting an imminent aversive event, unexpected reward omissions, and cues associated with the omission of an expected reward. The most widely described physiological effect of LHb activation is acutely suppressing midbrain dopaminergic signaling. However, recent studies have identified multiple means by which the LHb promotes this effect as well as other mechanisms of action. These findings reveal the complex nature of LHb circuitry. The present paper reviews the role of this structure in learning from reward omission. We approach this topic from the perspective of computational models of behavioral change that account for inhibitory learning to frame key findings. Such findings are drawn from recent behavioral neuroscience studies that use novel brain imaging, stimulation, ablation, and reversible inactivation techniques. Further research and conceptual work are needed to clarify the nature of the mechanisms related to updating motivated behavior in which the LHb is involved. As yet, there is little understanding of whether such mechanisms are parallel or complementary to the well-known modulatory function of the more recently evolved prefrontal cortex.

Effect of Schedule-Induced Behavior on Responses of Spontaneously Hypertensive and Wistar-Kyoto Rats in a Delay-Discounting Task: A Preliminary Report

Delay discounting is the loss of the subjective value of an outcome as the time to its delivery increases. It has been suggested that organisms can become more tolerant of this delay when engaging in schedule-induced behaviors. Schedule-induced behaviors are those that develop at a high rate during intermittent reinforcement schedules without the need of arranged contingency to the reinforcer, and they have been considered as a model of compulsivity. There is evidence that relates compulsivity to greater delay discounting. The rate of delay discounting represents how impulsive the subject is, as the rate of discounting increases the higher the impulsivity. Thus, the main purpose of this study was to undertake a preliminary evaluation of whether developing schedule-induced behaviors affects performance in a delay-discounting task, by comparing spontaneously hypertensive rats (SHRs) and Wistar-Kyoto (WKY) rats. The rats were exposed to a task that consisted of presenting the subjects with two levers: one produced a small, immediate food reinforcer while the other one produced a larger, delayed reinforcer. During Condition A, the levers were presented, and a water bottle and a running wheel were available in the conditioning chambers; during Condition B, only the levers were presented. SHR and WKY rats developed schedule-induced behaviors during Condition A and showed no difference in discounting rates, contradicting previous reports. Lick allocation during response-reinforcer delays and the inter-trial interval (ITI) showed, respectively, pre- and post-food distributions. Discounting rates during Condition B (when rats could not engage in schedule-induced behaviors) did not reach statistical significance difference among strains of animals, although it was observed a tendency for WKY to behave more self-controlled. Likewise it was not found any effect of schedule-induced behavior on discounting rates, however, a tendency for WKY rats to behave more impulsive during access to drink and run seems to tentatively support the idea of schedule-induced behavior as a model of compulsivity in those rats, being impulsivity simply defined as an excess in behavior.