Lesions of the nucleus accumbens disrupt reinforcement omission effects in rats

Reinforcement omission effects in rats with bilateral lesions in the substantia nigra pars compacta and ventral tegmental area

Reinforcement omission effects (ROEs) are characterized by higher response rates after reinforcement omission than after reinforcement delivery. This pattern of behavior is interpreted in terms of motivational and attentional processes. Recent studies from our laboratory have shown that the amygdala, nucleus accumbens, and medial prefrontal cortex are involved in ROE modulation. Also, the literature has demonstrated a role of other areas such as substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) in processes related to surprising events, such as prediction error and presentation or omission of an event (exteroceptive stimulus and reinforcement). Since these structures send projections to areas related to ROE modulation such as the amygdala, nucleus accumbens, and prefrontal cortex, the objective of the present study was to determine whether the SNc and VTA also integrate the circuit involved in ROE modulation. Rats were trained on a fixed-interval 12 s with limited-hold 6 s signaled schedule of reinforcement (Pre-lesion training). After acquisition of stable performance, the rats received bilateral neurotoxic lesions of the SNc (Experiment 1) and VTA (Experiment 2). Following postoperative recovery, the rats were submitted to two refresher sessions (Post-lesion training). Subsequently, the training was changed from a 100 to a 50% schedule of reinforcement (Post-lesion testing). In both experiments, the results showed that there was no difference in performance between sham rats and rats with bilateral lesions of the SNc or the VTA.

Cocaine withdrawal alters the reward omission effect and enhances traits of negative urgency in rats across multiple days of testing

BACKGROUND

The personality trait of negative urgency, characterized as behaving rashly when emotionally perturbed, is gaining attention as an indicator for susceptibility to problematic substance use. How this trait is influenced by exposure to drugs of abuse is still unclear. Using an animal model of binge cocaine consumption, we tested this relationship in a reward-omission task across multiple days.

METHODS

Adult, male, Sprague-Dawley rats received seven daily (ip) injections of saline, cocaine (10-20mg/kg), or cocaine (20-40mg/kg). Cocaine doses increased linearly each day from the lower to the higher dose. A separate group received RTI-113 (3.0mg/kg), a selective dopamine transporter inhibitor, for 7 days. Fifteen days after their final injection, rats were trained on a reward-omission task with an operant component to earn further rewards.

RESULTS

Previous exposure to cocaine resulted in dose-dependent increases in negative urgency in separate behavioral variables across days of testing. The lower dose range increased negative urgency on the dimension of decreased reaction time to press a lever, while the higher dose range increased the rate of increase in lever presses made per trial. Rats receiving RTI-113 did not resemble either cocaine group and instead showed a decrease in lever pressing across days.

CONCLUSIONS

Our results indicate that previous binge cocaine consumption enhances behavioral markers of negative urgency in a dose-dependent, time-sensitive manner on discrete behavioral dimensions. The results with RTI-113 suggest the relationship between cocaine exposure and negative urgency is unlikely to be explained solely by inhibition of dopamine reuptake.

Nucleus accumbens neurons track behavioral preferences and reward outcomes during risky decision making

BACKGROUND

To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.

METHODS

Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.

RESULTS

At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.

CONCLUSIONS

Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.

Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum), as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancelation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens.