Ventral hippocampus inactivation enhances the extinction of active avoidance responses in the presence of safety signals but leaves discrete trial operant active avoidance performance intact

A rat model of operant negative reinforcement in opioid-dependent males and females

RATIONALE AND OBJECTIVE

Avoidance of opioid withdrawal plays a key role in human opioid addiction. Here, we present a procedure for studying operant negative reinforcement in rats that was inspired by primate procedures where opioid-dependent subjects lever-press to prevent naloxone infusions.

METHODS

In Experiment 1, we trained rats (n = 30, 15 females) to lever-press to escape and then avoid mild footshocks (0.13-0.27 mA) for 35 days (30 trials/d). Next, we catheterized them and implanted minipumps containing methadone (10 mg/kg/day) or saline. We then paired (4 times, single session) a light cue (20-s) with a naloxone infusion (20 µg/kg, i.v) that precipitated opioid withdrawal. Next, we trained the rats to escape naloxone injections for 10 days (30 trials/d). Each trial started with the onset of the opioid-withdrawal cue. After 20-s, the lever extended, and an infusion of naloxone (1 to 2.2 µg/kg/infusion) began; a lever-press during an 11-s window terminated the withdrawal-paired cue and the infusion. In Experiment 2, we trained rats (n = 34, 17 females) on the same procedure but decreased the footshock escape/avoidance training to 20 days.

RESULTS

All rats learned to lever-press to escape or avoid mild footshocks. In both experiments, a subset, 56% (10/18) and 33% (8/24) of methadone-dependent rats learned to lever-press to escape naloxone infusions.

CONCLUSIONS

We introduce an operant negative reinforcement procedure where a subset of opioid-dependent rats learned to lever-press to escape withdrawal-inducing naloxone infusions. The procedure can be used to study mechanisms of individual differences in opioid negative reinforcement-related behaviors in opioid-dependent rats.

The ventral hippocampus is necessary for cue-elicited, but not outcome driven approach-avoidance conflict decisions: a novel operant choice decision-making task

Approach-avoidance conflict is induced when an organism encounters a stimulus that carries both positive and negative attributes. Accumulating evidence implicates the ventral hippocampus (VH) in the detection and resolution of approach-avoidance conflict, largely on the basis of maze-based tasks assaying innate and conditioned responses to situations of conflict. However, its role in discrete trial approach-avoidance decision-making has yet to be elucidated. In this study, we designed a novel cued operant conflict decision-making task in which rats were required to choose and respond for a low reward option or high reward option paired with varying shock intensities on a differential reinforcement of low rates of responding schedule. Post training, the VH was chemogenetically inhibited while animals performed the task with the usual outcomes delivered, and with the presentation of cues associated with the reward vs. conflict options only (extinction condition). We found that VH inhibition led to an avoidance of the conflict option and longer latency to choose this option when decision-making was being made on the basis of cues alone with no outcomes. Consistent with these findings, VH-inhibited animals spent more time in the central component of the elevated plus maze (EPM), indicating a potential deficit in decision-making under innate forms of approach-avoidance conflict. Taken together, these findings implicate the VH in cue-driven approach-avoidance decisions in the face of motivational conflict.

The ventral hippocampus CA3 is critical in regulating timing uncertainty in temporal decision-making

Timing uncertainty is a critical component of temporal decision-making, as it determines the decision strategies that maximize reward rate. However, little is known about the biological substrates of timing uncertainty. In this study, we report that the CA3 subregion of the ventral hippocampus (vCA3), a relatively unexplored area in timing, is critical in regulating timing uncertainty that informs temporal decision making. Using a variant of the differential reinforcement of low rates of responding (DRL) task that incorporates differential levels of approach-avoidance conflict, rats were trained to wait a minimum of 6 s to earn a reward that was paired with varying durations of foot shock. Post-training chemogenetic inhibition of the vCA3 reduced timing uncertainty without affecting mean wait times, irrespective of the level of conflict experienced. Simulations based on the information-processing variant of scalar expectancy theory (SET) revealed that the vCA3 may be important in modulating decision threshold or switch closure latency variability.

Arbitration of Approach-Avoidance Conflict by Ventral Hippocampus

When environmental cues or stimuli that represent both rewarding and aversive outcomes are presented, complex computations must be made in order to determine whether approach or avoidance is the better behavioral strategy. In many neuropsychiatric illnesses these computations can be skewed. In some instances, circumstances that may normally warrant avoidance instead promote approach, thus producing compulsive-like behavioral strategies that are inflexible in response to new or conflicting information. Alternatively, high sensitivity to aversion or low sensitivity to reward can result in the failure to achieve goals and loss of resilience that characterizes depressive disorders. Increases in compulsive-like behavior have been found to be associated with disrupted signaling in regions that regulate response to conflicting stimuli, including the hippocampus. Classic behavioral inhibition theories of hippocampus function in anxiety suggest that the hippocampus blocks aberrant behavior in response to anxiety related cues or stimuli. The hippocampus may act to block approach in the face of conflicting stimuli. Dysregulations of hippocampal function, as may be present in neuropsychiatric disorders, may therefore promote aberrant approach behavior. The ventral hippocampus (vHPC) subregion is key for coordinating this approach/avoidance conflict resolution, likely through its participation with cortico-striatal and mesolimbic circuits. We revisit Gray's behavioral inhibition theory of HPC function, first posited in the 1980s, and interpret in the context of new knowledge on vHPC function gained through modern technology. Taken together with the extant, classical literature on hippocampal function, we propose that these new findings suggest that vHPC circuits balance behavioral response to conflicting stimuli in a manner that is both state- and context-dependent and, further, that disruption of specific vHPC circuits tips the balance in favor of biased approach or avoidance behavioral strategies.