Roles of learning and motivation in preference behavior: Mediation by entorhinal cortex, dorsal and ventral hippocampus

Learning not to respond: Role of the hippocampus in withholding responses during omission training

Autoshaping is a Pavlovian learning paradigm in which rats experience pairings of a CS and a US independently of their behavior. When the CS is a lever inserted into the test cage and the US is food delivered to an adjacent magazine, many rats acquire a lever-pressing response called 'sign-tracking' even though that response has no effect on the occurrence of either the CS or the US. Since these lever presses are always followed by the US, it has been suggested that sign-tracking could be due to unintended reinforcement of the response. To eliminate the possibility of such instrumental learning the omission schedule, in which a response to the CS cancels the US, was introduced. Previous research has shown that training rats on autoshaping and switching them to an omission schedule generally reduces but does not eliminate sign-tracking, suggesting that it may be due to both Pavlovian and instrumental learning. In the present study naive rats trained on an omission schedule sign-tracked less than a control group exposed to random, unpaired CS and US presentations, suggesting that they learned to withhold the lever press response because of the negative contingency between that response and the US. In a second experiment rats with dorsal hippocampus lesions sign-tracked more than sham-lesioned rats on omission schedules, suggesting that this case of learning not to respond is hippocampus-based. This conclusion is consistent with many previous findings on the inability of hippocampal rats to withhold or suppress responding, and with studies suggesting that one form of extinction of learned responses in normal rats is due to competition from hippocampus-based learning not to respond.

Higher-order conditioning is impaired by hippocampal lesions

Behavior in the real world is rarely motivated by primary conditioned stimuli that have been directly associated with potent unconditioned reinforcers. Instead, motivation and choice behavior are driven by complex chains of higher-order associations that are only indirectly linked to intrinsic reward and often exert their influence outside awareness. Second-order conditioning (SOC) [1] is a basic associative-learning mechanism whereby stimuli acquire motivational salience by proxy, in the absence of primary incentives [2, 3]. Memory-systems theories consider first-order conditioning (FOC) and SOC to be prime examples of hippocampal-independent nondeclarative memory [4, 5]. Accordingly, neurobiological models of SOC focus almost exclusively on nondeclarative neural systems that support motivational salience and reward value. Transfer of value from a conditioned stimulus to a neutral stimulus is thought to require the basolateral amygdala [6, 7] and the ventral striatum [2, 3], but not the hippocampus. We developed a new paradigm to measure appetitive SOC of tones in rats. Hippocampal lesions severely impaired both acquisition and expression of SOC despite normal FOC. Unlike controls, rats with hippocampal lesions could not discriminate between positive and negative secondary conditioned tones, although they exhibited general familiarity with previously presented tones compared with new tones. Importantly, normal rats' behavior, in contrast to that of hippocampal groups, also revealed different confidence levels as indexed by effort, a central characteristic of hippocampal relational memory. The results indicate, contrary to current systems models, that representations of intrinsic relationships between reward value, stimulus identity, and motivation require hippocampal mediation when these relationships are of a higher order.

Latent learning of spatial information is impaired in middle-aged rats

The present study determined if the middle age related impairment that occurs with nonspatial latent learning also occurs in spatial latent learning. Thirty young (3-months-old) and 30 middle-aged (12-months-old) male Sprague-Dawley rats were given either pre-exposure to spatial cues surrounding a Barnes maze (SpatialPX), or pre-exposure to just the maze (MazePX). They were then given 10 training trials in which they had to find a hidden escape box while experiencing an aversive environment produced by bright lights and wind. Results showed that young rats given the SpatialPX condition demonstrated faster escape latencies and fewer errors than young rats given the MazePX condition. However, middle-aged rats given the SpatialPX condition did not show this improved performance. These findings indicate that the middle age learning deficit is not task specific, but rather is a general impairment in latent learning, possibly due to the early degeneration of the entorhinal cortex.

The entorhinal cortex, but not the dorsal hippocampus, is necessary for single-cue latent learning

Two experiments were conducted to examine the roles of the entorhinal cortex (EC), dorsal hippocampus (DH), and ventral hippocampus (VH) in a modified Latent Cue Preference (LCP) task. The modified LCP task utilized one visual cue in each compartment, compared to several multimodal cues used in a previous version. In the single-cue LCP task, water-replete rats drink water in one compartment of the LCP box on 1 day, and then have no water in a second compartment of the LCP box the following day (one training trial), for a total of three training trials. Rats are then water-deprived prior to a preference test, in which they are allowed to move freely between the two compartments with the water removed. Latent learning is demonstrated when water-deprived rats spend more time in the compartment that previously contained the water. Experiment 1 demonstrated that the single-cue LCP task results in the same irrelevant-incentive latent learning as the multicue LCP task. In addition, Experiment 1 replicated the finding that a compartment preference based on this latent learning requires a deprivation state during the preference test, while a compartment preference based on conditioning does not. Experiment 2 examined the effects of pretraining neurotoxin lesions of the EC, DH, and VH on this single-cue LCP task. Results showed that lesions of the EC and VH disrupted the irrelevant-incentive latent learning, while lesions of the DH did not. These results indicate that a latent learning task that involves one discrete compartment cue, rather than several compartmental cues, does not require the DH. Therefore, the EC appears to play a central role in single-cue latent learning in the LCP task.

Ultrasonic vocalization ratios reflect the influence of motivational state and amygdala lesions on different types of taste avoidance learning

Consumption of a sweet solution (the CS) and ultrasonic vocalizations (USVs) emitted by rats were recorded in a conditioned taste avoidance paradigm. The rats' affective states were inferred from a ratio of high to low-frequency ultrasonic calls, which have been associated with positive and negative affect, respectively. The interacting effects of deprivation state and lesions of the basolateral amygdala (BLA) on CS consumption and affective state were examined. Rats were trained during the light phase while either 23 h or 3h water deprived by exposing them to the CS and then injecting them with LiCl or saline. They were tested by re-exposing them to the CS while either 23 or 3h deprived. Sham-lesioned rats that received LiCl injections consumed significantly less of the CS and evidenced relatively negative affect (inferred from the USV ratio) compared to control rats that received saline injections, regardless of the deprivation state in which they were trained or tested. Rats with BLA lesions trained while 23 h deprived failed to exhibit either reduced consumption or negative affect, regardless of whether they were tested while deprived for 23 or 3h. Identical lesions had no effect on reduced consumption or on negative affect in rats trained while 3h deprived, regardless of whether they were tested while deprived for 3 or 23 h. The findings suggest that both reduced consumption and negative affect are the results of different learning processes in deprived (23 h) and nearly satiated (3h, during the light phase) rats. The amygdala-dependent negative affective shift observed in deprived rats may be due to an aversive Pavlovian conditioned response that acts to suppress drinking. The amygdala-independent negative affective response and reduced consumption in nearly satiated rats could be due to a form of latent learning of a stimulus-outcome association.

Middle-aged (12 month old) male rats show selective latent learning deficit

While many cognitive aging studies have been conducted using old (20+ months old) rats, few have demonstrated cognitive deficits in middle-aged (12 months old) rats. The present study was conducted to determine if deficits in latent learning (the acquisition of neutral information that does not immediately influence behavior) arise during middle age in rats. Twelve young (3 months old) and 12 middle-aged male Sprague-Dawley rats completed the latent cue preference (LCP) task, a conditioned cue preference (CCP) task in the same apparatus, and a reinforced spatial learning task using the Barnes maze. Results showed that the middle-aged rats were impaired on the latent learning (LCP) task relative to the young rats, but were not impaired on the CCP task or the spatial learning task. This may be because latent learning requires a functional entorhinal cortex, and the entorhinal cortex is one brain region that shows early age-related functional degeneration.

Hippocampal lesions in rhesus monkeys disrupt emotional responses but not reinforcer devaluation effects

BACKGROUND

Although the role of the hippocampus in emotional behavior has long been recognized, the extent to which the hippocampus plays a role in the regulation and expression of emotion in rhesus monkeys has not been systematically explored.

METHODS

Rhesus monkeys (Macaca mulatta) with excitotoxic lesions of the hippocampal formation and unoperated control animals were assessed on two different types of emotional processing: defensive reactions to a potential predator (experiment 1) and ability to update the value of positive reinforcers, in this case food (experiment 2). Monkeys with aspiration lesions of the perirhinal cortex were also included in this study as an operated control group.

RESULTS

In experiment 1, whereas both operated groups showed reduced latencies to retrieve food located near an innately fear-provoking stimulus, a fake snake, only monkeys with hippocampal lesions displayed reduced defensive reactions to the snake. In experiment 2, both operated groups performed as well as control animals when choosing objects flexibly based on the current value of a food.

CONCLUSIONS

These findings dissociate the hippocampus and perirhinal cortex in fear expression and specifically implicate the hippocampal formation in generating responses to stimuli that are potentially threatening.