Weaker situations: Uncertainty reveals individual differences in learning: Implications for PTSD

Few individuals who experience trauma develop posttraumatic stress disorder (PTSD). Therefore, the identification of individual differences that signal increased risk for PTSD is important. Lissek et al. (2006) proposed using a weak rather than a strong situation to identify individual differences. A weak situation involves less-salient cues as well as some degree of uncertainty, which reveal individual differences. A strong situation involves salient cues with little uncertainty, which produce consistently strong responses. Results from fear conditioning studies that support this hypothesis are discussed briefly. This review focuses on recent findings from three learning tasks: classical eyeblink conditioning, avoidance learning, and a computer-based task. These tasks are interpreted as weaker learning situations in that they involve some degree of uncertainty. Individual differences in learning based on behavioral inhibition, which is a risk factor for PTSD, are explored. Specifically, behaviorally inhibited individuals and rodents (i.e., Wistar Kyoto rats), as well as individuals expressing PTSD symptoms, exhibit enhanced eyeblink conditioning. Behaviorally inhibited rodents also demonstrate enhanced avoidance responding (i.e., lever pressing). Both enhanced eyeblink conditioning and avoidance are most evident with schedules of partial reinforcement. Behaviorally inhibited individuals also performed better on reward and punishment trials than noninhibited controls in a probabilistic category learning task. Overall, the use of weaker situations with uncertain relationships may be more ecologically valid than learning tasks in which the aversive event occurs on every trial and may provide more sensitivity for identifying individual differences in learning for those at risk for, or expressing, PTSD symptoms.

Neurocomputational correlates of learned irrelevance in humans

Inappropriate behaviors may result from acquiring maladaptive associations between irrelevant information in the environment and important events, such as reward or punishment. Pre-exposure effects are believed to prevent the expression of irrelevant associations. For example, learned irrelevance delays the expression of associations between conditioned (CS) and unconditioned (US) stimuli following their uncorrelated presentation. The neuronal substrates of pre-exposure effects in humans are largely unknown because these effects rapidly attenuate when using traditional pre-exposure paradigms. The latter are therefore incompatible with neuroimaging approaches that require many trial repetitions. Moreover, large methodological differences between animal and human research on pre-exposure effects challenge the presumption of shared neurocognitive substrates, and question the prevalent use of pre-exposure effects in animals to model symptoms of human mental disorders. To overcome these limitations, we combined a novel learned irrelevance task with model-based fMRI. We report the results of a model that describes learned irrelevance as a dynamic process, which evolves across trials and integrates the weighting between two state-action values pertaining to 'CS-no US' associations (acquired during pre-exposure) and 'CS-US' associations (acquired during subsequent conditioning). This relative weighting correlated i) positively with the learned irrelevance effect observed in the behavioral task, ii) positively with activity in the entorhinal cortex, and iii) negatively with activity in the nucleus accumbens (NAcc). Furthermore, the model updates the relative weighting of the two state-action values via two separate prediction error (PE) signals that allow the dynamic accumulation of evidence for the CS to predict the 'US' or a 'no US' outcome. One PE signal, designed to increase the relative weight of 'CS-US' associations following 'US' outcomes, correlated with activity in the NAcc, while another PE signal, designed to increase the relative weight of 'CS-no US' associations following 'no US' outcomes, correlated with activity in the basolateral amygdala. By extending previous animal observations to humans, the present study provides a novel approach to foster translational research on pre-exposure effects.

US alone trials presented during acquisition do not disrupt classical eyeblink conditioning: Empirical and computational findings

Studies of partial reinforcement in eyeblink conditioning have typically shown slower learning of a CS-US association when paired CS-US trials are interleaved with CS-alone trials. However, recent work has shown that CS-US learning is not slowed by interleaved US-alone trials. This discrepancy is surprising since both partial reinforcement protocols reduce the total number of paired CS-US trials. Previously, Kimble et al. (1955) reported that inserting a block of US-alone trials during CS-US training did not disrupt eyeblink acquisition. Here, we sought to replicate and extend these findings by comparing interleaved vs. blocked US-alone trials during CS-US paired training. Ninety-seven undergraduates volunteered for this experiment for research credit. Participants received 60 acquisition trials, consisting of either 100% CS-US paired trials, 50% US-alone trials intermixed with CS-US paired trials, or a block of 20 US-alone trials inserted between blocks of 20 CS-US trials. We also utilized a previously published computational model of hippocampal and cerebellar learning to test the effects of these US-alone protocols. Both empirical and computational results supported the finding that US-alone trials, either intermixed or inserted as a block of trials, do not disrupt acquisition of conditioned eyeblinks. Possible neural substrates of these US-alone effects are discussed.

Complementary learning systems within the hippocampus: a neural network modelling approach to reconciling episodic memory with statistical learning

A growing literature suggests that the hippocampus is critical for the rapid extraction of regularities from the environment. Although this fits with the known role of the hippocampus in rapid learning, it seems at odds with the idea that the hippocampus specializes in memorizing individual episodes. In particular, the Complementary Learning Systems theory argues that there is a computational trade-off between learning the specifics of individual experiences and regularities that hold across those experiences. We asked whether it is possible for the hippocampus to handle both statistical learning and memorization of individual episodes. We exposed a neural network model that instantiates known properties of hippocampal projections and subfields to sequences of items with temporal regularities. We found that the monosynaptic pathway-the pathway connecting entorhinal cortex directly to region CA1-was able to support statistical learning, while the trisynaptic pathway-connecting entorhinal cortex to CA1 through dentate gyrus and CA3-learned individual episodes, with apparent representations of regularities resulting from associative reactivation through recurrence. Thus, in paradigms involving rapid learning, the computational trade-off between learning episodes and regularities may be handled by separate anatomical pathways within the hippocampus itself.This article is part of the themed issue 'New frontiers for statistical learning in the cognitive sciences'.

Enhanced Eyeblink Conditioning in Behaviorally Inhibited Individuals is Disrupted by Proactive Interference Following US Alone Pre-exposures

Anxiety vulnerable individuals exhibit enhanced acquisition of conditioned eyeblinks as well as enhanced proactive interference from conditioned stimulus (CS) or unconditioned stimulus (US) alone pre-exposures (Holloway et al., 2012). US alone pre-exposures disrupt subsequent conditioned response (CR) acquisition to CS-US paired trials as compared to context pre-exposure controls. While Holloway et al. (2012) reported enhanced acquisition in high trait anxiety individuals in the context condition, anxiety vulnerability effects were not reported for the US alone pre-exposure group. It appears from the published data that there were no differences between high and low anxiety individuals in the US alone condition. In the work reported here, we sought to extend the findings of enhanced proactive interference with US alone pre-exposures to determine if the enhanced conditioning was disrupted by proactive interference procedures. We also were interested in the spontaneous eyeblinks during the pre-exposure phase of training. We categorized individuals as anxiety vulnerability or non-vulnerable individuals based scores on the Adult Measure of Behavioral Inhibition (AMBI). Sixty-six participants received 60 trials consisting of 30 US alone or context alone pre-exposures followed by 30 CS-US trials. US alone pre-exposures not only disrupted CR acquisition overall, but behaviorally inhibited (BI) individuals exhibited enhanced proactive interference as compared to non-inhibited (NI) individuals. In addition, US alone pre-exposures disrupted the enhanced acquisition observed in BI individuals as compared to NI individuals following context alone pre-exposures. Differences were also found in rates of spontaneous eyeblinks between BI and NI individuals during context pre-exposure. Our findings will be discussed in the light of the neural substrates of eyeblink conditioning as well as possible factors such as hypervigilance in the amygdala and hippocampal systems, and possible learned helplessness. Applications of these findings of enhanced proactive interference in BI individuals to pre-exposure therapies to reduce anxiety disorders such as posttraumatic stress disorder (PTSD) will be discussed.

The Anatomy and Physiology of Eyeblink Classical Conditioning

This chapter reviews the past research toward identifying the brain circuit and its computation underlying the associative memory in eyeblink classical conditioning. In the standard delay eyeblink conditioning paradigm, the conditioned stimulus (CS) and eyeblink-eliciting unconditioned stimulus (US) converge in the cerebellar cortex and interpositus nucleus (IPN) through the pontine nuclei and inferior olivary nucleus. Repeated pairings of CS and US modify synaptic weights in the cerebellar cortex and IPN, enabling IPN neurons to activate the red nucleus and generate the conditioned response (CR). In a variant of the standard paradigm, trace eyeblink conditioning, the CS and US are separated by a brief stimulus-free trace interval. Acquisition in trace eyeblink conditioning depends on several forebrain regions, including the hippocampus and medial prefrontal cortex as well as the cerebellar-brainstem circuit. Details of computations taking place in these regions remain unclear; however, recent evidence supports a view that the forebrain encodes a temporal sequence of the CS, trace interval, and US in a specific environmental context and signals the cerebellar-brainstem circuit to execute the CR when the US is likely to occur. Together, delay eyeblink conditioning represents one of the most successful cases of understanding the neural substrates of long-term memory in mammals, while trace eyeblink conditioning demonstrates its utility for uncovering detailed computations in the whole brain network underlying long-term memory.

GABAergic neurons in the medial septum-diagonal band of Broca (MSDB) are important for acquisition of the classically conditioned eyeblink response

The medial septum and diagonal band of Broca (MSDB) influence hippocampal function through cholinergic, GABAergic, and glutamatergic septohippocampal neurons. Non-selective damage of the MSDB or intraseptal scopolamine impairs classical conditioning of the eyeblink response (CCER). Scopolamine preferentially inhibits GABAergic MSDB neurons suggesting that these neurons may be an important modulator of delay CCER, a form of CCER not dependent on the hippocampus. The current study directly examined the importance of GABAergic MSDB neurons in acquisition of delay CCER. Adult male Sprague-Dawley rats received either a sham (PBS) or GABAergic MSDB lesion using GAT1-saporin (SAP). Rats were given two consecutive days of delay eyeblink conditioning with 100 conditioned stimulus-unconditioned stimulus paired trials. Intraseptal GAT1-SAP impaired acquisition of CCER. The impairment was observed on the first day with sham and lesion groups reaching similar performance by the end of the second day. Our results provide evidence that GABAergic MSDB neurons are an important modulator of delay CCER. The pathways by which MSDB neurons influence the neural circuits necessary for delay CCER are discussed.

Why trace and delay conditioning are sometimes (but not always) hippocampal dependent: a computational model

A recurrent-network model provides a unified account of the hippocampal region in mediating the representation of temporal information in classical eyeblink conditioning. Much empirical research is consistent with a general conclusion that delay conditioning (in which the conditioned stimulus CS and unconditioned stimulus US overlap and co-terminate) is independent of the hippocampal system, while trace conditioning (in which the CS terminates before US onset) depends on the hippocampus. However, recent studies show that, under some circumstances, delay conditioning can be hippocampal-dependent and trace conditioning can be spared following hippocampal lesion. Here, we present an extension of our prior trial-level models of hippocampal function and stimulus representation that can explain these findings within a unified framework. Specifically, the current model includes adaptive recurrent collateral connections that aid in the representation of intra-trial temporal information. With this model, as in our prior models, we argue that the hippocampus is not specialized for conditioned response timing, but rather is a general-purpose system that learns to predict the next state of all stimuli given the current state of variables encoded by activity in recurrent collaterals. As such, the model correctly predicts that hippocampal involvement in classical conditioning should be critical not only when there is an intervening trace interval, but also when there is a long delay between CS onset and US onset. Our model simulates empirical data from many variants of classical conditioning, including delay and trace paradigms in which the length of the CS, the inter-stimulus interval, or the trace interval is varied. Finally, we discuss model limitations, future directions, and several novel empirical predictions of this temporal processing model of hippocampal function and learning.

Differential role of muscarinic transmission within the entorhinal cortex and basolateral amygdala in the processing of irrelevant stimuli

Cholinergic projections to the entorhinal cortex (EC) and basolateral amygdala (BLA) mediate distinct cognitive processes through muscarinic acetylcholine receptors (mAChRs). In this study, we sought to further differentiate the role of muscarinic transmission in these regions in cognition, using the latent inhibition (LI) phenomenon. LI is a cross-species phenomenon manifested as poorer conditioning to a stimulus experienced as irrelevant during an earlier stage of repeated non-reinforced pre-exposure to that stimulus, and is considered to index the ability to ignore, or to in-attend to, irrelevant stimuli. Given our recent findings that systemic administration of the mAChR antagonist scopolamine can produce two contrasting LI abnormalities in rats, ie, abolish LI under conditions yielding LI in non-treated controls, or produce abnormally persistent LI under conditions preventing its expression in non-treated controls, we tested whether mAChR blockade in the EC and BLA would induce LI abolition and persistence, respectively. We found that intra-EC scopolamine infusion (1, 10 mug per hemisphere) abolished LI when infused in pre-exposure or both pre-exposure and conditioning, but not in conditioning alone, whereas intra-BLA scopolamine infusion led to persistent LI when infused in conditioning or both stages, but not in pre-exposure alone. Although cholinergic innervation of the EC and BLA has long been implicated in attention to novel stimuli and in processing of motivationally significant stimuli, respectively, our results provide evidence that EC mAChRs also have a role in the development of inattention to stimuli, whereas BLA mAChRs have a role in re-attending to previously irrelevant stimuli that became motivationally relevant.

Effect of stimulus pre-exposure on inhibitory avoidance retrieval-associated changes in the phosphorylated form of the extracellular signal-regulated kinase-1 and -2 (pERK1/2)

One goal of the present study was to determine how pre-exposure to a set of contextual cues affected subsequent reinforced inhibitory avoidance task performance using those cues (latent inhibition model). In addition, immunohistochemical assessment of the phosphorylated (activated) form of the extracellular signal-regulated kinase-1 and -2 (pERK1/2) was examined. Adult, male Long Evans rats were randomly assigned into either pre-exposure (PE) or different pre-exposure (DPE) groups. All rats received 3days of contextual pre-exposure (same or different context as that used for reinforced training) and were trained, 24h later, on an inhibitory avoidance task (with or without shock). Rats were euthanized 24h after training; half with a retention test and half without. Behaviorally, the PE group showed reduced latencies to enter the dark/shock compartment during the retention test compared to the DPE group showing the latent inhibition phenomenon. Compared to the shocked and tested DPE group, the shocked and tested PE group showed fewer pERK1/2-ir neurons in the secondary motor cortex, the anterior cingulate, the pre- and infra-limbic cortices, and the central nucleus of the amygdala. These regions showed similar numbers of pERK1/2-labeled neurons when comparing the shocked and tested PE group with the nonshocked and tested PE group. This suggests the possibility that brain regions showing decreased pERK1/2 levels in association with attenuated inhibitory avoidance performance may be involved in different aspects of the memory retrieval process.

Entorhinal cortex and cognition

Understanding the function of the entorhinal cortex (EC) has been an important subject over the years, not least because of its cortical intermediary to and from the hippocampus proper, and because of electrophysiological advances which have started to reveal the physiology in behaving animals. Clearly, a lot more needs to be done but is clear to date that EC is not merely a throughput station providing all hippocampal subfields with sensory information, but that processing within EC contributes significantly to attention, conditioning, event and spatial cognition possibly by compressing representations that overlap in time. These are transmitted to the hippocampus, where they are differentiated again and returned to EC. Preliminary evidence for such a role, but also their possible pitfalls are summarised.

A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning

Some existing models of hippocampal function simulate performance in classical conditioning tasks using the error backpropagation algorithm to guide learning (Gluck, M.A., and Myers, C.E., (1993). Hippocampal mediation of stimulus representation: a computational theory. Hippocampus, 3(4), 491-516.). This algorithm is not biologically plausible because it requires information to be passed backward through layers of nodes and assumes that the environment provides information to the brain about what correct outputs should be. Here, we show that the same information-processing function proposed for the hippocampal region in the Gluck and Myers (1993) model can also be implemented in a network without using the backpropagation algorithm. Instead, our newer instantiation of the theory uses only (a) Hebbian learning methods which match more closely with synaptic and associative learning mechanisms ascribed to the hippocampal region and (b) a more plausible representation of input stimuli. We demonstrate here that this new more biologically plausible model is able to simulate various behavioral effects, including latent inhibition, acquired equivalence, sensory preconditioning, negative patterning, and context shift effects. In addition, the newer model is able to address some new phenomena including the effect of the number of training trials on blocking and overshadowing.

Neurogenesis, learning and associative strength

Though the role of the hippocampus in processes of learning and memory is well established, the role of new neurons generated there is less understood. Training on some associative learning tasks increases the likelihood that new cells in the subgranular zone of the dentate gyrus will survive. In the rat, an effective training procedure is trace eyeblink conditioning, in which a conditioned stimulus (CS) is paired with an aversive stimulation to the eyelid (unconditioned stimulus; US), but the stimuli are separated by a temporal gap. Here, we manipulated the asymptote or rate of acquisition during trace conditioning, and examined survival of cells generated 1 week before training. Acquisition was disrupted by decreasing associative strength by insertion of unpredicted USs or slowed with latent inhibition. The number of cells was increased in animals that were trained with trace conditioning, irrespective of the decrease in associative strength or slowed acquisition. Disrupting acquisition with unsignaled USs still increased cell numbers, suggesting that the learning effect on cell survival is not dependent on reliable expression of the conditioned response. Further, animals in the latent inhibition conditions that learned but required more trials also retained more of the new cells than animals requiring fewer trials. The number of cells that survived after the effective training procedures was similar to the number of cells that were available for rescue at the beginning of training. Thus, learning can rescue the majority of cells expressed at the beginning of training, and does so most effectively when acquisition requires many trials.

Differential influence of the ventral subiculum on dopaminergic responses observed in core and dorsomedial shell subregions of the nucleus accumbens in latent inhibition

It has previously been reported that dopamine (DA) responses observed in the core and dorsomedial shell parts of the nucleus accumbens (Nacc) in latent inhibition (LI) are dependent on the left entorhinal cortex (ENT). The present study was designed to investigate the influence of the left ventral subiculum (SUB) closely linked to the ENT on the DA responses obtained in the Nacc during LI, using an aversive conditioned olfactory paradigm and in vivo voltammetry in freely moving rats. In the first (pre-exposure) session, functional blockade of the left SUB was achieved by local microinjection of tetrodotoxin (TTX). In the second session, rats were aversively conditioned to banana odor, the conditional stimulus (CS). In the retention (test) session the results were as follows: (1) pre-exposed (PE) conditioned animals microinjected with TTX, displayed aversion toward the CS; (2) in the core part of the Nacc, for PE-TTX-conditioned rats as for non-pre-exposed (NPE) conditioned animals, DA levels remained close to the baseline whereas DA variations in both groups were significantly different from the DA increases observed in PE-conditioned rats microinjected with the solvent (phosphate-buffered saline (PBS)); (3) in the shell part of the Nacc, for PE-TTX-conditioned rats, DA variations were close to or above the baseline. They were situated between the rapid DA increases observed in NPE-conditioned animals and the transient DA decreases obtained in PE-PBS-conditioned animals. These findings suggest that, in parallel to the left ENT, the left SUB controls DA LI-related responses in the Nacc. The present data may also offer new insight into the pathophysiology of schizophrenia.

Reversible inactivation of the entorhinal cortex disrupts the establishment and expression of latent inhibition of cued fear conditioning in C57BL/6 mice

For latent inhibition, preexposure to a conditioned stimulus (CS) prior to training with an unconditioned stimulus (US) results in decreased conditioned responses (CRs) to the CS at the time of testing. The mechanism by which decreased CRs occurs, however, is unknown; CS preexposure may interfere with subsequent conditioning, or modulate the expression of CRs. Previous research has suggested that the entorhinal cortex (EC) is necessary for latent inhibition of a variety of tasks. However, no studies have specifically compared the role of the EC in acquisition vs. expression of latent inhibition. The present study used reversible inactivation of the EC to address this issue. The GABA agonist muscimol (0.5 microg/side) was directly infused into the EC of mice prior to CS preexposure, training, or testing. Our results indicate that muscimol inactivation of the EC before CS preexposure disrupts latent inhibition of cued fear conditioning. Importantly, this same dose of muscimol did not disrupt cued fear conditioning, nor did it affect latent inhibition when infused into the subiculum. Furthermore, inactivation of the EC at testing disrupted the expression of latent inhibition of cued fear conditioning; that is, CS preexposed mice that received entorhinal cortical muscimol infusion at testing showed CRs compared to saline-infused CS preexposed mice. These findings suggest that repeated preexposure to the CS during latent inhibition may alter entorhinal cortical activity thereby allowing the EC to exert inhibitory control over the expression of CRs during testing of CS preexposed mice.

Functional networks underlying latent inhibition learning in the mouse brain

The present study reports the first comprehensive map of brain networks underlying latent inhibition learning and the first application of structural equation modeling to cytochrome oxidase data. In latent inhibition, repeated exposure to a stimulus results in a latent form of learning that inhibits subsequent associations with that stimulus. As neuronal energy demands to form learned associations changes, so does the induction of the respiratory enzyme cytochrome oxidase. Therefore, cytochrome oxidase can be used as an endpoint metabolic marker of the effects of experience on regional brain metabolic capacity. Quantitative cytochrome oxidase histochemistry was used to map brain regions in mice trained on a tone-footshock fear conditioning paradigm with either tone preexposure (latent inhibition), conditioning only (acquisition), conditioning followed by tone alone (extinction), or no handling or conditioning (naive). The ventral cochlear nucleus, medial geniculate, CA1 hippocampus, and perirhinal cortex showed modified metabolic capacity due to latent inhibition. Structural equation modeling was used to determine the causal influences in an anatomical network of these regions and others thought to mediate latent inhibition, including the accumbens and entorhinal cortex. An uncoupling of ascending influences between auditory regions was observed in latent inhibition. There was also a reduced influence on the accumbens from the perirhinal cortex in both latent inhibition and extinction. The results suggest a specific network with a neural mechanism of latent inhibition that appears to involve sensory gating, as evidenced by modifications in metabolic capacity and effective connectivity between auditory regions and reduced perirhinal cortex influence on the accumbens.

Evidence for a critical role of entorhinal cortex at pre-exposure for latent inhibition disruption in rats

Latent inhibition (LI), that is the decrease in conditioned response induced by the repeated nonreinforced pre-exposures to the to-be-conditioned stimulus, is disrupted by entorhinal cortex (EC) lesions. The mechanism involved in this disruption is unknown, and in particular the experimental stage (pre-exposure or conditioning) at which the integrity of EC is necessary has to be determined. The purpose of this study was to address this issue by using reversible inactivation of the EC by local micro-infusion of tetrodotoxin (TTX). TTX was infused either before the pre-exposure phase, before the conditioning phase, or before both phases. LI was unaffected in rats that received TTX before conditioning or before both pre-exposure and conditioning. In contrast, LI was disrupted in rats that received TTX before pre-exposure only. These results are discussed in the framework of LI models.

Hippocampal inactivation enhances taste learning

Learning tasks are typically thought to be either hippocampal-dependent (impaired by hippocampal lesions) or hippocampal-independent (indifferent to hippocampal lesions). Here, we show that conditioned taste aversion (CTA) learning fits into neither of these categories. Rats were trained to avoid two taste stimuli, one novel and one familiar. Muscimol infused through surgically implanted intracranial cannulae temporarily inactivated the dorsal hippocampus during familiarization, subsequent CTA training, or both. As shown previously, hippocampal inactivation during familiarization enhanced the effect of that familiarization on learning (i.e., hippocampal inactivation enhanced latent inhibition of CTA); more novel and surprising, however, was the finding that hippocampal inactivation during training sessions strongly enhanced CTA learning itself. These phenomena were not caused by specific aspects of our infusion technique--muscimol infusions into the hippocampus during familiarization sessions did not cause CTAs, muscimol infusions into gustatory cortex caused the expected attenuation of CTA, and hippocampal inactivation caused the expected attenuation of spatial learning. Thus, we suggest that hippocampal memory processes interfere with the specific learning mechanisms underlying CTA, and more generally that multiple memory systems do not operate independently.

Latent inhibition and asymmetrical visual-spatial attention in children with ADHD

The research was designed to determine whether the purported hemispheric asymmetries that are associated with attention deficit/hyperactivity disorder (ADHD) affect performance on a selective attention visual search task, and whether any obtained asymmetry will be modulated by methylphenidate. Two groups of children (8-15 years) with ADHD, one with methylphenidate treatment (ADHD+) and one without (ADHD+), were compared to matched controls on a two-stage visual search task. The task assessed right-left visual field asymmetries and the effects of changing a previous distractor into a target. Such a procedure, related to latent inhibition (LI; poorer performance to a previously irrelevant stimulus than to a novel one), can provide evidence for dysfunctional processing of irrelevant stimuli. All three groups exhibited the LI effect. The ADHD group, however, exhibited less LI for left- than right-side targets, an effect absent in the control and ADHD+ groups, suggesting a lateralized attentional deficit for ADHD+ that was normalized by methylphenidate.

Basolateral amygdala lesions in the rat produce an abnormally persistent latent inhibition with weak preexposure but not with context shift

Latent inhibition (LI) refers to retarded conditioning to a stimulus as a consequence of its nonreinforced preexposure. We have recently reported that basolateral amygdala (BLA) lesions lead to an abnormally persistent LI under conditions that normally disrupt LI, namely, extended conditioning. This study tested whether BLA lesions would induce abnormally persistent LI under two additional conditions disrupting LI in controls, namely, context shift and weak preexposure. LI was measured in an active avoidance procedure. In the first experiment, rats received 100 nonreinforced preexposures and were conditioned either in the same or in a different context from that of the preexposure stage. In the second experiment, rats received 50 nonreinforced preexposures and were conditioned in the same context as that of preexposure. Sham-operated rats showed LI in the same but not in the different context condition or with low number of preexposures. BLA lesions produced abnormally persistent LI with low number of preexposures but not with context shift. It is suggested that the BLA is involved in LI modulation based on the impact of preexposure and conditioning but not on contextual information.

Cortico-hippocampal interaction and adaptive stimulus representation: a neurocomputational theory of associative learning and memory

Computational models of the hippocampal region link psychological theories of associative learning with their underlying physiological and anatomical substrates. Our approach to theory development began with a broad description of the computations that depend on the hippocampal region in classical conditioning (Gluck and Myers, 1993 and Gluck and Myers, 2001). In this initial model, the hippocampal region was treated as an Information-processing system that transformed stimulus representations, compressing (making more similar) representations of inputs that co-occur or are otherwise redundant, while differentiating (or making less similar) representations of inputs that predict different future events. This model led to novel predictions for the behavioral consequences of hippocampal-region lesions in rodents and of brain damage in humans who have amnesia or are in the earliest stages of Alzheimer's disease. Many of these predictions have, since been confirmed by our lab and others. Functional brain imaging studies have provided further supporting evidence. In more recent computational modeling, we have shown how some aspects of this proposed information-processing function could emerge from known anatomical and physiological characteristics of the hippocampal region, including the entorhinal cortex and the septo-hippocampal cholinergic system. The modeling to date lays the groundwork for future directions that increase the depth of detail of the biological modeling, as well as the breadth of behavioral phenomena addressed. In particular, we are working now to reconcile these kinds of incremental associative learning models with other models of the hippocampal region that account for the rapid formation of declarative memories.

Brain-behaviour relationships in latent inhibition: a computational model

In a series of studies, we applied a neural network to study the neural bases of latent inhibition. We first designed a model able to handle behavioral data and then we investigated whether structures and neural elements in the brain were able to carry out the operations described by network. We demonstrated that the network was able to describe many of the behavioral properties of LI, and elucidate the effects of several manipulations of the dopaminergic system, the hippocampus, and the nucleus accumbens on LI, as well as some of the positive symptoms of schizophrenia. The results support the idea that a 'conceptual nervous system' can be successfully used to relate brain and behavior.

Latent inhibition is disrupted by nucleus accumbens shell lesion but is abnormally persistent following entire nucleus accumbens lesion: The neural site controlling the expression and disruption of the stimulus preexposure effect

Latent inhibition (LI) is the proactive interference of repeated nonreinforced preexposure to a stimulus with subsequent performance on a learning task involving that stimulus. The present experiments investigated the role of the nucleus accumbens (NAC) in LI. LI was measured in a thirst motivated conditioned emotional response procedure with low or high number of conditioning trials, and in two-way active avoidance procedure with the stages of preexposure and conditioning taking place in the same or different contexts. Sham-lesioned rats showed LI with low but not high number of conditioning trials and if preexposure and conditioning took place in the same context but not if the context was changed between the stages. Lesion to the shell subregion of the NAC disrupted LI but LI was preserved in rats with a combined lesion to the NAC shell and core subregions. Moreover, rats with a combined shell-core lesion persisted in showing LI in spite of high number of conditioning trials and in spite of context change. These results show that the NAC is not essential for the acquisition of LI but rather plays a key role in regulating the expression of LI. Moreover, they suggest that the two subregions of the NAC contribute competitively and cooperatively to this process, selecting the response appropriate to the stimulus-no event or the stimulus-reinforcement association in conditioning.

Inactivation of the dorsal hippocampus does not affect learning during exploration of a novel environment

The conditioned cue preference (CCP) task was used to study the ability of rats to discriminate between spatial locations. Food-deprived rats explored an eight-arm radial maze with no food present (pre-exposure). On subsequent days, they were alternately confined in one arm of the maze with food and in another arm with no food (training), followed by a preference test with no food present, to determine if they had learned to discriminate between the two arm locations. No injections were given during the two latter phases. With adjacent radial maze arms, rats given three 10-min pre-exposure sessions and four food-pairing trials exhibited a preference for their food-paired arms; rats not pre-exposed did not exhibit this preference. Rats pre-exposed 30 min after dorsal hippocampus injections of muscimol exhibited the preference. With widely separated maze arms, rats given two training trials with no pre-exposure exhibited a preference for the food-paired arm; rats that were given one pre-exposure session did not. Rats pre-exposed 30 min after dorsal hippocampus injections of muscimol did not exhibit the preference. The same intrahippocampal muscimol injections that failed to affect the influence of pre-exposure on CCP learning with both arm configurations impaired win-shift performance, a standard test of spatial learning. These findings suggest that a functional dorsal hippocampus is not required for the (incidental or latent) learning that occurs during unreinforced exploration of a novel environment. The information acquired during this activity subsequently produces a latent learning effect if it is used to discriminate between two ambiguous locations (adjacent arms) or a latent inhibition--like effect if it is used to discriminate between two unambiguous locations (separated maze arms).

Integrating Incremental Learning and Episodic Memory Models of the Hippocampal Region

By integrating previous computational models of corticohippocampal function, the authors develop and test a unified theory of the neural substrates of familiarity, recollection, and classical conditioning. This approach integrates models from 2 traditions of hippocampal modeling, those of episodic memory and incremental learning, by drawing on an earlier mathematical model of conditioning, SOP (A. Wagner, 1981). The model describes how a familiarity signal may arise from parahippocampal cortices, giving a novel explanation for the finding that the neural response to a stimulus in these regions decreases with increasing stimulus familiarity. Recollection is ascribed to the hippocampus proper. It is shown how the properties of episodic representations in the neocortex, parahippocampal gyrus, and hippocampus proper may explain phenomena in classical conditioning. The model reproduces the effects of hippocampal, septal, and broad hippocampal region lesions on contextual modulation of classical conditioning, blocking, learned irrelevance, and latent inhibition.

Effects of fimbria-fornix, hippocampus, and amygdala lesions on discrimination between proximal locations

The conditioned cue preference (CCP) task was used to study the information required to discriminate between spatial locations defined by adjacent arms of an 8-arm radial maze. Normal rats learned the discrimination after 3 unreinforced preexposure (PE) sessions and 4 food paired-unpaired training trials. Fimbria-fornix lesions made before, but not after, PE, and hippocampus lesions made at either time, blocked the discrimination, suggesting that the 2 structures processed different information. Lateral amygdala lesions made before PE facilitated the discrimination. This amygdala-mediated interference with the discrimination was the result of a conditioned approach response that did not discriminate between the 2 arm locations. A hippocampus/fimbria-fornix system and an amygdala system process different information about the same learning situation simultaneously and in parallel.

Lesions to the basolateral amygdala and the orbitofrontal cortex but not to the medial prefrontal cortex produce an abnormally persistent latent inhibition in rats

Repeated nonreinforced preexposure to a stimulus interferes with the establishment of conditioned responding to this stimulus when it is subsequently paired with reinforcement. This stimulus-preexposure effect is known as latent inhibition (LI). Rather remarkably, LI appears to be resistant to the effects of numerous lesions, including the prefrontal cortex (PFC) and the basolateral amygdala (BLA). However, intact behavioral expression of LI following damage to given brain regions does not preclude the possibility that such regions participate in the regulation of LI expression in the intact brain. The present study showed that lesions of the BLA and the orbitofrontal cortex (OFC) but not of the medial PFC (mPFC) led to an abnormally persistent LI which emerged under conditions that disrupted LI in control rats. LI was measured in a thirst motivated conditioned emotional response procedure by comparing suppression of drinking in response to a tone in rats which received 0 (nonpreexposed) or 40 tone presentations (preexposed) followed by either two or five tone-shock pairings. Control rats showed LI with 40 preexposures and two conditioning trials, but raising the number of conditioning trials to five disrupted LI. OFC- and BLA-lesioned rats showed LI under the former condition but in addition persisted in exhibiting LI under the latter condition. Rats with lesion of the mPFC did not show persistent LI. Thus, although LI does not depend on the integrity of BLA and OFC (because it is present in BLA- and OFC- lesioned rats even under conditions disrupting the phenomenon in normal rats), these regions play an important role in the modulation of its expression, more specifically, in the control of the non-expression of LI when the impact of conditioning increases beyond a certain level.

Influence of the entorhinal cortex on accumbal and striatal dopaminergic responses in a latent inhibition paradigm

The use of latent inhibition paradigms is one means of investigating the involvement of mesencephalic dopaminergic (DA) neurons in cognitive processes. We have shown recently that DA neurons reaching the core and the dorsomedial shell parts of the nucleus accumbens and the anterior part of the striatum are differentially involved in latent inhibition. In other respects, theoretical, behavioral and anatomo-functional data suggest that the entorhinal cortex (ENT) may control latent inhibition expression. In this study, using in vivo voltammetry in freely moving rats, we investigated the influence of the ENT on the DA responses obtained in the core and dorsomedial shell parts of the nucleus accumbens and the anterior part of the striatum. For this purpose a reversible inactivation of the left ENT was achieved by the local microinjection of tetrodotoxin, 3 h before pre-exposure to the conditional stimulus (banana odour). During the second session, animals were aversively conditioned to banana odour. Results obtained during the third session (test session), in animals submitted to the reversible blockade of the ENT before the first session were as follows: (1) pre-exposed conditioned animals displayed behavioral aversive responses; (2) where core DA responses were concerned, responses were situated between those observed in pre-exposed and non-pre-exposed conditioned animals; (3) by contrast, where the dorsomedial shell part of the nucleus accumbens and the anterior striatum were concerned, DA variations were not statistically different in pre-exposed and non-pre-exposed conditioned rats. These data suggest that the left ENT exerts a crucial influence over the latent-inhibition-related DA responses in the left dorsomedial shell part of the nucleus accumbens and the left anterior part of the striatum, whereas one or more other brain regions control DA variations in the left core part of the nucleus accumbens. These data may help us to understand the pathophysiology of schizophrenic psychoses.

Computational models of the hippocampal region: linking incremental learning and episodic memory

The hippocampal region, a group of brain structures important for learning and memory, has been the focus of a large number of computational models. These tend to fall into two groups: (1) models of the role of the hippocampal region in incremental learning, which focus on the development of new representations that are sensitive to stimulus regularities and environmental context; (2) models that focus on the role of the hippocampal region in the rapid storage and retrieval of episodic memories. Rather than being in conflict, it is becoming apparent that both approaches are partially correct and might reflect the different functions of substructures of the hippocampal region. Future computational models will help to elaborate how these different substructures interact.

Dissociating medial temporal and basal ganglia memory systems with a latent learning task

The medial temporal (MT) lobes and basal ganglia have both been implicated as brain substrates of associative learning. Here, we show a dissociation between medial temporal and basal ganglia damage using a latent learning task, in which prior exposure to cues, uncorrelated with each other, slows subsequent learning of an association between them. Consistent with prior work, we found a robust exposure effect in healthy controls, with exposed controls learning more slowly than non-exposed controls. This effect was abolished in medial temporal amnesia: both exposed and non-exposed amnesic patients learned at the same speed. A group of patients with basal ganglia damage due to Parkinson's disease showed a reversal of the effect: exposed subjects learned faster than non-exposed subjects. Our findings point to distinct and dissociable contributions of medial temporal lobe and basal ganglia structures to learning and memory.

Novel factors contributing to the expression of latent inhibition

Behavioral and neural correlates of latent inhibition (LI) during eyeblink conditioning were studied in 2 experiments. In Experiment 1, rabbits (Oryctolagus cuniculus) were conditioned after 8 days of tone conditioned stimulus (CS) presentations or 8 days of context-alone experience. LI was seen in the CS-preexposed rabbits when a relatively intense (5 psi) airpuff unconditioned stimulus was paired with the CS. In Experiment 2, rabbits were given 0, 4, or 8 days of CS preexposures or context-alone experience. Hippocampal activity was monitored from the 8-day CS- or context-exposure rabbits. The LI effect was seen only in rabbits given 4 days of CS preexposure, thus suggesting that LI depended largely on the rate of acquisition in the context-preexposed control group. The neural recordings showed that the hippocampus was sensitive to the relative novelty of the stimuli and the overall context, regardless of whether exposure to stimuli and context promoted LI.

Blocking in rabbit eyeblink conditioning is not due to learned inattention: indirect support for an error correction mechanism of blocking

Blocking is a classical conditioning task in which prior training to one cue such as a tone reduces learning about a second cue such as a light, when subsequently trained as a tone-light compound. Blocking has been theorized to come about through a US-modulated error correction mechanism by Rescorla & Wagner (1972) as well as through a mechanism of learned inattention as theorized by Mackintosh (1973). In the case of eyeblink conditioning, an error correction mechanism has been hypothesized to take place in the cerebellum while some form of inattention has been hypothesized to take place in the hippocampal region. The hypothesis we are testing is whether the mechanism of learned inattention is involved in blocking in rabbit eyeblink conditioning. If blocking in eyeblink conditioning is produced by a mechanism of learned inattention, then training to a previously blocked cue should be slower than training to that cue in a naïve animal. Rabbits that had received tone training followed by tone-light training exhibited blocking. Rabbits that had been previously blocked to the light acquired conditioned responses to the light at the same rate as naive rabbits. This finding failed to support the hypothesis that blocking in rabbit eyeblink conditioning is due to learned inattention, but does support the Rescorla-Wagner mechanism of error correction. The present finding along with previous work on error correction mechanism in the cerebellar-brainstem circuit (Kim et al., 1998) lend support to the theory that blocking, at least in rabbit eyeblink conditioning, seems to be due to an error correction mechanism rather than a learned inattention mechanism.

Ibotenic acid lesions of the medial septum retard delay eyeblink conditioning in rabbits (Oryctolagus cuniculus)

S. Berry and R. Thompson (1979) reported that electrolytic lesions of the medial septum significantly retard eyeblink conditioning. However, these electrolytic lesions were nonselective and may have also damaged the subcortical inputs to the hippocampus via the fimbria-fornix. In the present study, the medial septum was selectively lesioned with ibotenic acid in rabbits (Oryctolagus cuniculus), whose performance in a delay eyeblink conditioning paradigm was compared with that of intact controls. sham-operated controls, and intact controls given a systemic injection of scopolamine. Rabbits with selective medial septal lesions and rabbits receiving systemic scopolamine were significantly slower to condition than were intact and sham-lesioned rabbits. This finding demonstrates that the selective removal of the medial septum retards delay eyeblink conditioning in a manner similar to the disruption seen after systemic administration of scopolamine.

A comparison of latent inhibition and learned irrelevance pre-exposure effects in rabbit and human eyeblink conditioning

The learning of an association between a CS and a US can be retarded by unreinforced presentations of the CS alone (termed latent inhibition or LI) or by un-correlated presentations of the CS and US (termed learned irrelevance or LIRR). In rabbit eyeblink conditioning, there have been some recent failures to replicate LI. LIRR has been hypothesized as producing a stronger retardation effect than LI based on both empirical studies and computational models. In the work presented here, we examined the relative strength of LI and LIRR in eyeblink conditioning in rabbits and humans. In both species, a number of preexposure trials sufficient to produce LIRR failed to produce LI (Experiments 1 & 3). Doubling the number of CS pre-exposures did produce LI in rabbits (Experiment 2), but not in humans (Experiment 4). LI was demonstrated in humans only after manipulations including an increased inter-trial interval or ITI (Experiment 5). Overall, it appears that LIRR is a more easily producible pre-exposure retardation effect than LI for eyeblink conditioning in both rabbits and humans. Several theoretical mechanisms for LI including the conditioned attention theory, stimulus compression, novelty, and the switching theory are discussed as possible explanations for the differences between LIRR and LI. Overall, future work involving testing the neural substrates of pre-exposure effects may benefit from the use of LIRR rather than LI.

A volumetric MRI study of the entorhinal cortex in first episode neuroleptic-naive schizophrenia

BACKGROUND

Imaging studies have frequently reported volume loss of limbic structures in schizophrenia, yet there appears to be no quantitative data on entorhinal cortex volumes in patients with neuroleptic naive first-episode schizophrenia.

METHODS

The volume of the entorhinal cortices of 22 control subjects and 18 patients with neuroleptic-naïve first-episode schizophrenia were measured from magnetic resonance images (MRI) scans using recently designed anatomic criteria for MRI anatomy of the entorhinal cortex.

RESULTS

Smaller entorhinal volumes were found bilaterally in the schizophrenic patients. This volume loss did not correlate with items on the Positive and Negative Syndrome Scale.

CONCLUSIONS

These data suggest early involvement of the entorhinal cortex in schizophrenia.

The influence of selective lesions to components of the hippocampal system on the orienting [correction of orientating] response, habituation and latent inhibition

The contribution that components of the hippocampal system in the rat make to the modulation of attention or stimulus processing was assessed using several simple behavioural assays: the orienting response (OR) to a novel stimulus, the subsequent habituation and dishabituation of this OR, and the latent inhibition effect that typically results from repeated exposure to a stimulus. Excitotoxic lesions of components of the hippocampal system produce dissociable effects on the OR, habituation and latent inhibition: lesions of the entorhinal cortex have no effect on the OR or changes in the OR during exposure to a stimulus, but disrupt latent inhibition; lesions of the subiculum disrupt the OR but not latent inhibition; and lesions of the hippocampus disrupt the OR and latent inhibition. These effects have important implications for our understanding of habituation and latent inhibition, and the neural mechanisms involved in attentional modulation.

Dissociating basal forebrain and medial temporal amnesic syndromes: insights from classical conditioning

In humans, anterograde amnesia can result from damage to the medial temporal (MT) lobes (including hippocampus), as well as to other brain areas such as basal forebrain. Results from animal classical conditioning studies suggest that there may be qualitative differences in the memory impairment following MT vs. basal forebrain damage. Specifically, delay eyeblink conditioning is spared after MT damage in animals and humans, but impaired in animals with basal forebrain damage. Recently, we have likewise shown delay eyeblink conditioning impairment in humans with amnesia following anterior communicating artery (ACoA) aneurysm rupture, which damages the basal forebrain. Another associative learning task, a computer-based concurrent visual discrimination, also appears to be spared in MT amnesia while ACoA amnesics are slower to learn the discriminations. Conversely, animal and computational models suggest that, even though MT amnesics may learn quickly, they may learn qualitatively differently from controls, and these differences may result in impaired transfer when familiar information is presented in novel combinations. Our initial data suggests such a two-phase learning and transfer task may provide a double dissociation between MT amnesics (spared initial learning but impaired transfer) and ACoA amnesics (slow initial learning but spared transfer). Together, these emerging data suggest that there are subtle but dissociable differences in the amnesic syndrome following damage to the MT lobes vs. basal forebrain, and that these differences may be most visible in non-declarative tasks such as eyeblink classical conditioning and simple associative learning.

Medial dorsal thalamic lesions impair blocking and latent inhibition of the conditioned eyeblink response in rats

The effects of lesions of the medial dorsal thalamic nucleus (MD) on blocking and latent inhibition (LI) of the rat eyeblink response were examined in the present study. Previous work has demonstrated that the cingulate cortex and related thalamic areas are involved in processing conditioning stimuli throughout training. The experiments in the present study tested the hypothesis that disruption of cingulothalamic stimulus processing produced by lesions of the MD would impair 2 types of associative learning that involve decremental changes in attention. In Experiment 1, MD lesions severely impaired blocking. In Experiment 2, MD lesions severely impaired LI. The results indicate that lesions of the MD impair incremental, decremental, or both types of changes in stimulus processing during learning.

The entorhinal cortex-nucleus accumbens pathway and latent inhibition: a behavioral and neurochemical study in rats

Latent inhibition (LI) refers to the decrease in conditioned response produced by the repeated nonrein-forced preexposure to the to-be-conditioned stimulus. Experiment I investigated the effects of electrolytic lesions of the entorhinal cortex on LI in a conditioned emotional response procedure. Entorhinal cortex lesions attenuated LI. Experiments 2 and 3 investigated whether this attenuation of LI could result from a modification in nucleus accumbens (NAcc) dopamine (DA) release. Rats with entorhinal cortex lesions displayed normal spontaneous and amphetamine-induced locomotor activity, as well as normal basal and amphetamine-induced release of DA within the NAcc (assessed by microdialysis). Taken together, these results show that entorhinal cortex lesions disrupt LI in a way that is unlikely to be due to an alteration of DA release within the NAcc.

Involvement of the entorhinal cortex in a process of attentional modulation: evidence from a novel variant of an IDS/EDS procedure

Novel behavioral assays were used to assess the role of the entorhinal cortex in modulating attention to components of stimulus compounds. In Stage 1, rats received discrimination training with compounds constructed from 3 dimensions (auditory, visual, and tactile); in each compound the combination of components from 2 dimensions (e.g., auditory and visual) were relevant to the solution of the discrimination, and the remaining dimension (e.g., tactile) was irrelevant. In Stage 2, rats received a different discrimination in which the relevant dimensions were either congruent (auditory and visual) or incongruent (auditory and tactile) with those that were relevant in Stage 1. Sham-operated rats acquired the congruent discrimination more rapidly than the incongruent discrimination--a finding indicative of a process of attentional modulation--whereas rats with excitotoxic lesions of the entorhinal cortex acquired both discriminations equally readily.

Parallel neural systems for classical conditioning: support from computational modeling

Classical conditioning has been explained by two main types of theories that postulate different learning mechanisms. Rescorla and Wagner (1972) put forth a theory in which conditioning is based on the ability of the US to drive learning through error correction. Alternatively, Mackintosh (1973) put forth a theory in which the ability of the CS to be associated with the unconditioned stimulus is modulated. We have proposed a reconciliation of these two mechanisms as working in parallel within different neural systems: a cerebellar system for US modulation and a hippocampal system for CS modulation. We developed a computational model of cerebellar function in eyeblink conditioning based on the error correction mechanism of the Rescorla-Wagner rule in which learning-related activity from the cerebellum inhibits the inferior olive, which is the US input pathway to the cerebellum (Gluck et al., 1994). We developed a computational model of the hippocampal region that forms altered representations of conditioned stimuli based on their behavioral outcomes (Gluck & Myers, 1993; Myers et al., 1995). Overall, computational modeling and empirical findings support the idea that, at least in the case of eyeblink conditioning, there may be two different neural systems: the cerebellum which mediates US-based error correction and hippocampus which alters representations of CSs.