Selective hippocampal lesions abolish the contextual specificity of latent inhibition and conditioning

Human hippocampus and dorsomedial prefrontal cortex infer and update latent causes during social interaction

Latent-cause inference is the process of identifying features of the environment that have caused an outcome. This problem is especially important in social settings where individuals may not make equal contributions to the outcomes they achieve together. Here, we designed a novel task in which participants inferred which of two characters was more likely to have been responsible for outcomes achieved by working together. Using computational modeling, univariate and multivariate analysis of human fMRI, and continuous theta-burst stimulation, we identified two brain regions that solved the task. Notably, as each outcome occurred, it was possible to decode the inference of its cause (the responsible character) from hippocampal activity. Activity in dorsomedial prefrontal cortex (dmPFC) updated estimates of association between cause-responsible character-and the outcome. Disruption of dmPFC activity impaired participants' ability to update their estimate as a function of inferred responsibility but spared their ability to infer responsibility.

A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward

Much research has been dedicated to understanding the psychological and neural bases of goal-directed action, yet the relationship between context and goal-directed action is not well understood. Here, we used excitotoxic lesions, chemogenetics, and circuit-specific manipulations to demonstrate the role of the ventral hippocampus (vHPC) in contextual learning that supports sensitivity to action-outcome contingencies, a hallmark of goal-directed action. We found that chemogenetic inhibition of the ventral, but not dorsal, hippocampus attenuated sensitivity to instrumental contingency degradation. We then tested the hypothesis that this deficit was due to an inability to discern the relative validity of the action compared with the context as a predictor of reward. Using latent inhibition and Pavlovian context conditioning, we confirm that degradation of action-outcome contingencies relies on intact context-outcome learning and show that this learning is dependent on vHPC. Finally, we show that chemogenetic inhibition of vHPC terminals in the medial prefrontal cortex also impairs both instrumental contingency degradation and context-outcome learning. These results implicate a hippocampo-cortical pathway in adapting to changes in instrumental contingencies and indicate that the psychological basis of this deficit is an inability to learn the predictive value of the context. Our findings contribute to a broader understanding of the neural bases of goal-directed action and its contextual regulation.

Neuronal Ensembles Organize Activity to Generate Contextual Memory

Contextual learning is a critical component of episodic memory and important for living in any environment. Context can be described as the attributes of a location that are not the location itself. This includes a variety of non-spatial information that can be derived from sensory systems (sounds, smells, lighting, etc.) and internal state. In this review, we first address the behavioral underpinnings of contextual memory and the development of context memory theory, with a particular focus on the contextual fear conditioning paradigm as a means of assessing contextual learning and the underlying processes contributing to it. We then present the various neural centers that play roles in contextual learning. We continue with a discussion of the current knowledge of the neural circuitry and physiological processes that underlie contextual representations in the Entorhinal cortex-Hippocampal (EC-HPC) circuit, as the most well studied contributor to contextual memory, focusing on the role of ensemble activity as a representation of context with a description of remapping, and pattern separation and completion in the processing of contextual information. We then discuss other critical regions involved in contextual memory formation and retrieval. We finally consider the engram assembly as an indicator of stored contextual memories and discuss its potential contribution to contextual memory.

The Stop Signal Task for Measuring Behavioral Inhibition in Mice With Increased Sensitivity and High-Throughput Operation

Ceasing an ongoing motor response requires action cancelation. This is impaired in many pathologies such as attention deficit disorder and schizophrenia. Action cancelation is measured by the stop signal task that estimates how quickly a motor response can be stopped when it is already being executed. Apart from human studies, the stop signal task has been used to investigate neurobiological mechanisms of action cancelation overwhelmingly in rats and only rarely in mice, despite the need for a genetic model approach. Contributing factors to the limited number of mice studies may be the long and laborious training that is necessary and the requirement for a very loud (100 dB) stop signal. We overcame these limitations by employing a fully automated home-cage-based setup. We connected a home-cage to the operant box via a gating mechanism, that allowed individual ID chipped mice to start sessions voluntarily. Furthermore, we added a negative reinforcement consisting of a mild air puff with escape option to the protocol. This specifically improved baseline inhibition to 94% (from 84% with the conventional approach). To measure baseline inhibition the stop is signaled immediately with trial onset thus measuring action restraint rather than action cancelation ability. A high baseline allowed us to measure action cancelation ability with higher sensitivity. Furthermore, our setup allowed us to reduce the intensity of the acoustic stop signal from 100 to 70 dB. We constructed inhibition curves from stop trials with daily adjusted delays to estimate stop signal reaction times (SSRTs). SSRTs (median 88 ms) were lower than reported previously, which we attribute to the observed high baseline inhibition. Our automated training protocol reduced training time by 17% while also promoting minimal experimenter involvement. This sensitive and labor efficient stop signal task procedure should therefore facilitate the investigation of action cancelation pathologies in genetic mouse models.

What Happened in the Hippocampal Axon in a Rat Model of Posttraumatic Stress Disorder

Studies from postmortem and animal models have revealed altered synapse morphology and function in the brain of posttraumatic stress disorder (PTSD). And the effects of PTSD on dendrites and spines have been reported, however, the effection on axon include microtubule (MT) and synaptic vesicles of presynaptic elements remains unknown. Hippocampus is involved in abnormal memory in PTSD. In the present study, we used the single prolonged stress (SPS) model to mimic PTSD. Quantitative real-time polymerase chain reaction (RT-qPCR) and high-throughput sequencing (GSE153081) were utilized to analyze differentially expressed genes (DEGs) in the hippocampus of control and SPS rats. Immunofluorescence and western blotting were performed to examine change in axon-related proteins. Synaptic function was evaluated by measuring miniature excitatory postsynaptic currents (mEPSCs). RNA-sequencing analysis revealed 230 significantly DEGs between the control and SPS groups. Gene Ontology analysis revealed upregulation in axonemal assembly, MT formation, or movement, but downregulation in axon initial segment and synaptic vesicles fusion in the hippocampus of SPS rats. Increased expression in tau, β-tubulin MAP1B, KIF9, CCDC40, DNAH12 and decreased expression in p-tau, stathmin suggested SPS induced axon extension. Increased protein expression in VAMP, STX1A, Munc18-1 and decreased expression in synaptotagmin-1 suggested SPS induced more SNARE complex formation but decreased ability in synaptic vesicle fusion to presynaptic active zone membrane in the hippocampus of SPS rats. Further, low mEPSC frequency in SPS rats indicated dysfunction in presynaptic membrane. These results suggest that axon extension and synaptic vesicles fusion abnormality are involved in dysfunction of PTSD.

Learning task-state representations

Arguably, the most difficult part of learning is deciding what to learn about. Should I associate the positive outcome of safely completing a street-crossing with the situation 'the car approaching the crosswalk was red' or with 'the approaching car was slowing down'? In this Perspective, we summarize our recent research into the computational and neural underpinnings of 'representation learning'-how humans (and other animals) construct task representations that allow efficient learning and decision-making. We first discuss the problem of learning what to ignore when confronted with too much information, so that experience can properly generalize across situations. We then turn to the problem of augmenting perceptual information with inferred latent causes that embody unobservable task-relevant information, such as contextual knowledge. Finally, we discuss recent findings regarding the neural substrates of task representations that suggest the orbitofrontal cortex represents 'task states', deploying them for decision-making and learning elsewhere in the brain.

Study on the mechanism of TMRK electroacupuncture in repairing synaptic plasticity in amygdala and hippocampus to relieve fear memory in PTSD rats

BACKGROUND AND OBJECTIVE

Post-traumatic stress disorder (PTSD) is a chronic mental disorder caused by mental or psychological trauma after sudden events of a catastrophic or threatening nature. Synaptic plasticity is the core mechanism of PTSD and the main point of treatment of this disease.

METHODS

Male Sprague Dawley rats were randomly divided into blank control (Ctrl), SPS (single-prolonged stress) model, SPS&S model (SPS and foot electric shock), SPS+EA (SPS plus electroacupuncture), and SPS&S+EA groups. Tranquilize Mind and Regulate Kidney (TMRK) electroacupuncture method was performed in each rat in the SPS+EA and SPS&S+EA groups, the treatment lasted for 20 minutes per day, simultaneously for 3 consecutive weeks. Behavioral evaluations, molecular tests, electron microscopy, electrophysiological testing were conducted following the treatment.

RESULTS

First, electro-acupuncture can significantly improve the PTSD-like symptoms. Second, electro-acupuncture can up-regulate the long-term potentiation (LTP) in hippocampus, repair the synaptic morphology and improve BDNF levels in amygdala and hippocampus. Third, electroacupuncture can significantly up-regulate SYN, GAP43, and PSD95 protein levels and mRNA expression in amygdala and hippocampus.

CONCLUSIONS

The effect of TMRK electro-acupuncture method on the regression of fear memory of PTSD rats may be through its repair of synaptic plasticity in amygdala and hippocampus.

Rats with ventral hippocampal damage are impaired at various forms of learning including conditioned inhibition, spatial navigation, and discriminative fear conditioning to similar contexts

The ventral hippocampus (vHPC) has been implicated in learning and memory functions that seem to differ from its dorsal counterpart. The goal of this series of experiments was to provide further insight into the functional contributions of the vHPC. Our previous work implicated the vHPC in spatial learning, inhibitory learning, and fear conditioning to context. However, the specific role of vHPC on these different forms of learning are not clear. Accordingly, we assessed the effects of neurotoxic lesions of the ventral hippocampus on retention of a conditioned inhibitory association, early versus late spatial navigation in the water task, and discriminative fear conditioning to context under high ambiguity conditions. The results showed that the vHPC was necessary for the expression of conditioned inhibition, early spatial learning, and discriminative fear conditioning to context when the paired and unpaired contexts have high cue overlap. We argue that this pattern of effects, combined with previous work, suggests a key role for vHPC in the utilization of broad contextual representations for inhibition and discriminative memory in high ambiguity conditions.

Experimental extinction in Pavlovian conditioning: Behavioural and neuroscience perspectives

This paper reviews the behavioural and neuroscience literatures on extinction in Pavlovian conditioning with a view towards finding possible points of contact between these two often independent lines of investigation. Recent discoveries at the behavioural level indicate (1) that conditioned stimulus (CS)–unconditioned stimulus (US) associations specific in their sensory content are fully preserved during extinction, (2) that inhibitory stimulus-response associations appear to be learned during extinction, (3) that extinction is influenced by the level of activation of the US representation during nonreinforced trials, (4) that decreases in attention can influence conditioned performance during extinction, and (5) that contexts acquire an ability to modulate learning during both conditioning and extinction. Recent discoveries at the neural systems level suggest (1) that the hippocampus is important in context-specific learning during extinction, (2) that the prefrontal cortex is possibly important in long-term memory for extinction, (3) that the basolateral amygdala may be important in sustaining attention to a CS during extinction, (4) that NMDA receptors are important either in neural plasticity during extinction or by affecting the value of the US representation during extinction, and (5) that the GABAergic system may partially mediate inhibitory learning during extinction. It is concluded that both of these levels of analysis can benefit the other in the pursuit of a more comprehensive understanding of extinction.

Revisiting places passed: Sensitization of exploratory activity in rats with hippocampal lesions

We examined the involvement of the hippocampus in short-term changes in exploratory behaviour in an open field (Experiment 1) and experimental contexts (Experiment 2). In Experiment 1, rats with excitotoxic lesions of the hippocampus were more likely to revisit recently visited zones within the open field than were control rats. Similarly, in Experiment 2 rats with hippocampal lesions showed greater exploration of a context that they had recently explored than a context that they had less recently explored. This short-term sensitization effect was not evident in control rats. These findings are consistent with the suggestion that the recent presentation of a stimulus has two opposing effects on behaviour, sensitization, and habituation, and that hippocampal lesions disrupt the short-term process responsible for habituation, but not that responsible for sensitization.

Impaired Latent Inhibition in GDNF-Deficient Mice Exposed to Chronic Stress

Increased reactivity to stress is maladaptive and linked to abnormal behaviors and psychopathology. Chronic unpredictable stress (CUS) alters catecholaminergic neurotransmission and remodels neuronal circuits involved in learning, attention and decision making. Glial-derived neurotrophic factor (GDNF) is essential for the physiology and survival of dopaminergic neurons in substantia nigra and of noradrenergic neurons in the locus coeruleus. Up-regulation of GDNF expression during stress is linked to resilience; on the other hand, the inability to up-regulate GDNF in response to stress, as a result of either genetic or epigenetic modifications, induces behavioral alterations. For example, GDNF-deficient mice exposed to chronic stress exhibit alterations of executive function, such as increased temporal discounting. Here we investigated the effects of CUS on latent inhibition (LI), a measure of selective attention and learning, in GDNF-heterozygous (HET) mice and their wild-type (WT) littermate controls. No differences in LI were found between GDNF HET and WT mice under baseline experimental conditions. However, following CUS, GDNF-deficient mice failed to express LI. Moreover, stressed GDNF-HET mice, but not their WT controls, showed decreased neuronal activation (number of c-Fos positive neurons) in the nucleus accumbens shell and increased activation in the nucleus accumbens core, both key regions in the expression of LI. Our results add LI to the list of behaviors affected by chronic stress and support a role for GDNF deficits in stress-induced pathological behaviors relevant to schizophrenia and other psychiatric disorders.

Chronic mild stress impairs latent inhibition and induces region-specific neural activation in CHL1-deficient mice, a mouse model of schizophrenia

Schizophrenia is a neurodevelopmental disorder characterized by abnormal processing of information and attentional deficits. Schizophrenia has a high genetic component but is precipitated by environmental factors, as proposed by the 'two-hit' theory of schizophrenia. Here we compared latent inhibition as a measure of learning and attention, in CHL1-deficient mice, an animal model of schizophrenia, and their wild-type littermates, under no-stress and chronic mild stress conditions. All unstressed mice as well as the stressed wild-type mice showed latent inhibition. In contrast, CHL1-deficient mice did not show latent inhibition after exposure to chronic stress. Differences in neuronal activation (c-Fos-positive cell counts) were noted in brain regions associated with latent inhibition: Neuronal activation in the prelimbic/infralimbic cortices and the nucleus accumbens shell was affected solely by stress. Neuronal activation in basolateral amygdala and ventral hippocampus was affected independently by stress and genotype. Most importantly, neural activation in nucleus accumbens core was affected by the interaction between stress and genotype. These results provide strong support for a 'two-hit' (genes x environment) effect on latent inhibition in CHL1-deficient mice, and identify CHL1-deficient mice as a model of schizophrenia-like learning and attention impairments.

The computational nature of memory modification

Retrieving a memory can modify its influence on subsequent behavior. We develop a computational theory of memory modification, according to which modification of a memory trace occurs through classical associative learning, but which memory trace is eligible for modification depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience into statistically distinct clusters (latent causes). New memories are formed when the structure learning mechanism infers that a new latent cause underlies current sensory observations. By the same token, old memories are modified when old and new sensory observations are inferred to have been generated by the same latent cause. We derive this framework from probabilistic principles, and present a computational implementation. Simulations demonstrate that our model can reproduce the major experimental findings from studies of memory modification in the Pavlovian conditioning literature.

Placing memories in context: Hippocampal representations promote retrieval of appropriate memories

Returning to a familiar context triggers retrieval of relevant memories, making memories from other contexts less likely to intrude and cause interference. We investigated the physiology that underlies the use of context to prevent interference by recording hippocampal neurons while rats learned two conflicting sets of discrimination problems, either in the same context or in two distinct contexts. Rats that learned the conflicting problem sets in the same context maintained similar neural representations, and performed poorly because conflicting memories interfered with new learning. In contrast, rats that learned in different contexts formed distinct ensemble representations and performed significantly better. We also measured trial-to-trial variation in representations and found that hippocampal activity was directly linked with performance: on trials where an old representation was active, rats were far more likely to make errors. These results show that the formation of distinct hippocampal representations is critical for contextually appropriate memory retrieval. © 2016 Wiley Periodicals, Inc.

Tonic Inhibitory Control of Dentate Gyrus Granule Cells by α5-Containing GABAA Receptors Reduces Memory Interference

Interference between similar or overlapping memories formed at different times poses an important challenge on the hippocampal declarative memory system. Difficulties in managing interference are at the core of disabling cognitive deficits in neuropsychiatric disorders. Computational models have suggested that, in the normal brain, the sparse activation of the dentate gyrus granule cells maintained by tonic inhibitory control enables pattern separation, an orthogonalization process that allows distinct representations of memories despite interference. To test this mechanistic hypothesis, we generated mice with significantly reduced expression of the α5-containing GABAA (α5-GABAARs) receptors selectively in the granule cells of the dentate gyrus (α5DGKO mice). α5DGKO mice had reduced tonic inhibition of the granule cells without any change in fast phasic inhibition and showed increased activation in the dentate gyrus when presented with novel stimuli. α5DGKO mice showed impairments in cognitive tasks characterized by high interference, without any deficiencies in low-interference tasks, suggesting specific impairment of pattern separation. Reduction of fast phasic inhibition in the dentate gyrus through granule cell-selective knock-out of α2-GABAARs or the knock-out of the α5-GABAARs in the downstream CA3 area did not detract from pattern separation abilities, which confirms the anatomical and molecular specificity of the findings. In addition to lending empirical support to computational hypotheses, our findings have implications for the treatment of interference-related cognitive symptoms in neuropsychiatric disorders, particularly considering the availability of pharmacological agents selectively targeting α5-GABAARs.

SIGNIFICANCE STATEMENT

Interference between similar memories poses a significant limitation on the hippocampal declarative memory system, and impaired interference management is a cognitive symptom in many disorders. Thus, understanding mechanisms of successful interference management or processes that can lead to interference-related memory problems has high theoretical and translational importance. This study provides empirical evidence that tonic inhibition in the dentate gyrus (DG), which maintains sparseness of neuronal activation in the DG, is essential for management of interference. The specificity of findings to tonic, but not faster, more transient types of neuronal inhibition and to the DG, but not the neighboring brain areas, is presented through control experiments. Thus, the findings link interference management to a specific mechanism, proposed previously by computational models.

Involvement of D1 and D2 dopamine receptor in the retrieval processes in latent inhibition

RATIONALE

Contemporary theories propose that latent inhibition (LI) is due to a process of interference with the context playing a key role as recovery cue. Physiological studies have demonstrated that LI is a process dependent on striatal dopamine. D2 dopamine receptors have been specifically associated with its expression, while D1 receptor has shown a limited function. However, to evaluate the role of dopamine receptors in LI, it is necessary to analyse their activity during recovery phase, where the mechanisms involved in interference processes are performed.

OBJECTIVE

The experiments studied the involvement of the dopaminergic system in the retrieval process of LI. We analysed the effect of the systemic administration of dopaminergic D1 (SCH-23390) and D2 (sulpiride) antagonist during the test phase on LI and on its contextual specificity.

METHODS

Animals were pre-exposed to saccharin solution and conditioned with a LiCl administration in conditioning phase. Dopaminergic antagonist drugs were administered during the test phase. Experiment 2 used the same context in all the phases. Experiment 3 used a new context during conditioning and test phase.

RESULTS

The D2 antagonist increased the LI effect and, in turn, diminished the normally suppressant effect of the context shift on LI. The opposite effect was observed under the D1 antagonist administration. This drug disrupted LI and enhanced the effect that the context shift had on this cognitive process.

CONCLUSIONS

D2 receptor had a relevant role on retrieval processes of pre-exposure learning, while D1 receptor was related with the contextual control of conditioning.

The effect of the amount of blocking cue training on blocking of appetitive conditioning in mice

•

Blocking of appetitive conditioning in mice has rarely been demonstrated.

•

Blocking occurred when there was 200, but not 80 trials with a visual blocking cue.

•

Blocking occurred independent of trial number with an auditory blocking cue.

•

Post-asymptotic training is necessary under certain conditions for blocking.

Conditioning of a target cue is blocked when it occurs in compound with another cue (blocking cue) that has already received conditioning. Although blocking of appetitive conditioning is commonly used in rodents as a test of selective learning, it has been demonstrated rarely in mice. In order to investigate the conditions that result in blocking in mice two studies tested the effect of the extent of prior blocking cue training on blocking of appetitive conditioning. Mice received either 80 or 200 trials of blocking cue training prior to compound conditioning. A control group received only compound training. Experiment 1 assessed the ability of a visual cue to block conditioning to an auditory target cue. Exposure to the context and the unconditioned stimulus, sucrose pellets, was equated across groups. Blocking was evident in mice that received 200, but not 80 training trials with the visual blocking cue. Responding to the blocking cue was similar across groups. Experiment 2 assessed the ability of an auditory cue to block conditioning to a visual target cue. Blocking was evident in mice trained with 80 and 200 auditory blocking cue trials. The results demonstrate that the strength of blocking in mice is dependent on the modality and experience of the blocking cue. Furthermore, prolonged training of the blocking cue after asymptotic levels of conditioned responding have been reached is necessary for blocking to occur under certain conditions suggesting that the strength of conditioned responding is a limited measure of learning.

The form and function of hippocampal context representations

Context is an essential component of learning and memory processes, and the hippocampus is critical for encoding contextual information. However, connecting hippocampal physiology with its role in context and memory has only recently become possible. It is now clear that contexts are represented by coherent ensembles of hippocampal neurons and new optogenetic stimulation studies indicate that activity in these ensembles can trigger the retrieval of context appropriate memories. We interpret these findings in the light of recent evidence that the hippocampus is critically involved in using contextual information to prevent interference, and propose a theoretical framework for understanding contextual influence on memory retrieval. When a new context is encountered, a unique hippocampal ensemble is recruited to represent it. Memories for events that occur in the context become associated with the hippocampal representation. Revisiting the context causes the hippocampal context code to be re-expressed and the relevant memories are primed. As a result, retrieval of appropriate memories is enhanced and interference from memories belonging to other contexts is minimized.

Sex differences and chronic stress effects on the neural circuitry underlying fear conditioning and extinction

There are sex differences in the rates of many stress-sensitive psychological disorders such as posttraumatic stress disorder (PTSD). As medial prefrontal cortex and amygdala are implicated in many of these disorders, understanding differential stress effects in these regions may shed light on the mechanisms underlying sex-dependent expression of disorders like depression and anxiety. Prefrontal cortex and amygdala are key regions in the neural circuitry underlying fear conditioning and extinction, which thus has emerged as a useful model of stress influences on the neural circuitry underlying regulation of emotional behavior. This review outlines the current literature on sex differences and stress effects on dendritic morphology within medial prefrontal cortex and basolateral amygdala. Such structural differences and/or alterations can have important effects on fear conditioning and extinction, behaviors that are mediated by the basolateral amygdala and prefrontal cortex, respectively. Given the importance of extinction-based exposure therapy as a treatment for anxiety disorders such as PTSD, understanding the neural mechanisms by which stress differentially influences fear learning and extinction in males and females is an important goal for developing sex-appropriate interventions for stress-related disorders.

Associative structures in animal learning: dissociating elemental and configural processes

The central concern of associative learning theory is to provide an account of behavioral adaptation that is parsimonious in addressing three key questions: (1) under what conditions does learning occur, (2) what are the associative structures involved, and (3) how do these affect behavior? The principle focus here is on the second question, concerning associative structures, but we will have cause to touch on the others in passing. This question is one that has exercised theorists since Pavlov's descriptions of the conditioning process, where he identifies the shared significance of the study of conditioned reflexes for psychologists and neuroscientists alike.

Contextual behavior and neural circuits

Animals including humans engage in goal-directed behavior flexibly in response to items and their background, which is called contextual behavior in this review. Although the concept of context has long been studied, there are differences among researchers in defining and experimenting with the concept. The current review aims to provide a categorical framework within which not only the neural mechanisms of contextual information processing but also the contextual behavior can be studied in more concrete ways. For this purpose, we categorize contextual behavior into three subcategories as follows by considering the types of interactions among context, item, and response: contextual response selection, contextual item selection, and contextual item–response selection. Contextual response selection refers to the animal emitting different types of responses to the same item depending on the context in the background. Contextual item selection occurs when there are multiple items that need to be chosen in a contextual manner. Finally, when multiple items and multiple contexts are involved, contextual item–response selection takes place whereby the animal either chooses an item or inhibits such a response depending on item–context paired association. The literature suggests that the rhinal cortical regions and the hippocampal formation play key roles in mnemonically categorizing and recognizing contextual representations and the associated items. In addition, it appears that the fronto-striatal cortical loops in connection with the contextual information-processing areas critically control the flexible deployment of adaptive action sets and motor responses for maximizing goals. We suggest that contextual information processing should be investigated in experimental settings where contextual stimuli and resulting behaviors are clearly defined and measurable, considering the dynamic top-down and bottom-up interactions among the neural systems for contextual behavior.

ABA and ABC renewal of conditioned magazine approach are not impaired by dorsal hippocampus inactivation or lesions

Three experiments investigated the role of the dorsal hippocampus (DH) in renewal of conditioned and then extinguished magazine approach responding in rats. Experiments 1 and 2 found no effect of muscimol inactivation of the DH during testing on ABA and ABC renewal, respectively. However, subjects from these studies were subsequently found to be impaired on a delayed non-matching-to-place task following muscimol but not saline infusions. Experiment 3 found no effects of post-training excitotoxic lesions of the DH on ABA and ABC renewal. Lesioned subjects were, however, impaired on the delayed non-matching-to-place task compared to control subjects. These findings suggest that the DH may not play a similar role in Pavlovian extinction in appetitive learning tasks as has previously been reported in aversive learning.

Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior

Motivated behavior exhibits properties that change with experience and partially dissociate among a number of brain structures. Here, we review evidence from rodent experiments demonstrating that multiple brain systems acquire information in parallel and either cooperate or compete for behavioral control. We propose a conceptual model of systems interaction wherein a ventral emotional memory network involving ventral striatum (VS), amygdala, ventral hippocampus, and ventromedial prefrontal cortex triages behavioral responding to stimuli according to their associated affective outcomes. This system engages autonomic and postural responding (avoiding, ignoring, approaching) in accordance with associated stimulus valence (negative, neutral, positive), but does not engage particular operant responses. Rather, this emotional system suppresses or invigorates actions that are selected through competition between goal-directed control involving dorsomedial striatum (DMS) and habitual control involving dorsolateral striatum (DLS). The hippocampus provides contextual specificity to the emotional system, and provides an information rich input to the goal-directed system for navigation and discriminations involving ambiguous contexts, complex sensory configurations, or temporal ordering. The rapid acquisition and high capacity for episodic associations in the emotional system may unburden the more complex goal-directed system and reduce interference in the habit system from processing contingencies of neutral stimuli. Interactions among these systems likely involve inhibitory mechanisms and neuromodulation in the striatum to form a dominant response strategy. Innate traits, training methods, and task demands contribute to the nature of these interactions, which can include incidental learning in non-dominant systems. Addition of these features to reinforcement learning models of decision-making may better align theoretical predictions with behavioral and neural correlates in animals.

Opposing effects of 5,7-DHT lesions to the core and shell of the nucleus accumbens on the processing of irrelevant stimuli

There is good evidence that forebrain serotonergic systems modulate cognitive flexibility. Latent inhibition (LI) is a cross-species phenomenon which manifests as poor conditioning to a stimulus that has previously been experienced without consequence and is widely considered an index of the ability to ignore irrelevant stimuli. While much research has focused on dopaminergic mechanisms underlying LI, there is also considerable evidence of serotonergic modulation. However, the neuroanatomical locus of these effects remains poorly understood. Previous work has identified the nucleus accumbens (NAc) as a key component of the neural circuit underpinning LI and furthermore, this work has shown that the core and shell subregions of the NAc contribute differentially to the expression of LI. To examine the role of the serotonergic input to NAc in LI, we tested animals with 5,7-dihydroxytryptamine (5,7-DHT) lesions to the core and shell subregions on LI assessed under experimental conditions that produce LI in shams and subsequently with weak stimulus pre-exposure designed to prevent the emergence of LI in shams. We found that serotonergic deafferentation of the core disrupted LI whereas 5,7-DHT lesions to the shell produced the opposite effect and potentiated LI.

The unconditioned stimulus pre-exposure effect in preweanling rats in taste aversion learning: role of the training context and injection cues

The unconditioned stimulus pre-exposure effect (US-PE) refers to the interference paradigm in which acquisition of the conditioned response is retarded due to prior experience with the US. Most studies analyzing the psychological mechanisms underlying this effect have been conducted with adult rats. The most widely accepted hypothesis explains this effect as a contextual blocking effect. Contextual cues associated with the US block the conditioned stimulus (CS)-US association during conditioning. The modulatory role of a context devoid of distinctive olfactory attributes is not observable until approximately PD23 in rats, including modulation of interference paradigms such as latent inhibition or extinction. In this study, we analyzed US-PE in preweanling rats along with the role of the training context in this effect in terms of conditioned taste aversion preparation. Pre-exposure to LiCl before conditioning retarded the acquisition of taste aversion. The US-PE was observed in preweanling rats when, during pre-exposure, subjects were exposed to the conditioning context, and this effect was not attenuated either by the administration of the US in a familiar environment (Experiment 1a), or by the presence of an alternative, more salient context during pre-exposure (Experiment 1b). Additionally, the US-PE was still observed when the route by which the US was administered was changed between the pre-exposure and conditioning phases (Experiment 2a) as well as when the injection cues were removed during conditioning (Experiment 2b). These experiments show a strong US-PE in preweanling rats and fail to support the contextual blocking hypothesis, at least in this stage of ontogeny.

Hippocampal lesions can enhance discrimination learning despite normal sensitivity to interference from incidental information

Spatial properties of stimuli are sometimes encoded even when incidental to the demands of a particular learning task. Incidental encoding of spatial information may interfere with learning by (i) causing a failure to generalize learning between trials in which a cue is presented in different spatial locations and (ii) adding common spatial features to stimuli that predict different outcomes. Hippocampal lesions have been found to facilitate acquisition of certain tasks. This facilitation may occur because hippocampal lesions impair incidental encoding of spatial information that interferes with learning. To test this prediction mice with lesions of the hippocampus were trained on appetitive simple simultaneous discrimination tasks using inserts in the goal arms of a T-maze. It was found that hippocampal lesioned mice were facilitated at learning the discriminations, but they were sensitive to changes in spatial information in a manner that was similar to control mice. In a second experiment it was found that both control and hippocampal lesioned mice showed equivalent incidental encoding of egocentric spatial properties of the inserts, but both groups did not encode the allocentric information. These results demonstrate that mice show incidental encoding of egocentric spatial information that decreases the ability to solve simultaneous discrimination tasks. The normal egocentric spatial encoding in hippocampal lesioned mice contradicts theories of hippocampal function that suggest that the hippocampus is necessary for incidental learning per se, or is required for modulating stimulus representations based on the relevancy of information. The facilitated learning suggests that the hippocampal lesions can enhance learning of the same qualitative information as acquired by control mice. © 2011 Wiley Periodicals, Inc.

Hippocampal lesion effects on occasion setting by contextual and discrete stimuli

Three experiments examined the role of the dorsal hippocampus (dHIPP) in occasion setting with diffuse contextual and discrete light stimuli serving as occasion setters in classical fear conditioning with rats. Both sham-operated and dHIPP-lesioned animals readily learned a L→T+, T- serial feature-positive discrimination in which a light (L) "set the occasion" for reinforcement of a tone (T+). dHIPP-lesioned animals were deficient, however, in acquiring a similar discrimination in which different contexts (A and B) served as occasion setters, i.e., A(T+) and B(T-). The lesioned animals also failed to discriminate between a context in which a tone had been partially reinforced and a context in which no conditioning had taken place, whereas sham-operated animals froze more to the tone in the conditioned context than in the novel context. Collectively, the data indicate that the dorsal hippocampus is important in processing information about the signaling value of contextual, but not discrete, stimuli.

Catecholaminergic depletion within the prelimbic medial prefrontal cortex enhances latent inhibition

Latent inhibition (LI) refers to the reduction in conditioning to a stimulus that has received repeated non-reinforced pre-exposure. Investigations into the neural substrates of LI have focused on the nucleus accumbens (NAc) and its inputs from the hippocampal formation and adjacent cortical areas. Previous work has suggested that lesions to the medial prefrontal cortex (mPFC), another major source of input to the NAc, do not disrupt LI. However, a failure to observe disrupted LI does not preclude the possibility that a particular brain region is involved in the expression of LI. Moreover, the mPFC is a heterogeneous structure and there has been no investigation of a possible role of different regions within the mPFC in regulating LI under conditions that prevent LI in controls. Here, we tested whether 6-hydroxydopamine (6-OHDA)-induced lesions of dopamine (DA) terminals within the prelimbic (PL) and infralimbic (IL) mPFC would lead to the emergence of LI under conditions that do produce LI in controls (weak pre-exposure). LI was measured in a thirst motivated conditioned emotional response procedure with 10 pre-exposures to a noise conditioned stimulus (CS) and two conditioning trials. Sham-operated and IL-lesioned animals did not show LI and conditioned to the pre-exposed CS at comparable levels to the non-pre-exposed controls. 6-OHDA lesions to the PL, however, produced potentiation of LI. These results provide the first demonstration that the PL mPFC is a component of the neural circuitry underpinning LI.

Lesions to the ventral, but not the dorsal, medial prefrontal cortex enhance latent inhibition

The acquisition of a conditioned response to a stimulus when it is paired with a reinforcer is retarded if the stimulus has previously been repeatedly pre-exposed in the absence of the reinforcer. This effect, called latent inhibition, has previously been found to be insensitive to lesions of the medial prefrontal cortex (mPFC) in rats. Using an on-baseline conditioned emotional response procedure, which is especially sensitive to small variations in the absolute magnitude of latent inhibition, we found increased latent inhibition following excitotoxic lesions of the mPFC (Experiment 1) or the ventral mPFC alone (Experiment 2) as compared with sham-operated control rats. Lesions restricted to the dorsal mPFC, however, were without effect (Experiment 2). These results are consistent with those of experiments employing another type of interference procedure, extinction. Together, these findings suggest that when different contingencies between a stimulus and a reinforcer are established in separate learning phases, lesions to the ventral mPFC result in increased interference between first-learned and second-learned contingencies. As a consequence, retrieval of the second-learned contingency is impaired, and performance is dominated by the first-learned contingency. These findings are discussed in light of the use of latent inhibition to model cognitive deficits in schizophrenia.

On giving a more active and selective role to consciousness

An active role for conscious processes in the production of behaviour is proposed, involving top level controls in a hierarchy of behavioural control. It is suggested that by inhibiting or sensitizing lower levels in the hierarchy conscious processes can play a role in the organization of ongoing behaviour. Conscious control can be more or less evident, according to prevailing circumstances.

The control of consciousness via a neuropsychological feedback loop

Gray's neuropsychological model of consciousness uses a hierarchical feedback loop framework that has been extensively discussed by many others in psychology. This commentary therefore urges Gray to integrate with, or at least acknowledge previous models. It also points out flaws in his feedback model and suggests directions for further theoretical work.

Don't leave the “un” off “consciousness”

Gray extrapolates from circuit models of psychopathology to propose neural substrates for the contents of consciousness. I raise three concerns: (1) knowledge of synaptic arrangements may be inadequate to fully support his model; (2) latent inhibition deficits in schizophrenia, a focus of this and related models, are complex and deserve replication; and (3) this conjecture omits discussion of the neuropsychological basis for the contents of the unconscious.

Consciousness is for other people

Gray has expanded his account of schizophrenia to explain consciousness as well. His theory explains neither phenomenon adequately because he treats individual minds (and brains) in isolation. The primary function of consciousness is to permit high level interactions with other conscious beings. The key symptoms of schizophrenia reflect a failure of this mechanism.

Comparators, functions, and experiences

The comparator model is insufficient for three reasons. First, consciousness is involved in the process of comparison as well as in the output. Second, we still do not have enough neurophysiological information to match the events of consciousness, although such knowledge is growing. Third, the anatomical localisation proposed can be damaged bilaterally but consciousness will persist.

Possible roles for a predictor plus comparator mechanism in human episodic recognition memory and imitative learning

This commentary is divided into two parts. The first considers a possible role for Gray's predictor plus comparator mechanism in human episodic recognition memory. It draws on the computational specifications of recognition outlined in Humphreys et al. (1994) to demonstrate how the logically necessary components of recognition tasks might be mapped onto the mechanism. The second part demonstrates how the mechanism outlined by Gray might be implicated in a form of imitative learning suitable for the acquisition of complex tasks.

Consciousness does not seem to be linked to a single neural mechanism

On the basis of neuropsychological evidence, it is clear that attention should be given a role in any model (or conjecture) of consciousness. What is known about the many instances of dissociation between explicit and implicit knowledge after brain damage suggests that conscious experience might not be linked to a restricted area of the brain. Even if it were true that there is a single brain area devoted to consciousness, the subicular area would seem to be an unlikely possibility.

Segmentalized consciousness in schizophrenia

Segmentalized consciousness in schizophrenia reflects a loss of the normal Gestalt organization and contextualization of perception. Grays model explains such segmentalization in terms of septohippocampal dysfunction, which is consistent with known neuropsychological impairment in schizophrenia. However, other considerations suggest that everyday perception and its failure in schizophrenia also involve prefrontal executive mechanisms, which are only minimally elaborated by Gray.

Unitary consciousness requires distributed comparators and global mappings

Gray, like other recent authors, seeks a scientific approach to consciousness, but fails to provide a biologically convincing description, partly because he implicitly bases his model on a computationalist foundation that embeds the contents of thought in irreducible symbolic representations. When patterns of neural activity instantiating conscious thought are shorn of homuncular observers, it appears most likely that these patterns and the circuitry that compares them with memories and plans should be found distributed over large regions of neocortex.

On seeking the mythical fountain of consciousness

Because consciousness has an organizational, or functional, center, Gray supposes that there must be a corresponding physical center in the brain. He proposes further that since this center generates consciousness, ablating it would eliminate consciousness, while leaving behavior intact. But the center of consciousness is simply the product of the functional linkages among sensory input, memory, inner speech, and so on, and behavior.