Extinction learning, reconsolidation and the internal reinforcement hypothesis

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Neural Circuits Underlying Behavioral Flexibility: Insights From Drosophila

Behavioral flexibility is critical to survival. Animals must adapt their behavioral responses based on changes in the environmental context, internal state, or experience. Studies in Drosophila melanogaster have provided insight into the neural circuit mechanisms underlying behavioral flexibility. Here we discuss how Drosophila behavior is modulated by internal and behavioral state, environmental context, and learning. We describe general principles of neural circuit organization and modulation that underlie behavioral flexibility, principles that are likely to extend to other species.

Heritable Cognitive Phenotypes Influence Appetitive Learning but not Extinction in Honey Bees

Learning and attention allow animals to better navigate complex environments. While foraging, honey bees (Apis mellifera L.) learn several aspects of their foraging environment, such as color and odor of flowers, which likely begins to happen before they evaluate the quality of the food. If bees begin to evaluate quality before they taste food, and then learn the food is depleted, this may create a conflict in what the bee learns and remembers. Individual honey bees differ in their sensitivity to information, thus creating variation in how they learn or do not learn certain environmental stimuli. For example, foraging honey bees exhibit differences in latent inhibition (LI), a learning process through which regular encounter with a stimulus without a consequence such as food can later reduce conditioning to that stimulus. Here, we test whether bees from distinct selected LI genotypes learn differently if reinforced via just antennae or via both antennae + proboscis. We also evaluate whether learned information goes extinct at different rates in these distinct LI genetic lines. We find that high LI bees learned significantly better when they were reinforced both antenna + proboscis, while low LI and control bees learned similarly with the two reinforcement pathways. We also find no differences in the acquisition and extinction of learned information in high LI and low LI bees. Our work provides insight into how underlying cognition may influence how honey bees learn and value information, which may lead to differences in how individuals and colonies make foraging decisions.

A Mechanistic Model for Reward Prediction and Extinction Learning in the Fruit Fly

Extinction learning, the ability to update previously learned information by integrating novel contradictory information, is of high clinical relevance for therapeutic approaches to the modulation of maladaptive memories. Insect models have been instrumental in uncovering fundamental processes of memory formation and memory update. Recent experimental results in Drosophila melanogaster suggest that, after the behavioral extinction of a memory, two parallel but opposing memory traces coexist, residing at different sites within the mushroom body (MB). Here, we propose a minimalistic circuit model of the Drosophila MB that supports classical appetitive and aversive conditioning and memory extinction. The model is tailored to the existing anatomic data and involves two circuit motives of central functional importance. It employs plastic synaptic connections between Kenyon cells (KCs) and MB output neurons (MBONs) in separate and mutually inhibiting appetitive and aversive learning pathways. Recurrent modulation of plasticity through projections from MBONs to reinforcement-mediating dopaminergic neurons (DAN) implements a simple reward prediction mechanism. A distinct set of four MBONs encodes odor valence and predicts behavioral model output. Subjecting our model to learning and extinction protocols reproduced experimental results from recent behavioral and imaging studies. Simulating the experimental blocking of synaptic output of individual neurons or neuron groups in the model circuit confirmed experimental results and allowed formulation of testable predictions. In the temporal domain, our model achieves rapid learning with a step-like increase in the encoded odor value after a single pairing of the conditioned stimulus (CS) with a reward or punishment, facilitating single-trial learning.

Anxiety induces long-term memory forgetting in the crayfish

When two male crayfish encounter, agonistic bouts are initiated and a winner-loser relationship is established. Larger animals are more likely to win with their physical advantage, but they are frequently beaten by small dominant animals with previous winning experience. This winner effect remains for several days. In mammals, anxiety impairs learning and induces memory forgetting. In this study, dominant crayfish were exposed to electrical shocks two days after their first win, after which they were paired with large or small naive opponents the following day. Our results showed that electrical shock-applied dominant animals were beaten by large naive opponents, but overcame small naive opponents, suggesting that electrical shocks cause animals to forget their previous winner effect. Electrical shocks appeared to elicit serotonin-mediated anxiety since electrical shocks had no effect on mianserin-injected dominant animals. A 0.5 µM serotonin injection induced a caused anxiety-like reaction, while a 1.0 µM serotonin injection-induced no changes in posture and walking activity. For pairings between dominant and naive animals 1 day after serotonin injection, 0.5 µM serotonin caused similar forgetting of the winner effect, but 1.0 µM serotonin had no effect. Serotonin of low concentrations mediated anxiety and stimulated forgetting of the winner's memory.

Sex differences in cognitive performance and style across domains in mosquitofish (Gambusia affinis)

Given that the sexes often differ in their ecological and sexual selection pressures, sex differences in cognitive properties are likely. While research on sexually dimorphic cognition often focuses on performance, it commonly overlooks how sexes diverge across cognitive domains and in behaviors exhibited during a cognitive task (cognitive style). We tested male and female western mosquitofish (Gambusia affinis) in three cognitive tasks: associative learning (numerical discrimination), cognitive flexibility (detour task), and spatio-temporal learning (shuttlebox). We characterized statistical relationships between cognitive performances and cognitive style during the associative learning task with measures of anxiety, boldness, exploration, reaction time, and activity. We found sex differences in performance, cognitive style, and the relationships between cognitive domains. Females outperformed males in the spatio-temporal learning task, while the sexes performed equally in associate learning and cognitive flexibility assays. Females (but not males) exhibited a 'fast-exploratory' cognitive style during associative learning trials. Meanwhile, only males showed a significant positive relationship between domains (associative learning and cognitive flexibility). We propose that these sexually dimorphic cognitive traits result from strong sexual conflict in this taxon; and emphasize the need to explore suites of sex-specific cognitive traits and broader comparative work examining sexual selection and cognition.

The neonicotinoid clothianidin impairs memory processing in honey bees

Neonicotinoids act as agonists on the nicotinic Acetylcholine receptor (nAChR) in insect brains, an essential molecular component of central brain structures involved in learning and memory formation. Sublethal doses might, therefore, impair neural processes necessary for adaptive experience dependent behaviour and thus reduce the fitness of pollinating insects on the individual and community level. First, the question was addressed whether clothianidin has an aversive taste for honey bees and concluded with both a laboratory and a semi-field experiment that bees are unable to distinguish between control and contaminated sucrose solutions. In the laboratory, proboscis extension response conditioning was performed with forager bees exposed to different concentrations of clothianidin (0.1, 0.3 and 0.8 ng/bee) before learning, after learning during memory consolidation, and just before memory retention. These tests at different timings allowed uncovering an impairment of the consolidation and retrieval of memory due to the exposure to clothianidin. It was concluded that an acute exposure to clothianidin has an adverse effect on memory processing in honey bees.

The quick are the dead: pheasants that are slow to reverse a learned association survive for longer in the wild

Cognitive abilities probably evolve through natural selection if they provide individuals with fitness benefits. A growing number of studies demonstrate a positive relationship between performance in psychometric tasks and (proxy) measures of fitness. We assayed the performance of 154 common pheasant (Phasianus colchicus) chicks on tests of acquisition and reversal learning, using a different set of chicks and different set of cue types (spatial location and colour) in each of two years and then followed their fates after release into the wild. Across all birds, individuals that were slow to reverse previously learned associations were more likely to survive to four months old. For heavy birds, individuals that rapidly acquired an association had improved survival to four months, whereas for light birds, slow acquirers were more likely to be alive. Slow reversers also exhibited less exploratory behaviour in assays when five weeks old. Fast acquirers visited more artificial feeders after release. In contrast to most other studies, we showed that apparently ‘poor’ cognitive performance (slow reversal speed suggesting low behavioural flexibility) correlates with fitness benefits in at least some circumstances. This correlation suggests a novel mechanism by which continued exaggeration of cognitive abilities may be constrained.

This article is part of the theme issue ‘Causes and consequences of individual differences in cognitive abilities’.

Ants learn fast and do not forget: associative olfactory learning, memory and extinction in Formica fusca

Learning is a widespread phenomenon that allows behavioural flexibility when individuals face new situations. However, learned information may lose its value over time. If such a memory endures, it can be deleterious to individuals. The process of extinction allows memory updating when the initial information is not relevant anymore. Extinction is widespread among animals, including humans. We investigated associative appetitive learning in an ant species that is widely distributed in the Northern Hemisphere, Formica fusca. We studied acquisition and memory between 1 h and one week after conditioning, as well as the extinction process. Ants learn very rapidly, their memory lasts up to 3 days, decreases slowly over time and is highly resistant to extinction, even after a single conditioning trial. Using a pharmacological approach, we show that this single-trial memory critically depends on protein synthesis (long-term memory). These results indicate that individual ant workers of F. fusca show remarkable learning and memory performances. Intriguingly, they also show a strong resistance to updating learned associations. Resistance to extinction may be advantageous when the environment is stochastic and individuals need to switch often from one learned task to another.

A single factor explanation for associative learning performance on colour discrimination problems in common pheasants (Phasianus colchicus)

It remains unclear whether performance of non-human animals on cognitive test batteries can be explained by domain general cognitive processes, as is found in humans. The persistence of this dispute is likely to stem from a lack of clarity of the psychological or neural processes involved. One broadly accepted cognitive process, that may predict performance in a range of psychometric tasks, is associative learning. We therefore investigated intra-individual performances on tasks that incorporate processes of associative learning, by assessing the speed of acquisition and reversal learning in up to 187 pheasants (Phasianus colchicus) on four related binary colour discrimination tasks. We found a strong, positive significant bivariate relationship between an individual's acquisition and reversal learning performances on one cue set. Weak, positive significant bivariate relationships were also found between an individual's performance on pairs of reversal tasks and between the acquisition and reversal performances on different cue sets. A single factor, robust to parallel analysis, explained 36% of variation in performance across tasks. Inter-individual variation could not be explained by differential prior experience, age, sex or body condition. We propose that a single factor explanation, which we call 'a', summarises the covariance among scores obtained from these visual discrimination tasks, as they all assess capacities for associative learning. We argue that 'a' may represent an underlying cognitive ability exhibited by an individual, which manifests across a variety of tasks requiring associative processes.

Associative Learning of Stimuli Paired and Unpaired With Reinforcement: Evaluating Evidence From Maggots, Flies, Bees, and Rats

Finding rewards and avoiding punishments are powerful goals of behavior. To maximize reward and minimize punishment, it is beneficial to learn about the stimuli that predict their occurrence, and decades of research have provided insight into the brain processes underlying such associative reinforcement learning. In addition, it is well known in experimental psychology, yet often unacknowledged in neighboring scientific disciplines, that subjects also learn about the stimuli that predict the absence of reinforcement. Here we evaluate evidence for both these learning processes. We focus on two study cases that both provide a baseline level of behavior against which the effects of associative learning can be assessed. Firstly, we report pertinent evidence from Drosophila larvae. A re-analysis of the literature reveals that through paired presentations of an odor A and a sugar reward (A+) the animals learn that the reward can be found where the odor is, and therefore show an above-baseline preference for the odor. In contrast, through unpaired training (A/+) the animals learn that the reward can be found precisely where the odor is not, and accordingly these larvae show a below-baseline preference for it (the same is the case, with inverted signs, for learning through taste punishment). In addition, we present previously unpublished data demonstrating that also during a two-odor, differential conditioning protocol (A+/B) both these learning processes take place in larvae, i.e., learning about both the rewarded stimulus A and the non-rewarded stimulus B (again, this is likewise the case for differential conditioning with taste punishment). Secondly, after briefly discussing published evidence from adult Drosophila, honeybees, and rats, we report an unpublished data set showing that relative to baseline behavior after truly random presentations of a visual stimulus A and punishment, rats exhibit memories of opposite valence upon paired and unpaired training. Collectively, the evidence conforms to classical findings in experimental psychology and suggests that across species animals associatively learn both through paired and through unpaired presentations of stimuli with reinforcement – with opposite valence. While the brain mechanisms of unpaired learning for the most part still need to be uncovered, the immediate implication is that using unpaired procedures as a mnemonically neutral control for associative reinforcement learning may be leading analyses astray.

Contextual Fear Memory Formation and Destabilization Induce Hippocampal RyR2 Calcium Channel Upregulation

Hippocampus-dependent spatial and aversive memory processes entail Ca2+ signals generated by ryanodine receptor (RyR) Ca2+ channels residing in the endoplasmic reticulum membrane. Rodents exposed to different spatial memory tasks exhibit significant hippocampal RyR upregulation. Contextual fear conditioning generates robust hippocampal memories through an associative learning process, but the effects of contextual fear memory acquisition, consolidation, or extinction on hippocampal RyR protein levels remain unreported. Accordingly, here we investigated if exposure of male rats to contextual fear protocols, or subsequent exposure to memory destabilization protocols, modified the hippocampal content of type-2 RyR (RyR2) channels, the predominant hippocampal RyR isoforms that hold key roles in synaptic plasticity and spatial memory processes. We found that contextual memory retention caused a transient increase in hippocampal RyR2 protein levels, determined 5 h after exposure to the conditioning protocol; this increase vanished 29 h after training. Context reexposure 24 h after training, for 3, 15, or 30 min without the aversive stimulus, decreased fear memory and increased RyR2 protein levels, determined 5 h after reexposure. We propose that both fear consolidation and extinction memories induce RyR2 protein upregulation in order to generate the intracellular Ca2+ signals required for these distinct memory processes.

An Update on Memory Reconsolidation Updating

The reactivation of a stored memory in the brain can make the memory transiently labile. During the time it takes for the memory to restabilize (reconsolidate) the memory can either be reduced by an amnesic agent or enhanced by memory enhancers. The change in memory expression is related to changes in the brain correlates of long-term memory. Many have suggested that such retrieval-induced plasticity is ideally placed to enable memories to be updated with new information. This hypothesis has been tested experimentally, with a translational perspective, by attempts to update maladaptive memories to reduce their problematic impact. We review here progress on reconsolidation updating studies, highlighting their translational exploitation and addressing recent challenges to the reconsolidation field.

Determinants to trigger memory reconsolidation: The role of retrieval and updating information

Long-term memories can undergo destabilization/restabilization processes, collectively called reconsolidation. However, the parameters that trigger memory reconsolidation are poorly understood and are a matter of intense investigation. Particularly, memory retrieval is widely held as requisite to initiate reconsolidation. This assumption makes sense since only relevant cues will induce reconsolidation of a specific memory. However, recent studies show that pharmacological inhibition of retrieval does not avoid memory from undergoing reconsolidation, indicating that memory reconsolidation occurs through a process that can be dissociated from retrieval. We propose that retrieval is not a unitary process but has two dissociable components; one leading to the expression of memory and the other to reconsolidation, referred herein as executer and integrator respectively. The executer would lead to the behavioral expression of the memory. This component would be the one disrupted on the studies that show reconsolidation independence from retrieval. The integrator would deal with reconsolidation. This component of retrieval would lead to long-term memory destabilization when specific conditions are met. We think that an important number of reports are consistent with the hypothesis that reconsolidation is only initiated when updating information is acquired. We suggest that the integrator would initiate reconsolidation to integrate updating information into long-term memory.

Impairment of the serotonergic neurons underlying reinforcement elicits extinction of the repeatedly reactivated context memory

We analyzed changes in the activity of individually identifiable neurons involved in the networks underlying feeding and withdrawal behaviors in snails before, during, and after aversive learning in vitro. Responses to food in the “reinforcing” serotonergic neurons involved in withdrawal changed significantly after training, implying that these serotonergic cells participate in the reactivation of memory and are involved in the reconsolidation process. In behavioral experiments it was shown that impairment of the functioning of the serotonergic system with the selective neurotoxin 5,7-DiHT did not change the memory, when tested once, but resulted in a complete extinction of the contextual memory after repeated reactivation of memory. Conversely, the cued memory to a specific type of food was significantly reduced but still present. Thus, we conclude that it is only for the context memory, that participation of the “reinforcing” serotonergic neurons in memory retrieval may be the gate condition for the choice between extinction/reconsolidation.

Different dimensions of the prediction error as a decisive factor for the triggering of the reconsolidation process

The reconsolidation process is the mechanism by which strength and/or content of consolidated memories are updated. Prediction error (PE) is the difference between the prediction made and current events. It is proposed as a necessary condition to trigger the reconsolidation process. Here we analyzed deeply the role of the PE in the associative memory reconsolidation in the crab Neohelice granulata. An incongruence between the learned temporal relationship between conditioned and unconditioned stimuli (CS-US) was enough to trigger the reconsolidation process. Moreover, after a partial reinforced training, a PE of 50% opened the possibility to labilize the consolidated memory with a reminder which included or not the US. Further, during an extinction training a small PE in the first interval between CSs was enough to trigger reconsolidation. Overall, we highlighted the relation between training history and different reactivation possibilities to recruit the process responsible of memory updating.

DNA Methylation Adjusts the Specificity of Memories Depending on the Learning Context and Promotes Relearning in Honeybees

The activity of the epigenetic writers DNA methyltransferases (Dnmts) after olfactory reward conditioning is important for both stimulus-specific long-term memory (LTM) formation and extinction. It, however, remains unknown which components of memory formation Dnmts regulate (e.g., associative vs. non-associative) and in what context (e.g., varying training conditions). Here, we address these aspects in order to clarify the role of Dnmt-mediated DNA methylation in memory formation. We used a pharmacological Dnmt inhibitor and classical appetitive conditioning in the honeybee Apis mellifera, a well characterized model for classical conditioning. We quantified the effect of DNA methylation on naïve odor and sugar responses, and on responses following olfactory reward conditioning. We show that (1) Dnmts do not influence naïve odor or sugar responses, (2) Dnmts do not affect the learning of new stimuli, but (3) Dnmts influence odor-coding, i.e., 'correct' (stimulus-specific) LTM formation. Particularly, Dnmts reduce memory specificity when experience is low (one-trial training), and increase memory specificity when experience is high (multiple-trial training), generating an ecologically more useful response to learning. (4) In reversal learning conditions, Dnmts are involved in regulating both excitatory (re-acquisition) and inhibitory (forgetting) processes.

Post-trial dopaminergic modulation of conditioned catalepsy: A single apomorphine induced increase/decrease in dopaminergic activation immediately following a conditioned catalepsy response can reverse/enhance a haloperidol conditioned and sensitized catalepsy response

Haloperidol can induce catalepsy and this drug effect can be conditioned as well as sensitized to contextual cues. We used a paired/unpaired Pavlovian conditioning protocol to establish haloperidol catalepsy conditioned and sensitized responses. Groups of rats were given 10 daily catalepsy tests following administration of vehicle (n=24) or haloperidol (1.0mg/kg) either paired (n=18) or unpaired (n=18) to testing. Subsequently, testing for conditioning was conducted and conditioning and sensitization of catalepsy were observed selectively in the paired group. Immediately following a second test for catalepsy conditioning, the groups were subdivided into 4 vehicle groups, 3 unpaired haloperidol groups and 3 paired haloperidol groups and were given one of three post-trial treatments (vehicle, 0.05mg/kg or 2.0mg/kg apomorphine). One day later the conditioned catalepsy test 3 was carried out and on the next day, a haloperidol challenge test was performed. The post-trial apomorphine treatments had major effects on the paired groups upon both conditioning and the haloperidol challenge test. The low dose apomorphine post-trial treatment enhanced both the conditioned and the haloperidol sensitized catalepsy responses. The high dose apomorphine post-trial treatment eliminated conditioned catalepsy and eliminated the initial acute catalepsy response to haloperidol that was induced in the vehicle control groups. These results demonstrate the sensitivity of conditioned drug cues to modification by increases/decreases in activity of the dopamine system in the immediate post-trial interval after a conditioning trial. This demonstration that post-trial dopaminergic drug treatments can modify conditioned drug behavior has broad implications for conditioned drug effects.

Memories reactivated under ketamine are subsequently stronger: A potential pre-clinical behavioral model of psychosis

BACKGROUND

Sub-anesthetic doses of the NMDA antagonist ketamine have been shown to model the formation and stability of delusion in human subjects. The latter has been predicted to be due to aberrant prediction error resulting in enhanced destabilization of beliefs. To extend the scope of this model, we investigated the effect of administration of low dose systemic ketamine on memory in a rodent model of memory reconsolidation.

METHODS

Systemic ketamine was administered either prior to or immediately following auditory fear memory reactivation in rats. Memory strength was assessed by measuring freezing behavior 24h later. Follow up experiments were designed to investigate an effect of pre-reactivation ketamine on short-term memory (STM), closely related memories, and basolateral amygdala (BLA) specific destabilization mechanisms.

RESULTS

Rats given pre-reactivation, but not post-reactivation, ketamine showed larger freezing responses 24h later compared to vehicle. This enhancement was not observed 3h after the memory reactivation, nor was it seen in a closely related contextual memory. Prior inhibition of a known destabilization mechanism in the BLA blocked the effect of pre-reactivation ketamine.

CONCLUSIONS

Pre- but not post-reactivation ketamine enhances fear memory. These data together with recent data in human subjects supports a model of delusion fixity that proposes that aberrant prediction errors result in enhanced destabilization and strengthening of delusional belief.

Delusions and prediction error: clarifying the roles of behavioural and brain responses

Griffiths and colleagues provided a clear and thoughtful review of the prediction error model of delusion formation [Cognitive Neuropsychiatry, 2014 April 4 (Epub ahead of print)]. As well as reviewing the central ideas and concluding that the existing evidence base is broadly supportive of the model, they provide a detailed critique of some of the experiments that we have performed to study it. Though they conclude that the shortcomings that they identify in these experiments do not fundamentally challenge the prediction error model, we nevertheless respond to these criticisms. We begin by providing a more detailed outline of the model itself as there are certain important aspects of it that were not covered in their review. We then respond to their specific criticisms of the empirical evidence. We defend the neuroimaging contrasts that we used to explore this model of psychosis arguing that, while any single contrast entails some ambiguity, our assumptions have been justified by our extensive background work before and since.

Extinction learning, which consists of the inhibition of retrieval, can be learned without retrieval

In the present study we test the hypothesis that extinction is not a consequence of retrieval in unreinforced conditioned stimulus (CS) presentation but the mere perception of the CS in the absence of a conditioned response. Animals with cannulae implanted in the CA1 region of hippocampus were subjected to extinction of contextual fear conditioning. Muscimol infused intra-CA1 before an extinction training session of contextual fear conditioning (CFC) blocks retrieval but not consolidation of extinction measured 24 h later. Additionally, this inhibition of retrieval does not affect early persistence of extinction when tested 7 d later or its spontaneous recovery after 2 wk. Furthermore, both anisomycin, an inhibitor of ribosomal protein synthesis, and rapamycin, an inhibitor of extraribosomal protein synthesis, given into the CA1, impair extinction of CFC regardless of whether its retrieval was blocked by muscimol. Therefore, retrieval performance in the first unreinforced session is not necessary for the installation, maintenance, or spontaneous recovery of extinction of CFC.

Amygdala Dopamine Receptors Are Required for the Destabilization of a Reconsolidating Appetitive Memory

Disrupting maladaptive memories may provide a novel form of treatment for neuropsychiatric disorders, but little is known about the neurochemical mechanisms underlying the induction of lability, or destabilization, of a retrieved consolidated memory. Destabilization has been theoretically linked to the violation of expectations during memory retrieval, which, in turn, has been suggested to correlate with prediction error (PE). It is well-established that PE correlates with dopaminergic signaling in limbic forebrain structures that are critical for emotional learning. The basolateral amygdala is a key neural substrate for the reconsolidation of pavlovian reward-related memories, but the involvement of dopaminergic mechanisms in inducing lability of amygdala-dependent memories has not been investigated. Therefore, we tested the hypothesis that dopaminergic signaling within the basolateral amygdala is required for the destabilization of appetitive pavlovian memories by investigating the effects dopaminergic and protein synthesis manipulations on appetitive memory reconsolidation in rats. Intra-amygdala administration of either the D1-selective dopamine receptor antagonist SCH23390 or the D2-selective dopamine receptor antagonist raclopride prevented memory destabilization at retrieval, thereby protecting the memory from the effects of an amnestic agent, the protein synthesis inhibitor anisomycin. These data show that dopaminergic transmission within the basolateral amygdala is required for memory labilization during appetitive memory reconsolidation.

Molecular mechanisms underlying formation of long-term reward memories and extinction memories in the honeybee (Apis mellifera)

The honeybee (Apis mellifera) has long served as an invertebrate model organism for reward learning and memory research. Its capacity for learning and memory formation is rooted in the ecological need to efficiently collect nectar and pollen during summer to ensure survival of the hive during winter. Foraging bees learn to associate a flower's characteristic features with a reward in a way that resembles olfactory appetitive classical conditioning, a learning paradigm that is used to study mechanisms underlying learning and memory formation in the honeybee. Due to a plethora of studies on appetitive classical conditioning and phenomena related to it, the honeybee is one of the best characterized invertebrate model organisms from a learning psychological point of view. Moreover, classical conditioning and associated behavioral phenomena are surprisingly similar in honeybees and vertebrates, suggesting a convergence of underlying neuronal processes, including the molecular mechanisms that contribute to them. Here I review current thinking on the molecular mechanisms underlying long-term memory (LTM) formation in honeybees following classical conditioning and extinction, demonstrating that an in-depth analysis of the molecular mechanisms of classical conditioning in honeybees might add to our understanding of associative learning in honeybees and vertebrates.

Nitric oxide is necessary for labilization of a consolidated context memory during reconsolidation in terrestrial snails

Nitric oxide (NO) is known to be involved in associative memory formation. We investigated the influence of blocking NO function on the reconsolidation of context memory in terrestrial snails (Helix lucorum L.). After a 10 day session of electric shocks in one context only, context memory in snails was observed in test sessions as the significant difference of amplitudes of withdrawal responses to tactile stimuli in two different contexts. After a 1 day rest, a session of 'reminding' was performed, preceded by injection in different groups of the snails with either vehicle or combination of the protein synthesis blocker anisomycin (ANI) with one of the following drugs: the NO scavenger carboxy-PTIO, the NO-synthase inhibitors N-omega-nitro-L-arginin, nitroindazole and NG-nitro-L-arginine methyl ester hydrochloride, or the NO donor S-nitroso-N-acetyl-DL-penicillamine. Testing the context memory at different time intervals after the reminder under ANI injection showed that the context memory was impaired at 24 h and later, whereas the reminder under combined injection of ANI and each of the NO-synthase inhibitors used or the NO scavenger showed no impairment of long-term context memory. Injection of the NO donor S-nitroso-N-acetyl-DL-penicillamine with or without reminder had no effect on context memory. The results obtained demonstrated that NO is necessary for labilization of a consolidated context memory.

Odor memories regulate olfactory receptor expression in the sensory periphery

Odor learning induces structural and functional modifications throughout the olfactory system, but it is currently unknown whether this plasticity extends to the olfactory receptors (Or) in the sensory periphery. Here, we demonstrate that odor learning induces plasticity in olfactory receptor expression in the honeybee, Apis mellifera. Using quantitative RT-PCR analysis, we show that six putative floral scent receptors were differentially expressed in the bee antennae depending on the scent environment that the bees experienced. Or151, which we characterized using an in vitro cell expression system as a broadly tuned receptor binding floral odorants such as linalool, and Or11, the specific receptor for the queen pheromone 9-oxo-decenoic acid, were significantly down-regulated after honeybees were conditioned with the respective odorants in an olfactory learning paradigm. Electroantennogram recordings showed that the neural response of the antenna was similarly reduced after odor learning. Long-term odor memory was essential for inducing these changes, suggesting that the molecular mechanisms involved in olfactory memory also regulate olfactory receptor expression. Our study demonstrates for the first time that olfactory receptor expression is experience-dependent and modulated by scent conditioning, providing novel insight into how molecular regulation at the periphery contributes to plasticity in the olfactory system.

Distinct set of kinases induced after retrieval of spatial memory discriminate memory modulation processes in the mouse hippocampus

Protein phosphorylation and dephosphorylation events play a key role in memory formation and various protein kinases and phosphatases have been firmly associated with memory performance. Here, we determined expression changes of protein kinases and phosphatases following retrieval of spatial memory in CD1 mice in a Morris Water Maze task, using antibody microarrays and confirmatory Western blot. Comparing changes following single and consecutive retrieval, we identified stably and differentially expressed kinases, some of which have never been implicated before in memory functions. On the basis of these findings we define a small signaling network associated with spatial memory retrieval. Moreover, we describe differential regulation and correlation of expression levels with behavioral performance of polo-like kinase 1. Together with its recently observed genetic association to autism-spectrum disorders our data suggest a role of this kinase in balancing preservation and flexibility of learned behavior.

Ketamine effects on memory reconsolidation favor a learning model of delusions

Delusions are the persistent and often bizarre beliefs that characterise psychosis. Previous studies have suggested that their emergence may be explained by disturbances in prediction error-dependent learning. Here we set up complementary studies in order to examine whether such a disturbance also modulates memory reconsolidation and hence explains their remarkable persistence. First, we quantified individual brain responses to prediction error in a causal learning task in 18 human subjects (8 female). Next, a placebo-controlled within-subjects study of the impact of ketamine was set up on the same individuals. We determined the influence of this NMDA receptor antagonist (previously shown to induce aberrant prediction error signal and lead to transient alterations in perception and belief) on the evolution of a fear memory over a 72 hour period: they initially underwent Pavlovian fear conditioning; 24 hours later, during ketamine or placebo administration, the conditioned stimulus (CS) was presented once, without reinforcement; memory strength was then tested again 24 hours later. Re-presentation of the CS under ketamine led to a stronger subsequent memory than under placebo. Moreover, the degree of strengthening correlated with individual vulnerability to ketamine's psychotogenic effects and with prediction error brain signal. This finding was partially replicated in an independent sample with an appetitive learning procedure (in 8 human subjects, 4 female). These results suggest a link between altered prediction error, memory strength and psychosis. They point to a core disruption that may explain not only the emergence of delusional beliefs but also their persistence.

APIS-a novel approach for conditioning honey bees

Honey bees perform robustly in different conditioning paradigms. This makes them excellent candidates for studying mechanisms of learning and memory at both an individual and a population level. Here we introduce a novel method of honey bee conditioning: APIS, the Automatic Performance Index System. In an enclosed walking arena where the interior is covered with an electric grid, presentation of odors from either end can be combined with weak electric shocks to form aversive associations. To quantify behavioral responses, we continuously monitor the movement of the bee by an automatic tracking system. We found that escapes from one side to the other, changes in velocity as well as distance and time spent away from the punished odor are suitable parameters to describe the bee's learning capabilities. Our data show that in a short-term memory test the response rate for the conditioned stimulus (CS) in APIS correlates well with response rate obtained from conventional Proboscis Extension Response (PER)-conditioning. Additionally, we discovered that bees modulate their behavior to aversively learned odors by reducing their rate, speed and magnitude of escapes and that both generalization and extinction seem to be different between appetitive and aversive stimuli. The advantages of this automatic system make it ideal for assessing learning rates in a standardized and convenient way, and its flexibility adds to the toolbox for studying honey bee behavior.

Learning to forget: manipulating extinction and reconsolidation processes to treat addiction

Finding effective long-lasting treatments for drug addiction has been an elusive goal. Consequently, researchers are beginning to investigate novel treatment strategies including manipulations of drug-associated memories. When environmental stimuli (cues) become associated with drug use, they become powerful motivators of continued drug use and relapse after abstinence. Reducing the strength of these cue-drug memories could decrease the number of factors that induce craving and relapse to aid in the treatment of addiction. Enhancing the consolidation of extinction learning and/or disrupting cue-drug memory reconsolidation are two strategies that have been proposed to reduce the strength of cues in motivating drug-seeking and drug-taking behavior. Here, we review the latest basic and clinical research elucidating the mechanisms underlying consolidation of extinction and reconsolidation of cue-drug memories in the hopes of developing pharmacological tools that exploit these signaling systems to treat addiction.

Honeybees consolidate navigation memory during sleep

Sleep is known to support memory consolidation in animals, including humans. Here we ask whether consolidation of novel navigation memory in honeybees depends on sleep. Foragers were exposed to a forced navigation task in which they learned to home more efficiently from an unexpected release site by acquiring navigational memory during the successful homing flight. This task was quantified using harmonic radar tracking and applied to bees that were equipped with a radio frequency identification device (RFID). The RFID was used to record their outbound and inbound flights and continuously monitor their behavior inside the colony, including their rest during the day and sleep at night. Bees marked with the RFID behaved normally inside and outside the hive. Bees slept longer during the night following forced navigation tasks, but foraging flights of different lengths did not lead to different rest times during the day or total sleep time during the night. Sleep deprivation before the forced navigation task did not alter learning and memory acquired during the task. However, sleep deprivation during the night after forced navigation learning reduced the probability of returning successfully to the hive from the same release site. It is concluded that consolidation of novel navigation memory is facilitated by night sleep in bees.

Cognition-emotion dysinteraction in schizophrenia

Evolving theories of schizophrenia emphasize a "disconnection" in distributed fronto-striatal-limbic neural systems, which may give rise to breakdowns in cognition and emotional function. We discuss these diverse domains of function from the perspective of disrupted neural circuits involved in "cold" cognitive vs. "hot" affective operations and the interplay between these processes. We focus on three research areas that highlight cognition-emotion dysinteractions in schizophrenia: First, we discuss the role of cognitive deficits in the "maintenance" of emotional information. We review recent evidence suggesting that motivational abnormalities in schizophrenia may in part arise due to a disrupted ability to "maintain" affective information over time. Here, dysfunction in a prototypical "cold" cognitive operation may result in "affective" deficits in schizophrenia. Second, we discuss abnormalities in the detection and ascription of salience, manifest as excessive processing of non-emotional stimuli and inappropriate distractibility. We review emerging evidence suggesting deficits in some, but not other, specific emotional processes in schizophrenia - namely an intact ability to perceive emotion "in-the-moment" but poor prospective valuation of stimuli and heightened reactivity to stimuli that ought to be filtered. Third, we discuss abnormalities in learning mechanisms that may give rise to delusions, the fixed, false, and often emotionally charged beliefs that accompany psychosis. We highlight the role of affect in aberrant belief formation, mostly ignored by current theoretical models. Together, we attempt to provide a consilient overview for how breakdowns in neural systems underlying affect and cognition in psychosis interact across symptom domains. We conclude with a brief treatment of the neurobiology of schizophrenia and the need to close our explanatory gap between cellular-level hypotheses and complex behavioral symptoms observed in this illness.

Cognition-emotion dysinteraction in schizophrenia

Evolving theories of schizophrenia emphasize a "disconnection" in distributed fronto-striatal-limbic neural systems, which may give rise to breakdowns in cognition and emotional function. We discuss these diverse domains of function from the perspective of disrupted neural circuits involved in "cold" cognitive vs. "hot" affective operations and the interplay between these processes. We focus on three research areas that highlight cognition-emotion dysinteractions in schizophrenia: First, we discuss the role of cognitive deficits in the "maintenance" of emotional information. We review recent evidence suggesting that motivational abnormalities in schizophrenia may in part arise due to a disrupted ability to "maintain" affective information over time. Here, dysfunction in a prototypical "cold" cognitive operation may result in "affective" deficits in schizophrenia. Second, we discuss abnormalities in the detection and ascription of salience, manifest as excessive processing of non-emotional stimuli and inappropriate distractibility. We review emerging evidence suggesting deficits in some, but not other, specific emotional processes in schizophrenia - namely an intact ability to perceive emotion "in-the-moment" but poor prospective valuation of stimuli and heightened reactivity to stimuli that ought to be filtered. Third, we discuss abnormalities in learning mechanisms that may give rise to delusions, the fixed, false, and often emotionally charged beliefs that accompany psychosis. We highlight the role of affect in aberrant belief formation, mostly ignored by current theoretical models. Together, we attempt to provide a consilient overview for how breakdowns in neural systems underlying affect and cognition in psychosis interact across symptom domains. We conclude with a brief treatment of the neurobiology of schizophrenia and the need to close our explanatory gap between cellular-level hypotheses and complex behavioral symptoms observed in this illness.

No trade-off between learning speed and associative flexibility in bumblebees: a reversal learning test with multiple colonies

Potential trade-offs between learning speed and memory-related performance could be important factors in the evolution of learning. Here, we test whether rapid learning interferes with the acquisition of new information using a reversal learning paradigm. Bumblebees (Bombus terrestris) were trained to associate yellow with a floral reward. Subsequently the association between colour and reward was reversed, meaning bees then had to learn to visit blue flowers. We demonstrate that individuals that were fast to learn yellow as a predictor of reward were also quick to reverse this association. Furthermore, overnight memory retention tests suggest that faster learning individuals are also better at retaining previously learned information. There is also an effect of relatedness: colonies whose workers were fast to learn the association between yellow and reward also reversed this association rapidly. These results are inconsistent with a trade-off between learning speed and the reversal of a previously made association. On the contrary, they suggest that differences in learning performance and cognitive (behavioural) flexibility could reflect more general differences in colony learning ability. Hence, this study provides additional evidence to support the idea that rapid learning and behavioural flexibility have adaptive value.

Revisiting olfactory classical conditioning of the proboscis extension response in honey bees: a step toward standardized procedures

The honey bee Apis mellifera has emerged as a robust and influential model for the study of classical conditioning thanks to the existence of a powerful Pavlovian conditioning protocol, the olfactory conditioning of the proboscis extension response (PER). In 2011, the olfactory PER conditioning protocol celebrated its 50 years since it was first introduced by Kimihisa Takeda in 1961. In this protocol, individually harnessed honey bees are trained to associate an odor with sucrose solution. The resulting olfactory learning is fast and induces robust olfactory memories that have been characterized at the behavioral, neuronal and molecular levels. Despite the success of this protocol for studying the bases of learning and memory at these different levels, innumerable procedural variants have arisen throughout the years, which render comparative analyses of behavioral performances difficult. Moreover, because even slight variations in conditioning procedures may introduce significant differences in acquisition and retention performances, we revisit olfactory PER conditioning and define here a standardized framework for experiments using this behavioral protocol. To this end, we present and discuss all the methodological steps and details necessary for successful implementation of olfactory PER conditioning.

Memory re-consolidation and drug conditioning: an apomorphine conditioned locomotor stimulant response can be enhanced or reversed by a single high versus low apomorphine post-trial treatment

RATIONALE

Psychostimulant sensitization can have transformative effects upon contextual stimuli such as acquired conditioned stimuli and conditioned incentive motivational properties.

OBJECTIVE

The aim of this study is to induce apomorphine sensitization and conduct non-drug exposures to the contextual cues followed by post-trial treatments designed to associate increases/decreases in dopamine activity with re-consolidation of the contextual cue conditioned stimulus.

METHODS

Separate groups received five daily apomorphine (2.0 mg/kg) treatments, paired or unpaired to the test environment. Two days later, a 30-min non-drug conditioning test was performed. Subsequently, there were three brief (5 min) conditioning tests on successive days. After removal from the test environment on the three test days, all groups received post-trial treatment with vehicle, 0.05, and 2.0 mg/kg apomorphine. One day later, a second 30-min conditioning test was conducted.

RESULTS

There was a sensitized and a conditioned locomotor stimulant response in the paired groups. After the first and second post-trial treatments with 0.05 mg/kg apomorphine, the conditioned stimulant response in the paired group was transformed into a conditioned inhibitory response. In contrast, the conditioned stimulant response of the paired group administered with apomorphine 2.0 mg/kg post-trial was amplified. The apomorphine post-trial treatments administered to the unpaired groups or 2 h post-trial to paired groups were without effect.

CONCLUSIONS

These findings suggest that sensitization substantially enhances the associative sensitivity of contextual stimuli and imply that brief exposure to cues linked to drugs of addiction followed by treatments that inhibit neurotransmitter systems may provide a new direction in drug abuse treatment.

Generalization of fear inhibition by disrupting hippocampal protein synthesis-dependent reconsolidation process

Repetitive replay of fear memories may precipitate the occurrence of post-traumatic stress disorder and other anxiety disorders. Hence, the suppression of fear memory retrieval may help prevent and treat these disorders. The formation of fear memories is often linked to multiple environmental cues and these interconnected cues may act as reminders for the recall of traumatic experiences. However, as a convenience, a simple paradigm of one cue pairing with the aversive stimulus is usually used in studies of fear conditioning in animals. Here, we built a more complex fear conditioning model by presenting several environmental stimuli during fear conditioning and characterize the effectiveness of extinction training and the disruption of reconsolidation process on the expression of learned fear responses. We demonstrate that extinction training with a single-paired cue resulted in cue-specific attenuation of fear responses but responses to other cures were unchanged. The cue-specific nature of the extinction persisted despite training sessions combined with D-cycloserine treatment reveals a significant weakness in extinction-based treatment. In contrast, the inhibition of the dorsal hippocampus (DH) but not the basolateral amygdala (BLA)-dependent memory reconsolidation process using either protein synthesis inhibitors or genetic disruption of cAMP-response-element-binding protein-mediated transcription comprehensively disrupted the learned connections between fear responses and all paired environmental cues. These findings emphasize the distinct role of the DH and the BLA in the reconsolidation process of fear memories and further indicate that the disruption of memory reconsolidation process in the DH may result in generalization of fear inhibition.

A mismatch-based model for memory reconsolidation and extinction in attractor networks

The processes of memory reconsolidation and extinction have received increasing attention in recent experimental research, as their potential clinical applications begin to be uncovered. A number of studies suggest that amnestic drugs injected after reexposure to a learning context can disrupt either of the two processes, depending on the behavioral protocol employed. Hypothesizing that reconsolidation represents updating of a memory trace in the hippocampus, while extinction represents formation of a new trace, we have built a neural network model in which either simple retrieval, reconsolidation or extinction of a stored attractor can occur upon contextual reexposure, depending on the similarity between the representations of the original learning and reexposure sessions. This is achieved by assuming that independent mechanisms mediate Hebbian-like synaptic strengthening and mismatch-driven labilization of synaptic changes, with protein synthesis inhibition preferentially affecting the former. Our framework provides a unified mechanistic explanation for experimental data showing (a) the effect of reexposure duration on the occurrence of reconsolidation or extinction and (b) the requirement of memory updating during reexposure to drive reconsolidation.

Reversal of apomorphine locomotor sensitization by a single post-conditioning trial treatment with a low autoreceptor dose of apomorphine: a memory re-consolidation approach

Sensitization is a common feature of psychostimulants and sensitization effects are generally considered to be linked to the addictive properties of these drugs. We used a conventional paired/unpaired Pavlovian protocol to induce a context specific sensitization to the locomotor stimulant effect of a high dose of apomorphine (2.0mg/kg). Two days following a 5 session sensitization induction phase, a brief 5min non-drug test for conditioning was conducted. Only the paired groups exhibited locomotor stimulant conditioned response effects. Immediately following this brief test for conditioning, the paired and the unpaired groups received injections of 0.05mg/kg apomorphine, 2.0mg/kg apomorphine or vehicle designed to differentially impact memory re-consolidation of the conditioning. Two days later, all groups received a sensitization challenge test with 2.0mg/kg apomorphine. The 2.0mg/kg apomorphine post-trial treatment potentiated sensitization while the 0.05mg/kg eliminated sensitization. These effects were only observed in the paired groups. The activation of dopaminergic systems by the high dose of apomorphine strengthened the drug/environment association whereas the inhibition of dopamine activity by the low auto-receptor dose eliminated this association. The results point to the importance of conditioning to context specific sensitization and targeting memory re-consolidation of conditioning as a paradigm to modify sensitization.

Effects of the novel endocannabinoid uptake inhibitor, LY2183240, on fear-potentiated startle and alcohol-seeking behaviors in mice selectively bred for high alcohol preference

RATIONALE

Alcohol-use disorders often occur together with anxiety disorders in humans which may be partly due to common inherited genetic factors. Evidence suggests that the endocannabinoid system (ECS) is a promising therapeutic target for the treatment of individuals with anxiety and/or alcohol-use disorders.

OBJECTIVES

The present study assessed the effects of a novel endocannabinoid uptake inhibitor, LY2183240, on anxiety- and alcohol-seeking behaviors in a unique animal model that may represent increased genetic risk to develop co-morbid anxiety and alcohol-use disorders in humans. Mice selectively bred for high alcohol preference (HAP) show greater fear-potentiated startle (FPS) than mice selectively bred for low alcohol preference (LAP). We examined the effects of LY2183240 on the expression of FPS in HAP and LAP mice and on alcohol-induced conditioned place preference (CPP) and limited-access alcohol drinking behavior in HAP mice.

RESULTS

Repeated administration of LY2183240 (30 mg/kg) reduced the expression of FPS in HAP but not LAP mice when given prior to a second FPS test 48 h after fear conditioning. Both the 10 and 30 mg/kg doses of LY2183240 enhanced the expression of alcohol-induced CPP and this effect persisted in the absence of the drug. LY2183240 did not alter limited-access alcohol drinking behavior, unconditioned startle responding, or locomotor activity.

CONCLUSIONS

These findings suggest that ECS modulation influences both conditioned fear and conditioned alcohol reward behavior. LY2183240 may be an effective pharmacotherapy for individuals with anxiety disorders, such as post-traumatic stress disorder, but may not be appropriate for individuals with co-morbid anxiety and alcohol-use disorders.

Toward a neurobiology of delusions

Delusions are the false and often incorrigible beliefs that can cause severe suffering in mental illness. We cannot yet explain them in terms of underlying neurobiological abnormalities. However, by drawing on recent advances in the biological, computational and psychological processes of reinforcement learning, memory, and perception it may be feasible to account for delusions in terms of cognition and brain function. The account focuses on a particular parameter, prediction error--the mismatch between expectation and experience--that provides a computational mechanism common to cortical hierarchies, fronto-striatal circuits and the amygdala as well as parietal cortices. We suggest that delusions result from aberrations in how brain circuits specify hierarchical predictions, and how they compute and respond to prediction errors. Defects in these fundamental brain mechanisms can vitiate perception, memory, bodily agency and social learning such that individuals with delusions experience an internal and external world that healthy individuals would find difficult to comprehend. The present model attempts to provide a framework through which we can build a mechanistic and translational understanding of these puzzling symptoms.

The effect of propranolol dose and novelty of the reactivation procedure on the reconsolidation of a morphine place preference

Previously consolidated memories may become labile when they are reactivated and require reconsolidation. It has been suggested that when novel information is present at the time of memory reactivation reconsolidation is engaged but when no new information is present, reconsolidation may not occur, and extinction may be the dominant process instead. To test this idea we trained rats to associate a context with the rewarding properties of morphine (5 mg/kg, sc) over four conditioning pairings. Following training, animals were reactivated by a 30-min test session, once a day for 3 days. Rats were injected with the amnestic drug propranolol (10 or 40 mg/kg, sc) following reactivation either on the first or on the second day. They received saline on the alternate day. Propranolol disrupted reconsolidation for a conditioned place preference only when given on the first reactivation day, and this effect was more robust following the higher dose of propranolol. In contrast, animals given propranolol on the second reactivation day still displayed a preference for the morphine-paired context on the final test day. These results support the view that for memory to return to a labile state, the situation that evokes reactivation needs to be novel in some way. If the reactivation situation is familiar, reconsolidation may not occur.

The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction

Memory reconsolidation is the process by which memories, destabilised at retrieval, require restabilisation to persist in the brain. It has been demonstrated that even old, well-established memories require reconsolidation following retrieval; therefore, memory reconsolidation could potentially be exploited to disrupt, or even erase, aberrant memories that underlie psychiatric disorders, thereby providing a novel therapeutic target. Drug addiction is one such disorder; it is both chronic and relapsing, and one prominent risk factor for a relapse episode is the presentation of environmental cues that have previously been associated with drugs of abuse. This 'cue-induced relapse' can be accounted for in psychological terms by reinforcing memories of the pavlovian association between the cue and the drug, which can thus influence behaviour through at least three psychologically and neurobiologically dissociable mechanisms: conditioned reinforcement, conditioned approach and conditioned motivation. As each of these psychological processes could contribute to the resumption of drug-seeking following abstinence, it is important to develop treatments that can reduce drug-seeking re-established via influences on each or all of these pavlovian processes, in order to minimise the risk of a subsequent relapse. Investigation of the memory reconsolidation mechanisms of the memories underlying conditioned reinforcement, conditioned approach and conditioned motivation indicate that they depend upon different neurochemical systems, including the glutamatergic and adrenergic systems within limbic corticostriatal circuitry. We also discuss here the subsequent translation to the clinic of this preclinical work.

Are delusions biologically adaptive? Salvaging the doxastic shear pin

In their target article, McKay & Dennett (M&D) conclude that only “positive illusions” are adaptive misbeliefs. Relying on overly strict conceptual schisms (deficit vs. motivational, functional vs. organic, perception vs. belief), they prematurely discount delusions as biologically adaptive. In contrast to their view that “motivation” plays a psychological but not a biological function in a two-factor model of the forming and maintenance of delusions, we propose a single impairment in prediction-error–driven (i.e., motivational) learning in three stages in which delusions play a biologically adaptive role.