Learning rules for aversive associative memory formation

Contextual fear conditioning in zebrafish: Influence of different shock frequencies, context, and pharmacological modulation on behavior

Contextual fear conditioning is a protocol used to assess associative learning across species, including fish. Here, our goal was to expand the analysis of behavioral parameters that may reflect aversive behaviors in a contextual fear conditioning protocol using adult zebrafish (Danio rerio) and to verify how such parameters can be modulated. First, we analyzed the influence of an aversive stimulus (3 mild electric shocks for 5 s each at frequencies of 10, 100 or 1000 Hz) on fish behavior, and their ability to elicit fear responses in the absence of shock during a test session. To confirm whether the aversive responses are context-dependent, behaviors were also measured in a different experimental environment in a test session. Furthermore, we investigated the effects of dizocilpine (MK-801, 2 mg/kg, i.p.) on fear-related responses. Zebrafish showed significant changes in baseline activity immediately after shock exposure in the training session, in which 100 Hz induced robust contextual fear responses during the test session. Importantly, when introduced to a different environment, animals exposed to the aversive stimulus did not show any differences in locomotion and immobility-related parameters. MK-801 administered after the training session reduced fear responses during the test, indicating that glutamate NMDA-receptors play a key role in the consolidation of contextual fear-related memory in zebrafish. In conclusion, by further exploring fear-related behaviors in a contextual fear conditioning task, we show the effects of different shock frequencies and confirm the importance of context on aversive responses for associative learning in zebrafish. Additionally, our data support the use of zebrafish in contextual fear conditioning tasks, as well as for advancing pharmacological studies related to associative learning in translational neurobehavioral research.

Prefrontal and lateral entorhinal neurons co-dependently learn item-outcome rules

The ability to learn novel items depends on brain functions that store information about items classified by their associated meanings and outcomes1-4, but the underlying neural circuit mechanisms of this process remain poorly understood. Here we show that deep layers of the lateral entorhinal cortex (LEC) contain two groups of 'item-outcome neurons': one developing activity for rewarded items during learning, and another for punished items. As mice learned an olfactory item-outcome association, we found that the neuronal population of LEC layers 5/6 (LECL5/6) formed an internal map of pre-learned and novel items, classified into dichotomic rewarded versus punished groups. Neurons in the medial prefrontal cortex (mPFC), which form a bidirectional loop circuit with LECL5/6, developed an equivalent item-outcome rule map during learning. When LECL5/6 neurons were optogenetically inhibited, tangled mPFC representations of novel items failed to split into rewarded versus punished groups, impairing new learning by mice. Conversely, when mPFC neurons were inhibited, LECL5/6 representations of individual items were held completely separate, disrupting both learning and retrieval of associations. These results suggest that LECL5/6 neurons and mPFC neurons co-dependently encode item memory as a map of associated outcome rules.

From aversive associations to defensive programs: experience-dependent synaptic modifications in the central amygdala

Plasticity elicited by fear conditioning (FC) is thought to support the storage of aversive associative memories. Although work over the past decade has revealed FC-induced plasticity beyond canonical sites in the basolateral complex of the amygdala (BLA), it is not known whether modifications across distributed circuits make equivalent or distinct contributions to aversive memory. Here, we review evidence demonstrating that experience-dependent synaptic plasticity in the central nucleus of the amygdala (CeA) has a circumscribed role in memory expression per se, guiding the selection of defensive programs in response to acquired threats. We argue that the CeA may be a key example of a broader phenomenon by which synaptic plasticity at specific nodes of a distributed network makes a complementary contribution to distinct memory processes.

Modulation of aversive value coding in the vertebrate and invertebrate brain

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

Transforming experiences: Neurobiology of memory updating/editing

Long-term memory is achieved through a consolidation process where structural and molecular changes integrate information into a stable memory. However, environmental conditions constantly change, and organisms must adapt their behavior by updating their memories, providing dynamic flexibility for adaptive responses. Consequently, novel stimulation/experiences can be integrated during memory retrieval; where consolidated memories are updated by a dynamic process after the appearance of a prediction error or by the exposure to new information, generating edited memories. This review will discuss the neurobiological systems involved in memory updating including recognition memory and emotional memories. In this regard, we will review the salient and emotional experiences that promote the gradual shifting from displeasure to pleasure (or vice versa), leading to hedonic or aversive responses, throughout memory updating. Finally, we will discuss evidence regarding memory updating and its potential clinical implication in drug addiction, phobias, and post-traumatic stress disorder.

Caffeine facilitates extinction of auditory fear conditioning in rats

Caffeine is the most widely consumed psychostimulant drug which could affect learning and memory acting through central adenosine receptors. Although caffeine has been suggested to impair the acquisition and the expression of auditory fear conditioning, its effect on the extinction has not been elucidated. To address this issue, in the present study, we investigated whether caffeine affects the extinction of conditioned fear in an auditory fear conditioning paradigm. During conditioning, rats received pairings of auditory cues (conditioned stimulus, CS) and foot shocks (unconditioned stimulus). On the next day, the rats were intraperitoneally administrated saline or caffeine (5 or 10 mg/kg) and then subjected to the extinction training, in which CSs were repeatedly presented without the foot shocks. Twenty-four hours later, the rats were re-exposed to the presentations of CSs (retrieval test). We found an acute caffeine administration dose-dependently decreased freezing rates during the presentations of CS in the extinction training. Furthermore, caffeine-treated animals showed lower conditioned freezing responses in the retrieval test. These findings suggest that caffeine facilitates the extinction of conditioned fear.

Exploring the associative learning capabilities of the segmented attractor network for lifelong learning

This work explores the process of adapting the segmented attractor network to a lifelong learning setting. Taking inspirations from Hopfield networks and content-addressable memory, the segmented attractor network is a powerful tool for associative memory applications. The network's performance as an associative memory is analyzed using multiple metrics. In addition to the network's general hit rate, its capability to recall unique memories and their frequency is also evaluated with respect to time. Finally, additional learning techniques are implemented to enhance the network's recall capacity in the application of lifelong learning. These learning techniques are based on human cognitive functions such as memory consolidation, prediction, and forgetting.

Cortico-Brainstem Mechanisms of Biased Perceptual Decision-Making in the Context of Pain

Prior expectations can bias how we perceive pain. Using a drift diffusion model, we recently showed that this influence is primarily based on changes in perceptual decision-making (indexed as shift in starting point). Only during unexpected application of high-intensity noxious stimuli, altered information processing (indexed as increase in drift rate) explained the expectancy effect on pain processing. Here, we employed functional magnetic resonance imaging to investigate the neural basis of both these processes in healthy volunteers. On each trial, visual cues induced the expectation of high- or low-intensity noxious stimulation or signaled equal probability for both intensities. Participants categorized a subsequently applied electrical stimulus as either low- or high-intensity pain. A shift in starting point towards high pain correlated negatively with right dorsolateral prefrontal cortex activity during cue presentation underscoring its proposed role of "keeping pain out of mind". This anticipatory right dorsolateral prefrontal cortex signal increase was positively correlated with periaqueductal gray (PAG) activity when the expected high-intensity stimulation was applied. A drift rate increase during unexpected high-intensity pain was reflected in amygdala engagement and increased functional connectivity between amygdala and PAG. Our findings suggest involvement of the PAG in both decision-making bias and altered information processing to implement expectancy effects on pain. PERSPECTIVE: Modulation of pain through expectations has been linked to changes in perceptual decision-making and altered processing of afferent information. Our results suggest involvement of the dorsolateral prefrontal cortex, amygdala, and periaqueductal gray in these processes.

Cerebellar Circuits for Classical Fear Conditioning

Accumulating evidence indicates that the cerebellum is critically involved in modulating non-motor behaviors, including cognition and emotional processing. Both imaging and lesion studies strongly suggest that the cerebellum is a component of the fear memory network. Given the well-established role of the cerebellum in adaptive prediction of movement and cognition, the cerebellum is likely to be engaged in the prediction of learned threats. The cerebellum is activated by fear learning, and fear learning induces changes at multiple synaptic sites in the cerebellum. Furthermore, recent technological advances have enabled the investigation of causal relationships between intra- and extra-cerebellar circuits and fear-related behaviors such as freezing. Here, we review the literature on the mechanisms underlying the modulation of cerebellar circuits in a mammalian brain by fear conditioning at the cellular and synaptic levels to elucidate the contributions of distinct cerebellar structures to fear learning and memory. This knowledge may facilitate a deeper understanding and development of more effective treatment strategies for fear-related affective disorders including post-traumatic stress or anxiety related disorders.

The Roles of Basolateral Amygdala Parvalbumin Neurons in Fear Learning

The basolateral amygdala (BLA) is obligatory for fear learning. This learning is linked to BLA excitatory projection neurons whose activity is regulated by complex networks of inhibitory interneurons, dominated by parvalbumin (PV)-expressing GABAergic neurons. The roles of these GABAergic interneurons in learning to fear and learning not to fear, activity profiles of these interneurons across the course of fear learning, and whether or how these change across the course of learning all remain poorly understood. Here, we used PV cell-type-specific recording and manipulation approaches in male transgenic PV-Cre rats during pavlovian fear conditioning to address these issues. We show that activity of BLA PV neurons during the moments of aversive reinforcement controls fear learning about aversive events, but activity during moments of nonreinforcement does not control fear extinction learning. Furthermore, we show expectation-modulation of BLA PV neurons during fear learning, with greater activity to an unexpected than expected aversive unconditioned stimulus (US). This expectation-modulation was specifically because of BLA PV neuron sensitivity to aversive prediction error. Finally, we show that BLA PV neuron function in fear learning is conserved across these variations in prediction error. We suggest that aversive prediction-error modulation of PV neurons could enable BLA fear-learning circuits to retain selectivity for specific sensory features of aversive USs despite variations in the strength of US inputs, thereby permitting the rapid updating of fear associations when these sensory features change.SIGNIFICANCE STATEMENT The capacity to learn about sources of danger in the environment is essential for survival. This learning depends on complex microcircuitries of inhibitory interneurons in the basolateral amygdala. Here, we show that parvalbumin-positive GABAergic interneurons in the rat basolateral amygdala are important for fear learning during moments of danger, but not for extinction learning during moments of safety, and that the activity of these neurons is modulated by expectation of danger. This may enable fear-learning circuits to retain selectivity for specific aversive events across variations in expectation, permitting the rapid updating of learning when aversive events change.

Defining circuit-specific roles for G protein-coupled receptors in aversive learning

The encoding of negative valence in response to noxious stimuli/experiences and in turn, the behavioral representation of negative affective states is essential for survival. Recent advances in neuroscience have determined multiple sites of neural plasticity and key circuits of connectivity across these regions in mediating aversive behavior. G protein-coupled receptors (GPCRs), owing to their neuromodulatory role, are especially important to refining our understanding of the molecular substrates involved in these circuits. In this review, we will focus on recent, contemporary findings that explore neural circuit-specific roles for neurotransmitter/peptide GPCRs and the importance of using novel approaches to illuminate the molecular mechanisms central to aversive learning.

Synaptic encoding of fear memories in the amygdala

Over the years Pavlovian fear conditioning has proved to be a powerful model to investigate the neural underpinnings of aversive associative memory formation. Although it is well appreciated that plasticity occurring at excitatory synapses within the basolateral complex of the amygdala (BLA) plays a critical role in associative memory formation, recent evidence suggests that plasticity within the amygdala is more distributed than previously appreciated. In particular, studies demonstrate that plasticity in the central nucleus (CeA) is critical for the acquisition of conditioned fear. In addition, a variety of interneuron populations within the amygdala, defined by unique neurochemical markers, contribute to distinct aspects of stimulus processing and memory formation during fear conditioning. Here, we will review and summarize recent advances in our understanding of amygdala networks and how unique players within this network contribute to synaptic plasticity associated with the acquisition of conditioned fear.