NMDA receptors in the avian amygdala and the premotor arcopallium mediate distinct aspects of appetitive extinction learning

Parallel executive pallio-motor loops in the pigeon brain

A core component of the avian pallial cognitive network is the multimodal nidopallium caudolaterale (NCL) that is considered to be analogous to the mammalian prefrontal cortex (PFC). The NCL plays a key role in a multitude of executive tasks such as working memory, decision-making during navigation, and extinction learning in complex learning environments. Like the PFC, the NCL is positioned at the transition from ascending sensory to descending motor systems. For the latter, it sends descending premotor projections to the intermediate arcopallium (AI) and the medial striatum (MSt). To gain detailed insight into the organization of these projections, we conducted several retrograde and anterograde tracing experiments. First, we tested whether NCL neurons projecting to AI (NCLarco neurons) and MSt (NCLMSt neurons) are constituted by a single neuronal population with bifurcating neurons, or whether they form two distinct populations. Here, we found two distinct projection patterns to both target areas that were associated with different morphologies. Second, we revealed a weak topographic projection toward the medial and lateral striatum and a strong topographic projection toward AI with clearly distinguishable sensory termination fields. Third, we investigated the relationship between the descending NCL pathways to the arcopallium with those from the hyperpallium apicale, which harbors a second major descending pathway of the avian pallium. We embed our findings within a system of parallel pallio-motor loops that carry information from separate sensory modalities to different subpallial systems. Our results also provide insights into the evolution of the avian motor system from which, possibly, the song system has emerged.

Molecular biology of serotonergic systems in avian brains

Serotonin (5-hydroxytryptamine, 5-HT) is a phylogenetically conserved neurotransmitter and modulator. Neurons utilizing serotonin have been identified in the central nervous systems of all vertebrates. In the central serotonergic system of vertebrate species examined so far, serotonergic neurons have been confirmed to exist in clusters in the brainstem. Although many serotonin-regulated cognitive, behavioral, and emotional functions have been elucidated in mammals, equivalents remain poorly understood in non-mammalian vertebrates. The purpose of this review is to summarize current knowledge of the anatomical organization and molecular features of the avian central serotonergic system. In addition, selected key functions of serotonin are briefly reviewed. Gene association studies between serotonergic system related genes and behaviors in birds have elucidated that the serotonergic system is involved in the regulation of behavior in birds similar to that observed in mammals. The widespread distribution of serotonergic modulation in the central nervous system and the evolutionary conservation of the serotonergic system provide a strong foundation for understanding and comparing the evolutionary continuity of neural circuits controlling corresponding brain functions within vertebrates. The main focus of this review is the chicken brain, with this type of poultry used as a model bird. The chicken is widely used not only as a model for answering questions in developmental biology and as a model for agriculturally useful breeding, but also in research relating to cognitive, behavioral, and emotional processes. In addition to a wealth of prior research on the projection relationships of avian brain regions, detailed subdivision similarities between avian and mammalian brains have recently been identified. Therefore, identifying the neural circuits modulated by the serotonergic system in avian brains may provide an interesting opportunity for detailed comparative studies of the function of serotonergic systems in mammals.

Characterisation of the neural basis underlying appetitive extinction & renewal in Cacna1c rats

Recent studies have revealed impairments in Cacna1c ± heterozygous animals (a gene that encodes the Cav 1.2 L-type voltage-gated calcium channels and is implicated in risk for multiple neuropsychiatric disorders) in aversive forms of learning, such as latent inhibition, reversal learning or context discrimination. However, the role of Cav 1.2 L-type voltage-gated calcium channels in extinction of appetitive associations remains under-investigated. Here, we used an appetitive Pavlovian conditioning task and evaluated extinction learning (EL) with a change of context from that of training and test (ABA) and without such a change (AAA) in Cacna1c ± male rats versus their wild-type (WT) littermates. In addition, we used fluorescence in situ hybridization of somatic immediate early genes (IEGs) Arc and Homer1a expression to scrutinize associated changes in the medial prefrontal cortex and the amygdala. Cacna1c ± animals successfully adapt their responses by engaging in appetitive EL and renewal. However, the regional IEG expression profile changed. For the EL occurring in the same context, Cacna1c ± animals presented higher IEG expression in the infralimbic cortex and the central amygdala than controls. The prelimbic region presented a larger neural ensemble in Cacna1c ± than WT animals, co-labelled for the time window of EL in the original context and prolonged exposure to the unrewarded context. With a context change, the Cacna1c ± infralimbic region displayed higher IEG expression during renewal than controls. Taken together, our findings provide novel evidence of distinct brain activation patterns occurring in Cacna1c ± rats after appetitive extinction and renewal despite preserved behavioral responses. This article is part of the Special Issue on "L-type calcium channel mechanisms in neuropsychiatric disorders".

Developmental treatments with Δ9- tetrahydrocannabinol and the MAGL inhibitor JZL184 persistently alter adult cocaine conditioning in contrasting ways

Using a songbird, zebra finches, as a developmental drug abuse model we found previously that cannabinoid agonists administered during the sensorimotor period of vocal learning (50-75 days of age) persistently alter song patterns and cocaine responsiveness in adulthood. However, these effects were not produced in adults exposed to similar treatment regimens. Currently, we have used the MAGL inhibitor, JZL184, to test whether enhanced endocannabinoid signaling may similarly alter cocaine responsiveness. We found that, as expected and consistent with prior results, repeated developmental (but not adult) treatments with Δ⁹-tetrahydrocannabinol (THC, 3 mg/kg QD IM) resulted in increased time spent in cocaine-paired chambers. Unexpectedly and in contrast, repeated developmental JZL184 (4 mg/kg QD IM) treatments decreased time spent in cocaine-conditioned chambers. That is, young finches repeatedly treated with JZL184 avoided cocaine-paired chambers later in adulthood, while similar development treatments with THC had the opposite effect. To begin to identify brain regions that may underly this differential responsiveness we used c-Fos expression as a marker of neuronal activity. Differences in c-Fos expression patterns following placement of cocaine-conditioned finches into vehicle- vs. cocaine-paired chambers suggest distinct involvement of circuits through striatal and amygdaloid regions in respective effects of THC and JZL184. Results demonstrate that, like exogenous cannabinoid exposure, inhibition of MAGL activity during late post-natal development persistently alters behavior in adulthood. Contrasting effects of THC vs. MAGL inhibition with JZL184 suggests the latter alters development of brain regions to favor promotion of aversive rather than appetitive cocaine responsiveness later in adulthood.

The role of posterior pallial amygdala in mediating motor behaviors in pigeons

The posterior pallial amygdala (PoA) is located on the basolateral caudal telencephalon, including the basal division of PoA (PoAb) and the compact division of PoA (PoAc). PoA plays a vital role in emotion regulation and is considered a part of the amygdala in birds. However, the regulatory functions responsible for motor behaviors and emotions between PoAb and PoAc are poorly understood. Therefore, we studied the structure and function of PoA by tract-tracing methods, constant current electrical stimulation, and different dopamine receptor drug injections in pigeons (Columba livia domestica). PoAb connects reciprocally with two nuclear groups in the cerebrum: 1) a continuum comprising the temporo–parieto–occipitalis, corticoidea dorsolateralis, hippocampus, and parahippocampalis areas and 2) rostral areas of the hemisphere, including the nucleus septalis lateralis and nucleus taeniae amygdalae. Extratelencephalic projections of PoAb terminate in the lateral hypothalamic nucleus and are scattered in many limbic midbrain regions. PoAb and PoAc mainly mediated the turning movement. In the ‘open-field’ test, D1 agonist and D2 antagonist could significantly reduce the latency period for entering into the central area and increase the residence time in the central area, whereas D1 antagonist and D2 agonist had the opposite effect. PoAb and PoAc are important brain areas that mediate turning behavior.

Emergence of complex dynamics of choice due to repeated exposures to extinction learning

Extinction learning, the process of ceasing an acquired behavior in response to altered reinforcement contingencies, is not only essential for survival in a changing environment, but also plays a fundamental role in the treatment of pathological behaviors. During therapy and other forms of training involving extinction, subjects are typically exposed to several sessions with a similar structure. The effects of this repeated exposure are not well understood. Here, we studied the behavior of pigeons across several sessions of a discrimination-learning task in context A, extinction in context B, and a return to context A to test the context-dependent return of the learned responses (ABA renewal). By focusing on individual learning curves across animals, we uncovered a session-dependent variability of behavior: (1) during extinction, pigeons preferred the unrewarded alternative choice in one-third of the sessions, predominantly during the first one. (2) In later sessions, abrupt transitions of behavior at the onset of context B emerged, and (3) the renewal effect decayed as sessions progressed. We show that the observed results can be parsimoniously accounted for by a computational model based only on associative learning between stimuli and actions. Our work thus demonstrates the critical importance of studying the trial-by-trial dynamics of learning in individual sessions, and the power of “simple” associative learning processes.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Renewal of extinguished behavior in pigeons (Columba livia) does not require memory consolidation of acquisition or extinction in a free-operant appetitive conditioning paradigm

Extinction learning is a fundamental capacity for adaptive and flexible behavior. As extinguished conditioned responding is prone to relapse under certain conditions, the necessity of memory consolidation for recovery phenomena to occur has been highlighted recently. Several studies have demonstrated that both acquisition and extinction training need to be properly consolidated for a relapse of the original acquired memory trace to occur. Does this imply that extinguished responses cannot relapse before memory consolidation? To answer this question, we investigated the renewal effect subsequent to an immediate or a delayed (24 h) extinction in a discriminative operant conditioning paradigm. In three different experiments, we could show (1) that acquisition learning does not need to be long-term consolidated for the occurrence of renewal, (2) that the offset of extinction training is a reliable marker for extinction recall in a free-operant extinction learning paradigm where organisms undergo consecutive acquisition training, extinction training as well as testing of conditioned responding and (3), that immediate and long-term consolidated renewal do not demonstrate any qualitative difference in terms of the behavioral output. Our results indicate on the behavioral level that the inhibitory nature of extinction is already present in free-operant learning paradigms and that it does not seem to be affected by the absence of long-term memory consolidation.